Deliverable 4.4 - INSEAD CALT

AtGentive IST-4-027529-STP - Attentive Agents for Collaborative LearnersFor the Experimental group, however, nine of the same measured attitudes changedbetween questionnaires:2. The software does exactly what I want3. The software does not do anything that I want5. Honza is really friendly6. Honza is very helpful7. Honza is very annoying9. When I use the keyboard or mouse, the software does something inresponse straight away11. I like the look of the software14. The instructions on the screen are really helpful18. I really enjoyed the lessonAll changes were effectively positive. That is, all positive statements (such as “Honza isreally friendly”) increase between the first and second questionnaires, whereas negativestatements decrease (such as “Honza is very annoying”).4.2.3 Analysis4.2.3.1. Summary of significant resultsTable 13 shows the differences found between the Experimental and Control groups (interms of the effects on the Experimental group).SourceMarksMarksTime on screensTime on screensTime on screensFeedbacksFeedbacksInterventionsInterventionsPre-testPost-testPost-testAttitude change –improvement overtime (notcompared to theControl group)Significant difference observed in the Experimental groupAsked more questions of the expertWrote a better quality paperLESS time describing themselvesLESS time looking at the expert’s diaryMORE time in the forumLess clicks on “Neutral”, and “Sad”Similar rate of “Confused” clicks (for week one) by Ability (In Controlgroup, “Smart” students clicked less on “Confused”.)a POSITIVE correlation between the number of meta-cognitiveinterventions and the number of questions to the experta NEGATIVE correlation between paper quality and both cognitiveand meta-cognitive interventionsScored BETTER on one questionScored BETTER on one question and LESS WELL on one questionLess students completed the post-test questionnaire2. The software does exactly what I want (+)3. The software does not do anything that I want (-)5. Honza is really friendly (+)6. Honza is very helpful (+)7. Honza is very annoying (-)9. When I use the keyboard or mouse, the software doessomething in response straight away (+)11. I like the look of the software (+)14. The instructions on the screen are really helpful (+)18. I really enjoyed the lesson (+)Table 13 - Summary of effects seen in the EXPERIMENTAL group (in comparison to theControl)Del 4.4: AtGentive Final Evaluation Report page 50