Deliverable 4.4 - INSEAD CALT

AtGentive IST-4-027529-STP - Attentive Agents for Collaborative Learners6. Attention6.1. Evaluating the attention indicatorThis indicator is probably the most difficult one to evaluate and unfortunately, we will notbe able to report on all aspects of the analysis because data is still being analyzed as wewrite. Furthermore, temporal aspects are particular important in this analysis andextracting detailed temporal data from the log has proven more complex than expected.Overall we plan to look at three aspects of attention allocation: task fragmentation, tasksequencing, and time on task. In this report we briefly report our findings on taskfragmentation.6.2. Task fragmentationWe have initiated an analysis of task fragmentation, which we measure by looking at thenumber of times children started each task. Our initial hypothesis was that the systemwould have reduced task fragmentation but in fact, the charts in Figure 11 show thatchildren in the Experimental group have interrupted and restarted tasks somehow morefrequently than children in the Control group. It should be noted that however, theaverage total task fragmentation between the two groups was not significantly different,with an average of 149.33 Start tasks for the Control group, and 150.57 for theExperimental group. Also, table 27 shows that the only statistically significant correlationsare relative to the Diary task (where children in the Control group fragmented the taskmore than children in the Experimental group), and the Forum task (where children in theExperimental group fragmented the task more than children in the Control group).Avg # of Start Task in Control andExperimentAvg # od Start Task in Control andExperimentAvg. number ofStart4.504.003.503.002.502.001.501.000.500.00IntroAssignmentConc. MapQuestionnaire80.0070.0060.0050.0040.0030.0020.00control10.00experiment 0.00Avg. number ofStartDiaryForumPaperProject ScreencontrolexperimentTask being startedTask being startedFigure 11 – On average, children in the Experimental group have (re)started morefrequently all tasks (with the exception of the Introduction and the Diary tasks) thanchildren in the Control groupVariable Parameter Estimate p-valueIntercept 1.0422 0.3530Total_start_persinfo -0.0297 0.7549Total_start_assignmenttarget 0.1366 0.4285Total_start_conceptmap -0.0826 0.6810Del 4.4: AtGentive Final Evaluation Report – Appendix C page 24