Deliverable 4.4 - INSEAD CALT

AtGentive IST-4-027529-STP - Attentive Agents for Collaborative Learners6050403020CTLXP100En Lv Rd PrSELFRd PrOTHERRd Ms Vi non-HP Vi HPoverview76543CTLXP210Vi HPVi HP NewsVi HP InvitationsVi HP KnowledgeVi HP personalVi HP agentsVi HP communityVi HP watchCr threadCr MsEd MsSe queryFigure 21 - Pre-Eagle Racing mean system use counts (split over two graphs to allowdifferent scale values)However, a closer examination of the data shows a more complex picture. Firstly, aMann-Whitney test 7 shows that most of the differences are not statistically significantsee Table 15). (Note that the graphs show mean total values in order to clearlydemonstrate differences, whereas the statistical analyses use a ranking-basedalgorithm.) The two variables that are significantly different between treatment groups (atthe 0.05 level) are “Vi place 'homepage - knowledge'” and “Vi place 'homepage -agents'”. (It should be noted that the agent homepage was not very feature-rich for theControl group and was essentially unused, whereas five out of the 12 Experimentalgroup participants used the agent homepage.)7 Significance referred to is at the 0.05 level. Exact significance is quoted to compensate for thesmall sample size. 1-tailed test is quoted as visual inspection of the data shows the Experimentalgroup has consistently greater system useDel 4.4: AtGentive Final Evaluation Report page 59