Deliverable 4.4 - INSEAD CALT

AtGentive IST-4-027529-STP - Attentive Agents for Collaborative Learners3. Tools for Summative EvaluationThis section describes the development of suitable tools – evaluation instruments – forthe summative evaluation of AtGentSchool and AtGentNet. Before development of thesetools begins, it is necessary to consider the user-groups and the tasks they will be askedto perform.3.1 Description of users and tasks3.1.1 Description of users - AtGentSchoolFive elementary schools in or near Prague in the Czech Republic participated in the usertrial, with either one or two classes per school. In some cases, only a portion of theregular class participated in the trial. Number of students participating per class thereforeranged from 6 to 14 per class, with 6 classes. The modal age of students was 11 years.Students had previous experience of working in groups, though not necessarily while atthe computer. The teachers assessed students as to their Ability, using the criteria ofCommunication Ability and Interest in the Outside World. Students were allocated intopairs for working on AtGentSchool. This was done by friendships, but in practice tendedto pair students of similar ability.The students worked in their native language (Czech). All teachers either spoke goodEnglish or had access to the appropriate translation / interpretation facilities. Facilitiesand infrastructure at the schools (such as computers and network connections) generallymet those anticipated of a contemporary UK school.3.1.2 Description of tasks - AtGentSchoolAtGentSchool is built on the Ontdeknet eLearning platform, created by the Dutchcompany Ontdeknet. This platform is an electronic learning environment that makesknowledge and skills in society accessible to educational institutions in general andindividual students in particular. Virtual learning relationships between subject expertsand students are established in this virtual learning environment. The Ontdeknetenvironment provides guidance to support individuals to learn together based uponcommon interests.The students were set the task of examining their home country (Czech Republic) and aforeign country (New Zealand) using AtGentSchool, with a view to deciding in whichcountry the students would prefer to live. A colleague teacher with experience of NewZealand acted as expert-traveller.3.1.3 Description of users - AtGentNetThe Swedish Trade Council (STC) runs a distance learning course for business peopleentitled TRIM (Trade Management Implementation). The TRIM project implements thenew International Trade Management (ITM) concept, devised by STC. This concept aimsto help SMEs (Small and Medium-sized Enterprises) to grow internationally. Participantsof the distance learning TRIM course are based in Namibia, South Africa, Slovenia,Norway, Iceland, Hungary and Sweden. The TRIM project ran until the end of October2007. The participants continue to have access to a “Virtual Trade Network” offering lifelong learning, career and business opportunities.Trainees within these seven countries comprised 46 managers who followed classes intheir own country and internationally as a group. The classes were on subjects aboutinternational business issues; examples include cross cultural training, changeDel 4.4: AtGentive Final Evaluation Report page 20