Volume Two - Academic Conferences

6. Results and analysis
Fabio Serenelli et al.
Here we present some results, even if the analysis phase is still ongoing. In fact we still have to run
the evaluation of the UX questionnaires, and the correlation between learning performances and
students engagement. In our further analysis we’ll proceed splitting the sample into two age groups:
11-12 years old subjects “pre-adolescents” attending the 6th grade of primary school; and 13-14
years old “adolescents” attending the 6th grade of primary school (that means that these pupils has
been repeating one or two years during their school curriculum). Hereinafter some preliminary
considerations are following to comment the results of the two main tests (Comprehension Test and
Problem Solving Test; Transfer Test provides their mean general measure). We decided not to
consider the Retention Test (pr=0.7629; see Table 8***) and the comparison between Problem
Solving Test and the Problem Solving Delayed Test.
Table 8: Analisys of variance
Df Sum Sq Mean Sq F value Pr(>F)
Retention 4 0.1138 0.028458 2.1348 0.07629***
Comprehension 4 0.550 0.13750 3.5667 0.007286
Problem_Solving 4 1.4106 0.35264 4.8926 0.0007658
Transfer 4 0.7045 0.17612 4.0526 0.003207
Table 9: Performance averages relating to the setting and to the LO
CS1=
CS2=
CS3=
CS4=
CS5=
LO1/SET-A LO2/SET-A LO3/SET-A LO3/SET-B LO4/SET-C
Comprehension 0,44 0,530 0,535 0,475 0,442
Problem_Solving 0,365 0,562 0,467 0,513 0,50
Transfer 0,403 0,546 0,501 0,494 0,473
Figure 5: Average performance for each experimental condition (CS)
Comprehension Test: performances on concepts understanding tasks and concepts application tasks
are higher in Self-Directed Learning using the laptop (Setting A), regardless of LO formats. In fact the
results between the Learning-Game and the Multimedia Step by Step (LO2 and LO3) are comparable.
Probably the use of the laptop with earphones allows a strong reduction from distractions in the
classroom and increases the focus on relevant information. Both the Teacher-Directed (LO4/Setting
C) and the Infographic Resume (LO1/Setting A) conditions are not recommended to study the food
950