October 2007 Volume 10 Number 4 - Educational Technology ...

Table 2. Assignment evaluation responsibilities and the weight of each procedure in relation to the assessment
system
Responsible of assignment Evaluated Weight
I-1 Automatic assignment
I-2 Automatic assignment.
I-3 Automatic assignment. Pertinence was decided by tutor
I-4 Tutor does assignments.
I-5 Peers: two or more colleges do assignments
I-6 Expert does assignments
I-7 Assignment by participants (self evaluation)
I-8 Self evaluation learning
Research Design
Individual
Individual
Individual
Group Group
Group Group
Individual
This single case study focused on multiple sources as Yin (1984), Stake (1995) and Weiss (1997) have
recommended. Tests, archival records, and participants’ perspective were recorded. According to Yin (1994), this
case study design was used to describe the AAS implemented in a specific web based course, and to analyze several
variables related to a small number of subjects.
The study considered individuals and small groups as units of analysis, according to an embedded case study design
(Yin, 1994). Data were connected to indicators by means of correlations and triangulation analysis. Traditional alpha
0.5 and 0.01 were used.
Both the evidence of validity based on criteria of judges, parallel instruments, and non obstructive data, and the
evidence of reliability obtained from indices of association between equivalent items, and reiterated measurements,
are sustained in correlations. In effect, the Rho of Spearman coefficient for nonparametric data, index r of Pearson
for variables of normal distribution, and the value alpha of Cronbach for groups of variables, express a correlation or
degree of association between the measured variables. These univariated measurements are used in exploratory
studies because they are simple and they aid in elaborating integrated models. 5% and 1% of the critical values
considered in this study are used habitually in education with cuasi-experimental designs, unlike the values such as
0.1%, or lower, used in experimental designs or in the area of medicine.
Instruments
This study used records of the eight AAS procedures, and three additional data sources to validate the AAS.
The eight AAS instruments
AAS was made up of 8 procedures associated with their respective instruments. When using the Cronbach
coefficient as an indicator of AAS's reliability, we got a positive, but not significant value (α(26)=.22, p>.05), which
was expected because AAS measurements did not refer to a one-dimensional variable.
Internal Instruments
Table 3. Correlation of each instrument with the rest of the AAS
Correlation 1 (one-tailed)
I-1 Forum Design contribution
rho(26) = 0,37 p.05
I-3 Individual Contributions mailed
rho(28) = 0,50 p.05
I-7Own Design Forum opinion
rho(26) = 0.47 p