I__. - International Military Testing Association

Table 3 shows the intercorrelations among the instruments across the
nine MOS. For the rating scales and, to a lesser degree, for the written
tests, there are high correlations across the different job components. This
may indicate that the test mode itself is responsible for much of the observed
variance. Because the raters for a soldier were the same individuals for all
three sets of scales, we would expect the results to be correlated; likewise,
we expect scores on written multiple-choice tests to be correlated simply
because of the cognitive processing burden imposed by the written material.
The job sample tests, on the other hand, are less affected by the similarity
of method, not surprising in view of the fact that nearly every job sample
exercise (hands-on task test or role-play situation) is conducted and scored
by a different administrator.
Table 3
Intercorrelations (Uncorrected) Among Test Modes (Written, Job Sample, and
Rating Scales) and Job Components (Supervisory, Common Task, and MOS-Specific)
WRITTEN MODE
Supervisory (Situational Test)
Cornnon Task (Job Knowledge Test)
MOS-Specific (Job Knowledge Test)
JOB SAMPLE MODE
Supervisory (Role-Plays)
Comnon Task (Hands-On Test)
MOS-Specific (Hands-On Test)
RATINGS MODE
Supervisory (Army-Wide Ratings)
Comn Task (Army-Wide Ratings)
MOS-Specific (MOS Ratings)
Written Mode Job Sample Mode
Sup. Comn. MOS Sup. Comn. MOS
1.00
.40 1.00
.34 .48 1.00
.12 .19 .13 1.00
.09 .30 .20 .I0 1.00
.ll .23 .42 .06 .17 1.00
.I7 .13 .13 -10 .08 .08 I..00
Ratinqs Mode
Sup. Comn. MOS
.13 -12 .09 .07 -06 .09 .71 1.00
.ll .15 .12 .05 .07 -09 .74 .64 1.00
The correlations between different test modes measuring the same job
components are highlighted in the table. The correlations between the two
task-based instruments (job knowledge tests and hands-on tests) are relatively
high even across the job components of common tasks and MOS-specific tasks.
At the same time, the cognitive aspects of supervisory activities seem to be
related to observed supervisory skill (ratings) to a greater degree than to
job samples of supervisory behaviors. It appears that, for common and MOS
tasks, knowins how to perform and beinq able to perform are more highly
related than either of those is to actuallv performinq on the job. However,
545