I__. - International Military Testing Association

_--. _-...- __--- . . . . .__.. -. - _- __
Table 2
Generalizability Coefficients for Hands-On Tests
Task One Rater Two Raters
*Broadcast Operator 0.96 0.98
*Log Messages 0.96 0.98
*File Messages 0.95 0.98
*Manually Route Messages 0.95 0.98
Change Paper/Ribbons 0.60 0.75
Establish System - Golf 0.91 0.95
Establish System - November 0.94 0.97
*Inventory Classified Documents 0.69 0.82
Preventive Maintenance - Receiver 0.93 0.96
Preventive Maintenance - Transmitter 0.95 0.98
*Prepare Message DD173 0.98 0.99
*Prioritize Outgoing Messages 0.90 0.95
*Type/Format/Edit 0.96 0.98
*Verify Outgoing Messages 0.97 0.98
*Indicates primarily product scored tests.
Table 3
Intertask/Item Correlations by Test Component
Component Correlation
Hands-On 0.89
Written Performance 0.74
General Knowledge 0.71
Intercorrelations Amona Test Methods
Correlations, particularly between hands-on and written performance
tests, are important because of the possibility of substituting written tests
for resource-demanding hands-on tests. The correlations between written and
hands-on task tests are shown in Table 4 and the overall correlations between
test methods is shown in Table 5.
532