Technical Report - International Military Testing Association

I--
,
c
Now, an MOS Evaluation Test. rates examinees’ ebilitiec to perform the
full scope of the duties of an HOS skill level, weighted to fit the
objective3 and concepts of relative importance of the standards setting
level of the Army pro&ream manager3 staff. In other words, the testo are
biased in favor of the broadly-skilled examinee rather than one who is
exceptionally skilled in a pnrt of his HOS skill level reqafremcnts.
The test score indicates the exazinee’s relative standing among all
examineee ansigned the MOS skill level. If peers and supervisors can
adjust their ratings of exr=,inces to comyenaate for their personal
bioaes and influences, if they thoroughly understood and accepted the
objectives and important concepts of the standards setting level of the
program manager’s staff, and if they could simultaneously and comprehensively
evaluate the abilities of all personnel assigned the primory
MOS skill level, they would probably rate the exnminee as the test rated
him, if the examinee reacted to them as he reacted to the ceet during the
evaluation period. Ohviot~sly, peers, auperviuore, and exainees interreact
differently, differ in their opinions a8 to the relative importance
of tasks, have varying degrees of understanding of the specific objective3
of top level standard setter3, and have rarely, if ever, had the opportunity
to evaluate the abilities of 311 persons assigned to any MOS skill level,
let alone nimultaneously. The test3 do provide.a basis for predicting how
well an examinee could do on the ; Jb when permitted to do the whole job
rather than a oubspecialty and when motivated in the acne degree and
direction aa he was at the time he took the test. A greet deal more information
concerning his interpcreonal relationships and attitudes along
with those of his peer3 and supcrvisor3, their rating attitudes 6J d
abilities, and the dynamics of the group would bc required before one
could predict Low an examinee would be regarded oy his peers with
reasonable accuracy.
A few item writing and technical publications writing groups have
cooperatively used test question response data as a cue to whether technical
material has been dietribuced to and understood by examinees. With
few exceptions, the test question analyses developed by the Enlisted
Evoluation Center reflect how all of the personnel in each MOS skill level
responded to each test question. Items relating to equipment or doctrinal
changes are carefully reviewed when only a small proportion of the CXaminecs
answer the questions to determine whether the queetione or the
cxaminees are deficient. Checks are also made to determine when guides
and training materials were distributed to exeminees and whether these
material6 require clarification or amplification.
Many will envision other u3es of PiOS Evaluation Tests. In planning
the uses, one must bear in mind and insure:
a. The te6t content and objectives are compatible with each
planned use.
trolled,
b.
All pertinent variables are identified, evaluated, and con-
____ __- .--.--- --
146
-.-_- _._. _ ..-.._. -
- - -_ - -.