Technical Report - International Military Testing Association

.1 , .I . . ., .;., ., _-
.
-.< “. ,:. ,L ,._.,._. _
Another group of continual research studies lies in the Inv’eetf-
Bation of Possible Test Ccmpromiee. One study i.n this area vns the
davelopwnt of investigation procedures.
An MOS !Zvslustion Test would be comprolaiaed if one or more copltes
, of the test booklet came into.tho possession of an unauthorized enlisted
_ nun, and the Information vats used by him before or during the admints-
/ tration of the test, An HOS Evaluation Test is subject to possible
compromise if it is lost or is unaccounted for prior to the ccmpletion
of an “02 evaluation p%riod. . .
: . .
. .
., _,‘.
.
.
In this study three methods for investigating possible compromise
in a large military program in which tests are administered once a year
were developed and experimentally tested. Compromise may be checked by
(1) comparison of test scores of individuals or possible compromise groups
with population parameters; (2) standardization and analysis of test
scores wer two test periods; and (3) regression analysis of test scores
over two test periods. prom the resulting statistical analyses the
limitatfors and advantages of each method vere shovn, as well a8 a
rationale for the interpretation of results and the formulation of
subsequent administrative decisions and recolmlendations, Presently,
any one of these metho,ds may be used depending on the circumstances.
Two more recently carsrenced studies are A Comparison of Six Me,hoda
of Item-Test Correlations and k Comparison E v a of%ur l u a t i o n Proceduref!
for Pieasuring ParforuGG Efficiency. The first fesearch project was
based on Cuilford’s (1950) study in which he compared the biaerfal r, the
point-bieer?al r, the ordinary tetrachoric r, the Flanagan tetrachoric r,
and two applications of the Phi Coefficient methc-;s of itein-tese correlation.
~%a point-biseripl r proved to be the superior method. Therefore,
thfe project was designed to replicate and extend Gutlford’e study
since the point-bisarial correlation is sued in item analysis at EbC.
This project will either substuntiate Guilford’s findings and give
further proof of the value of the point-bisarial method, or it will
reviee his results and indicate possibly another more accurate index of
Item-teat correlation. ho data have been collected as yet.
The second study noted above can be classified as a criterion study.
Sufficient procedures are used by EEC for increasing and maintaining the
reliability and content validity of the HOS Evaluation Tests. However,
a number of problems are encountered in the establishment of concurrent
or predfctive val:ldfty since an adequate criterion is necessary. The EEC
has developed a rating scale which is presently being used for getting
criterion data via co-worker or peer ratings. However, more satfsfactory
criterion data msy be accessible by using other measurement procedures.
The purpose of this project is then to compare four methods of
measuring perfor=mancaefficiency to learn whether a superior rating
119
,