Technical Report - International Military Testing Association

.\- .
‘.
,-.
/
I
\ ,
_. /’
,
/
/’
. .
,_ -y...---
. . --
I
.
.
.
FoeoiL\‘ly the most important area of research at the Ealfated t-kaluation
Center are, the validation ctudiee, of the Cczzindtr’i: ZvalusrLon
,Repzt and the KG Evaluation Testa which ere conducted routinely.
Formal val.idiry rcpmtlng is quite comprehanui:te and tncltrdes the
validatioil of both the CER aitd the EvaloAt.fon Teat as *:ell as the interrelationship&
between these instrrantc. Dee t o thrj lergthy processin,%
t&e required for the forwl validity report, a prclimin~ry reporting
procedure io employed to provide maxiliium data for te3t revicion.
A preltmtnary validity report is to prwtda guidcltaea in test
revision based on pertinent statistical deta. TF;fo vaiiGi.ty data
cover&z’ the entire evalwtion test outlin 1) and individual test item
are provided prior to test revision to allw for their UB~ in the
decision-making process of test development. Emphasis is now placed
on the WIfi and HOW of test vslidity.
Statistical bases are provided to allow control in :c?~~t revhim
over the evaluaticq test characteristics of wan, ste.ndard deviati.on,
reliability, and v.llidity. The test characteristic of valfdity is
given specfal atta.;tLon, and is considered at both the item and test
outline levels. The statistical rationale and data necessary for thinpurpose
are provided to enable their use In test develcpment procedures.
Tha users of the information SGI data provided in the validation
report should: (1) have a thorough working knout,cdye of the interrelttionshfpa
between item and te6t stat!.st:cs to enable zzre control
in test revision Over evaluation test means, atar.darJ devls.tkona,
rcliabflfties, and validitlrs; (2) insofar a8 is ~racr.fcable, include
items of substantial vaiic:ity in revised tests; (3) study itema of etibstanti.al
valfdfty to deten?fne the particuler types of items which tend
to be most valid far a given Rvaluation test; (4) ff ouClina revision
is deeut?d appropriate, make such revisions in view of known intarrelatio.%hips
between Eroad Subject-patter Areas; and (5) reconcile item
requests vith both optin item allocations by Broad Subject-t!nttor
Areas and considerations of n practical nature. In this way, mxtnwn
control of the test results can be attefned.
A Corcparative Study of a Short Form and a Lorq Porn of Performance
- -
Dictation Test for Legal Clerk or COure Reporter - - te 8 research project
presently being conducted at the Enlisted Evaluation Cuntar.
his project was designed to detennfne whether a short form of the
Dfctation Perfornnnce Teat may be relLable enough to use in place of the
longer form, thus savfng administration and scoring time 88 vell as
providing a more maruzgeable measurement of the selected examineen. fie
short form is composed of preeelected sections of the dictation test
crmaprising 4GX of the total test. In a preliminary aralyeis, a Peareon
r correlation cofficiene of .95 was obtained bemeen the long form and
the exparitintal short revfsion. It would appear further examination
of this relationship wfll prove fruitful, and the recommendation for
the shorter test can be anticipated.
118
-- .- , -. . ..____. _____-... - __ .- _..-- ___---- ___^____ l_--