Technical Report - International Military Testing Association

Th? systems concept to be mortt effective, demands a alngIC mancger 1
to align the subsysths so that each nerrhoe vlth the other aa lt evolves
into tha einglo eyaten. Affter KQ US&’ has ccrtlficd that the contents
of a opeclfic Specialty Dcocrlptlon correlate significantly with the
relevant tasks involved In the fob, Air Training Commd break@ the job
down lnto tasks and level6 of proficiency vhlch rare ueed as u Job Trafning
Standard, If these tvo documents, villch wa coneldor 8uboystems, are
atgnlflcont, then the subsystezs charged vlth vrltlng the training materials
la off to n good start in making its contrlbutlon to the total reyatm.
Assuming that each eubsystes has been properly constructed, and la properly
coordinated with the other subsyeteae, vork ln the SKI tooting subsystem
ohould proceed amoothly since ve would then be charged only with conatructlng
an instrument that memore: how ~011 a:n airman haa mastered the
metcrlals found in a career development courao. With the syetcm working
optfmall)i wltheach subsystem making Lts proper contribution there need
be no queetlon or concern over &at the SKT ia meaouring. Under euch
circwatnnccs it will be meaaurlng the objectlvce and crfterfa eetabllahcd
by the subsystem charged ofth prcparlng the career development course.
At this point it must be remembered, however. that the SKT ia only sampling
rcpresantativc areas of a teak as datcxmlncd by the teat conatructlon
rubaystain.
ihccaria (1563) hna eaid in dlacuoelng the problem of maeursman~.
“Too often students are meoeurcd to fraction8 of a percentage pctnt agalnet
other students vlthout ever being raeesurad agelnst mlnirxnn job requirements.
There are two t :ln reusona for this phenomenon. Flrat, tralntng oblectlvco
ara seldom atated in definitive enough terms, and aacond, a relative
rather than an abeolute measurement oyetem i8 employed.”
Thlo leads u8 to a diacuseicn of the usea for which an evaluation
ir made. It la important to the whole system that this use be aperiflcally
announced so that it will be one of the objectlvee for each subsystem to
keep in mlnd title making their contrlbutfon, If Dr. Zaccaria’s crlterlonbaeed
evalua:lon isuacd,it will result in a certain group being found
proficient without knowing hov proficient. If the percentile rank lo
used, ltwlll tell us the relative standing of each lndlvlduel in the
group. It 1s up to the eyrtem manager to decide vhlch evaluation
correlates best vlth the use for bhlch the measuring instrument is dosigned.
A system8 approach vi11 work oniy when each subsystem la working
towurd the rame goal under the direction of a slngla manager.
124
--... . ._-_. ^. --- - - .----.-- - -- . _ _ __- -._-- _..,.-.
.
. .