15.11.2012 Views

Technical Report - International Military Testing Association

Technical Report - International Military Testing Association

Technical Report - International Military Testing Association

SHOW MORE
SHOW LESS

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

. .<br />

-<br />

. -. .<br />

. ‘.<br />

-<br />

-m.__ ’<br />

We need careful definition of what we w4nt aach texst to do. we<br />

IWad ~108tar 6tbt6mant6 of what we want it to ~1~1oura and the condition8<br />

under aiich it owe do ito job. For a given aiammxwnt task w4 may nsed<br />

4 toot which yield8 89% perfect @core4 , or one that nsbodp parscoo ualeoo<br />

ha nsakeo a perfect ocara,aud there ara time0 when thi4 is 4 reoooneble<br />

toquirement. What kiod of diocriaination doe6 your test need to aukt?<br />

Doe4 e4ch queotion naud to opcrata at tha one parcent level? Are you<br />

aokfng it tcs diocrFrninate in ouaa othar fashion? 50 you want the tMt<br />

to be uoed a8 a motivation:1 device -- to moko your teat takoro uu;iouo<br />

to get out 4nd do more, better, 4nd Cantor? Do you want 4 toot that is<br />

basically a teaching dcvica? That wa4 the initial motivr~tion of S. I..<br />

Preooey’o teaching machine. In uoing hio mochineo,ovory time o otudant<br />

puohod 4n answer button to uIewer the tart 4nd got the right 4n4wor, the<br />

-chine went on to tha noxt quartion. If he got 4 wrong rnswar he kept<br />

on prrooing anover buttono until he got tbo right enover,, How vc erll<br />

thio reinforcement; imediaco feed bock.<br />

Thare aro ocane othar quaotiono to which pa Q not h&ve uuwcr~. ilou<br />

volid ohould 4 toot be? We have ha4rd about maximum validity, about lack<br />

of validity; but molly wh4t io the optim41 v4lidity YU rlhould look for?<br />

Anothsr quartion io *How rapidily and under whet cmditicmn do tsot ocoreo<br />

loose thair validity?” I have conoidorad the po4slbility of submitting a<br />

rootirch propooal for the development of tcot record inb: -0 ink4 for cuking<br />

teot recordo -- 80 that the teat � ���� for each teat wou1.d be faded out Juot<br />

at the tlme tha tart 4cora had lort it4 validity. At me time in 4 cwanooling<br />

center, wo act up a hard and foot yle, “Any percouality, intorest, or<br />

oimil4r tert has lort it4 validity 4ftcr 3 months.” After that,o5t4in 4<br />

freoh ocore - 4 04mpla of whrt that individual lo like now. And it might<br />

be noted that people oeeking counoelfag are parh:?o leoot stable in ouch<br />

charoctariotico. For b4ric rptituda teat8 ouch a# tha Ohio Stats Poychological<br />

Tort, we aokod for 4 frarh tart or rumple after one year. We nacd<br />

more knowledge 4bout thfr queetion not only in toner of tho teat, but 4140<br />

the intervening aventr. In measuring how wall 4n electronic6 technician<br />

parform on tho Job you msy get 4 meaouramnt at the time he completer<br />

bio training. Suppore he had �� � it and wait 60 dayo for �� � rafgnmont;<br />

hw volid lo hfo ta4t bcore after 60 d4yr with no practfce in the electronico<br />

ohopt Hw valid would hi8 t44t ocoro bat<br />

In being here tonight, I have triad to point to 4om3 of the future<br />

and to � tir up your thinking. I hove tried to illurtrata the l’taot’@ 40 4<br />

sample of behavior. I w4nt to cheer for axtending 4nd trying out new concapto<br />

of 4n8wer pattarnr in tart fonnulatfon. I want to iace ue devalop the<br />

ure of computer6 to do things in test rcoring and teat analyrfa th4t wo<br />

hove only tolked or drarsled 4bout and to do � ome thing4 that wa h4ve not<br />

avan rtartad to inugine. Keep your w4ys and maano, your rechniques, in<br />

proper peropectiva; and keep in front of you a clsrr idea of the purport4<br />

of the test itself by defining it4 uoeo, 48 well as ftr limft4tion4, 4nd;<br />

through these, extending Its ueefulneoo a8 a me4euring device or w4y of<br />

drawing more 4dequ4te, 4nd more effective samples of behavior.<br />

I .<br />

I<br />

29<br />

_ . _ __ .._^_ - .._-_ . -. -<br />

-<br />

._. ,. .<br />

.<br />

:<br />

I<br />

.<br />

.<br />

*.- ._ ,(<br />

\~<br />

._,. _ _ .____. ._-. .- ___--__<br />

*<br />

--.-<br />

,I(<br />

- --<br />

,<br />

-_-

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!