15.11.2012 Views

Technical Report - International Military Testing Association

Technical Report - International Military Testing Association

Technical Report - International Military Testing Association

SHOW MORE
SHOW LESS

You also want an ePaper? Increase the reach of your titles

YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.

.<br />

.<br />

ANNEX 3<br />

CRITERIA FCR PERFORMANCE CHECK TEST ITEHS<br />

1. Items should requfre as little judgment as to quality as possible.<br />

Ideally, each item would be evaluated as being “possessed” or “not possessed”<br />

by examinee.<br />

2. Item6 should emphasize licrftical’V motor skills that discriminate<br />

between various levels of performance.<br />

3. Readily observable differences should exist in the motor tasks,<br />

(or portion thereof, described by the item.<br />

4. The performance can be evaluated objectively in that it is<br />

directly measurable (i.e. can be evaluated as to percent accuracy of<br />

performance , count can be made of specific number of times something was<br />

done, is.performed at the defined level, etc., rather than having to<br />

evaluate it in a highly subjective manner where the standard6 will vary<br />

greatly from one observer to another.)<br />

5. Items selected for objective evaluation should be a representative<br />

trampling or cross section of the overall performance in order that the<br />

evaluation will not be one-sided or unfair to 6ome.<br />

6. Items of performance selected should be those that can be<br />

Ipresented in a uniform manner by different observers at different locations.<br />

7. Items should be those which when being used will have a high<br />

degree of agreement among observers.<br />

8. Items requiring a special performance of standard task may be used<br />

when required, but otherwise should be avoided to simplify completion of<br />

the PCT.<br />

9. Item6 which can be evaluated better and more efficiently by paper<br />

and pencil testing should not be included in this list. No item should<br />

have a lower correlation withtotal PCT score than with written test score.<br />

10. Items selected should be considered in terms of use for minimum<br />

qualification, proficiency, and pranotion score determination. This implies<br />

that items may need to be restricted to activities commonly per-<br />

IEormed by most or all.<br />

11. PCT items must conform with usual measurement principles and<br />

item and test criteria.<br />

.<br />

.<br />

,<br />

.<br />

:<br />

i

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!