I__. - International Military Testing Association

- __-.-. -.. .~ .-... _ .._...
‘(2) If the objective calls for an understanding of the
material, then the test item should be written to one of the
higher learning levels.
(3) If the objective calls for a higher learning level
not all test items should be written to the highest level.
Enough must be on the test to ensure that the student has met the
objective to the learning level required.
Step Four. Select appropriate test items from the test bank
or develop test items. If a test bank is already in existence,
each item must be cross-referenced to the objective it
supports and a level of learning identified.
If the test bank
does not have an adequate number of items, new items may be
required. If it appears that new items that support the objective
are difficult to prepare, the plan may need to be altered.
Stels Five. Establish a minimum cutoff score. Setting a cutoff
score means that a point must be determined that differentiates
between the student that has achieved the objective and the student
that has not. If the first four steps have been followed, it is
safe to assume that the test has content validity. If there is any
doubt, the test should be reviewed again before attempting to
establish the minimum cutoff score.
Setting a cutoff score, as with the other steps is a judgemental
process. While several methods of establishing the minimum
cutoff score exist, the following methods are suggested.
METHOD 1
(1) A panel of subject matter experts are selected based on
their current knowledge of the job and the performance required
of the graduate in the fleet.
(2) A discussion should be conducted centering around what
is the minimally competent person. Caution should be taken not to
allow one person to dominate the discussion and that the goal
should be one of consensus. The discussion is designed to get all
members thinking along the same lines.
(3) Next, the technique of establishing the cutoff score
should be explained.
(a) Review each test item on the test.
(b) Check items that the student with minimum
competency should be expected to know. Care
should be taken that this is not what the average
student will know, or what the subject matter
expert would like for them to know.
(c) If there are any items that the student must know,
these items will be noted.
(d) Add the number of checks for each objective.
208
.