I__. - International Military Testing Association

predicts MARS III training success, but does not improve the
prediction of MARS III beyond that already provided by the file
review, and the leadership stand assessment does not predict MARS
IV training success; (c) the NOAB merit score predicts MARS III and
MARS IV performance, but all of this criteria prediction actually
originates with the file review; (d) neither the interview,
conducting officer, leaderless group discussion, nor the two CFRC
measures -- tested learning ability and military potential -provide
any prediction of MARS III or MARS IV training success; (e)
the file review is the only NOAB measure that appears to be
psychometrically sound; (f) the other four operational measures
(interview, leadership stands, conducting officer, and leaderless _
group discussion) require a psychometric overhaul (or replacement);
and (g) of the two experimental NOAB measures, the PPT has the most
potential for use as an operational NOAB predictor.
Based on this study and the earlier BOTC validation by Okros
et al. (1988), it has been recommended that the NOAB be retained
as the assessment method for selecting MARS candidates and that
efforts be made to improve the board's predictive efficacy by: (a)
increasing the construct validity of exercise dimensions; (b)
investigating the potential for applying situational interview
methods and patterned behavioural interview techniques; (c)
improving the predictive efficacy of the leadership stands; (d)
evaluating the predictive efficacy of the General Classification
(GC) test; and (e) developing new selection measures to replace
the leaderless group discussion and conducting officers'
assessments.
References
Campbell, D.T., & Fiske, D.W. (1959). Convergent and discriminant
validation bY the multitrait-multimethod matrix.
Psvcholoaical Bulletin, x, 81-105.
Bradley, J.P. (1990). A validation studv on the Naval Officer
Assessment Board's abilitv to predict MARS Officer training
success. (Working Paper 90-7). Willowdale, Ontario: Canadian
Forces Personnel Applied Research Unit.
Okros A.C., Johnston V.W., and Rodgers, M.N. (1988). An evaluation
of the effectiveness of the Naval Officer Selection Board as
a Dredictor of success on the Basic Officer Traininu Course
(Working Paper 88-l). Willowdale, Ontario: Canadian Forces
Personnel Applied Research Unit.
267