I__. - International Military Testing Association

.
TABLE 1
Means, Standard Deviations, and Interrater
Reliability Coefficients for New Interview
Protocol Ratings
(N=59)
Dimension -a.- S D Reliabilitya*
NROTC Interest and Motivation 3.95
Leadership Potential 3.78
Responsibilities 4.00
Organization of Tasks & Activities 4.20
Communication 4.24
Overall Evaluation 3.98
Sum of First Five Dimensions 20.17
1.07 . 81
1.26 . 8 7
. 95 . 81
. 87 . 83
. 99 . 93
. 97 . 93
4.35 . 95
a. These are 2-rater intraclass correlations; N=24
In addition, officer interviewers who used the new interview
procedures were asked their opinions about this protocol compared to the
previous one. Their comments are summarized in Table 2.
TABLE 2
Summary of Comments on the New
Interview Protocol Rating Form
a Big improvement over old form
a Not too long or burdensome (interviews timed at 12-30 minutes
including answering candidate questions, not filling out form; aver;rc:;.
about 15-18 minutes)
a Concept of behavioral standards well understood and accepted
a Worksheet especially helpful when doing several interviews back-toback
without completing the ratings
a Videotape seen as very clear and useful
a Interview program takes pressure off interviewer by providing good
questions to ask
a Interview program gives diverse interviewer types (e.g., NROTC staff,
officer recruiters, Reservists, etc.) more common frame of reference
DISCUSSION AND CONCLUSIONS
Evaluations of the new interview materials and procedures by NROTC
Selection Board members, NROTC officers, and officer recruiters responsiblk:,
for interviewing NROTC applicants (as well as data from field tests of th?
interview), suggest that these materials and procedures are ready for
implementation. What is most urgently needed to evaluate the usefulness of
496