Technical Report - International Military Testing Association

,’
‘.
,-- -
: ’
‘.b
:’
_. _
:
:
I ,
_.
. .
f
-.. \
‘\
-.
‘.
Another area of reoearch is the longitudinal studies on the cmmander’s
Evaluation Report (CER). The CER is the officfal rating form
which constitutes one of the cmpone’nte of the Enlfated t’valuation
System. The primary purpose of the CER is to provide an sseessraent of
the soldier’s job performance and potentinl-for advancement by his imdiate
and secondary supervisors. Although ratings, per se, ‘are not perfect they
are the best available evaluation method when no objective masure can be
obtained; therefore, the enlisted Evaluation Center is quite interested
in the perfomance and improvement of the CER.
no studies presently beinS conducted to facilitate the continual
improvement of the CER are A Factor Analysis of CER Scales, Technical
Subtest. and Suoervieorv Subtest. and
I A CccJlparison of a Graphic Raa
Method, A Normative Paired-Compartson Rating Method, and An IpeatFve
Paired-Comparison Ratfng Method via the Multitraiz-Multimethod Hatrix.
The factor analytic study was to determine the degree of c-n-factor
variance of each of the twelve CER Pcalee and the technical and supervisory
subteata ofanMOS Evaluat:on Test. prom the results of this
research will come information necessary for proper revision of the CER
to eliminate rhe measurement overlap or c-n-factor variance, thus
improving the evaluative ability of the zating. Seven orthogonal factors
emerged from the analysis, however, tbey a:1 have not been named. One of
more important results thus far, however, was the high loadfng of the
technical subtest on the initiative Factor.
The second rating study, presently in the planning stages, ie A
Comparison of a Graphic Rating Method, A Normative Paired-Cozparieon-
Rating Method, and an Ipaative Paired-Comparison Rating Method via the
Multitrsit-Hultim+thod rWtrix. This research endeavor was dec Lgned to
statistically letemine whether the graphic rating method as used in CER
ratings is adequately serving its purpose by providing valid and accurate
information to the Enlisted Evaluation Center, or, if either the normative
paired-canparison 4th certainty judgments method or the ipsative pairedcomparison
with certainty judgments method would be superior and provide
more accurate and valid results. Also, since the normative and ipaative
data are aupplemntary to each other, it is possible to statistically
combine the data from these two methods, thus yielding a fourth rating
method for the analysis. ft is felt that this information will be
valuable in assessing the adequacy of the CER ratfng method in comparison
to the other rating methods. No data have been collected yet,
One very important previuus study was The Effect of Rater-Ratee
Acquaintance Period on CER Ratings. This research project was designed
to determine ii a specified minimum period of acquaintance between the
rater and ratee was neceesary for satisfactory and reliable CER ratings.
The results obtained on various NOS skill levels indicated that a minimum
period of two months (60 days) acquaintance was esaentfal for proper
evaluation. This time period is now mandatory in the Department of the
Amy for all CER ratings, although some leniency in this requirement is
alloued.
117
-------
.
‘I
;;