I__. - International Military Testing Association

iors, these items are more likely to be verifiable. Thus, an effort was made to include as many biodata
items as possible in the pilot version of the PEC. However, when sufficient numbers of biodata items
could not be written to adequately cover a construct, temperament items were also included. Between 13
and 21 items’were written to tap each of the eight predictor constructs. In order to detect response distortion
by applicants if it occurs, a ten item response validity scale (called the Unlikely Virtues scale) was
also developed and included in the inventory. Thus, the pilot version of the inventory, called the Profile
of Experiences and Characteristics (PEC), contained 151 items.
Evaluating the PEC
Both rational and empirical approaches were taken in evaluating and refining the PEC. The rational
approach was a retranslation exercise in which researchers independently categorized the PEC items into
the eight biodata/temperament constructs. The empirical approach involved administering the PEC to a
large sample of NROTC applicants. The inventory was also administered to a comparison sample of
NROTC scholarship students.
Retranslation Exercise
The retranslation exercise had two purposes: (1) to determine whether researchers would agree concerning
the placement of items on constructs; and (2) to obtain information that could be used to further
revise and refine the composition of the constructs and their definitions. Seven researchers who were
knowledgeable about biodata and/or personality research were asked to independently sort each of the
PEC items into one of the construct categories according to the perceived match between item and category
content. The degree of agreement among these researchers concerning the placement of items was
then evaluated.
Pilot Test
The PEC was administered to all Board Eligible NROTC applicants who were processed for the
1990 NROTC scholarship program between 18 December 1989 and 30 January 1990 as part of their application
process. Completed PEC inventories were obtained for 972 NROTC applicants from nearly all
of the 41 Navy Recruiting Districts. About 90 percent of the respondents in this pilot test sample were
either 18 or 19 years old, and 91 percent were male.
Frequency counts were conducted to identify and eliminate items where the vast majority of respondents
marked the same response alternative. Next, a rational scoring scheme was developed so that a
preliminary set of item- and scale-level scores could be computed. When cntenon data become available,
this scoring system may need to be modified. The item-level scores that were computed were intercorrelated
and factor analyzed.
Comparison with “Honest” Sample
In order to obtain some base rate information regarding how “honest” respondents (i.e., respondents
who have little to gain by distorting their responses) score on the PEC, a comparison sample of students
already enrolled in the NROTC scholarship program was administered the PEC under instructions to respond
as honestly as possible, A total of 175 first-year NROTC scholarship students from the University
of Minnesota, Notre Dame University, and Carnegie-Mellon University completed the PEC in January
1990. This sample was 93 percent male.