09.12.2012 Views

I__. - International Military Testing Association

I__. - International Military Testing Association

I__. - International Military Testing Association

SHOW MORE
SHOW LESS

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

abilities for test development (Studies 1 and 21, as well as look at the relationship<br />

between relative importance and relative time spent ratings (Study 3).<br />

1STUDY<br />

Data Collection: Ninety four professional and administrative occupations in the<br />

civilian Federal work force were studied. A list of major duties was developed<br />

for each occupation. Then a list of abilities was developed by reviewing the<br />

construct literature (Northrop, 1989; French, Ekstrom and Price, 1363; and<br />

Peterson and Bowans, 1982). Abilities that could not be assessed through a .<br />

written test were not included. The resulting list contained seven abilities:<br />

verbal comprehension, general reasoning, number facility, logical reasoning,<br />

perceptual speed, spatial orientation, and visualization.<br />

Using the job-specific duty lists that were developed for each occupation,<br />

five research psychologists rated the seven abilities for their importance to<br />

SdCh overall job using a five-point scale. The scale ranged from "l-Unimportant"<br />

to "5-Crucial." It should be stressed that rather than rate each ability against<br />

each duty for every job, the psychologists were asked to read each duty list in<br />

its entirety and make a "holistic" judgment concerning the importance of aach<br />

of the abilities for the overall job. The psychologists made holistic ratings<br />

for tl-le occupations. Based on each psychologist's overall ratings for each job,<br />

averages for each ability were computed for each of the six job families.<br />

Approximately 6,000 job incumbents completed and returned the inventory.<br />

As part of this inventory, job incumbents were asked to rate each of the seven<br />

abilities using the sama five-point scale used by the psychologists. The<br />

inventory stressed that the incumbents rate each ability as it related to their<br />

overall job. That is, they were asked to make a "holistic" judgment about the<br />

importance of each ability. Based on each ir,cumbant's overall rating for the‘;r<br />

job, averages were computed for each job family for each ability.<br />

RESULTS<br />

The mean overall ability ratings of the psychologists and the job<br />

incumbents, for two of the largest job families, can be found in Table 1.<br />

Table 1. Comparisons of ability ratings for psychologists (N=5) and job<br />

incumbents by job family.<br />

Psychologists Incumbents<br />

mS.D.<br />

Business, Finance & Management Occupations<br />

Mean S.D.<br />

Verbal Comprehension 4.56 (.41) 4.40 (1.10) 2306<br />

General Reasoning 4.60 (.41) 4.13 (1.13) 2306<br />

Number Facility 3.99 C.71) 3.54 (1.27) 2306<br />

Logical Reasoning 4.38 (.48) 3.59 (1.29) 23c5<br />

Perceptual Speed 1.82 (1.12) 2.72 (1.33) 2306<br />

Spatial Orientation 1.68 c.62) 1.57 (1.29) 2306<br />

Visualization 1.55 c.38) 1.95 (1.46) 2306<br />

Personnel, Administration & Computer Occupations<br />

Verbal Comprehension 4.64 l.44) 4.51 (1.03) 1197<br />

Ganeral Reasoning 4.59 (.40) 4.25 (1.07) 1197<br />

Number Facility 3.18 l.56) 3.07 (1.31) 1197<br />

Loyical Reasoning 4.44 (.50) 3.59 (1.29) 1197<br />

Perceptual Speed 1.66 c.92) 2. 72 (1.33) 1197<br />

Spatial Orientation 1.34 (.49) 1.57 (1.29) 1197<br />

Visualization 1.26 (.46) 1.95 (1.46) 1197<br />

53

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!