I__. - International Military Testing Association

t h e SME,;. This in turn may have biased the SMES’ ratings on the CVR forms
and on the surveys as we11.
The results of this study suggested several areas for future research.
First, to the extent that the forms are used, one would expect the content
validity of SKTs to improve over time since ideally, the forms would help
SMEs identify and retain those items most essential to successful performance
in the specialty. This could be observed by charting the average content
validity rating for all SKTs over a period of years.
Also, with the imminent manpower cutbacks, the USAFOMS mission may be directly
affected. By charting these average content validity rating values, it
would be possible to see whether the content validity of the test% declined.
This would be helpful in illustrating the impact of cutbacks on the test. development
mission at USAFOMS.
Finally, it would be interesting to examine the relationship between project
psychologist and SME responses to the survey questions and to investigate the
possibility of psychologist biases affecting the SMEs’ use of the forms.
Although the attitudinal portion of the research showed some disagreement as
to the value of this quantitative procedure, statistically, the content validity
of the items has a significant impact on the subsequent identification
of items for reuse.
References
Carrier, M. R., Dalessio, A. T., and Brown, S. H. (1990).
Correspondence
between estimates of content and criterion-related validity values. Personnel
Psychology, 43, 85-100.
Distefano, M. K., Jr., Pryer, M. W., and Craig, S. II. (1980). Job-relatedness
of a posttraining job knowledge criterion used to assess validity and
test fairness. Personnel Psychology, 33, 785-793.
Applica-
Distefano, M. K., Jr., Pryer, M. W., and Erffmeyer, R. C. (1983).
tion of content validity methods to the development of a job-related performance
rating criterion. Personnel Psychology, 36, 621-631.
Fitzpatrick, A. R. (1983). The meaning of content validity. Applied Psychological
Measurement, 7, 3-13.
Kesselman, G. A. and Lopez, F. E. (1979). The impact of job analysis on em-
ployment test validation for minority and nonminority accounting personnel.
Personnel Psychology, 32, 91-108.
Lawshe, C . H . (1975). A quantitative approach to content validity. Personnel
Psychology, 28, 563-575.
240
.