Technical Report - International Military Testing Association

description pbliehed in AR 611-201. This job description lists all the
skills and knowledge pertaining to a portlcular job (Military Occupational
Speci al ty) , In many instances these job descriptions have not been upJnted
for several years. There are many other publications relied upon by the
teat specialist chat are net updated.
b. The test specialist and reviewing and rcvistng personnel uho are
constructing a test outline for a partfcular Hflitarj Cccupnticnai Specialty
have had very lfnlted experience with the job in many cases; therefore, the
test outlines might include areas to be tested that are not signiricant or
it might exclude areas that definitely should be sampled. Lack of experience
with the job also results in poo r weighting of the test outline.
c. Some of the terminology used by the constructors of test outlines,
who have had limited experience in the jobs for which the test outlfnea are
being built, is not stated in terms that are understandable to the item
writers and examinees.
The US Army Artillery and MFasile School recognized some of the inherent
weaknesses of reviewing a test outline through a decentralized organization
and began to plan some means of improving test OuKlfne review
prccedures. There was some thou;\rt of sending questionnaires to enlisted
personnel and asking for suggestions on changes to the test outline. Another
idea entertained was that of makin g visits to some Army nrganlrntions,
talking with enlisted personnel,and asking for suggested improvements to
the test outlines. These ideas seemed unfeasible for various r.,asons. It
was finally ihcided that the US Amy Artillery and Missile School would use
what it calls anHOS Evaluation Test Outline Seminar in an attempt to improve
test outline review procedures.
The underlying idea of the HOS Evaluation Test Outline Seminar is to
gamer the thoughts of test specialists, experienced School instructors,
and ffeld experienced anliated personnel at various skill levels and use
theee thoughts when constructing, reviewing, or revising test outlines, thus
creating a test outline balanced on academic school thought, test specialist
thought, and job expertence thought.
These seminars are still !n the experimental stage, To date, two !-lOS
Evaluation Test Outline Seminars have been held. The success of the last
two seminars has indicated that the US Army Artillery and Hissilc School
will use seminars in the future as a regular part of its test outline review
procedures. The last HOS Evaluation Test Outline Seminar was held on
16 September 1964 at the US Army Artillery and Missile School for the pur-
Tose of reviewing and revising the MOS Evaluation Test outline for HOS 142
(Heavy and Very Heavy Field Artfllery Crewman). Those taking part in the
seminar included 20 enlisted personnel, a test specialist from the Enlisted
Evaluation Center, a senior instructor from the Gunnery Department, and test
specialists from the US Army Artillery and Missile School.
157