09.12.2012 Views

I__. - International Military Testing Association

I__. - International Military Testing Association

I__. - International Military Testing Association

SHOW MORE
SHOW LESS

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

-<br />

t<br />

of TAs across tasks: shadow scoring: on-site data entry; and<br />

ongoing counselling of TAs.<br />

Recruiting of Former/Retired Marines as TAs<br />

We sought former or retired Marines to serve 'as TAs,<br />

preferably those with experience in the MOSS which were tested.<br />

This offered several advantages over using civilians or active<br />

duty Marines. Their Marine Corps background enabled them to<br />

relate better to the examinees and promoted a more realistic<br />

testing atmosphere. Also, using former rather than active duty<br />

Marines eliminated a possible bias of Staff Non-Commissioned<br />

Officers toward their troops. Former Marines would have no<br />

vested interest in seeing that "their" mechanics performed well.<br />

Selection of TAs Based on Structured Interviews<br />

All TA candidates were screened using a structured interview<br />

which evaluated their suitability in several categories.<br />

Applicants were questioned concerning their previous experience<br />

in six areas: performance of mechanical tasks; test<br />

administration; administrative duties: planning and organization:<br />

public speaking; and vehicle maintenance. For each dimension,<br />

applicants were evaluated using a three point scale indicating<br />

noI moderate, or high familiarity. There were more applicants<br />

at the East Coast test sites, but overall TA quality was high at<br />

all locations. West Coast TAs for helicopter testing tended to<br />

be less experienced former Marines than at all other locations.<br />

Standardized Test Site Set Un<br />

<strong>Testing</strong> was conducted at five test sites. There was one site<br />

for automotive testing on each coast, and a single test site for<br />

helicopter testing on the East Coast. Due to the wide separation<br />

of helicopter assets on the West Coast, it was necessary to set<br />

up two test sites there. To reduce site differences, the same<br />

people were involved in establishing the site requirements and<br />

setup procedures at all test sites for air or ground. Where more<br />

than one test site was set up simultaneously, individuals<br />

directing the set up had previous experience at another test<br />

site. Site directors at all sites were involved in the site<br />

requirements determination from beginning to end. Standardized<br />

aircraft/vehicle, test equipment, parts, tools, publications, and<br />

other requirements lists were prepared for all sites. Local<br />

variations in equipment brands, procedures, and facilities were<br />

carefully analyzed for their possible impact and eliminated or<br />

minimized across all sites.<br />

Extensive and Onqoing TA Traininq<br />

TAs underwent a thorough week-long training program. Most<br />

had served in the Marine Corps where training had been an<br />

integral part of their responsibilities for years. We stressed<br />

the requirement to avoid giving feedback to the examinee which<br />

536

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!