2003 IMTA Proceedings - International Military Testing Association

Table 1: Responses from 10 Subject Matter Experts on the Performance Content Survey
Response scale:
1 To no extent
2 To a limited extent
3 To some extent
4 To a considerable extent
5 To a great extent
6 Perfectly
To what extent:
1. …does the Assessment Center reflect the knowledge, skills, abilities, and
M SD
tasks acquired during the team training?
5.3 .48
2. …does team performance (rated at the end of the team training phase) reflect
the knowledge, skills, abilities, and tasks required during the team training?
3.…is the content of the Assessment Center similar to the content of the team
training?
4.…does the team performance rated in the team training phase tap the same
performance domain as the team performance rated in the Assessment Center?
5.…do the ratings from the Assessment Center and the ratings from the team
training phase tap the same dimensions of performance?
6.…are the team training objectives similar to the performance criteria used in
the Assessment Center?
7.…are the team training objectives similar to the performance ratings used in
the team training phase?
8.…are the team tasks (e.g., quick attack) performed in the Assessment Center
similar to the team tasks learned in team training?
9.…. are the behaviors (e.g., fire and movement) exhibited in the Assessment
Center similar to the behaviors exhibited during team training?
10.Yes or no: Does the Assessment Center measure the same content, tasks,
knowledge, skills, abilities, and other characteristics as the team training?
5.0
5.3
5.2
5.1
4.7
5.3
5.5
5.3
YES-10
NO- 0
Note: n = 10 . These experts do not use the term “performance ratings in typical contexts,” rather
in the language of this organization such ratings would be known as “team performance rated in
the team training phase.” We therefore used the language familiar to these experts to refer to the
performance measures across both contexts.
651
.47
.67
.63
.88
.67
.48
.53
.48
45 th Annual Conference of the International Military Testing Association
Pensacola, Florida, 3-6 November 2003