2003 IMTA Proceedings - International Military Testing Association

140
SUCCESS AT COLLABORATION
AS A FUNCTION OF KNOWLEDGE DEPTH*
Mark A. Sabol, Brooke B. Schaab, and J. Douglas Dressel
U. S. Army Research Institute for the Behavioral and Social Sciences, Alexandria, Virginia
Andrea L. Rittman
George Mason University, Fairfax, Virginia, Consortium Research Fellows Program**
Abstract
Pairs of college students played a computer game, SCUDHunt***, that requires
collaboration. Separated but communicating players deployed information-gathering “assets” to
locate 3 missile launchers on a 5x5 grid. Since each player controlled only half the assets (either
the "ground" or "air" set), pairs had to coordinate asset deployment to maximize the value of
information collected. Before the game, each player in 13 pairs received Deep-but-Narrow
(DbN) training, i.e., two identical sessions on the attributes (possible movements and reliability)
of assets controlled by that player; 13 other pairs received Broad-but-Shallow (BbS) training, a
session on one's own assets, followed by equivalent training on one's partner's assets. A quiz on
training content followed each session. Pairs then played two 5-turn games, each turn requiring
each player to guess the fixed launcher locations.
Results suggest that knowledge of one set of assets – those of the "ground controller" –
was more crucial to game-playing success than knowledge of the other set – those of the "air
controller." But knowledge of that more crucial set proved more complex and difficult to
acquire. During the first game, players assigned the more crucial set needed DbN training to
succeed. However, players given BbS training appeared to gain knowledge of their partners'
assets while playing the first game, leading to improvement in later performance. Players given
DbN training on the less crucial assets did poorly throughout. We interpret these preliminary
results as addressing the question whether training for collaborative tasks should include systemwide
aspects or concentrate on a single role.
____________
* The views expressed in this paper are those of the authors and do not necessarily represent an
official position of the U. S. Army or Department of Defense.
** Farrasha L. Jones made important contributions to the data collection phase of this research
while a student at George Mason University and a participant in the Consortium Research
Fellows Program.
*** Reference to and use of this product does not constitute endorsement by the
U. S. government.
45 th Annual Conference of the International Military Testing Association
Pensacola, Florida, 3-6 November 2003