MAP-01-011 HFI Technical Guide - Human Factors Integration ...

MAP-01-011 – HFI Technical Guide (STGP 11)• Disadvantages• The extent to which team members can provide an accurate assessment ofoverall team workload is questionable and requires further testing.• A host of problems are associated with collecting data post-trial.Participants may have forgotten high or low workload aspects of the taskand workload ratings may also be correlated with task performance e.g.subjects who performed poorly on the primary task may rate their workloadas very high and vice versa. This is not always the case.• The approach is seen as cumbersome by some HF practitioners and doesnot provide separate estimates for teamwork vs. task-work.A3.9.8Distributed Assessment of Team Mutual AwarenessThe Distributed Assessment of Team Mutual Awareness questionnaires methodis based upon a team mutual awareness model, the methodology comprisesthree questionnaires:• The task mutual awareness questionnaire.• Workload awareness questionnaire.• Teamwork awareness questionnaire.The task mutual awareness questionnaire involves the participants recallingsalient events that occurred during the task under analysis and then describingthe tasks that they were performing during these events and also the tasks thatthey think the other team members were performing during these events.The workload awareness questionnaire is a subjective workload assessmenttechnique based upon the NASA TLX and involves team members subjectivelyrating their own workload on the dimensions: mental demand, temporal demand,performance effort and frustration. Team members also provide an overall ratingof the other team member’s workload and also provide a rating for each TLXdimension for the team as a whole.The teamwork awareness questionnaire is used to rate the team on fourcomponents of teamwork processes. Team members offer subjective ratings ofthe teams performance on the following team behaviours: Communication, backup,co-ordination and information management, and leadership/team orientation.Each of the questionnaires are administered post-trial in order to gain a measureof ‘team mutual awareness’.• Advantages• The questionnaire techniques used are quick, cheap and easy to apply.• Minimal training is required in order to use the technique effectively.May 2006 Page A3-82 Issue 4