MAP-01-011 HFI Technical Guide - Human Factors Integration ...

Annex 3 – HF Techniques, Methods and ToolsOriginally designed as a retrospective workload assessment technique, SWORDuses subjective paired comparisons of tasks in order to provide a rating ofworkload for each individual task. When using SWORD, participants rate onetask’s dominance over another in terms of workload imposed. A variation of theSWORD technique has been developed to assess pilot SA when using twodifferent displays (FCR display and the HSF display). The SA-SWORDtechnique involves participants rating their SA across different combinations offactors such as displays, enemy threat and flight segment. For example, whencomparing two cockpit displays, participants are asked to rate the display, whichprovided the greater level of SA.• Advantages• Very easy technique to learn and use.• The SA-SWORD technique can be used in any domain.• In a study using the SA-SWORD technique, pilots were interviewed inorder to evaluate the validity and ease of use of the technique (DTC190 -Vidulich & Hughes 1991). According to Vidulich & Hughes (DTC190 -1991) comments regarding the technique were either positive or neutral,indicating a promising level of face validity and user acceptance.• The SA-SWORD technique would be a very useful technique to use whencomparing two different interface design concepts and their effect uponoperator SA.• Intrusiveness is reduced, as SA-SWORD is administered post-trial.• Has the potential to be used as a back up SA assessment technique.• Disadvantages• A very clear definition of SA would need to be developed in order for thetechnique to work. For example, each participant may have different ideasas to what SA actually is, and as a result, the data obtained would beincorrect.• The technique does not provide a direct measure of SA. The analyst ismerely given an assessment of the conditions in which SA is highest.• SA is reported post-trial• Similar to other post-trial subjective techniques, SA ratings may becorrelated with performance.• There is limited evidence of the use of the SA-SWORD technique in theliterature.• Limited validation evidence.• Unlike SAGAT, the SA-SWORD technique is not based upon anyunderpinning theory.May 2006 Page A3-63 Issue 4