MAP-01-011 HFI Technical Guide - Human Factors Integration ...

MAP-01-011 – HFI Technical Guide (STGP 11)• Encouraging validation data (No citation reference - Jones 2000, DTC195 -Waag & Houck 1994)• A very simple technique requiring little training.• Less intrusive than freeze techniques.• The technique can be used in ‘real-world’ settings, as well as simulatedones.• The technique does not restrict itself to the three levels of SA proposed byEndsley (DTC054 & DTC056 - 1995)• Disadvantages• As the SARS behaviours represent SA requirements when flying F-15s incombat type scenarios, the use of the technique in other domains is verydoubtful. Significant re-development would have to take place for thetechnique to be used in C4I environments.• The technique has been used infrequently and requires further validation.• The technique is administered post-trial, which carries a number ofassociated problems. Typically, post-trial subjective ratings of SA correlatewith task performance (i.e. I performed well, so I must have had good SA).Also, participants may forget the periods of the task when they possesseda poor level of SA.• The SA data is subjectiveA3.7.5Situation Awareness Rating Technique (SART)The situation awareness rating technique (SART) is a quick and easy self–ratingSA measurement technique that was developed for the subjective estimation ofSA. The technique was developed from interviews with operational RAF aircrewaimed at eliciting relevant workload and SA knowledge. As a result of theseinterviews, 10 dimensions that could be used to measure pilot SA were derived.These 10 dimensions are used in conjunction with a Likert scale, categories (lowvs. high), or pairwise comparisons in order to rate pilot SA. When using thesedimensions the technique becomes the 10D-SART.Furthermore, for a quicker version of 10D-SART, the 10 dimensions can begrouped into three dimensions, in order to create 3D SART.• Advantages• SART is very quick and easy to apply, requiring minimal training.• The SART dimensions were derived directly from interviews with RAFpersonnel, thus the technique was developed using specific aircrewknowledge.May 2006 Page A3-60 Issue 4