A Review of the Event Analysis of Systemic Teamwork Methodology

More documents

Recommendations

Info

HFIDTC/WP1.1.3/10 Version 2/ 31 October 2005 Flowchart START Define study requirements Define scenario(s) to be observed Prepare/design observation Conduct pilot observation session Are there any problems Y Conduct observation of scenario(s) N For data analysis, choose from the following based on study/data requirements: • Transcribe scenario • Record task sequences • Record task times • Record any errors observed • Record frequency of tasks STOP 31
HFIDTC/WP1.1.3/10 Version 2/ 31 October 2005 Advantages Disadvantages • Observation technique data provides a ‘real life’ insight into man-machine, and team interaction. • Various data can be elicited from an observational study, including task sequences, task analysis, error data, task times, verbal interaction and task performance. • Observation has been used extensively in a wide range of domains. • Observation provides objective information. • Detailed physical task performance data is recorded, including social interactions and any environmental task influences (Kirwan & Ainsworth 1992). • Observation is excellent for the initial stages of the task analysis procedure. • Observation analysis can be used to highlight problems with existing operational systems. It can be used in this way to inform the design of new systems or devices. • Specific Scenarios are observed in their ‘real world’ setting. • Observational data is used as the core input into numerous HF analyses techniques, such as human error identification techniques (SHERPA), task analysis (HTA), communications analysis (Comms Usage Diagrams), and charting techniques (operator sequence diagrams). • Observational techniques are intrusive to task performance. Knowing that they are being watched tends to elicit new and different behaviours in participants. For example, when observing control room operators, they may perform exactly as their procedures say they should. However, when not being observed, the same control room operator’s may perform completely differently, using short-cuts and behaviours that are not stated in their procedures. This may be due to the fact that the operator’s do not wish to be caught bending the rules in any way i.e. bypassing a certain procedure. This effect on behaviour can bias the observational data that is obtained. • Observational techniques are time consuming in their application, particularly the data analysis procedure. Kirwan & Ainsworth (1992) suggest that when conducting the transcription process, 1 hour of recorded audio data takes on analyst approximately 8 hours to transcribe. 32
Page 1 and 2: Analysing C4i Activity: A Review of
Page 3 and 4: HFIDTC/WP1.1.3/10 Version 2/ 31 Oct
Page 33: HFIDTC/WP1.1.3/10 Version 2/ 31 Oct
Page 85 and 86:
HFIDTC/WP1.1.3/10 Version 2/ 31 Oct
Page 87 and 88:
Page 89 and 90:
Page 91 and 92:
Page 93 and 94:
Page 95 and 96:
Page 97 and 98:
Page 99 and 100:
Page 101 and 102:
Page 103 and 104:
Page 105 and 106:
Page 107 and 108:
Page 109 and 110:
Page 111 and 112:
Page 113:
show all

A Review of the Event Analysis of Systemic Teamwork Methodology

Create successful ePaper yourself

Delete template?

Save as template?