A Review of the Event Analysis of Systemic Teamwork Methodology

More documents

Recommendations

Info

HFIDTC/WP1.1.3/10 Version 2/ 31 October 2005 3 Methods Review 3.1 EAST – Event Analysis of Systemic Teamwork Background and applications The EAST methodology (Baber and Stanton 2004) was developed for the analysis of C4i (command, control, communications, computers and intelligence) activity. EAST uses a combination of HF methods to form a framework for analysing C4i activity. A brief description of each component method is provided below: • Hierarchical Task Analysis (HTA) – involves describing the scenario under analysis using a hierarchy of goals, sub-goals and operations. • Observation – is used during an EAST analysis to gather data surrounding the scenario under analysis. The observational data obtained is used as the primary input to an EAST analysis. • Co-ordination demands analysis (CDA) – involves defining the task-work and team-work tasks involved during the scenario, and then rating each teamwork task step against the CDA taxonomy of; communication; situational awareness; decision making; mission analysis; leadership; adaptability; and assertiveness. • Comms Usage Diagram (CUD) - is used to describe collaborative activity between distributed agents. The output of CUD describes how and why communications between a team occur, which technology is involved in the communication, and the advantages and disadvantages of the technology medium used. • Social Network Analysis – involves defining and analysing the relationships between agents within a scenario network. A matrix of association and a social network diagram are constructed, and agent centrality, sociometric status and network density figures are calculated. • Operation Sequence Diagram (OSD) – is used to represents the tasks, the actors, the communications, the social organisation, the sequence and time in which the scenario took place. An OSD captures the flow of information among distributed actors and shows how this is mediated through technology and team working. Additionally, operational loafing figures are calculated for the following OSD operators; Operation, Receive, Delay, Decision, Transport, Combined Operations. • Critical Decision Method (CDM) – involves the use of interview probes to elicit information regarding agent decision making strategies adopted during the scenario under analysis. 5
HFIDTC/WP1.1.3/10 Version 2/ 31 October 2005 • Propositional Networks – The CDM output is used to construct propositional networks for each incident phase. Propositional networks are comprised of nodes that represent sources of information, agents, and objects that are linked through specific causal paths. The propositional network thus represents the ‘ideal’ collection of knowledge for an incident. The EAST methodology has been applied in a number of domains, including the fire service (Baber et al 2004a), police service (Baber et al 2004b) naval warfare (Stewart et al 2004), military aviation, energy distribution (Salmon et al 2004b), air traffic control and rail domains (Walker et al 2004), in order to analyse C4i activity. EAST is a comprehensive technique offering a multi-faceted assessment of the C4i network in question. EAST provides an assessment of agent roles within the network, a description of the activity including the flow of information, the component tasks, communication between agents and the operational loading of each agent. Co-ordination between agents is also rated and the knowledge required throughout the task under analysis is defined. Domain of application Generic. The EAST methodology can be used in any domain that utilises a C4i infrastructure during task performance. Procedure and advice Step 1: Define scenario(s) The first step in an EAST analysis involves defining the scenario(s) that are to be the subject of the analysis. It is recommended that this is done in collaboration with a SME from the domain in question. The chosen scenario(s) should be representative of all C4i activity in the domain in question. For example, in an analysis of C4i activity in the civil energy distribution (Salmon et al 2004), a switching out of circuit’s scenario and a return to service of circuits scenario were used. Step 2: Conduct HTA for the scenario(s) under analysis Once they are clearly defined, the analyst(s) should conduct a HTA for each scenario. Again, it is recommended that this is done in collaboration with a relevant SME. Step 3: Plan observation The next step of the EAST analysis involves planning the observation of the scenario(s) under analysis. Typically the scenarios involved in C4i activity are dispersed over a number of different locations involving a number of agents, and so who to observe and where to observe it requires careful thought. Again, input from an appropriate SME is useful here. It is also useful at this stage to clearly define what data is to be collected. The use of recording equipment (e.g. type, location, focus etc) should also be clarified. If time permits, it may also be pertinent to conduct a trial run of the planned observation. Step 4: Observe scenario(s) 6
Page 1 and 2: Analysing C4i Activity: A Review of
Page 3 and 4: HFIDTC/WP1.1.3/10 Version 2/ 31 Oct
Page 7: HFIDTC/WP1.1.3/10 Version 2/ 31 Oct
Page 59 and 60:
HFIDTC/WP1.1.3/10 Version 2/ 31 Oct
Page 61 and 62:
Page 63 and 64:
Page 65 and 66:
Page 67 and 68:
Page 69 and 70:
Page 71 and 72:
Page 73 and 74:
Page 75 and 76:
Page 77 and 78:
Page 79 and 80:
Page 81 and 82:
Page 83 and 84:
Page 85 and 86:
Page 87 and 88:
Page 89 and 90:
Page 91 and 92:
Page 93 and 94:
Page 95 and 96:
Page 97 and 98:
Page 99 and 100:
Page 101 and 102:
Page 103 and 104:
Page 105 and 106:
Page 107 and 108:
Page 109 and 110:
Page 111 and 112:
Page 113:
show all

A Review of the Event Analysis of Systemic Teamwork Methodology

Create successful ePaper yourself

Delete template?

Save as template?