A Review of the Event Analysis of Systemic Teamwork Methodology
A Review of the Event Analysis of Systemic Teamwork Methodology
A Review of the Event Analysis of Systemic Teamwork Methodology
- No tags were found...
Create successful ePaper yourself
Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.
HFIDTC/WP1.1.3/10<br />
Version 2/ 31 October 2005<br />
Related methods<br />
The EAST methodology is comprised <strong>of</strong> a number <strong>of</strong> HF methods, including HTA,<br />
observation, CDA, CUD, OSD’s, SNA, CDM and propositional networks. The authors<br />
have also developed <strong>the</strong> WESTT methodology, which can be used to automate a large<br />
portion <strong>of</strong> <strong>the</strong> EAST analysis procedure.<br />
Approximate training and application times<br />
The EAST methodology is conceptually simple, however due to <strong>the</strong> number <strong>of</strong><br />
component methods involved, requires a lengthy training session. Some prior experience<br />
in <strong>the</strong> application <strong>of</strong> HF methods is required. For <strong>the</strong> recent applications <strong>of</strong> EAST<br />
described in this report, a training session lasting approximately 8 hours was given to <strong>the</strong><br />
analysts involved. Due to <strong>the</strong> exhaustive nature <strong>of</strong> <strong>the</strong> EAST methodology, and <strong>the</strong><br />
complex nature <strong>of</strong> C4i activity, <strong>the</strong> typical application time is high. The construction <strong>of</strong><br />
<strong>the</strong> HTA and <strong>the</strong> OSD for C4i scenarios is a particularly lengthy process. Conducting an<br />
EAST analysis manually can take up to two weeks for large, complex scenarios. The<br />
application time is significantly reduced by <strong>the</strong> provision <strong>of</strong> <strong>the</strong> WESTT s<strong>of</strong>tware<br />
package, which automates a large portion <strong>of</strong> <strong>the</strong> EAST analysis process.<br />
Reliability and validity<br />
Intra and inter reliability may be questionable in some instances. For example, different<br />
analysts may make different interpretations <strong>of</strong> <strong>the</strong> OSD symbols in <strong>the</strong> OSD glossary.<br />
The use <strong>of</strong> multiple methods within <strong>the</strong> EAST framework heightens <strong>the</strong> potential for<br />
unreliability. It is difficult to assess <strong>the</strong> validity <strong>of</strong> <strong>the</strong> data obtained during an EAST<br />
analysis. Typically, SMEs are used during data collection, and so a high level <strong>of</strong> validity<br />
is assumed.<br />
Congruent validity is favourable due to effective methods integration. Construct validity<br />
also good, as component methods relate well to <strong>the</strong> core descriptive constructs <strong>of</strong> C4i<br />
(Walker et al 2005b). Construct and face validity are also good because many <strong>of</strong> <strong>the</strong><br />
features <strong>of</strong> interest are also observable and manifest in <strong>the</strong> environment <strong>of</strong> interest. The<br />
CDM complements this approach by tapping into <strong>the</strong> ‘implicit’ parts <strong>of</strong> <strong>the</strong> decision<br />
making process.<br />
Tools needed<br />
Due to <strong>the</strong> various component analyses involved in an EAST analysis, a number <strong>of</strong><br />
different tools and s<strong>of</strong>tware packages are required. For <strong>the</strong> observation and CDM phases<br />
<strong>of</strong> an EAST analysis, video and audio recording equipment is required. A word<br />
processing s<strong>of</strong>tware package such as Micros<strong>of</strong>t Word is required to transcribe <strong>the</strong><br />
observation and CDM data. The CDA is typically conducted using Micros<strong>of</strong>t Excel. A<br />
large part (e.g. OSD and SNA) <strong>of</strong> <strong>the</strong> EAST procedure can be automated by using <strong>the</strong><br />
WESTT s<strong>of</strong>tware package. Alternatively, <strong>the</strong> OSD CUD, and propositional networks are<br />
typically drawn using Micros<strong>of</strong>t Visio. The SNA is conducted using <strong>the</strong> Agna SNA<br />
s<strong>of</strong>tware package.<br />
24