2003 IMTA Proceedings - International Military Testing Association

676
There are a variety of data collection templates that could be attached to the performance
case to assist in detailed analysis. The current version of the AOOPA model uses a gap
analysis template (see figure 4) in which data is collected about current and desired
performance in the tasks that are carried out in pursuit of a performance goal. Where a
gap is found, for example if 100% accuracy is required on a task and only 60% of those
assigned to the task are able to achieve this, then a cause and solution analysis will be
initiated. In a cause analysis, stakeholders review gap data, brainstorm possible causes,
put them into cause categories, rate them by user-defined criteria, and select which ones
to pursue. The AOOPA prototype allows users to categorize causes so the recommended
solutions are more likely to address the underlying causes. The specific process used in
this version is described in more detail in Douglas et al, 2003.
Organization
Process
Organization
Process
X
X Version
Version of
Y
Version
X
Analysis
data
Y
Analysis
data
dl
Figure 5: Transferring data between different organizations
FUTURE WORK
An important concept embedded in the design of the prototype is configurability
(Cameron, 2002). As noted in the introduction, a framework is meant to provide a
structure for a variety of approaches that can be tailored to specific groups or situations
rather than to provide a set of rules for a single correct way of developing systems. The
philosophy is that no “one size fits all” methodology will be effective; methodologies
evolve to fit organizations, situations, and new technologies. The same is true for
software tools, which are of limited use when fixed on a particular methodology. Given
that different organizations will adopt different methods to suit different circumstances,
software support should be adaptable. The vision is of a system of configurable tools and
methods, which have a shared underlying representation of performance analysis
knowledge. This will allow custom interfaces to a continuously refined shared repository
of knowledge on human performance (see figure 5).
The software architecture used allows the plug-in of different components, thus allowing
a different set of components to be configured to each methodology that conforms to the
45 th Annual Conference of the International Military Testing Association
Pensacola, Florida, 3-6 November 2003
Process
Independen
t