I__. - International Military Testing Association

lesson templates. Intelligent lesson templates have preestablished
instructional parameters and are executable upon
input of informational content by a subject matter expert. In a
sense, intelligent lesson templates l'know how" to present the
kind of instruction they contain. Experienced instructors can
alter the instructional parameters in order to customize
instruction. The most noteworthy intelligent lesson templates
are Merrill's transaction shells (Merrill et al., 1990).
AFHRL and Merrill signed a Memorandum of Agreement wherein
Merrill loaned two transaction shells to AFHRL for purposes of
evaluation. AFHRL is using these transaction shells to develop a _
model of CBI authoring interactions that affect the productivity
and the quality of developed CBI courseware.
Methodology
The purpose of the initial evaluation study of Merrill's
transaction shells was to develop a working model of user
interactions with instructional design software. In addition to
determining if Merrill's transaction shells with particular user
interfaces were worthy of refinement and continued development,
the aim was to establish an initial model with relevant
characteristics that predict user success with other authoring
environments.
The answer to the question about the value of using
transaction shell technology is that transaction shell technology
appears to provide a very usable and productive courseware
authoring environment. Details are elaborated in subsequent
sections of this report.
The primary question, however, concerned the establishment
of a model of courseware authoring interactions that would
influence the productivity and quality of a CBI authoring
environment. Because all of the relevant characteristics were
not known ahead of time, an approach that allowed iterative
refinement of a quantifiable and predictive model was required.
Falk's soft modeling technique satisfied this requirement and was
used to guide the design of the study (Falk, 1987).
The initial phase of developing a soft model consists of
identifying inputs, processes, and outputs that are relevant to
the task being modelled. Weighted links between input and
process measurements and output measurements are then
hypothesized. Additional subjects are then tested using the
proposed tentative model. The model and its associated measures
and weights are modified to reflect the outcome of new subjects.
New input, process, or output measurements may be added as deemed
necessary in the model development phase. Over time, the model
stabilizes and can be used as a predictive or analytical tool.
Initial input measures for this soft model included the
187