Guenter Hilmer - Phd Thesis - Glamorgan Dspace - University of ...

6.4 Analysis of the HEAT based markup task 6 INTERVIEW EVALUATION
6.4 Analysis of the HEAT based markup task
Similar to the situation described in 6.2, the analysis of the test candidates’ obser-
vations during their second markup task can potentially give additional insights
into the HEAT and the EFTECS.
6.4.1 HEAT
There were some problems observed during the candidates’ work with the HEAT.
None of them were problems that led to an interruption of the evaluation, but
the candidates could not use the HEAT immediately and easily. One reason for
those problems were based on the fact that the HEAT was in a prototype phase
of development. Another problematic issue was the fact that the HEAT had been
developed in JAVA and that the test environment was set under a Linux environ-
ment, not giving the test candidates a typical Microsoft Windows look and feel
environment (cf. table 36 on page 253).
Although most of the candidates were comfortable with the system after the first
minutes working with the HEAT, it has to be mentioned that a later conversion of
the XEML and the HEAT should also offer a Windows version. Most users prefer
an environment that corresponds with their usual software interaction interface,
for example the Windows environment (cf. table 35 on page 253 and table 37 on
page 253).
All of the test candidates did complete the HEAT based markup task and no mem-
ber of the evaluation group considered stopping the task due to complexity rea-
sons. This fact suggests that the EFTECS and the framework are feasible and
comprehensible in general.
6.4.2 EFTECS and 3-Layer-Model
After having completed the first markup task (cf. appendix A.1) with the provided
material the test candidates did not have any problems with the 3-Layer-Model
concept during the second, HEAT based markup task.
157