MAP-01-011 HFI Technical Guide - Human Factors Integration ...

Annex 3 – HF Techniques, Methods and ToolsA3.12 Human-Machine Interface Evaluation TechniquesHuman-Machine Interface (HMI) Evaluation Techniques are used to assess theadequacy of the design and realisation of a human-machine interface, device orproduct. In addition to checking consistency within the design and conformitywith specified requirements and standards, the techniques are used to assessmore subjective aspects of the interface, such as usability and user satisfaction.Typical HMI techniques include:• Heuristics.• Checklists.• Interface Surveys.• Satisfaction Questionnaires.• User trials.Some techniques, such as those that check conformity with requirements andconsistency in the way in which design rules have been applied can be utilisedthroughout the various stages of the system life cycle, including those before theHMI is fully implemented. The use of computer-generated 2-D and pseudo 3-Dmodels permit the emerging HMI design to be visualised, allowing logical andspatial checking to be carried out. The use of using full-size models (mock-ups)of parts of the HMI evaluation remains an option to be considered. However, indepthassessment cannot dispense with evaluation of the real, as-built HMI,which needs to be examined in realistic operational conditions to identify theinfluences of the operating environment, platform motion, time pressures andother factors that cannot be satisfactorily measured within a laboratory / designenvironment.The following sub-sections provide an overview of each of the aforementionedHMI techniques and the associated strengths and weaknesses.A3.12.1HeuristicsPrior to conducting any formal assessment of an HMI, a simple and valuableapproach is to conduct a heuristic assessment. A heuristic assessment isprobably the simplest technique available to the Human Factors practitioner andis a quick and easy technique based upon obtaining analyst(s) subjectiveopinions on a design concept or product.Heuristic assessment is based upon a group of informed designers, users, ormaintainers interacting with the HMI, device or product giving their impromptuopinions and reactions. These may be initiated by interaction with the HMI,device or product, or stimulated by the group dynamics of the occasion.Heuristic analysis should be conducted continually throughout the design processin order to evaluate and modify the design concept. The lead analyst may alsointroduce prompts, to direct the group in particular directions and a simple set ofMay 2006 Page A3-115 Issue 4