Evaluating User Experience in Games: Concepts and Methods - Lirmm
Evaluating User Experience in Games: Concepts and Methods - Lirmm
Evaluating User Experience in Games: Concepts and Methods - Lirmm
Create successful ePaper yourself
Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.
13 Us<strong>in</strong>g Heuristics to Evaluate the Overall <strong>User</strong> <strong>Experience</strong> 247<br />
by Cowley et al. (2008). Us<strong>in</strong>g the approach described <strong>in</strong> this chapter, we are able to<br />
overcome the described weaknesses such as the possibility to lose elementary issues.<br />
First, we do not use any k<strong>in</strong>d of mapp<strong>in</strong>g to the flow concept. The 29 heuristics<br />
as <strong>in</strong>troduced <strong>in</strong> Table 13.1 represent a summary of exist<strong>in</strong>g heuristics,<br />
without any direct connection or modification towards the flow theory. Second, the<br />
above-mentioned ambiguities of social <strong>in</strong>teraction are not treated <strong>in</strong> the heuristics.<br />
Moreover, they are part of the device- <strong>and</strong> application-specific part of the framework<br />
<strong>in</strong>troduced above. Especially, s<strong>in</strong>ce games on different devices offer different k<strong>in</strong>ds<br />
of social experiences, this particular area has been relocated to this separate part of<br />
our framework as shown <strong>in</strong> Section 13.7.<br />
The work <strong>in</strong>troduced <strong>in</strong> this section leads us to the conclusion that it is possible<br />
to detect a computer game’s user experience through heuristic evaluation. Our<br />
assumption is that a game that is enjoyable to play has to a large extent be free of<br />
usability issues that keep the user from enjoy<strong>in</strong>g a game. Especially, the heuristics<br />
target<strong>in</strong>g game play/game story deem appropriate not only for classical usability<br />
issues (miss<strong>in</strong>g feedback, etc.), but also to issues connected to enjoyment <strong>and</strong> fun<br />
of a game (challenge, fairness, etc.).<br />
In order to be able to estimate the user experience through heuristics, we have set<br />
up a methodology to prove this concept (see follow<strong>in</strong>g section). Our approach states<br />
that the overall user experience of video games can be determ<strong>in</strong>ed by conduct<strong>in</strong>g an<br />
expert-based evaluation of the game <strong>in</strong> question, us<strong>in</strong>g the heuristics shown above.<br />
The more heuristics are met, the higher the overall user experience is, the more<br />
heuristics po<strong>in</strong>t to flaws <strong>in</strong> the game, the worse the user experience is.<br />
13.6.2 Heuristic Approach to <strong>User</strong> <strong>Experience</strong><br />
To prove our assumption that an expert-based heuristic usability evaluation of a<br />
game can be used to determ<strong>in</strong>e its user experience, we have chosen to conduct an<br />
evaluation. Larsen states <strong>in</strong> his work that common game reviews are to a major<br />
part based on the subjective evaluation of a game’s user experience from the game<br />
reviewer’s po<strong>in</strong>t of view (Larsen 2008). Game reviewers have been unwitt<strong>in</strong>gly<br />
evaluat<strong>in</strong>g user experience of games for nearly two decades.<br />
Follow<strong>in</strong>g this idea, we chose to evaluate a number of computer games us<strong>in</strong>g<br />
our 29 heuristics <strong>and</strong> compare the results to common game reviews. Therefore, we<br />
were able to compare the heuristics–primarily designed to detect usability issues–<br />
with the user experience-oriented game reviews. In order to be able to make a<br />
quantitative statement, we tried to establish a connection between the number of<br />
problems found through the heuristic evaluation <strong>and</strong> the numerical rat<strong>in</strong>g obta<strong>in</strong>ed<br />
from several different game reviews. The process of our evaluation was designed as<br />
a heuristic evaluation for video games. To obta<strong>in</strong> mean<strong>in</strong>gful results, two evaluators<br />
conducted the study. Both of them were experienced <strong>in</strong> the area of computer games<br />
<strong>and</strong> usability, with one be<strong>in</strong>g a usability expert with gam<strong>in</strong>g experience <strong>and</strong> the other<br />
vice versa. To avoid gender-specific ambiguities, a female <strong>and</strong> a male researcher<br />
were selected. S<strong>in</strong>ce gam<strong>in</strong>g habits <strong>and</strong> preferences could <strong>in</strong>fluence the outcome,