Evaluating User Experience in Games: Concepts and Methods - Lirmm

More documents

Recommendations

Info

204 F. Mueller and N. Bianchi-Berthouze provide a lively account in order to inspire researchers for further investigations into this area and present them with opportunities for future work encouraged by our results. We have presented methods known from traditional evaluation tasks and described their different use in an exertion game setup. We found that whether asking a participant interview or questionnaire-style questions, any post-experience evaluation should take into account that the player will be exhausted after the game. The exertion activity demanded the investment of physical effort, and players can be expected to be out of breath, tired and in an altered emotional state. This altered state can show in many ways, and although mostly beneficial when it comes to the well-being of the player, it can also affect the evaluation task, an issue we believe researchers should be aware of in future studies. Evaluators should also be aware that motivation to play these exertion games can be facilitated not only through the game play, but also by an intrinsic drive to improve one’s health: Many players have subscribed to a weight-loss goal and use their game as a more “fun” way to achieve this goal, instead of exercising in a traditional gym. The user experience might be affected if such an internal motivation is dampened by the weight scale not responding in the expected direction: It could be that the game facilitated increased energy expenditure; however, environmental factors outside the magic circle of the game (Salen and Zimmerman 2003) might have caused a weight gain. Gyms that use such exertion games to combine the advantages of engaging game play with the social aspects of working out in a dedicated space are emerging (XRtainment), and evaluating exertion games in such contexts is a new and exciting area that provides novel opportunities to understand these games with a holistic view on health and social aspects. Measuring physiological or bodily performance data might not only enhance our understanding of physical health implications, but also supplement results from other methods to help paint a more complete picture of the user experience. Making such data available to the user, for example through displaying the heart rate, could also contribute to the experience itself, as the users’ intrinsic motivation might benefit from an immediate feedback showing the game “works” for their goals. Using the body’s actions to not only facilitate, but also understand affective experience is an exciting new area. Technological advances will contribute towards rapid evolvement of this field. Using the inter-relationship between affect and body movements for evaluation purposes not only might provide new opportunities for understanding how exertion games engage players, but also be used in other areas of human–computer interaction to create more affective-aware technology. Combining some of the other methods with their individual advantages will also contribute to being able to tell a story that gives justice to the many benefits exertion can offer to its players. By learning from past experiences and appreciating perspectives from various research views, an understanding of exertion games will unfold that, in turn, can offer an exciting new outlook on how we play and interact with technology. We hope with our work that we have contributed towards such advancement and we were able to excite other researchers to explore this emerging new field further.
11 Evaluating Exertion Games 205 Acknowledgements Some of the case studies presented in this chapter have been supported by the Marie Curie International Re-Integration Grant “AffectME” (MIRG-CT-2006-046434). The authors also wish to acknowledge the role of Media Lab Europe and the MIT Media Lab in supporting initial work on Breakout for Two, together with Stefan Agamanolis, Rosalind Picard and Ted Selker. Thanks also to the University of Melbourne and CSIRO Collaborative Research Support Scheme in supporting initial development work on Table Tennis for Three. Special thanks to Martin R. Gibbs and Frank Vetere in the Interaction Design Group at the University of Melbourne. References Ambady N, Rosenthal R (1992) Thin slices of expressive behavior as predictors of interpersonal consequences: A meta-analysis. Psychological Bulletin 111: 256–274. Argyle M (1988) Bodily Communication. Methuen, London. Bernhardt D, Robinson P (2008) Interactive control of music using emotional body expressions. In: CHI ’08 Extended Abstracts on Human Factors in Computing Systems, ACM, New York. Bianchi-Berthouze N, Cairns P, Cox A, Jennett C, Kim WW (2006) On posture as a modality for expressing and recognizing emotions. Workshop on the Role of Emotion in HCI, HCI 2006. Bianchi-Berthouze N, Kim W, Patel D (2007) Does body movement engage you more in digital game play? and why? Affective Computing and Intelligent Interaction. Bianchi-Berthouze N, Kleinsmith A (2003) A categorical approach to affective gesture recognition. Connection Science 15: 259–269. Bogost I (2005) The rhetoric of exergaming. Digital Arts and Cultures (DAC) Conference, Denmark. Borg G (1998) Borg’s Perceived Exertion and Pain Scales. Human Kinetics, Champaign, IL. Chen M, Kolko B, Cuddihy E, Medina E (2005) Modelling and measuring engagement in computer games. Presentation at the Annual Conference for the Digital Games Research Association (DiGRA), Vancouver, Canada. Clark R (2008) Seniors trump barriers in Wii bowling tourney. http://www.nj.com/sunbeam/ index.ssf?/base/news-4/1222587621327110.xml&coll=9. Accessed 20 April 2009. Clark M, Gronbegh E (1987) The effect of age, sex and participation in age group athletics on the development of trust in children. International Journal of Sport Psychology 18: 181–187. Csikszentmihalyi M (1990) Flow: The Psychology of Optimal Performance. Harper and Row, New York. De Silva PR, Bianchi-Berthouze N (2004) Modeling human affective postures: An information theoretic characterization of posture features. Computer Animation and Virtual Worlds 15: 269–276. DeLorenzo M (2007) Wii sports experiment. http://wiinintendo.net/2007/01/15/wii-sportsexperiment-results/. Accessed 20 April 2009. Ekman P, Rosenberg EL (2005) What the Face Reveals: Basic and Applied Studies of Spontaneous Expression Using the Facial Action Coding System (FACS). Oxford University Press, New York. Eriksson E, Hansen T, Lykke-Olesen A (2007) Movement-based interaction in camera spaces: A conceptual framework. Personal and Ubiquitous Computing 11: 621–632. Graves L, Stratton G, Ridgers ND, Cable NT (2007) Comparison of energy expenditure in adolescents when playing new generation and sedentary computer games: Cross sectional study. British Medical Journal 335: 1282–1284. Hart M (2003) Borg scale gets ‘thumbs up’. http://www.torq.ltd.uk/pfm_disp.asp?newsid=18. Accessed 20 April 2009. Hero G (2009) Guitar Hero. http://guitarhero.com. Accessed 20 April 2009. Hoysniemi J (2006) Design and evaluation of physically interactive games. Tampere University. Iso-Ahola SE, Hatfield BD (1986) Psychology of Sports: A Social Psychological Approach. Wm. C. Brown Publishers, Dubuque, IA.
Page 2 and 3:
Human-Computer Interaction Series E
Page 4 and 5:
Regina Bernhaupt Editor Evaluating
Page 6:
For Philippe
Page 9 and 10:
viii Foreword Chapter 3, Presence I
Page 11 and 12:
x Foreword personality which evolve
Page 14 and 15:
Contents Part I Introduction to Eva
Page 16 and 17:
Contributors Regina Bernhaupt IRIT,
Page 18:
Contributors xvii Manfred Tscheligi
Page 21 and 22:
xx About the Authors Emily Brown is
Page 23 and 24:
xxii About the Authors a post-docto
Page 25 and 26:
xxiv About the Authors Christina Ko
Page 27 and 28:
xxvi About the Authors MIT Media La
Page 29:
xxviii About the Authors Theft Auto
Page 33 and 34:
Chapter 1 User Experience Evaluatio
Page 35 and 36:
1 User Experience Evaluation in Ent
Page 37:
1 User Experience Evaluation in Ent
Page 41 and 42:
Chapter 2 Enabling Social Play: A F
Page 43 and 44:
2 Enabling Social Play 13 It is als
Page 45 and 46:
2 Enabling Social Play 15 observati
Page 47 and 48:
2 Enabling Social Play 17 for playe
Page 49 and 50:
2 Enabling Social Play 19 to provid
Page 51 and 52:
2 Enabling Social Play 21 Colwell J
Page 53 and 54:
Chapter 3 Presence, Involvement, an
Page 55 and 56:
3 Presence, Involvement, and Flow i
Page 57 and 58:
Page 59 and 60:
Page 61 and 62:
Page 63 and 64:
Page 65 and 66:
Page 67 and 68:
Page 69 and 70:
Page 71 and 72:
Page 73 and 74:
Page 75 and 76:
Page 77 and 78:
Chapter 4 Assessing the Core Elemen
Page 79 and 80:
4 Assessing the Core Elements of th
Page 81 and 82:
Page 83 and 84:
Page 85 and 86:
Page 87 and 88:
Page 89 and 90:
Page 91 and 92:
Page 93 and 94:
Page 95 and 96:
Page 97 and 98:
Page 99 and 100:
Page 101:
Page 104 and 105:
74 E. Brown (2005). Björk and Holo
Page 106 and 107:
76 E. Brown 5.2.3 How We Work Toget
Page 108 and 109:
78 E. Brown could be simulated on p
Page 110 and 111:
80 E. Brown 5.3.2 Pre-production At
Page 112 and 113:
82 E. Brown from the code. This is
Page 114 and 115:
84 E. Brown At this point, there is
Page 116 and 117:
86 E. Brown Game developers have be
Page 119 and 120:
Chapter 6 Investigating Experiences
Page 121 and 122:
6 Investigating Experiences and Att
Page 123 and 124:
Page 125 and 126:
Page 127 and 128:
Page 129 and 130:
Page 131 and 132:
Page 133 and 134:
Page 135:
Page 138 and 139:
108 G. McAllister and G.R. White Th
Page 140 and 141:
110 G. McAllister and G.R. White su
Page 142 and 143:
112 G. McAllister and G.R. White of
Page 144 and 145:
114 G. McAllister and G.R. White te
Page 146 and 147:
116 G. McAllister and G.R. White qu
Page 148 and 149:
Page 150 and 151:
120 G. McAllister and G.R. White 7.
Page 152 and 153:
Page 154 and 155:
124 G. McAllister and G.R. White an
Page 156 and 157:
126 G. McAllister and G.R. White Al
Page 158 and 159:
128 G. McAllister and G.R. White Ne
Page 161 and 162:
Chapter 8 User Experience Design fo
Page 163 and 164:
8 User Experience Design for Inexpe
Page 165 and 166:
Page 167 and 168:
Page 169 and 170:
Page 171 and 172:
Page 173 and 174:
Page 175 and 176:
Page 177:
Page 180 and 181:
150 K. Poels et al. in games. This
Page 182 and 183:
152 K. Poels et al. their game char
Page 184 and 185: 154 K. Poels et al. If we apply thi
Page 186 and 187: 156 K. Poels et al. Participants ge
Page 188 and 189: 158 K. Poels et al. 9.3.2 Exploring
Page 190 and 191: 160 K. Poels et al. If our train is
Page 192 and 193: 162 K. Poels et al. would be intere
Page 195 and 196: Chapter 10 Evaluating User Experien
Page 197 and 198: 10 Evaluating User Experience Facto
Page 213: 10 Evaluating User Experience Facto
Page 217 and 218: Chapter 11 Evaluating Exertion Game
Page 219 and 220: 11 Evaluating Exertion Games 189 pr
Page 221 and 222: 11 Evaluating Exertion Games 191 th
Page 223 and 224: 11 Evaluating Exertion Games 193 to
Page 225 and 226: 11 Evaluating Exertion Games 195 co
Page 227 and 228: 11 Evaluating Exertion Games 197 11
Page 229 and 230: 11 Evaluating Exertion Games 199 an
Page 231 and 232: 11 Evaluating Exertion Games 201 11
Page 233: 11 Evaluating Exertion Games 203 to
Page 237: 11 Evaluating Exertion Games 207 Pa
Page 240 and 241: 210 M. Brown et al. challenges that
Page 242 and 243: 212 M. Brown et al. was also happen
Page 244 and 245: 214 M. Brown et al. Another importa
Page 246 and 247: 216 M. Brown et al. Albinsson and Z
Page 248 and 249: 218 M. Brown et al. asked to report
Page 250 and 251: 220 M. Brown et al. Table 12.2 Mean
Page 252 and 253: 222 M. Brown et al. Table 12.7 Cont
Page 254 and 255: 224 M. Brown et al. Table 12.9 Cont
Page 256 and 257: 226 M. Brown et al. Count 450 400 3
Page 258 and 259: 228 M. Brown et al. feedback. Thus,
Page 260 and 261: 230 M. Brown et al. Desurvivre H, C
Page 263 and 264: Chapter 13 Using Heuristics to Eval
Page 265 and 266: 13 Using Heuristics to Evaluate the
Page 285 and 286:
13 Using Heuristics to Evaluate the
Page 287 and 288:
Index A Advanced interaction games,
show all

Evaluating User Experience in Games: Concepts and Methods - Lirmm

Create successful ePaper yourself

Delete template?

Save as template?