Serious Games Usability Testing: How to Ensure Proper Usability, Playability, and Effectiveness

  • Tanner Olsen
  • Katelyn Procci
  • Clint Bowers
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6770)


Usability testing is an important, yet often overlooked, aspect of serious game development. Issues in usability can drastically impact user experience and thus the learning outcomes associated with serious games. The goal of this paper is to provide serious game developers with an approach to efficiently and effectively apply usability testing into their development process. We propose a three-tiered approach to the assessment of game usability with the addition of assessments playability and learning to traditional usability. Learning or training is the main objective of a serious game and enjoyment is often required when trying to elicit the necessary usage to achieve this goal. Step-by-step procedures and associated measures are provided to assess usability, playability, and learning outcomes concurrently with game development, while taking into account the unique goals and limitations of time, personnel, and budget that small development companies often encounter.


usability user experience serious games 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Crawford, C.: Lessons from Computer Game Design. In: Laurel, B. (ed.) The Art of Human-Computer Interface Design, pp. 103–111. Addison-Wesley, Reading (1999)Google Scholar
  2. 2.
    Resnick, H., Sherer, M.: Computerized Games in the Human Services – An Introduction. In: Resnick, H. (ed.) Electronic Tools for Social Work Practice and Education, pp. 5–16. The Haworth Press, Bington (1994)Google Scholar
  3. 3.
    Witmer, B.G., Singer, M.J.: Measuring Presence in Virtual Environments: A Presence Questionnaire. In: Presence: Teleoperators and Virtual Environments, vol. 7, pp. 225–240. MIT Press, Boston (1998)Google Scholar
  4. 4.
    Jackson, S.A., Eklund, R.C.: The Flow Scales Manual. Fitness Information Technology (2004)Google Scholar
  5. 5.
    Brockmyer, J.H., Fox, C.M., Curtiss, K.A., McBroom, E., Burkhart, K.M., Pidruzny, J.N.: The Development of the Game Engagement Questionnaire: A measure of engagement in video game-playing. J. Exp. Soc. Psychol. 45, 624–634 (2009)CrossRefGoogle Scholar
  6. 6.
    Dillman, D.A.: Mail and telephone surveys: The total design method. Wiley, New York (1978)Google Scholar
  7. 7.
    Sudman, S., Bradburn, N.B.: Asking Questions: A practical guide to questionnaire design. Jossey-Bass Publishers, San Francisco (1982)Google Scholar
  8. 8.
    Shneiderman, B., Plaisant, C.: Evaluating Interface Designs. In: Shneiderman, B., Plaisant, C. (eds.) Designing the User Interface, pp. 140–171. Pearson Education, Boston (2005)Google Scholar
  9. 9.
    Medero, S.: Paper Prototyping. A List Apart (January 23, 2007)Google Scholar
  10. 10.
    Brooke, J.: SUS: A Quick and Dirty Usability Scale. In: Jordan, P.W., Thomas, B., Weerdmeester, B.A., McClelland, I.L. (eds.) Usability Evaluation in Industry, pp. 189–194. Taylor & Francis, London (1996)Google Scholar
  11. 11.
    Chin, J.P., Diehl, V.A., Norman, K.L.: Development of an instrument measuring user satisfaction of the human-computer interface. In: SIGCHI 1988, New York, pp. 213–218 (1988)Google Scholar
  12. 12.
    Yi, M.Y., Hwang, Y.: Predicting the use of web-based information systems: self-efficacy, enjoyment, learning goal orientation, and technology acceptance model. Int. J. Hum.-Comput. Stud. 59, 431–449 (2003)CrossRefGoogle Scholar
  13. 13.
    Krug, S.: Don’t Make Me think: A Common-Sense Approach to Web Usability. New Riders Publishing, Indianapolis (2006)Google Scholar
  14. 14.
    Ericsson, K.A., Simon, H.A.: Protocol Analysis: Verbal reports as data. Bradford Books/MIT Press, Cambridge (1984)Google Scholar
  15. 15.
    Preece, J., Rogers, Y., Sharp, H.: Interaction Design: Beyond human-computer interaction. John Wiley & Sons, New York (2002)Google Scholar
  16. 16.
    Hoonhout, H.C.M.: Let the game tester do the talking: Think aloud and interviewing to learn about the game experience. In: Isbister, K., Schaffer, N. (eds.) Game Usability: Advice from the Experts for Advancing the Player Experience, pp. 65–77. Morgan Kaufmann, New York (2009)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Tanner Olsen
    • 1
  • Katelyn Procci
    • 1
  • Clint Bowers
    • 1
  1. 1.Department of PsychologyUniversity of Central FloridaOrlandoUSA

Personalised recommendations