Skip to main content

Investigating the Design and Evaluation of Educational Games Under the Perspective of Player Experience

  • Conference paper
  • First Online:
Games and Learning Alliance (GALA 2017)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 10653))

Included in the following conference series:

Abstract

Educational games are praised for their potential in providing engaging and self motivating learning experiences. However, in order to fully leverage those capabilities, game designers have to carefully balance factors that provide an enjoyable experience, without losing the focus on the instructional aspect. This work examines the design and evaluation of educational games focusing on the perspective of individual player emotions and experience. This investigation targets the following research questions: how to include (and balance) both the educational and the player experience elements into the game design? Which specific methodologies are available to evaluate player experience in educational games? After discussing possible answers to these questions, we briefly sketch directions that demand further research.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Blikstein, P., Worsley, M.: Multimodal learning analytics and education data mining: using computational technologies to measure complex learning tasks. J. Learn. Anal. 3(2), 220–238 (2016)

    Article  Google Scholar 

  2. Csikszentmihalyi, M.: Beyond Boredom and Anxiety. Jossey-Bass, San Francisco (2000)

    Google Scholar 

  3. De Grove, F., et al.: Towards a serious game experience model: validation, extension and adaptation of the GEQ for use in an educational context. In: Calvi, L., Nuijten, K., Bouwknegt, H. (eds.) Playability and Player Experience, vol. 10, pp. 47–61. Breda University of Applied Sciences, Breda (2010)

    Google Scholar 

  4. Dele-Ajayi, O., et al.: Learning mathematics through serious games: an engagement framework. In: Frontiers in Education Conference (FIE), pp. 1–5. IEEE (2016)

    Google Scholar 

  5. I. DIS. 9241-210: 2010. ergonomics of human system interaction-part 210: Human-centred design for interactive systems. International Standardization Organization (ISO), Switzerland (2009)

    Google Scholar 

  6. Dolar, D.P.: Experiments on flow and learning in games. Ph.D. thesis (2014)

    Google Scholar 

  7. Dos Santos, A.D., Strada, F., Martina, A., Bottino, A.: Designing collaborative games for children education on sustainable development. In: Poppe, R., Meyer, J.-J., Veltkamp, R., Dastani, M. (eds.) INTETAIN 2016 2016. LNICST, vol. 178, pp. 3–12. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-49616-0_1

    Chapter  Google Scholar 

  8. dos Santos, A.D., Fraternali, P.: A comparison of methodological frameworks for digital learning game design. In: de De Gloria, A., Veltkamp, R. (eds.) GALA 2015. LNCS, vol. 9599, pp. 111–120. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-40216-1_12

    Google Scholar 

  9. Fitchat, L., Jordaan, D.: Ten heuristics to evaluate the user experience of serious games. Int. J. Soc. Sci. Humanit. Stud. 8(2), 209–225 (2016)

    Google Scholar 

  10. Freire, M., et al.: Game learning analytics: learning analytics for serious games. In: Spector, M.J., Lockee, B.B., Childress, M.D. (eds.) Learning, Design and Technology, pp. 1–29. Springer, Switzerland (2016). https://doi.org/10.1007/978-3-319-17727-4_21-1

    Google Scholar 

  11. Fu, F.-L., Su, R.-C., Yu, S.-C.: Egameflow: a scale to measure learners enjoyment of e-learning games. Comput. Educ. 52(1), 101–112 (2009)

    Article  Google Scholar 

  12. Gerling, K.M., et al.: Measuring the impact of game controllers on player experience in FPS games. In: 15th International Academic MindTrek Conference, pp. 83–86. ACM (2011)

    Google Scholar 

  13. Gomes, J., et al.: Analysing engineering expertise of high school students using eye tracking and multimodal learning analytics. In: Educational Data Mining (2013)

    Google Scholar 

  14. Gunter, G.A., Kenny, R.F., Vick, E.H.: Taking educational games seriously: using the retain model to design endogenous fantasy into standalone educational games. Educ. Tech. Res. Dev. 56(5–6), 511–537 (2008)

    Article  Google Scholar 

  15. Huizenga, J.: Digital game-based learning in secondary education. Ph.D. thesis (2017)

    Google Scholar 

  16. Ibrahim, A., et al.: Educational video game design based on educational playability: a comprehensive and integrated literature review. Int. J. Adv. Intell. Syst. 5(3), 400–414 (2012)

    Google Scholar 

  17. Isbister, K., Schaffer, N.: Chapter 20 - the four fun keys. In: Game Usability, pp. 317–343. Morgan Kaufmann, Boston (2008)

    Google Scholar 

  18. ISO 9241-11: Ergonomic requirements for office work with visual display terminals (VDTs), p. 45. The International Organization for Standardization (1998)

    Google Scholar 

  19. Kiili, K., de Freitas, S., Arnab, S., Lainema, T.: The design principles for flow experience in educational games. Procedia Comput. Sci. 15, 78–91 (2012)

    Article  Google Scholar 

  20. Malone, T.W.: What makes things fun to learn? heuristics for designing instructional computer games. In: 3rd ACM SIGSMALL, pp. 162–169. ACM (1980)

    Google Scholar 

  21. Mohamed, H., Jaafar, A.: Playability assessment for educational computer games: pilot study for model development. In: Zaman, H.B., Robinson, P., Olivier, P., Shih, T.K., Velastin, S. (eds.) IVIC 2013. LNCS, vol. 8237, pp. 396–407. Springer, Cham (2013). https://doi.org/10.1007/978-3-319-02958-0_36

    Chapter  Google Scholar 

  22. Nacke, L.: From playability to a hierarchical game usability model. In: Proceedings of the Conference on Future Play, pp. 11–12. ACM (2009)

    Google Scholar 

  23. Nacke, L., et al.: Methods for evaluating gameplay experience in a serious gaming context. Int. J. Comput. Sci. Sport 9(2), 1–12 (2010)

    Google Scholar 

  24. Nagalingam, V., Ibrahim, R.: User experience of educational games: a review of the elements. Procedia Comput. Sci. 72, 423–433 (2015)

    Article  Google Scholar 

  25. Prensky, M.: Digital Game-Based Learning. McGraw Hill, New York (2001)

    Google Scholar 

  26. Sampayo-Vargas, S., et al.: The effectiveness of adaptive difficulty adjustments on students’ motivation and learning in an educational computer game. Comput. Educ. 69, 452–462 (2013)

    Article  Google Scholar 

  27. Sauro, J., Kindlund, E.: A method to standardize usability metrics into a single score. In: Human Factors in Computing Systems, pp. 401–409. ACM (2005)

    Google Scholar 

  28. Shoukry, L., Göbel, S., Steinmetz, R.: Learning analytics and serious games: trends and considerations. In: Proceedings of the 2014 ACM International Workshop on Serious Games, pp. 21–26. ACM (2014)

    Google Scholar 

  29. Shute, V., Ke, F., Wang, L.: Assessment and adaptation in games. In: Wouters, P., van Oostendorp, H. (eds.) Instructional Techniques to Facilitate Learning and Motivation of Serious Games. AGL, pp. 59–78. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-39298-1_4

    Chapter  Google Scholar 

  30. Sweetser, P., Wyeth, P.: Gameflow: a model for evaluating player enjoyment in games. Comput. Entertain. (CIE) 3(3), 3–3 (2005)

    Article  Google Scholar 

  31. Whitton, N.: Learning with Digital Games: A Practical Guide to Engaging Students in Higher Education. Routledge, New York (2009)

    Google Scholar 

  32. Wiemeyer, J., Nacke, L., Moser, C., ‘Floyd’ Mueller, F.: Player experience. In: Dörner, R., Göbel, S., Effelsberg, W., Wiemeyer, J. (eds.) Serious Games, pp. 243–271. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-40612-1_9

    Chapter  Google Scholar 

  33. Witte, M., et al.: Neuronal correlates of cognitive control during gaming revealed by near-infrared spectroscopy. PLoS ONE 10(8), 1–15 (2015)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Alysson Diniz dos Santos .

Editor information

Editors and Affiliations

Appendix: Literature Review Protocol

Appendix: Literature Review Protocol

In order to draw a representative picture of the state of the art, we formulated the following guiding research questions: (i) what recent papers approached PX in EGs?; (ii) what are the design frameworks expressly proposed to address PX in EGs? And (iii) which tools and methodologies are used to evaluate PX in EGs?

We carried out a search with the terms “player AND experience AND learning”, in ACM Library and IEEE Explore portals, limiting the time span between 2006 and 2016. We then removed duplicated results and selected relevant papers according to the following criteria: (i) does the study consider player experience/user emotions? And (ii) does the study deals with EGs?

Finally, the remaining papers were read completely, and their references were also taken into account, thus expanding the list of analyzed works.

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

dos Santos, A.D., Strada, F., Bottino, A. (2017). Investigating the Design and Evaluation of Educational Games Under the Perspective of Player Experience. In: Dias, J., Santos, P., Veltkamp, R. (eds) Games and Learning Alliance. GALA 2017. Lecture Notes in Computer Science(), vol 10653. Springer, Cham. https://doi.org/10.1007/978-3-319-71940-5_20

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-71940-5_20

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-71939-9

  • Online ISBN: 978-3-319-71940-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics