Evaluating Serious Game Trainings
Developing and conducting serious game-based trainings can consume considerable resources and time. This chapter offers recommendations on how to plan and conduct evaluations of virtual reality (VR)-based serious games for training purposes. A concrete example of such an evaluation from the AUGGMED project showcases the practical steps of running meaningful VR-based training evaluations as well as potential challenges that need to be taken into account.
KeywordsTraining evaluations Evaluation designs Serious games Virtual reality Learning outcomes
- Alfalah, S., Falah, J., Alfalah, T., Elfalah, M., Muhaidat, N., & Falah, O. (2019). A comparative study between a virtual reality heart anatomy system and traditional medical teaching modalities. Virtual Reality, 23(3), 229–234. https://doi.org/10.1007/s10055-018-0359-y
- Burke, L. A. & Hutchins, H. M. (2007). Training transfer: An integrative literature review. Human Resource Development Review, 6(3), 263–296.Google Scholar
- CAIPE (1999). Evaluating interprofessional education: A United Kingdom review for health and social care. The British Educational Research Association and The United Kingdom Centre for the Advancement of Interprofessional Education, London.Google Scholar
- Carpenter, J. (2011). Evaluating social work education: A review of outcomes, measures, research designs and practicalities. Social Work Education, 30 (2), 122–140.Google Scholar
- Fagan, K. (2018). Here’s what happens to your body when you’ve been in virtual reality for too long. [Online]. Available at: https://www.businessinsider.com/virtual-reality-vr-side-effects-2018-3. (Accessed 4 July 2019).
- Jin, G., Tu, M., Kim, T.-H., Heffron, J., & White, J. (2018). Game based cybersecurity training for high school students. In Proceedings of the 49th ACM Technical Symposium on Computer Science Education (SIGCSE ‘18) (pp. 68–73). New York: ACM.Google Scholar
- Kirkpatrick, D. L. (1967). Evaluation of training. In R. L. Craig & L. R. Bittel (Eds.), Training and development handbook (pp. 87–112). New York: McGraw-Hill.Google Scholar
- Saks, A. M. (2002). So what is a good transfer of training estimate? A reply to Fitzpatrick. The Industrial-Organizational Psychologist, 39, 29–30.Google Scholar
- Saunders, J., Davey, S., Bayerl, P. S., & Lohrmann, P. (2019). Validating virtual reality as an effective training medium in the security domain. In Proceedings of the 2019 IEEEVR Conference.Google Scholar
- Schendel, J. D., & Hagman, J. D. (1991). Long-term retention of motor skills. In J. E. Morrison (Ed.), Training for performance: Principles of applied human learning (pp. 53–92). New York: Wiley and Sons.Google Scholar