Skip to main content
SpringerLink
Log in

Evaluating Serious Game Trainings

  • Chapter
  • First Online:
Serious Games for Enhancing Law Enforcement Agencies

Part of the book series: Security Informatics and Law Enforcement ((SILE))

  • 725 Accesses

Abstract

Developing and conducting serious game-based trainings can consume considerable resources and time. This chapter offers recommendations on how to plan and conduct evaluations of virtual reality (VR)-based serious games for training purposes. A concrete example of such an evaluation from the AUGGMED project showcases the practical steps of running meaningful VR-based training evaluations as well as potential challenges that need to be taken into account.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
eBook
USD 16.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 159.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    http://blog.leapmotion.com/art-storytelling-narrative-vr/

  2. 2.

    http://auggmed-project.eu/AUGGMED has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 653590.

  3. 3.

    The sense of being present in the virtual place and time rather than in the actual real-world location (Sanchez-Vives & Slater, 2005).

References

  • Alfalah, S., Falah, J., Alfalah, T., Elfalah, M., Muhaidat, N., & Falah, O. (2019). A comparative study between a virtual reality heart anatomy system and traditional medical teaching modalities. Virtual Reality, 23(3), 229–234. https://doi.org/10.1007/s10055-018-0359-y

  • Arthur Jr., W., Bennett Jr., W., Stanush, P., & McNelly, T. (1998). Factors that influence skill decay and retention: A quantitative review and analysis. Human Performance, 11(1), 57–101.

    Article  Google Scholar 

  • Baldwin, T. T., & Ford, J. K. (1988). Transfer of training: A review and directions for future research. Personnel Psychology, 41, 63–105.

    Article  Google Scholar 

  • Bevan, N. (2001). International standards for HCI and usability. International Journal of Human-Computer Studies, 55(4), 533–552.

    Article  Google Scholar 

  • Blume, B., Ford, J. K., Baldwin, T. T., & Huang, J. L. (2010). Transfer of training: A meta-analytic review. Journal of Management, 36(4), 1065–1105.

    Article  Google Scholar 

  • Burke, L. A. & Hutchins, H. M. (2007). Training transfer: An integrative literature review. Human Resource Development Review, 6(3), 263–296.

    Google Scholar 

  • CAIPE (1999). Evaluating interprofessional education: A United Kingdom review for health and social care. The British Educational Research Association and The United Kingdom Centre for the Advancement of Interprofessional Education, London.

    Google Scholar 

  • Carpenter, J. (2011). Evaluating social work education: A review of outcomes, measures, research designs and practicalities. Social Work Education, 30 (2), 122–140.

    Google Scholar 

  • Fagan, K. (2018). Here’s what happens to your body when you’ve been in virtual reality for too long. [Online]. Available at: https://www.businessinsider.com/virtual-reality-vr-side-effects-2018-3. (Accessed 4 July 2019).

  • Feng, Z., Gonzales, V., Amor, R., Lovreglio, R., & Cabrera-Guerrero, G. (2018). Immersive virtual reality serious games for evacuation training and research: A systematic literature review. Computers & Education, 127, 252–266.

    Article  Google Scholar 

  • Haferkamp, N., Kraemer, N., Linehan, C., & Schembri, M. (2011). Training disaster communication by means of serious games in virtual environments. Entertainment Computing, 2, 81–88.

    Article  Google Scholar 

  • Hanley, P., Chambers, B., & Haslam, J. (2016). Reassessing RCTs as the ‘gold standard’: Synergy not separatism in evaluation designs. International Journal of Research & Method in Education, 39(3), 287–298.

    Article  Google Scholar 

  • Howard, M., & Jacobs, R. (2016). The multiphase optimization strategy (MOST) and the sequential multiple assignment randomized trial (SMART): Two novel evaluation methods for developing optimal training programs. Journal of Organizational Behavior, 37, 1246–1270.

    Article  Google Scholar 

  • Jin, G., Tu, M., Kim, T.-H., Heffron, J., & White, J. (2018). Game based cybersecurity training for high school students. In Proceedings of the 49th ACM Technical Symposium on Computer Science Education (SIGCSE ‘18) (pp. 68–73). New York: ACM.

    Google Scholar 

  • Joël, M., Pu, Z., Wiegert, O., Oitzl, M., & Krugers, H. (2006). Learning under stress: How does it work? Trends in Cognitive Sciences, 10(4), 152–158.

    Article  Google Scholar 

  • Kim, J., Ritter, F., & Koubek, R. (2013). An integrated theory for improved skill acquisition and retention in the three stages of learning. Theoretical Issues in Ergonomics Science, 14(1), 22–37.

    Article  Google Scholar 

  • Kirkpatrick, D. L. (1967). Evaluation of training. In R. L. Craig & L. R. Bittel (Eds.), Training and development handbook (pp. 87–112). New York: McGraw-Hill.

    Google Scholar 

  • LaViola Jr., J. J. (2000). A discussion of cybersickness in virtual environments. ACM SIGCHI Bulletin, 32(1), 47–56.

    Article  Google Scholar 

  • Mancuso, D. S., Chlup, D. T., & McWhorter, R. R. (2010). A study of adult learning in a virtual world. Advances in Developing Human Resources, 12(6), 681–699.

    Article  Google Scholar 

  • Morina, N., Ijntemaa, H., Meyerbröker, K., & Emmelkamp, P. (2015). Can virtual reality exposure therapy gains be generalized to real-life? A meta-analysis of studies applying behavioral assessments. Behavior Research and Therapy, 17, 18–24.

    Article  Google Scholar 

  • Overall, J. E., Tonidandel, S., & Schmitz, J. M. (2009). Testing the significance of difference in average rates of change in controlled longitudinal studies with high dropout rates. Methodology, 5(2), 46–54.

    Article  Google Scholar 

  • Ricci, K. E., Salas, E., & Cannon-Bowers, J. A. (1996). Do computer-based games facilitate knowledge acquisition and retention? Military Psychology, 8, 295–307.

    Article  Google Scholar 

  • Sackett, P., & Mullen, E. (1993). Beyond formal experimental design: Towards an expanded view of the training evaluation process. Personnel Psychology, 46, 613–627.

    Article  Google Scholar 

  • Saks, A. M. (2002). So what is a good transfer of training estimate? A reply to Fitzpatrick. The Industrial-Organizational Psychologist, 39, 29–30.

    Google Scholar 

  • Sanchez-Vives, M., & Slater, M. V. (2005). From presence to consciousness through virtual reality. Nature Reviews Neuroscience, 6(4), 332–339.

    Article  Google Scholar 

  • Saunders, J., Davey, S., Bayerl, P. S., & Lohrmann, P. (2019). Validating virtual reality as an effective training medium in the security domain. In Proceedings of the 2019 IEEEVR Conference.

    Google Scholar 

  • Schendel, J. D., & Hagman, J. D. (1991). Long-term retention of motor skills. In J. E. Morrison (Ed.), Training for performance: Principles of applied human learning (pp. 53–92). New York: Wiley and Sons.

    Google Scholar 

  • Schmidt, S. W. (2007). The relationship between satisfaction with workplace training and overall job satisfaction. Human Resource Development Quarterly, 18(4), 481–498.

    Article  Google Scholar 

  • Slater, M., Khanna, P., Mortensen, J., & Yu, I. (2009). Visual realism enhances realistic response in an immersive virtual environment. IEEE Computer Graphics and Applications, 29(3), 76–84.

    Article  Google Scholar 

  • Weech, S., Kenny, S., & Barnett-Cowan, M. (2019). Presence and cybersickness in virtual reality are negatively related: A review. Frontiers in Psychology, 10, 158.

    Article  Google Scholar 

  • Wei, L., Zhou, H., & Nahavandi, S. (2019). Haptically enabled simulation system for firearm shooting training. Virtual Reality, 23(3), 217–228. https://doi.org/10.1007/s10055-018-0349-0

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. CENTRIC, Sheffield Hallam University, Sheffield, UK

    P. Saskia Bayerl, Steffi Davey & Jonathan Saunders

  2. ROQAS Solutions Limited, Hornchurch, UK

    Philipp Lohrmann

Authors
  1. P. Saskia Bayerl
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Steffi Davey
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Philipp Lohrmann
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jonathan Saunders
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to P. Saskia Bayerl .

Editor information

Editors and Affiliations

  1. CENTRIC (Centre of Excellence in Terrorism, Resilience, Intelligence and Organised Crime Research), Sheffield Hallam University, Sheffield, UK

    Babak Akhgar

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Bayerl, P.S., Davey, S., Lohrmann, P., Saunders, J. (2019). Evaluating Serious Game Trainings. In: Akhgar, B. (eds) Serious Games for Enhancing Law Enforcement Agencies. Security Informatics and Law Enforcement. Springer, Cham. https://doi.org/10.1007/978-3-030-29926-2_9

Download citation

Publish with us

Policies and ethics

Search

Navigation