Skip to main content

Measuring the Commercial Outcomes of Serious Games in Companies – A Review

  • Conference paper

Part of the Lecture Notes in Computer Science book series (LNIP,volume 8778)

Abstract

The objective of this paper is to review the work on the measurement of the commercial outcomes of serious games in companies and to provide a framework for their measurement in companies. The literature on the evaluation of training and in particular serious games is presented. A systematic literature review of studies of the impacts of business games in companies was undertaken. The paper summarises the existing studies on measuring the effectiveness of serious games in companies. A search of the grey literature was also conducted to establish what kinds of commercial outcomes have been measured and how. Finally, the paper presents some examples of measuring the commercial outcomes. It also provides some advice on how to measure commercial outcomes.

Keywords

  • Serious games
  • commercial outcomes
  • evaluation framework
  • evidence
  • literature review

This is a preview of subscription content, access via your institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-3-319-11623-5_15
  • Chapter length: 16 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
USD   44.99
Price excludes VAT (USA)
  • ISBN: 978-3-319-11623-5
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   59.99
Price excludes VAT (USA)

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Baalsrud Hauge, J., Boyle, E., Mayer, I., Nadolski, R., Riedel, J.C.K.H., Moreno-Ger, P., Bellotti, F., Lim, T., Ritchie, J.M.: Study design and data gathering guide for serious games’ evaluation. In: Connolly, T.M., Hainey, T., Boyle, E., Baxter, G., Moreno-Ger, P. (eds.) Psychology, Pedagogy, and Assessment in Serious Games, pp. 394–419. IGI Global (2014), doi:10.4018/978-1-4666-4773-2.ch018

    Google Scholar 

  2. Bartel, A.P.: Measuring the Employer’s Return on Investments in Training: Evidence from the Literature. Industrial Relations 39(3), 502–524 (2000)

    Google Scholar 

  3. Bellotti, F., Kapralos, B., Lee, K., Moreno-Ger, P., Berta, R.: Assessment in and of Serious Games: An Overview. Advances in Human-Computer Interaction 2013, Article ID 136864, 11 pages (2013), doi:10.1155/2013/136864

    Google Scholar 

  4. Ben-Zvi, T.: Using business games in teaching DSS. Journal of Information Systems Education 18(1), 113 (2007)

    Google Scholar 

  5. Cook, D.M.: The effect of frequency of feedback on attitudes and performance. Journal of Accounting Research 5, 213–224 (1967)

    CrossRef  Google Scholar 

  6. Connolly, T.M., Boyle, E.A., MacArthur, E., Hainey, T., Boyle, J.M.: A systematic literature review of empirical evidence on computer games and serious games. Computers & Education 59, 661–686 (2012)

    CrossRef  Google Scholar 

  7. de Wit-Zuurendonk, L.D., Oei, S.G.: Serious gaming in women’s health care. BJOG: An International Journal of Obstetrics & Gynaecology 118(s3), 17–21 (2011)

    CrossRef  Google Scholar 

  8. Donovan, L.: The Use of Serious Games in the Corporate Sector. A State of the Art Report. Learnovate Centre (December 2012)

    Google Scholar 

  9. Johnson, W.L., Wu, S.: Assessing aptitude for learning with a serious game for foreign language and culture. In: Woolf, B.P., Aïmeur, E., Nkambou, R., Lajoie, S. (eds.) ITS 2008. LNCS, vol. 5091, pp. 520–529. Springer, Heidelberg (2008)

    CrossRef  Google Scholar 

  10. Kirkpatrick, D.L.: Techniques for evaluating training programs. Journal of American Society of Training Directors 13(3), 21–26 (1959)

    Google Scholar 

  11. Kirkpatrick, D.L.: Evaluating Training Programs: The Four Levels. Berrett-Koehler Publishers, San Francisco (1994)

    Google Scholar 

  12. Martínez-Durá, M., Arevalillo-Herráez, M., García-Fernández, I., Gamón-Giménez, M.A., Rodríguez-Cerro, A.: Serious Games for Health and Safety Training. In: Prensky, M. (ed.) Digital Game-Based Learning. McGraw-Hill, New York (2001)

    Google Scholar 

  13. Mayer, I., Bekebrede, G., Harteveld, C., Warmelink, H., Zhou, Q., van Ruijven, T., Lo, J., Kortmann, R., Wenzler, I.: The research and evaluation of serious games: Toward a comprehensive methodology. British Journal of Educational Technology (2013), doi:10.1111/bjet.12067

    Google Scholar 

  14. Mulrow, C.D.: Systematic reviews: Rationale for systematic reviews. British Medical Journal 309(6954), 597–599 (1994)

    CrossRef  Google Scholar 

  15. O’Neil, H.F., Wainess, R., Baker, E.: Classification of learning outcomes: evidence from the computer games literature. The Curriculum Journal 16(4), 455–474 (2005)

    CrossRef  Google Scholar 

  16. Oprins, E., Korteling, H.: Transfer of gaming: effectiveness of a Cashier Trainer. (2012), http://www.just.nl/en/files/2012/11/TNO-paper-CASA-2012-Singapore.pdf

  17. Pattabhiram, C.: Expanding and Engaging Marketo’s “Marketing Nation” (May 17, 2013), http://blog.badgeville.com/2013/05/17/engaging-marketos-marketing-nation/ (retrieved)

  18. Phillips, J.J.: Measuring ROI – Fact, Fad, or Fantasy, ASTD White Paper (April 2007)

    Google Scholar 

  19. Pourabdollahian, B., Taisch, M., Kerga, E.: Serious games in manufacturing education: Evaluation of learners’ engagement. Procedia Computer Science 15, 256–265 (2012)

    CrossRef  Google Scholar 

  20. Tranfield, D., Denyer, D., Smart, P.: Towards a methodology for developing evidence-informed management knowledge by means of systematic review. British Journal of Management 14(3), 207–222 (2003)

    CrossRef  Google Scholar 

  21. TrainingZone, http://www.trainingzone.co.uk/topic/kirkpatrick-new-world-level-3/155784

  22. Trifschmann, J.S.: Teaching insurance with an insurance management computer game. Journal of Risk and Insurance 43(1), 43 (1976)

    CrossRef  Google Scholar 

  23. Wolfe, J.: Effective performance behaviors in a simulated policy and decision making environment. Management Science 21(8) (1975)

    Google Scholar 

  24. Wolfe, J., Luethge, D.J.: The impact of involvement on performance in business simulations: An examination of Goosen’s ‘know little’ decision making thesis. Journal of Education for Business 79(2), 69 (2003)

    CrossRef  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this paper

Cite this paper

Riedel, J.C.K.H., Feng, Y., Azadegan, A., Romero, M., Usart, M., Baalsrud Hauge, J. (2014). Measuring the Commercial Outcomes of Serious Games in Companies – A Review. In: Ma, M., Oliveira, M.F., Baalsrud Hauge, J. (eds) Serious Games Development and Applications. SGDA 2014. Lecture Notes in Computer Science, vol 8778. Springer, Cham. https://doi.org/10.1007/978-3-319-11623-5_15

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-11623-5_15

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-11622-8

  • Online ISBN: 978-3-319-11623-5

  • eBook Packages: Computer ScienceComputer Science (R0)