Skip to main content
Book cover

International Conference on Serious Games Development and Applications

SGDA 2014: Serious Games Development and Applications pp 176–191Cite as

Measuring the Commercial Outcomes of Serious Games in Companies – A Review

  • Conference paper

Part of the Lecture Notes in Computer Science book series (LNIP,volume 8778)

Abstract

The objective of this paper is to review the work on the measurement of the commercial outcomes of serious games in companies and to provide a framework for their measurement in companies. The literature on the evaluation of training and in particular serious games is presented. A systematic literature review of studies of the impacts of business games in companies was undertaken. The paper summarises the existing studies on measuring the effectiveness of serious games in companies. A search of the grey literature was also conducted to establish what kinds of commercial outcomes have been measured and how. Finally, the paper presents some examples of measuring the commercial outcomes. It also provides some advice on how to measure commercial outcomes.

Keywords

  • Serious games
  • commercial outcomes
  • evaluation framework
  • evidence
  • literature review

This is a preview of subscription content, access via your institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-3-319-11623-5_15
  • Chapter length: 16 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
USD   44.99
Price excludes VAT (USA)
  • ISBN: 978-3-319-11623-5
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   59.99
Price excludes VAT (USA)
Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Baalsrud Hauge, J., Boyle, E., Mayer, I., Nadolski, R., Riedel, J.C.K.H., Moreno-Ger, P., Bellotti, F., Lim, T., Ritchie, J.M.: Study design and data gathering guide for serious games’ evaluation. In: Connolly, T.M., Hainey, T., Boyle, E., Baxter, G., Moreno-Ger, P. (eds.) Psychology, Pedagogy, and Assessment in Serious Games, pp. 394–419. IGI Global (2014), doi:10.4018/978-1-4666-4773-2.ch018

    Google Scholar 

  2. Bartel, A.P.: Measuring the Employer’s Return on Investments in Training: Evidence from the Literature. Industrial Relations 39(3), 502–524 (2000)

    Google Scholar 

  3. Bellotti, F., Kapralos, B., Lee, K., Moreno-Ger, P., Berta, R.: Assessment in and of Serious Games: An Overview. Advances in Human-Computer Interaction 2013, Article ID 136864, 11 pages (2013), doi:10.1155/2013/136864

    Google Scholar 

  4. Ben-Zvi, T.: Using business games in teaching DSS. Journal of Information Systems Education 18(1), 113 (2007)

    Google Scholar 

  5. Cook, D.M.: The effect of frequency of feedback on attitudes and performance. Journal of Accounting Research 5, 213–224 (1967)

    CrossRef  Google Scholar 

  6. Connolly, T.M., Boyle, E.A., MacArthur, E., Hainey, T., Boyle, J.M.: A systematic literature review of empirical evidence on computer games and serious games. Computers & Education 59, 661–686 (2012)

    CrossRef  Google Scholar 

  7. de Wit-Zuurendonk, L.D., Oei, S.G.: Serious gaming in women’s health care. BJOG: An International Journal of Obstetrics & Gynaecology 118(s3), 17–21 (2011)

    CrossRef  Google Scholar 

  8. Donovan, L.: The Use of Serious Games in the Corporate Sector. A State of the Art Report. Learnovate Centre (December 2012)

    Google Scholar 

  9. Johnson, W.L., Wu, S.: Assessing aptitude for learning with a serious game for foreign language and culture. In: Woolf, B.P., Aïmeur, E., Nkambou, R., Lajoie, S. (eds.) ITS 2008. LNCS, vol. 5091, pp. 520–529. Springer, Heidelberg (2008)

    CrossRef  Google Scholar 

  10. Kirkpatrick, D.L.: Techniques for evaluating training programs. Journal of American Society of Training Directors 13(3), 21–26 (1959)

    Google Scholar 

  11. Kirkpatrick, D.L.: Evaluating Training Programs: The Four Levels. Berrett-Koehler Publishers, San Francisco (1994)

    Google Scholar 

  12. Martínez-Durá, M., Arevalillo-Herráez, M., García-Fernández, I., Gamón-Giménez, M.A., Rodríguez-Cerro, A.: Serious Games for Health and Safety Training. In: Prensky, M. (ed.) Digital Game-Based Learning. McGraw-Hill, New York (2001)

    Google Scholar 

  13. Mayer, I., Bekebrede, G., Harteveld, C., Warmelink, H., Zhou, Q., van Ruijven, T., Lo, J., Kortmann, R., Wenzler, I.: The research and evaluation of serious games: Toward a comprehensive methodology. British Journal of Educational Technology (2013), doi:10.1111/bjet.12067

    Google Scholar 

  14. Mulrow, C.D.: Systematic reviews: Rationale for systematic reviews. British Medical Journal 309(6954), 597–599 (1994)

    CrossRef  Google Scholar 

  15. O’Neil, H.F., Wainess, R., Baker, E.: Classification of learning outcomes: evidence from the computer games literature. The Curriculum Journal 16(4), 455–474 (2005)

    CrossRef  Google Scholar 

  16. Oprins, E., Korteling, H.: Transfer of gaming: effectiveness of a Cashier Trainer. (2012), http://www.just.nl/en/files/2012/11/TNO-paper-CASA-2012-Singapore.pdf

  17. Pattabhiram, C.: Expanding and Engaging Marketo’s “Marketing Nation” (May 17, 2013), http://blog.badgeville.com/2013/05/17/engaging-marketos-marketing-nation/ (retrieved)

  18. Phillips, J.J.: Measuring ROI – Fact, Fad, or Fantasy, ASTD White Paper (April 2007)

    Google Scholar 

  19. Pourabdollahian, B., Taisch, M., Kerga, E.: Serious games in manufacturing education: Evaluation of learners’ engagement. Procedia Computer Science 15, 256–265 (2012)

    CrossRef  Google Scholar 

  20. Tranfield, D., Denyer, D., Smart, P.: Towards a methodology for developing evidence-informed management knowledge by means of systematic review. British Journal of Management 14(3), 207–222 (2003)

    CrossRef  Google Scholar 

  21. TrainingZone, http://www.trainingzone.co.uk/topic/kirkpatrick-new-world-level-3/155784

  22. Trifschmann, J.S.: Teaching insurance with an insurance management computer game. Journal of Risk and Insurance 43(1), 43 (1976)

    CrossRef  Google Scholar 

  23. Wolfe, J.: Effective performance behaviors in a simulated policy and decision making environment. Management Science 21(8) (1975)

    Google Scholar 

  24. Wolfe, J., Luethge, D.J.: The impact of involvement on performance in business simulations: An examination of Goosen’s ‘know little’ decision making thesis. Journal of Education for Business 79(2), 69 (2003)

    CrossRef  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Nottingham University Business School, Nottingham, UK

    Johann C. K. H. Riedel & Yanan Feng

  2. School of Computer Science, University of the West of Scotland, Paisley, UK

    Aida Azadegan

  3. Université Laval, Québec, QC, G1V 0A6, Canada

    Margarida Romero

  4. ESADE Law & Business School, 60-62 Avenue Pedralbes, Barcelona, Spain

    Mireia Usart

  5. BIBA, Hochschulring 20, D-28359, Bremen, Germany

    Jannicke Baalsrud Hauge

Authors
  1. Johann C. K. H. Riedel
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yanan Feng
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Aida Azadegan
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Margarida Romero
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Mireia Usart
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Jannicke Baalsrud Hauge
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Digital Design Studio, Glasgow School of Art, The Hub Building, Pacific Quay, G51 1EA, Glasgow, UK

    Minhua Ma

  2. Industrial Management SINTEF Technology and Society, Norway

    Manuel Fradinho Oliveira

  3. Bremen Institute for Production & Logistics (BIBA), University of Bremen, High school ring 20, 28359, Bremen, Germany

    Jannicke Baalsrud Hauge

Rights and permissions

Reprints and Permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this paper

Cite this paper

Riedel, J.C.K.H., Feng, Y., Azadegan, A., Romero, M., Usart, M., Baalsrud Hauge, J. (2014). Measuring the Commercial Outcomes of Serious Games in Companies – A Review. In: Ma, M., Oliveira, M.F., Baalsrud Hauge, J. (eds) Serious Games Development and Applications. SGDA 2014. Lecture Notes in Computer Science, vol 8778. Springer, Cham. https://doi.org/10.1007/978-3-319-11623-5_15

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-11623-5_15

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-11622-8

  • Online ISBN: 978-3-319-11623-5

  • eBook Packages: Computer ScienceComputer Science (R0)