Abstract
The objective of this paper is to review the work on the measurement of the commercial outcomes of serious games in companies and to provide a framework for their measurement in companies. The literature on the evaluation of training and in particular serious games is presented. A systematic literature review of studies of the impacts of business games in companies was undertaken. The paper summarises the existing studies on measuring the effectiveness of serious games in companies. A search of the grey literature was also conducted to establish what kinds of commercial outcomes have been measured and how. Finally, the paper presents some examples of measuring the commercial outcomes. It also provides some advice on how to measure commercial outcomes.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Baalsrud Hauge, J., Boyle, E., Mayer, I., Nadolski, R., Riedel, J.C.K.H., Moreno-Ger, P., Bellotti, F., Lim, T., Ritchie, J.M.: Study design and data gathering guide for serious games’ evaluation. In: Connolly, T.M., Hainey, T., Boyle, E., Baxter, G., Moreno-Ger, P. (eds.) Psychology, Pedagogy, and Assessment in Serious Games, pp. 394–419. IGI Global (2014), doi:10.4018/978-1-4666-4773-2.ch018
Bartel, A.P.: Measuring the Employer’s Return on Investments in Training: Evidence from the Literature. Industrial Relations 39(3), 502–524 (2000)
Bellotti, F., Kapralos, B., Lee, K., Moreno-Ger, P., Berta, R.: Assessment in and of Serious Games: An Overview. Advances in Human-Computer Interaction 2013, Article ID 136864, 11 pages (2013), doi:10.1155/2013/136864
Ben-Zvi, T.: Using business games in teaching DSS. Journal of Information Systems Education 18(1), 113 (2007)
Cook, D.M.: The effect of frequency of feedback on attitudes and performance. Journal of Accounting Research 5, 213–224 (1967)
Connolly, T.M., Boyle, E.A., MacArthur, E., Hainey, T., Boyle, J.M.: A systematic literature review of empirical evidence on computer games and serious games. Computers & Education 59, 661–686 (2012)
de Wit-Zuurendonk, L.D., Oei, S.G.: Serious gaming in women’s health care. BJOG: An International Journal of Obstetrics & Gynaecology 118(s3), 17–21 (2011)
Donovan, L.: The Use of Serious Games in the Corporate Sector. A State of the Art Report. Learnovate Centre (December 2012)
Johnson, W.L., Wu, S.: Assessing aptitude for learning with a serious game for foreign language and culture. In: Woolf, B.P., Aïmeur, E., Nkambou, R., Lajoie, S. (eds.) ITS 2008. LNCS, vol. 5091, pp. 520–529. Springer, Heidelberg (2008)
Kirkpatrick, D.L.: Techniques for evaluating training programs. Journal of American Society of Training Directors 13(3), 21–26 (1959)
Kirkpatrick, D.L.: Evaluating Training Programs: The Four Levels. Berrett-Koehler Publishers, San Francisco (1994)
Martínez-Durá, M., Arevalillo-Herráez, M., García-Fernández, I., Gamón-Giménez, M.A., Rodríguez-Cerro, A.: Serious Games for Health and Safety Training. In: Prensky, M. (ed.) Digital Game-Based Learning. McGraw-Hill, New York (2001)
Mayer, I., Bekebrede, G., Harteveld, C., Warmelink, H., Zhou, Q., van Ruijven, T., Lo, J., Kortmann, R., Wenzler, I.: The research and evaluation of serious games: Toward a comprehensive methodology. British Journal of Educational Technology (2013), doi:10.1111/bjet.12067
Mulrow, C.D.: Systematic reviews: Rationale for systematic reviews. British Medical Journal 309(6954), 597–599 (1994)
O’Neil, H.F., Wainess, R., Baker, E.: Classification of learning outcomes: evidence from the computer games literature. The Curriculum Journal 16(4), 455–474 (2005)
Oprins, E., Korteling, H.: Transfer of gaming: effectiveness of a Cashier Trainer. (2012), http://www.just.nl/en/files/2012/11/TNO-paper-CASA-2012-Singapore.pdf
Pattabhiram, C.: Expanding and Engaging Marketo’s “Marketing Nation” (May 17, 2013), http://blog.badgeville.com/2013/05/17/engaging-marketos-marketing-nation/ (retrieved)
Phillips, J.J.: Measuring ROI – Fact, Fad, or Fantasy, ASTD White Paper (April 2007)
Pourabdollahian, B., Taisch, M., Kerga, E.: Serious games in manufacturing education: Evaluation of learners’ engagement. Procedia Computer Science 15, 256–265 (2012)
Tranfield, D., Denyer, D., Smart, P.: Towards a methodology for developing evidence-informed management knowledge by means of systematic review. British Journal of Management 14(3), 207–222 (2003)
TrainingZone, http://www.trainingzone.co.uk/topic/kirkpatrick-new-world-level-3/155784
Trifschmann, J.S.: Teaching insurance with an insurance management computer game. Journal of Risk and Insurance 43(1), 43 (1976)
Wolfe, J.: Effective performance behaviors in a simulated policy and decision making environment. Management Science 21(8) (1975)
Wolfe, J., Luethge, D.J.: The impact of involvement on performance in business simulations: An examination of Goosen’s ‘know little’ decision making thesis. Journal of Education for Business 79(2), 69 (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Riedel, J.C.K.H., Feng, Y., Azadegan, A., Romero, M., Usart, M., Baalsrud Hauge, J. (2014). Measuring the Commercial Outcomes of Serious Games in Companies – A Review. In: Ma, M., Oliveira, M.F., Baalsrud Hauge, J. (eds) Serious Games Development and Applications. SGDA 2014. Lecture Notes in Computer Science, vol 8778. Springer, Cham. https://doi.org/10.1007/978-3-319-11623-5_15
Download citation
DOI: https://doi.org/10.1007/978-3-319-11623-5_15
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-11622-8
Online ISBN: 978-3-319-11623-5
eBook Packages: Computer ScienceComputer Science (R0)