Skip to main content

Advertisement

Log in

Evaluation of Gamified Training A Solomon Four-Group Analysis of the Impact of Gamification on Learning Outcomes

  • Original Paper
  • Published:
TechTrends Aims and scope Submit manuscript

Abstract

Gamification is the application of game elements to non-game contexts. The process of gamification has been found to improve engagement levels, motivate participation and improve outcomes of activities. The primary focus of Gamification research has been on understanding how it can improve the process of learning, especially in academics or education. The impact of gamification in the organizational context is still relatively unexplored. The current study attempts to provide evidence supporting the use of gamification in organizational training. The study adopted an experimental methodology and is set in the context of organizations in India. The findings suggest that potential learners responded more positively to the gamified module and the knowledge gained was also higher through the gamified module. The gamified module also resulted in higher learner motivation. Thus, the current study provide support for the Theory of Gamified Learning that proposes that Gamification would increase Learner Motivation and thereby improve Learner reaction to the training and increase Learning.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  • Andriamiarisoa, R. (2018). Impact of gamification on student engagement in graduate medical studies. Doctoral dissertation.

    Google Scholar 

  • Armstrong, M. B. (2015). An evaluation of game fiction-enhanced training: Using narrative to improve trainee reactions and learning.

    Google Scholar 

  • Arthur Jr., W., Tubré, T., Paul, D. S., & Edens, P. S. (2003). Teaching effectiveness: The relationship between reaction and learning evaluation criteria. Educational Psychology, 23(3), 275–285.

    Article  Google Scholar 

  • Braver, M. W., & Braver, S. L. (1988). Statistical treatment of the Solomon four-group design: A meta-analytic approach. Psychological Bulletin, 104(1), 150.

    Article  Google Scholar 

  • Brown, K. G. (2005). An examination of the structure and nomological network of trainee reactions: A closer look at" smile sheets". Journal of Applied Psychology, 90(5), 991.

    Article  Google Scholar 

  • Deci, E. L., & Ryan, R. M. (1980). Self-determination theory: When mind mediates behavior. The Journal of Mind and Behavior, 33–43.

  • Deterding, S., Dixon, D., Khaled, R., & Nacke, L. (2011). From game design elements to gamefulness: Defining "gamification". MindTrek ‘11, proceedings from the 15th international academic MindTrek conference: Envisioning future media environments, (pp. 9-15).

  • Flannelly, K. J., Flannelly, L. T., & Jankowski, K. R. (2018). Threats to the internal validity of experimental and quasi-experimental research in healthcare. Journal of Health Care Chaplaincy, 24(3), 107–130.

    Article  Google Scholar 

  • Garris, R., Ahlers, R., & Driskell, J. E. (2002). Games, motivation, and learning: A research and practice model. Simulation & Gaming.

  • Hamari, J., Koivisto, J., & Sarsa, H. (2014). Does gamification work? A literature review of empirical studies on gamification. In HICSS (Vol. 14, no. 2014, pp. 3025-3034).

  • Hayes, A. F. (2018). Partial, conditional, and moderated mediation: Quantification, inference, and interpretation. Communication Monographs, 85(1), 4–40.

    Article  Google Scholar 

  • Kapp, K. M. (2016). Gamification designs for instruction. In instructional-design theories and models, volume IV (pp. 367-400). Routledge.

  • Kline, R. B. (2005). Principles and practice of structural equation modeling. The Guilford Press.

    Google Scholar 

  • Landers, R. N. (2014). Developing a theory of gamified learning: Linking serious games and gamification of learning. Simulation & Gaming, 45(6), 752–768.

    Article  Google Scholar 

  • Landers, R. N. (2019). Gamification misunderstood: How badly executed and rhetorical gamification obscures its transformative potential. Journal of Management Inquiry, 28(2), 137–140.

    Article  Google Scholar 

  • Landers, R. N., & Callan, R. C. (2011). Casual social games as serious games: The psychology of gamification in undergraduate education and employee training, In serious games and edutainment applications (pp. 399–423). Springer.

    Google Scholar 

  • MacKinnon, R. J., Stoeter, R., Doherty, C., Fullwood, C., Cheng, A., Nadkarni, V., et al. (2015). Self-motivated learning with gamification improves infant CPR performance, a randomised controlled trial. BMJ Simulation and Technology Enhanced Learning, 1(3), 71–76.

    Article  Google Scholar 

  • Mangalindan, J. P. (2010). Play to win: The game-based economy. Fortune, September, 3.

  • Meyer, J. P., & Gagne, M. (2008). Employee engagement from a self-determination theory perspective. Industrial and Organizational Psychology, 1(1), 60–62.

  • Navarro, M. A., & Siegel, J. T. (2018). The SAGE encyclopedia of educational research, measurement, and evaluation.

  • Olen, J. (2008). "Vergence Entertainment's gamification portfolio". The Advent of Ringorang. Dreamentia.

  • ONeill, K., Robb, M., Kennedy, R., Bhattacharya, A., Dominici, N. R., & Murphy, A. (2018). Mobile technology, just-in-time learning and gamification: Innovative strategies for a CAUTI education program. On-Line Journal of Nursing Informatics, 22(2).

  • Rikers, R. M., & Paas, F. (2005). Recent advances in expertise research. Applied Cognitive Psychology, 19(2), 145–149.

    Article  Google Scholar 

  • Ryan, R. M., & Deci, E. L. (2000). The darker and brighter sides of human existence: Basic psychological needs as a unifying concept. Psychological Inquiry, 11(4), 319–338.

    Article  Google Scholar 

  • Sargent, R. (2017). Gamifying self-assessments in online corporate training: Points and levels (Doctoral dissertation, Northcentral University).

  • Seidel, T., & Shavelson, R. J. (2007). Teaching effectiveness research in the past decade: The role of theory and research design in disentangling meta-analysis results. Review of Educational Research, 77(4), 454–499.

    Article  Google Scholar 

  • Skinner, E. A., & Belmont, M. J. (1993). Motivation in the classroom: Reciprocal effects of teacher behavior and student engagement across the school year. Journal of Educational Psychology, 85(4), 571.

    Article  Google Scholar 

  • Suh, A., & Wagner, C. (2017). How gamification of an enterprise collaboration system increases knowledge contribution: An affordance approach. Journal of Knowledge Management, 21(2), 416–431.

    Article  Google Scholar 

  • Trimblett, S. M. (2016). Gamification in nursing jurisprudence (Doctoral dissertation, Royal Roads University (Canada)).

  • Werbach, K. (2014). (Re)Defining gamification: a process approach. Persuasive Technology, 266–272. https://doi.org/10.1007/978-3-319-07127-5_23.

  • Wilson, K. A., Bedwell, W. L., Lazzara, E. H., Salas, E., Burke, C. S., Estock, J. L., ... & Conkey, C. (2009). Relationships between game attributes and learning outcomes: Review and research proposals. Simulation & Gaming, 40(2), 217–266.

  • Zaniboni, S., Fraccaroli, F., Truxillo, D. M., Bertolino, M., & Bauer, T. N. (2011). Training valence, instrumentality, and expectancy scale (T-VIES-it). Journal of Workplace Learning.

  • Zhao, C. M., & Kuh, G. D. (2004). Adding value: Learning communities and student engagement. Research in Higher Education, 45(2), 115–138.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Sridevi Nair.

Ethics declarations

Declarations

The datasets generated during and/or analysed during the current study are available from the corresponding author on reasonable request.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Nair, S., Mathew, J. Evaluation of Gamified Training A Solomon Four-Group Analysis of the Impact of Gamification on Learning Outcomes. TechTrends 65, 750–759 (2021). https://doi.org/10.1007/s11528-021-00651-3

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11528-021-00651-3

Keywords

Navigation