Abstract
The purpose of this study was to examine the effects of gamification used in formal educational settings on student affective and behavioral outcomes. Using systematic procedures to identify and screen the manuscripts across 18 academic databases, we identified 13 studies with behavioral outcomes and 19 studies with affective outcomes employing gamification in educational settings. These manuscripts accounted for a total of N = 1974 (n = 987 in gamification, n = 987 in control) participants in the affective model, and N = 1596 (n = 760 in gamification, n = 836 in control) in the behavioral model. Employing random-effects models, we calculated two statistically significant medium overall effect sizes for affective outcomes at g = .574 [.384, .764] and for behavioral outcomes at g = .740 [.465, 1.014]. We also examined 14 different gamification design elements (e.g., leaderboards, badges, etc.) as moderators to pinpoint the conditions in which gamification may be effective. Additionally, we examined contextual elements as moderators, including the discipline, student level, and publication source. Publication bias was not identified as a threat to either the affective or behavioral model. We also provide a discussion of our findings, limitations, and suggestions for future research.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
The citations for this meta-analysis included manuscripts with asterisk marks
Alhalafawy, W. S., & Zaki, M. Z. T. (2019). The effect of mobile digital content applications based on gamification in the development of psychological well-being. International Journal of Interactive Mobile Technologies, 13(8), 107–123. https://doi.org/10.3991/ijim.v13i08.10725
Alomari, I., Al-Samarraie, H., & Yousef, R. (2019). The role of gamification techniques in promoting student learning: A review and synthesis. Journal of Information Technology Education: Research, 18, 395–417. https://doi.org/10.28945/4417
Baptista, G., & Oliveira, T. (2019). Gamification and serious games: A literature meta-analysis and integrative model. Computers in Human Behavior, 92, 306–315. https://doi.org/10.1016/j.chb.2018.11.030
Bedwell, W. L., Pavlas, D., Heyne, K., Lazzara, E. H., & Salas, E. (2012). Toward a taxonomy linking game attributes to learning: An empirical study. Simulation & Gaming, 43(6), 729–760. https://doi.org/10.1177/1046878112439444
*Bernik, A., Bubas, G., & Radosevic, D. (2018). Measurement of the effects of e-learning courses gamification on motivation and satisfaction of students. 2018 41st International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO) (pp. 0806–0811). https://doi.org/10.23919/MIPRO.2018.8400149
Bloom, B. S. (1965). Taxonomy of educational objectives: The classification of educational goals. David McKay Company Inc.
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009). Introduction to meta-analysis. Wiley.
Brown, K. G. (2001). Using computers to deliver training: Which employees learn and why? Personnel Psychology, 54(2), 271–296. https://doi.org/10.1111/j.1744-6570.2001.tb00093.x
Cagiltay, N. E., Ozcelik, E., & Ozcelik, N. S. (2015). The effect of competition on learning in games. Computers & Education, 87, 35–41. https://doi.org/10.1016/j.compedu.2015.04.001
*Çakır, M. P., Çakır, N. A., Ayaz, H., & Lee, F. J. (2016). Behavioral and neural effects of game-based learning on improving computational fluency with numbers: An optical brain imaging study. Zeitschrift Für Psychologie, 224, 297–302. https://doi.org/10.1027/2151-2604/a000267
Caton, H., & Greenhill, D. (2013). The effects of gamification on student attendance and team performance in a third-year undergraduate game production module. Reading: Academic Conferences International Limited. Retrieved from https://login.lp.hscl.ufl.edu/login?url=https://www.proquest.com/conference-papers-proceedings/effects-gamification-on-student-attendanceteam/docview/1549957240/se-2?accountid=10920
Chapman, J. R., & Rich, P. J. (2018). Does educational gamification improve students’ motivation? If so, which game elements work best? Journal of Education for Business, 93(7), 315–322. https://doi.org/10.1080/08832323.2018.1490687
Cheng, L., Ritzhaupt, A. D., & Antonenko, P. (2019). Effects of the flipped classroom instructional strategy on students’ learning outcomes: A meta-analysis. Educational Technology Research and Development, 67(4), 793–824. https://doi.org/10.1007/s11423-018-9633-7
Cohen, J. (1992). A power primer. Psychological Bulletin, 112(1), 155–159. https://doi.org/10.1037/0033-2909.112.1.155
Cooper, H. (2017). Research synthesis and meta-analysis: A step-by-step approach (5th ed.). Sage.
*Cosgrove, P. J. (2016). The Effects of Gamification on Self-Efficacy and Persistence in Virtual World Familiarization (Doctoral dissertation). Retrieved from https://hdl.handle.net/10355/56469
*Denny, P., McDonald, F., Empson, R., Kelly, P., & Petersen, A. (2018). Empirical support for a causal relationship between gamification and learning outcomes. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems—CHI ’18 (pp. 1–13). https://doi.org/10.1145/3173574.3173885
Deterding, S., Dixon, D., Khaled, R., & Nacke, L. (2011). From game design elements to gamefulness: Defining “Gamification.” MindTrek '11: Proceedings of the 15th International Academic MindTrek Conference: Envisioning Future Media Environments (pp. 9–15). https://doi.org/10.1145/2181037.2181040
Dicheva, D., Dichev, C., Agre, G., & Angelova, G. (2015). Gamification in education: A systematic mapping study. Educational Technology & Society, 18(3), 75–88. https://www.jstor.org/stable/jeductechsoci.18.3.75
*Domínguez, A., Saenz-de-Navarrete, J., de-Marcos, L., Fernández-Sanz, L., Pagés, C., & Martínez-Herráiz, J.-J. (2013). Gamifying learning experiences: Practical implications and outcomes. Computers & Education, 63, 380–392. https://doi.org/10.1016/j.compedu.2012.12.020
Duval, S., & Tweedie, R. (2000). Trim and fill: A simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics, 56(2), 455–463. https://doi.org/10.1111/j.0006-341X.2000.00455.x
Fabricatore, C., & López, X. (2014). Using gameplay patterns to gamify learning experiences. Proceedings of the 8th European Conference on Game Based Learning (pp. 110–117). Academic Conferences and Publishing International Limited, Reading, UK. ISBN 978-1910309-55-1. http://eprints.hud.ac.uk/id/eprint/22100/
*Frost, R. D., Matta, V., & MacIvor, E. (2015). Assessing the efficacy of incorporating game dynamics in a learning management system. Journal of Information Systems Education, 26(1), 59–70.
*Hanus, M. D., & Fox, J. (2015). Assessing the effects of gamification in the classroom: A longitudinal study on intrinsic motivation, social comparison, satisfaction, effort, and academic performance. Computers & Education, 80, 152–161. https://doi.org/10.1016/j.compedu.2014.08.019
*Haruna, H., Hu, X., Chu, S. K. W., Mellecker, R. R., Gabriel, G., & Ndekao, P. S. (2018). Improving sexual health education programs for adolescent students through game-based learning and gamification. International Journal of Environmental Research and Public Health, 15(9), 2027. https://doi.org/10.3390/ijerph15092027
Hattie, J. (2008). Visible learning: A synthesis of over 800 meta-analyses relating to achievement. Routledge. ISBN 978‐0‐415‐47618‐8.
*Hew, K. F., Huang, B., Chu, K. W. S., & Chiu, D. K. W. (2016). Engaging Asian students through game mechanics: Findings from two experiment studies. Computers & Education, 92–93, 221–236. https://doi.org/10.1016/j.compedu.2015.10.010
Huang, R., Ritzhaupt, A. D., Sommer, M., Zhu, J., Stephen, A., Valle, N., Hampton, J., & Li, J. (2020). The impact of gamification in educational settings on student learning outcomes: A meta-analysis. Educational Technology Research and Development. https://doi.org/10.1007/s11423-020-09807-z
*Kim, E., Rothrock, L., & Freivalds, A. (2016). The effects of Gamification on engineering lab activities. 2016 IEEE Frontiers in Education Conference (FIE) (pp. 1–6), Erie, PA, USA, 2016. https://doi.org/10.1109/FIE.2016.7757442
*Kyewski, E., & Krämer, N. C. (2018). To gamify or not to gamify? An experimental field study of the influence of badges on motivation, activity, and performance in an online learning course. Computers & Education, 118, 25–37. https://doi.org/10.1016/j.compedu.2017.11.006
Landers, R. N. (2014). Developing a theory of gamified learning: Linking serious games and gamification of learning. Simulation & Gaming, 45(6), 752–768.
Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33(1), 159–174. https://www.jstor.org/stable/2529310
*Lieberoth, A. (2015). Shallow gamification: Testing psychological effects of framing an activity as a game. Games and Culture, 10(3), 229–248. https://doi.org/10.1177/1555412014559978
Lipsey, M., & Wilson, D. (2001). Practical meta-analysis. Sage.
Mekler, E. D., Brühlmann, F., Tuch, A. N., & Opwis, K. (2017). Towards understanding the effects of individual gamification elements on intrinsic motivation and performance. Computers in Human Behavior, 71, 525–534. https://doi.org/10.1016/j.chb.2015.08.048
*Meşe, C., & Dursun, Ö. Ö. (2018). Influence of gamification elements on emotion, interest and online participation. Education and Science Tedmem, 43(196), 67–95. https://doi.org/10.15390/EB.2018.7726
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group. (2009). Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. PLoS Med, 6(7), e1000097. https://doi.org/10.1371/journal.pmed1000097
*Morillas Barrio, C., Munoz-Organero, M., & Sánchez Soriano, J. (2016). Can gamification improve the benefits of student response systems in learning? An experimental study. IEEE Transactions on Emerging Topics in Computing, 4(3), 429–438. https://doi.org/10.1109/TETC.2015.2497459
*Moritz, S. C. (2017). Examination of Badges to Increase Nursing Student Engagement: A Quasi-Experimental Study (Doctoral dissertation). Retrieved from ProQuest (10258458).
Morrison, G. R., Ross, S. J., Morrison, J. R., & Kalman, H. K. (2019). Designing effective instruction. Wiley.
Ortiz, M., Chiluiza, K., & Valcke, M. (2016). Gamification in higher education and STEM: A systematic review of literature. EDULEARN16 Proceedings (pp. 6548–6558). https://doi.org/10.21125/edulearn.2016.0422
*Ortiz Rojas, M. E., Chiluiza, K., & Valcke, M. (2017). Gamification in computer programming: Effects on learning, engagement, self-efficacy and intrinsic motivation. Proceedings of the 11th European Conference on Games Based Learning (ECGBL 2017) (pp. 507–514). England: ACAD CONFERENCES LTD. http://hdl.handle.net/1854/LU-8607271
Orwin, R. G. (1983). A fail-safe N for effect size in meta-analysis. Journal of Educational Statistics, 8(2), 157–159. https://doi.org/10.3102/10769986008002157
*Owens, D. C. (2016). The effects of gamification on achievement goal orientation and motivation to learn biology in an introductory undergraduate laboratory course (Order No. 10111216). Available from ProQuest Dissertations & Theses Global (1794167061). Retrieved from https://login.lp.hscl.ufl.edu/login?url=https://search.proquest.com/docview/1794167061?accountid=10920
Pitoyo, M. D., Sumardi, S., & Asib, A. (2019). Gamification based assessment: A test anxiety reduction through game elements in Quizizz platform. International Online Journal of Education & Teaching (IOJET), 6(3), 454–470. http://iojet.org/index.php/IOJET/article/view/626
*Poondej, C., & Lerdpornkulrat, T. (2016). The development of gamified learning activities to increase student engagement in learning. Australian Educational Computing, 31(2). Retrieved from http://journal.acce.edu.au/index.php/AEC/article/view/110
Rocha, E. M., Pereira, G. M., & Pacheco, D. A. d. j. (2019). The role of the predictive gamification to increase the sales performance: A novel business approach. Journal of Business & Industrial Marketing, 35(5), 817–833. https://doi.org/10.1108/JBIM-01-2019-0005
Rojas Torrijos, J. L. (2020). Gamification of sports media coverage: An infotainment approach to Olympics and Football World Cups. Communication & Society, 33(1), 29–44. https://doi.org/10.15581/003.33.1.29-44
Rosenthal, R. (1979). The file drawer problem and tolerance for null results. Psychological Bulletin, 86(3), 638–641. https://doi.org/10.1037/0033-2909.86.3.638
Rosenthal, R. (1995). Writing meta-analytic reviews. Psychological Bulletin, 118(2), 183–192. https://doi.org/10.1037/0033-2909.118.2.183
*Rouse, K. E. (2013). Gamification in Science Education: The Relationship of Educational Games to Motivation and Achievement (Doctoral dissertation). Retrieved from https://aquila.usm.edu/dissertations/622
Sailer, M., & Homner, L. (2019). The gamification of learning: A meta-analysis. Educational Psychology Review, 32, 77–112. https://doi.org/10.1007/s10648-019-09498-w
Sailer, M., Hense, J. U., Mayr, S. K., & Mandl, H. (2017). How gamification motivates: An experimental study of the effects of specific game design elements on psychological need satisfaction. Computers in Human Behavior, 69, 371–380. https://doi.org/10.1016/j.chb.2016.12.033
*Stansbury, J. A., & Earnest, D. R. (2017). Meaningful gamification in an industrial/organizational psychology course. Teaching of Psychology, 44(1), 38–45. https://doi.org/10.1177/0098628316677645
*Star, K. (2015). Gamification, Interdependence and the Moderating Effect of Personality on Performance (Doctoral Dissertation). Retrieved from https://curve.coventry.ac.uk/open/file/6cf42d00-d033-4403-88d1-8090a04ee04f/1/Star%202015.pdf
Sterne, J. A., & Egger, M. (2001). Funnel plots for detecting bias in meta-analysis: Guidelines on choice of axis. Journal of Clinical Epidemiology, 54(10), 1046–1055. https://doi.org/10.1016/S0895-4356(01)00377-8
Subhash, S., & Cudney, E. A. (2018). Gamified learning in higher education: A systematic review of the literature. Computers in Human Behavior, 87, 192–206. https://doi.org/10.1016/j.chb.2018.05.028
*Sun, J., & Hsieh, P. (2018). Application of a gamified interactive response system to enhance the intrinsic and extrinsic motivation, student engagement, and attention of English learners. Journal of Educational Technology & Society, 21(3), 104–116. Retrieved August 26, 2020, from https://www.jstor.org/stable/26458511
*Tan, M., & Hew, K. F. (2016). Incorporating meaningful gamification in a blended learning research methods class: Examining student learning, engagement, and affective outcomes. Australasian Journal of Educational Technology, 32(5). https://doi.org/10.14742/ajet.2232
*Terrell, J. E. (2016). Instructional Methods and Engagement: The Impact of Gamification on Student Learning of APA Style (Doctoral Dissertation). Retrieved from http://scholarworks.uark.edu/etd/1502
*Tsay, C. H.-H., Kofinas, A., & Luo, J. (2018). Enhancing student learning experience with technology-mediated gamification: An empirical study. Computers & Education, 121, 1–17. https://doi.org/10.1016/j.compedu.2018.01.009
*Wichadee, S., & Pattanapichet, F. (2018). Enhancement of performance and motivation through application of digital games in an English language class. The Journal of Teaching English with Technology, 18(1), 77–92.
Wilson, K. A., Bedwell, W. L., Lazzara, E. H., Salas, E., Burke, C. S., Estock, J. L., Orvis, K. L., & Conkey, C. (2009). Relationships between game attributes and learning outcomes: Review and research proposals. Simulation & Gaming, 40(2), 217–266. https://doi.org/10.1177/1046878108321866
*Yildirim, I. (2017). The effects of gamification-based teaching practices on student achievement and students’ attitudes toward lessons. The Internet and Higher Education, 33, 86–92. https://doi.org/10.1016/j.iheduc.2017.02.002
*Zainuddin, Z. (2018). Students’ learning performance and perceived motivation in gamified flipped-class instruction. Computers & Education, 126, 75–88. https://doi.org/10.1016/j.compedu.2018.07.003
Funding
This study was not funded by any grants or contracts.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Research involving human participants and/or animals
This research did not involve human participants and/or animals.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Ritzhaupt, A.D., Huang, R., Sommer, M. et al. A meta-analysis on the influence of gamification in formal educational settings on affective and behavioral outcomes. Education Tech Research Dev 69, 2493–2522 (2021). https://doi.org/10.1007/s11423-021-10036-1
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11423-021-10036-1