Skip to main content
Log in

Effects of Scaffolding in Digital Game-Based Learning on Student’s Achievement: a Three-Level Meta-analysis

  • Review Article
  • Published:
Educational Psychology Review Aims and scope Submit manuscript

Abstract

Previous empirical studies on the effect of scaffolding in game-based learning environments have shown inconsistent findings. In this study, we conducted a meta-analysis to examine the effect of scaffolding in digital game-based learning (DGBL) and to explore a range of moderating factors that may have contributed to the inconsistencies of primary studies. We used the three-level meta-analysis method to analyze the data for handling data non-dependency issues of multiple effect sizes in one study. A total of 49 primary studies and 154 effect sizes were identified through systematic literature search. The results show that scaffolding in DGBL could effectively improve learning (g = 0.43, 95% CI: [0.30, 0.56]), and the heterogeneity among studies was significant (Q = 708.99, p < 0.001). Furthermore, our results indicate that the studies involving elementary school students and university students showed larger effect sizes of scaffolding than those involving secondary school students. Scaffolding also appeared to be differentially effective in different types of games: more effective in adventure, puzzle, and simulation games than in role-playing and strategy games. Future studies should pay attention to the design of scaffolding mechanisms in educational digital games and to the influence of scaffolding on behavioral patterns and learning processes of learners engaged in DGBL.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

References marked with an asterisk indicate studies included in the meta-analysis.

  • Abdul Jabbar, A. I., & Felicia, P. (2015). Gameplay engagement and learning in game-based learning: A systematic review. Review of Educational Research, 85(4), 740–779. https://doi.org/10.3102/0034654315577210

    Article  Google Scholar 

  • Acquah, E. O., & Katz, H. T. (2020). Digital game-based L2 learning outcomes for primary through high-school students: A systematic literature review. Computers & Education, 143, 103667. https://doi.org/10.1016/j.compedu.2019.103667

    Article  Google Scholar 

  • *Adams, D. M., & Clark, D. B. (2014). Integrating self-explanation functionality into a complex game environment: Keeping gaming in motion. Computers & Education, 73, 149-159. https://doi.org/10.1016/j.compedu.2014.01.002.

  • Adkins, S. S. (2017). The 2017-2022 Global Game-based Learning Market. https://seriousplayconf.com/wpcontent/uploads/2017/07/Metaari_2017-2022_Global_Game-based_Learning_Market_Executive_Overview.pdf

  • *Arthur, W., Jr., Day, E. A., Bennett, W., Jr., McNelly, T. L., & Jordan, J. A. (1997). Dyadic versus individual training protocols: Loss and reacquisition of a complex skill. Journal of Applied Psychology, 82(5), 783-791. https://doi.org/10.1037/0021-9010.82.5.783.

  • Bai, S., Hew, K. F., & Huang, B. (2020). Does gamification improve student learning outcome? Evidence from a meta-analysis and synthesis of qualitative data in educational contexts. Educational Research Review, 30, 100322. https://doi.org/10.1016/j.edurev.2020.100322

    Article  Google Scholar 

  • Barron, B. (2009). When smart groups fail. The Journal of the Learning Sciences, 12(3), 307–359. https://doi.org/10.1207/S15327809JLS1203_1

    Article  Google Scholar 

  • *Barzilai, S., & Blau, I. (2014). Scaffolding game-based learning: Impact on learning achievements, perceived learning, and game experiences. Computers & Education, 70, 65-79. https://doi.org/10.1016/j.compedu.2013.08.003.

  • Becker, B. J. (2000). Multivariate meta-analysis. In In Handbook of applied multivariate statistics and mathematical modeling (pp. 499–525). Academic Press.

    Chapter  Google Scholar 

  • Belland, B. R. (2014). Scaffolding: Definition, current debates, and future directions. In J. Spector, M. Merrill, J. Elen, & M. Bishop (Eds.), Handbook of research on educational communications and technology. Springer.

    Google Scholar 

  • Belland, B. R., Walker, A. E., Kim, N. J., & Lefler, M. (2017). Synthesizing results from empirical research on computer-based scaffolding in STEM education: A meta-analysis. Review of Educational Research, 87(2), 309–344. https://doi.org/10.3102/0034654316670999

    Article  Google Scholar 

  • Broza, O., & Barzilai, S. (2011). When the mathematics of life meets school mathematics: Playing and learning on the “my money” website. In Learning in the technological era: Proceedings of the sixth chais conference on instructional technologies research (pp. 92-100).

  • Bulu, S. T., & Pedersen, S. (2012). Supporting problem-solving performance in a hypermedia learning environment: The role of students’ prior knowledge and metacognitive skills. Computers in Human Behavior, 28(4), 1162–1169. https://doi.org/10.1016/j.chb.2012.01.026

    Article  Google Scholar 

  • Cai, Z., & Fan, X. (2020). A comparison of fixed-effects and random-effects models for multivariate meta-analysis using an SEM approach. Multivariate Behavioral Research, 55(6), 839–854. https://doi.org/10.1080/00273171.2019.1689348

    Article  Google Scholar 

  • Charsky, D., & Ressler, W. (2011). “Games are made for fun”: Lessons on the effects of concept maps in the classroom use of computer games. Computers & Education, 56(3), 604–615. https://doi.org/10.1016/j.compedu.2010.10.001

    Article  Google Scholar 

  • *Chen, C. H. (2019). The impacts of peer competition-based science gameplay on conceptual knowledge, intrinsic motivation, and learning behavioral patterns. Educational Technology Research and Development, 69(1), 179-198. https://doi.org/10.1007/s11423-018-9635-5.

  • Chen, S. Y., & Chang, Y. M. (2020). The impacts of real competition and virtual competition in digital game-based learning. Computers in Human Behavior, 104, 106171. https://doi.org/10.1016/j.chb.2019.106171

    Article  Google Scholar 

  • *Chen, C. H., Huang, K., & Liu, J. H. (2020a). Inquiry-enhanced digital game-based learning: Effects on secondary students’ conceptual understanding in science, game performance, and behavioral patterns. The Asia-Pacific Education Researcher, 29(4), 319-330. https://doi.org/10.1007/s40299-019-00486-w.

  • Chen, X., Zou, D., Cheng, G., & Xie, H. (2020b). Detecting latent topics and trends in educational technologies over four decades using structural topic modeling: A retrospective of all volumes of computers & education. Computers & Education, 151, 103855. https://doi.org/10.1016/j.compedu.2020.103855

    Article  Google Scholar 

  • Chen, K.-C., Jang, S.-J., & Branch, R. M. (2010). Autonomy, affiliation, and ability: Relative salience of factors that influence online learner motivation and learning outcomes. Knowledge Management & E-Learning: An International Journal (KM&EL), 2(1), 30–50.

    Google Scholar 

  • *Chen, C. H., & Law, V. (2016). Scaffolding individual and collaborative game-based learning in learning performance and intrinsic motivation. Computers in Human Behavior, 55, 1201-1212. https://doi.org/10.1016/j.chb.2015.03.010

  • Chen, C. H., Law, V., & Chen, W. Y. (2017). The effects of peer competition-based science learning game on secondary students’ performance, achievement goals, and perceived ability. Interactive Learning Environments, 26(2), 1–10. https://doi.org/10.1080/10494820.2017.1300776

    Article  Google Scholar 

  • Chen, C. H., Liu, J. H., & Shou, W. C. (2018). How competition in a game-based science learning environment influences students’ learning achievement, flow experience, and learning behavioral patterns. Educational Technology & Society, 21(2), 164–176. Retrieved May 15, 2020 from https://www.jstor.org/stable/26388392

  • *Chen, C. H., Wang, K. C., & Lin, Y. H. (2015). The comparison of solitary and collaborative modes of game-based learning on students’ science learning and motivation. Educational Technology & Society, 18(2), 237-248. Retrieved May 15, 2020 from https://www.jstor.org/stable/10.2307/jeductechsoci.18.2.237

  • Chen, C.-H., Wu, I. C., & Jen, F. L. (2013). Designing online scaffolds for interactive computer simulation. Interactive Learning Environments, 21(3), 229–243. https://doi.org/10.1080/10494820.2010.549831

    Article  Google Scholar 

  • Cheng, M. T., Chen, J. H., Chu, S. J., & Chen, S. Y. (2015). The use of serious games in science education: A review of selected empirical research from 2002 to 2013. Journal of Computers in Education, 2(3), 353–375. https://doi.org/10.1007/s40692-015-0039-9

    Article  Google Scholar 

  • Cheng, P. H., Yeh, T. K., Tsai, J. C., Lin, C. R., & Chang, C. Y. (2019a). Development of an issue-situation-based board game: A systemic learning environment for water resource adaptation education. Sustainability, 11(5), 1341. https://doi.org/10.3390/su11051341

    Article  Google Scholar 

  • Cheng, Y. W., Wang, Y., Cheng, I. L., & Chen, N. S. (2019b). An in-depth analysis of the interaction transitions in a collaborative augmented reality-based mathematic game. Interactive Learning Environments, 27(5-6), 782–796. https://doi.org/10.1080/10494820.2019.1610448

    Article  Google Scholar 

  • Cheung, M. W. L. (2014). Modeling dependent effect sizes with three-level meta analyses: A structural equation modeling approach. Psychological Methods, 19(2), 211-229. https://doi.org/10.1037/a0032968

  • Chun Hung, L., & Liu, E. Z. F. (2014). The effect of self-efficacy and scaffolding on students’ programming learning in robotics learning context. Paper presented at the International Conference on Ubi-Media Computing and Workshops (UMEDIA). https://doi.org/10.1109/U-MEDIA.2014.64

    Book  Google Scholar 

  • Clark, D. B., Nelson, B. C., Sengupta, P., & D’ Angelo, C. (2009). Rethinking science learning through digital games and simulations: Genres, examples, and evidence. National Research Council.

    Google Scholar 

  • Clark, D. B., Tanner-smith, E. E., & Killingsworth, S. S. (2016). Digital games, design, and learning: A systematic review and meta-analysis. Review of Educational Research, 86(1), 79–122. https://doi.org/10.3102/0034654315582065

    Article  Google Scholar 

  • Cohen, J. (1992). A power primer. Psychological Bulletin, 112, 155–159.

    Article  Google Scholar 

  • Conati, C., Jaques, N., & Muir, M. (2013). Understanding attention to adaptive hints in educational games: An eye-tracking study. Journal of Artificial Intelligence in Education, 23, 136–161. https://doi.org/10.1007/s40593-013-0002-8

    Article  Google Scholar 

  • *Conati, C., & Manske, M. (2009). Evaluating adaptive feedback in an educational computer game. International Conference on Intelligent Virtual Agents. Springer.

  • *Day, E. A., Boatman, P. R., Kowollik, V., Espejo, J., McEntire, L. E., & Sherwin, R. E. (2007). Collaborative training with a more experienced partner: Remediating low pretraining self-efficacy in complex skill acquisition. Human Factors, 49(6), 1132-1148. https://doi.org/10.1518/001872007X249983.

  • Dindar, M. (2018). An empirical study on gender, video game play, academic success and complex problem solving skills. Computers & Education, 125, 39–52. https://doi.org/10.1016/j.compedu.2018.05.018

    Article  Google Scholar 

  • Doo, M. Y., Bonk, C. J., & Heo, H. (2020). A meta-analysis of scaffolding effects in online learning in higher education. The International Review of Research in Open and Distance Learning, 21(3), 60–80.

    Article  Google Scholar 

  • Duval, S., & Tweedie, R. (2000). Trim and fill: A simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics, 56(2), 455–463. https://doi.org/10.1111/j.0006-341X.2000.00455.x

    Article  Google Scholar 

  • van Eck, R. N. (2015). SAPS and digital games: Improving mathematics transfer and attitudes in schools. In Lowrie T., Jorgensen (Zevenbergen) R. (eds) Digital games and mathematics learning in the digital era (pp. 141-173). Springer.

  • Erhel, S., & Jamet, E. (2013). Digital game-based learning: Impact of instructions and feedback on motivation and learning effectiveness. Computers & Education, 67, 156–167. https://doi.org/10.1016/j.compedu.2013.02.019

    Article  Google Scholar 

  • Faizan, N., Löffler, A., Heininger, R., Utesch, M., & Krcmar, H. (2019). Classification of Evaluation Methods for the Effective Assessment of Simulation Games: Results from a Literature Review. International Association of Online Engineering. Retrieved August 10, 2020 from 9(1), 19–33 https://www.learntechlib.org/p/207576/

  • Fernández-Castilla, B., Declercq, L., Jamshidi, L., Beretvas, S. N., Onghena, P., & Van den Noortgate, W. (2019). Detecting selection bias in meta-analyses with multiple outcomes: A simulation study. The Journal of Experimental Education. https://doi.org/10.1080/00220973.2019.1582470

  • *Fiorella, L., & Mayer, R. E. (2012). Paper-based aids for learning with a computer-based game. Journal of Educational Psychology, 104(4), 1074-1082. https://doi.org/10.1037/a0028088

  • Hamari, J., Shernoff, D. J., Rowe, E., Coller, B., Asbell-Clarke, J., & Edwards, T. (2016). Challenging games help students learn: An empirical study on engagement, flow and immersion in game-based learning. Computers in Human Behavior, 54, 170–179. https://doi.org/10.1016/j.chb.2015.07.045

    Article  Google Scholar 

  • Hedges, L. V., & Olkin, I. (1985). Statistical methods for meta-analysis. Academic Press.

    Google Scholar 

  • Herz, J. C. (1997). Joystick nation: How videogames ate our quarters, won our hearts, and rewired our minds. Atlantic/Little.

    Google Scholar 

  • Higgins, J. P., Thomas, J., Chandler, J., Cumpston, M., Li, T., Page, M. J., & Welch, V. A. (2019). Cochrane handbook for systematic reviews of interventions. John Wiley & Sons.

    Book  Google Scholar 

  • Higgins, J. P., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003). Measuring inconsistency in meta-analyses. British Medical Journal, 327, 557–560. https://doi.org/10.1136/bmj.327.7414.557

    Article  Google Scholar 

  • Hsiao, H.-S., Chang, C.-S., Lin, C.-Y., Chang, C.-C., & Chen, J.-C. (2014). The influence of collaborative learning games within different devices on student’s learning performance and behaviours. Australasian Journal of Educational Technology, 30(6), 652–669. https://doi.org/10.14742/ajet.347

    Article  Google Scholar 

  • *Hsu, C. Y., & Tsai, C. C. (2013). Examining the effects of combining self-explanation principles with an educational game on learning science concepts. Interactive Learning Environments, 21(2), 104-115. https://doi.org/10.1080/10494820.2012.705850.

  • *Hsu, C. Y., Tsai, C. C., & Wang, H. Y. (2012). Facilitating third graders’ acquisition of scientific concepts through digital game-based learning: The effects of self-explanation principles. Asia-Pacific Education Researcher, 21(1), 71-82.

  • *Hsu, C. Y., Tsai, C. C., & Wang, H. Y. (2016). Exploring the effects of integrating self-explanation into a multi-user game on the acquisition of scientific concepts. Interactive Learning Environments, 24(4), 844-858. https://doi.org/10.1080/10494820.2014.926276.

  • *Huang, Y. M., & Huang, Y. M. (2015). A scaffolding strategy to develop handheld sensor-based vocabulary games for improving students’ learning motivation and performance. Educational Technology Research and Development, 63(5), 691-708. https://doi.org/10.1007/s11423-015-9382-9.

  • *Hung, C. Y., Kuo, F. O., Sun, J. C. Y., & Yu, P. T. (2013). An interactive game approach for improving students’ learning performance in multi-touch game-based learning. IEEE Transactions on Learning Technologies, 7(1), 31-37. https://doi.org/10.1109/TLT.2013.2294806.

  • *Hwang, G. J., Sung, H. Y., Hung, C. M., Huang, I., & Tsai, C. C. (2012). Development of a personalized educational computer game based on students’ learning styles. Educational Technology Research and Development, 60(4), 623-638. https://doi.org/10.1007/s11423-012-9241-x.

  • Hwang, G. J., & Wu, P. H. (2012). Advancements and trends in digital game-based learning research: A review of publications in selected journals from 2001 to 2010. British Journal of Educational Technology, 43(1), 6–10. https://doi.org/10.1111/j.1467-8535.2011.01242.x

    Article  Google Scholar 

  • *Hwang, G. J., Yang, L. H., & Wang, S. Y. (2013). A concept map-embedded educational computer game for improving students’ learning performance in natural science courses. Computers & Education, 69, 121-130. https://doi.org/10.1016/j.compedu.2013.07.008.

  • *Inkpen, K., Booth, K., Klawe, M., & Upitis, R. (1995). Playing together beats playing apart, especially for girls. Paper presented at The First International Conference on Computer Support for Collaborative Learning. https://doi.org/10.3115/222020.222164.

  • Järvinen, A. (2008). Games without frontiers: Theories and methods for game studies and design. Tampere University Press.

  • Jiang, D. Y., & Kalyuga, S. (2020). Confirmatory factor analysis of cognitive load ratings supports a two-factor model. Quantitative Methods for. Psychology, 16(3), 216–225. https://doi.org/10.20982/tqmp.16.3.p216

    Article  Google Scholar 

  • *Johnson, C. I., & Mayer, R. E. (2010). Applying the self-explanation principle to multimedia learning in a computer-based game-like environment. Computers in Human Behavior, 26(6), 1246-1252. https://doi.org/10.1016/j.chb.2010.03.025.

  • Ju, E., & Wagner, C. (1997). Personal computer adventure games: Their structure, principles, and applicability for training. ACM Sigmis Database: the DATABASE for Advances in Information Systems, 28(2), 78–92. https://doi.org/10.1145/264701.264707

    Article  Google Scholar 

  • Kalyuga, S. (2011). Cognitive load theory: how many types of load does it really need? Educational Psychology Review, 23(1), 1–19. https://doi.org/10.1007/s10648-010-9150-7

    Article  Google Scholar 

  • *Kao, G. Y. M., Chiang, C. H., & Sun, C. T. (2017). Customizing scaffolds for game-based learning in physics: Impacts on knowledge acquisition and game design creativity. Computers & Education, 113, 294-312. https://doi.org/10.1016/j.compedu.2016.10.005.

  • *Kermani, H. (2017). Computer mathematics games and conditions for enhancing young children’s learning of number sense. Malaysian Journal of Learning and Instruction, 14(2), 23-57.

  • Khenissi, M. A., Essalmi, F., Jemni, M., Kinshuk, G., & S., & Chen, N. S. (2016). Relationship between learning styles and genres of games. Computers & Education, 101, 1–14. https://doi.org/10.1016/j.compedu.2016.05.005

    Article  Google Scholar 

  • Kirkham, J. J., Riley, R. D., & Williamson, P. R. (2012). A multivariate meta-analysis approach for reducing the impact of outcome reporting bias in systematic reviews. Statistics in Medicine, 31(20), 2179–2195. https://doi.org/10.1002/sim.5356

    Article  Google Scholar 

  • *Koenig, A. D. (2008). Exploring effective educational video game design: The interplay between narrative and game-schema construction. Arizona State University

  • Konstantopoulos, S. (2011). Fixed effects and variance components estimation in threenents metaenents est Research Synthesis. Methods, 2(1), 61–76. https://doi.org/10.1002/jrsm.35

    Article  Google Scholar 

  • Kraft, M. A. (2020). Interpreting effect sizes of education interventions. Educational Researcher, 49(4), 241–253. https://doi.org/10.3102/0013189X20912798

    Article  Google Scholar 

  • Kraiger, K., Ford, J. K., & Salas, E. (1993). Application of cognitive, skill-based, and affective theories of learning outcomes to new methods of training evaluation. Journal of Applied Psychology, 78(2), 311–328. https://doi.org/10.1037//0021-9010.78.2.311

    Article  Google Scholar 

  • *Kranenburg, N. A. (2019). The effects of concept mapping in game-based learning. Master’s thesis, University of Twente.

  • *Lal, S. (2019). Investigating the effect of process-oriented worked examples in a game-based problem-solving environment on knowledge-acquisition and transfer. Master's thesis, University of Twente.

  • Law, V., & Chen, C. H. (2016). Promoting science learning in game-based learning with question prompts and feedback. Computers & Education, 103, 134–143. https://doi.org/10.1016/j.compedu.2016.10.005

    Article  Google Scholar 

  • *Lee, Y. H. (2013). The interaction effects of working memory capacity, gaming expertise, and scaffolding design on attention and comprehension in digital game based learning. Michigan State University.

  • *Leemkuil, H., & de Jong, T. (2012). Adaptive advice in learning with a computer-based knowledge management simulation game. Academy of Management Learning & Education, 11(4), 653-665. https://doi.org/10.5465/amle.2010.0141.

  • *Leutner, D. (1993). Guided discovery learning with computer-based simulation games: Effects of adaptive and non-adaptive instructional support. Learning and Instruction, 3(2), 113-132. https://doi.org/10.1016/0959-4752(93)90011-N

  • *Liao, C. W., Chen, C. H., & Shih, S. J. (2019). The interactivity of video and collaboration for learning achievement, intrinsic motivation, cognitive load, and behavior patterns in a digital game-based learning environment. Computers & Education, 133, 43-55. https://doi.org/10.1016/j.compedu.2019.01.013.

  • Lin, X. (2001). Designing metacognitive activities. Educational Technology Research and Development, 49(2), 23–40. https://doi.org/10.1007/BF02504926

    Article  Google Scholar 

  • Lin, C., Hwang, G., Fu, Q., & Chen, J. (2018). A flipped contextual game-based learning approach to enhancing EFL students’ English business writing performance and reflective behaviors. Educational Technology & Society, 21(3), 117–131. Retrieved May 18, 2020 from https://www.jstor.org/stable/26458512

  • Macaskill, P., Walter, S. D., & Irwig, L. (2001). A comparison of methods to detect publication bias in meta-analysis. Statistics in Medicine, 20(4), 641–654. https://doi.org/10.1002/sim.698

    Article  Google Scholar 

  • Mayer, R. E. (2019). Computer games in education. Annual Review of Psychology, 70(1), 531–549. https://doi.org/10.1146/annurev-psych-010418-102744

    Article  Google Scholar 

  • *Mayer, R. E., & Johnson, C. I. (2010). Adding instructional features that promote learning in a game-like environment. Journal of Educational Computing Research, 42(3), 241-265. https://doi.org/10.2190/EC.42.3.a.

  • *Mayer, R. E., Mautone, P., & Prothero, W. (2002). Pictorial aids for learning by doing in a multimedia geology simulation game. Journal of Educational Psychology, 94(1), 171-185. https://doi.org/10.1037/0022-0663.94.1.171.

  • Mayer, R. E., & Moreno, R. (2003). Nine ways to reduce cognitive load in multimedia learning. Educational Psychologist, 38(1), 43–52. https://doi.org/10.1207/S15326985EP3801_6

    Article  Google Scholar 

  • *van der Meij, H., Albers, E., & Leemkuil, H. (2011). Learning from games: Does collaboration help?. British Journal of Educational Technology, 42(4), 655-664. https://doi.org/10.1111/j.1467-8535.2010.01067.x.

  • Moeyaert, M., Ugille, M., Ferron, J. M., Beretvas, S. N., & Van den Noortgate, W. (2016). The misspecification of the covariance structures in multilevel models for single-case data: A Monte Carlo simulation study. The Journal of Experimental Education, 84(3), 473–509. https://doi.org/10.1080/00220973.2015.1065216

    Article  Google Scholar 

  • *Moreno, R., & Mayer, R. E. (2005). Role of guidance, reflection, and interactivity in an agent-based multimedia game. Journal of Educational Psychology, 97(1), 117-128.

  • Newman, J. A. (2013). Videogames. Routledge.

    Google Scholar 

  • Nihalani, P. K., Mayrath, M., & Robinson, D. H. (2011). When feedback harms and collaboration helps in computer simulation environments: An expertise reversal effect. Journal of Educational Psychology, 103(4), 776–785. https://doi.org/10.1037/a0025276

    Article  Google Scholar 

  • Ninaus, M., Kiili, K., Mcmullen, J., & Moeller, K. (2017). Assessing fraction knowledge by a digital game. Computers in Human Behavior, 70, 197–206. https://doi.org/10.1016/j.chb.2017.01.004

    Article  Google Scholar 

  • *O’Neil, H. F., Chung, G. K., Kerr, D., Vendlinski, T. P., Buschang, R. E., & Mayer, R. E. (2014). Adding self-explanation prompts to an educational computer game. Computers in Human Behavior, 30, 23-28. https://doi.org/10.1016/j.chb.2013.07.025.

  • *Obikwelu, C. O. (2017). Evaluating scaffolding in serious games with children. Unpublished doctoral dissertation, University of Central Lancashire.

  • Palinscar, A., & Brown, A. (1984). Reciprocal teaching of comprehension-fostering and comprehension-monitoring activities. Cognition and Instruction, 1, 117–175. https://doi.org/10.1207/s1532690xci0102_1

    Article  Google Scholar 

  • Pass, F., Tuovinen, J. E., Tabbers, H., & Van Gerven, P. W. M. (2003). Cognitive load measurement as a means to advance cognitive load theory. Educational Psychologist, 38(1), 63–71. https://doi.org/10.1207/S15326985EP3801_8

    Article  Google Scholar 

  • *Plass, J. L., O'Keefe, P. A., Homer, B. D., Case, J., Hayward, E. O., Stein, M., & Perlin, K. (2013). The impact of individual, competitive, and collaborative mathematics game play on learning, performance, and motivation. Journal of Educational Psychology, 105(4), 1050–1066. https://doi.org/10.1037/a0032688.

  • van de Pol, J., Volman, M., & Beishuizen, J. (2010). Scaffolding in teacher–student interaction: A decade of research. Educational Psychology Review, 22(3), 271–296. https://doi.org/10.1007/s10648-010-9127-6

    Article  Google Scholar 

  • Pratama, L. D., & Setyaningrum, W. (2018). GBL in math problem solving: Is it effective? International Journal of Interactive Mobile Technologies, 12(6), 101–111. https://doi.org/10.3991/ijim.v12i6.8658

    Article  Google Scholar 

  • Prensky, M. (2001). Digital game-based learning. McGraw-Hill.

    Google Scholar 

  • Puntambekar, S., & Hubscher, R. (2005). Tools for scaffolding students in a complex learning environment: What have we gained and what have we missed? Educational Psychologist, 40(1), 1–12. https://doi.org/10.1207/s15326985ep4001_1

    Article  Google Scholar 

  • R Core Team. (2019). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. Retrieved March 10, 2020 from https://www.R-project.org/

  • Reed, D. A., Cook, D. A., Beckman, T. J., Levine, R. B., Kern, D. E., & Wright, S. M. (2007). Association between funding and quality of published medical education research. JAMA, 298(9), 1002–1009. https://doi.org/10.1001/jama.298.9.1002

    Article  Google Scholar 

  • Riley, R. D. (2009). Multivariate meta-analysis: the effect of ignoring within-study correlation. Journal of the Royal Statistical Society: Series A (Statistics in Society), 172(4), 789–811. https://doi.org/10.1111/j.1467-985X.2008.00593.x

    Article  Google Scholar 

  • Rosenthal, R. (1979). The file drawer problem and tolerance for null results. Psychological Bulletin, 86(3), 638–641. https://doi.org/10.1037/0033-2909.86.3.638

    Article  Google Scholar 

  • Ross, J. A. (2008). Explanation giving and receiving in cooperative learning groups. In R. M. Gillies, A. F. Ashman, & J. Terwel (Eds.), The teacher’s role in implementing cooperative learning in the classroom (pp. 222–237). Springer.

    Chapter  Google Scholar 

  • Sailer, M., & Homner, L. (2020). The gamification of learning: A meta-analysis. Educational Psychology Review, 32, 77–112. https://doi.org/10.1007/s10648-019-09498-w

    Article  Google Scholar 

  • *Sandberg, J. A. C., Wielinga, B. J., & Christoph, L. H. (2012). The role of prescriptive models in learning. Computers & Education, 59(2), 839-854. https://doi.org/10.1016/j.compedu.2011.11.021

  • *Schrader, C., & Bastiaens, T. (2012). Learning in educational computer games for novices: The impact of support provision types on virtual presence, cognitive load, and learning outcomes. The International Review of Research in Open and Distributed Learning, 13(3), 206-227. https://doi.org/10.19173/irrodl.v13i3.1166.

  • *Segedy, J. R., Biswas, G., Blackstock, E. F., & Jenkins, A. (2013). Guided skill practice as an adaptive scaffolding strategy in open-ended learning environments. In International Conference on Artificial Intelligence in Education (pp. 532-541). Springer.

  • Shute, V. J., & Ke, F. (2012). Games, learning and assessment. In D. Ifenthaler & D. Eseryel (Eds.), Assessment in game-based learning: Foundations, innovations, and perspectives (pp. 43–58). Springer.

    Chapter  Google Scholar 

  • Skulmowski, A., & Xu, K. M. (2021). Understanding cognitive load in digital and online learning: A new perspective on extraneous cognitive load. Educational Psychology Review. Advance online publication. https://doi.org/10.1007/s10648-021-09624-7

  • Smith, R. P., & Learman, L. A. (2017). A plea for MERSQI: The medical education research study quality instrument. Obstetrics & Gynecology, 130(4), 686–690. https://doi.org/10.1097/AOG.0000000000002091

    Article  Google Scholar 

  • *Stewart Jr, P. (2013). Learning the rules of the game: The nature of game and classroom supports when using a concept-integrated digital physics game in the middle school science classroom. Doctoral dissertation, Columbia University.

  • Sun, C. T., Chen, L. X., & Chu, H. M. (2018). Associations among scaffold presentation, reward mechanisms and problem-solving behaviors in game play. Computers & Education, 119, 95–111. https://doi.org/10.1016/j.compedu.2018.01.001

    Article  Google Scholar 

  • *Sun, C. T., Wang, D. Y., & Chan, H. L. (2011). How digital scaffolds in games direct problem-solving behaviors. Computers & Education, 57(3), 2118-2125. https://doi.org/10.1016/j.compedu.2011.05.022.

  • *Sung, H. Y., & Hwang, G. J. (2013). A collaborative game-based learning approach to improving students’ learning performance in science courses. Computers & education, 63, 43-51. https://doi.org/10.1016/j.compedu.2012.11.019.

  • *Sung, H., & Hwang, G. (2018). Facilitating effective digital game-based learning behaviors and learning performances of students based on a collaborative knowledge construction strategy. Interactive Learning Environments, 26(1), 118-134. https://doi.org/10.1080/10494820.2017.1283334.

  • Sweller, J. (2010). Element interactivity and intrinsic, extraneous, and germane cognitive load. Educational Psychology Review, 22(2), 123–138. https://doi.org/10.1007/s10648-010-9128-5

    Article  Google Scholar 

  • Sweller, J., van Merrienboer, J. J. G., & Paas, F. (1998). Cognitive architecture and instructional design. Educational Psychology Review, 10, 251–296. https://doi.org/10.1023/a:1022193728205

    Article  Google Scholar 

  • Sweller, J., van Merriënboer, J. J. G., & Paas, F. (2019). Cognitive architecture and instructional design: 20 years later. Educational Psychology Review, 31(2), 261–292. https://doi.org/10.1007/s10648-019-09465-5

    Article  Google Scholar 

  • Tapingkae, P., Panjaburee, P., Hwang, G. J., & Srisawasdi, N. (2020). Effects of a formative assessment-based contextual gaming approach on students’ digital citizenship behaviours, learning motivations, and perceptions. Computers & Education, 159, 103998. https://doi.org/10.1016/j.compedu.2020.103998

    Article  Google Scholar 

  • Taub, M., Sawyer, R., Smith, A., Rowe, J., Azevedo, R., & Lester, J. (2020). The agency effect: The impact of student agency on learning, emotions, and problem-solving behaviors in a game-based learning environment. Computers & Education, 147, 103781. https://doi.org/10.1016/j.compedu.2019.103781

    Article  Google Scholar 

  • Tokac, U., Novak, E., & Thompson, C. G. (2019). Effects of game-based learning on students’ mathematics achievement: A meta-analysis. Journal of Computer Assisted Learning, 35(3), 407–420. https://doi.org/10.1111/jcal.12347

    Article  Google Scholar 

  • Tsai, M. J., Huang, L. J., Hou, H. T., Hsu, C. Y., & Chiou, G. L. (2016). Visual behavior, flow and achievement in game-based learning. Computers & Education, 98, 115–129. https://doi.org/10.1016/j.compedu.2016.03.011

    Article  Google Scholar 

  • *Tsai, F. H., Kinzer, C., Hung, K. H., Chen, C. L. A., & Hsu, I. Y. (2013). The importance and use of targeted content knowledge with scaffolding aid in educational simulation games. Interactive Learning Environments, 21(2), 116-128. https://doi.org/10.1080/10494820.2012.705852.

  • Tsai, Y. L., & Tsai, C. (2018). Digital game-based second-language vocabulary learning and conditions of research designs: A meta-analysis study. Computers & Education, 125, 345–357. https://doi.org/10.1016/j.compedu.2018.06.020

    Article  Google Scholar 

  • Tsai, Y. L., & Tsai, C. C. (2020). A meta-analysis of research on digital gameigital science learning. Journal of Computer Assisted Learning, 36(3), 280–294. https://doi.org/10.1111/jcal.12430

    Article  Google Scholar 

  • Tychsen, A., & Hitchens, M. (2009). Game time: Modeling and analyzing time in multiplayer and massively multiplayer games. Games and Culture, 4(2), 170–201. https://doi.org/10.1177/1555412008325479

    Article  Google Scholar 

  • *Vandercruysse, S., Ter Vrugte, J., De Jong, T., Wouters, P., Van Oostendorp, H., & Verschaffel, L., et al. (2016). The effectiveness of a math game: The impact of integrating conceptual clarification as support. Computers in Human Behavior, 64, 21-33. https://doi.org/10.1016/j.chb.2016.06.004.

  • Viechtbauer, W. (2010). Conducting meta-analyses in R with the metafor package. Journal of Statistical Software, 36(3), 1–48. https://doi.org/10.18637/jss.v036.i03

    Article  Google Scholar 

  • Viechtbauer, W., & Cheung, M. W. (2010). Outlier and influence diagnostics for meta-analysis. Research Synthesis Methods, 1(2), 112–125. https://doi.org/10.1002/jrsm.11

    Article  Google Scholar 

  • Vogel, J. J., Vogel, D. S., Cannon-Bowers, J., Bowers, C. A., Muse, K., & Wright, M. (2006). Computer gaming and interactive simulations for learning: A meta-analysis. Journal of Educational Computing Research, 34, 229–243. https://doi.org/10.2190/FLHV-K4WA-WPVQ-H0YM

    Article  Google Scholar 

  • *ter Vrugte, J., de Jong, T., Wouters, P., Vandercruysse, S., Elen, J., & Van Oostendorp, H. (2015a). When a game supports prevocational math education but integrated reflection does not. Journal of Computer Assisted Learning, 31(5), 462-480. https://doi.org/10.1111/jcal.12104.

  • *ter Vrugte, J., de Jong, T., Vandercruysse, S., Wouters, P., van Oostendorp, H., & Elen, J. (2015b). How competition and heterogeneous collaboration interact in prevocational game-based mathematics education. Computers & Education, 89, 42-52. https://doi.org/10.1016/j.compedu.2015.08.010.

  • Vygotsky, L. S. (1978). In M. Cole, V. John-Steiner, S. Scribner, & E. Souberman (Eds.), Mind in society—The development of higher psychological processes. Harvard University Press.

    Google Scholar 

  • *Wang, Y. H. (2020). Exploring the effects of designing a role-playing game with single and peer mode for campus learning. Educational Technology Research and Development, 68(3), 1275-1299. https://doi.org/10.1007/s11423-019-09726-8.

  • Wood, D., Bruner, J. S., & Ross, G. (1976). The role of tutoring in problem solving. Journal of Child Psychology and Psychiatry, 17(2), 89–100. https://doi.org/10.1111/j.1469-7610.1976.tb00381.x

    Article  Google Scholar 

  • Wouters, P., van Nimwegen, C., van Oostendorp, H., & van Der Spek, E. D. (2013). A meta-analysis of the cognitive and motivational effects of serious games. Journal of Educational Psychology, 105(2), 249–265. https://doi.org/10.1037/a0031311

    Article  Google Scholar 

  • Wouters, P., & van Oostendorp, H. (2013). A meta-analytic review of the role of instructional support in game-based learning. Computers & Education, 60, 412–425. https://doi.org/10.1016/j.compedu.2012.07.018

    Article  Google Scholar 

  • Wronowski, M., Urick, A., Wilson, A. S., Thompson, W., Thomas, D., Wilson, S., …, & Ralston, R. (2019). Effect of a serious educational game on academic and affective outcomes for statistics instruction. Journal of educational computing research, 0735633118824693.

  • *Yang, K. H. (2017). Learning behavior and achievement analysis of a digital game-based learning approach integrating mastery learning theory and different feedback models. Interactive Learning Environments, 25(2), 235-248. https://doi.org/10.1080/10494820.2017.1286099.

  • Yang, K. H., & Lu, B. C. (2021). Towards the successful game-based learning: Detection and feedback to misconceptions is the key. Computers & Education, 160, 104033. https://doi.org/10.1016/j.compedu.2020.104033

    Article  Google Scholar 

  • Zheng, L. (2016). The effectiveness of self-regulated learning scaffolds on academic performance in computer-based learning environments: A meta-analysis. Asia Pacific Education Review, 17(2), 187–202. https://doi.org/10.1007/s12564-016-9426-9

    Article  Google Scholar 

  • *Zumbach, J., Rammerstorfer, L., & Deibl, I. (2020). Cognitive and metacognitive support in learning with a serious game about demographic change. Computers in Human Behavior, 103, 120-129. https://doi.org/10.1016/j.chb.2019.09.026.

Download references

Funding

This research was supported by the National Natural Science Foundation of China (nos. 62107018 and 62077016) and grant CCNU20QN025 from the Fundamental Research Funds for the Central Universities.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Zhihui Cai.

Ethics declarations

Conflict of Interest

The authors declare no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Supplementary data to this article can be found at https://doi.org/10.1007/s10648-021-09655-0

ESM 1

(XLSX 21 kb)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Cai, Z., Mao, P., Wang, D. et al. Effects of Scaffolding in Digital Game-Based Learning on Student’s Achievement: a Three-Level Meta-analysis. Educ Psychol Rev 34, 537–574 (2022). https://doi.org/10.1007/s10648-021-09655-0

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10648-021-09655-0

Keywords

Navigation