Abstract
The use of virtual reality (VR) in formal education has burgeoned in recent years, with enthusiastic uptake by teachers and instructors across a wide range of subject areas and academic disciplines. We conducted a systematic meta-analysis of effects of VR on Science, Technology, Engineering, and Mathematics learning from middle school through postsecondary education. Eighteen published journal articles met inclusion criteria, yielding 52 effects from 2214 participants. VR has an overall positive effect on learning of g = .33, with the largest significant moderator effects for redesign of VR, classroom settings, science learning, desktop displays, and all types of learning outcomes (factual, conceptual, and transfer). Results depart somewhat from Howard’s (2019) and Wu et al.’s (2020b) meta-analyses of VR across learning and treatment, multiple domains, and ages; in our study, desktop VR showed larger effects than head-mounted display, and we found positive effects for all learning outcome types. One trend within studies showing the largest effects is the inclusion of active learning techniques, which may shift learners’ focus from interesting but irrelevant details to the most learning-relevant aspects of the VR learning environment.
Similar content being viewed by others
Data Availability
All data are publicly available in the published journal articles that were meta-analysed; all analysed data are in Supplementary Table 1 of the manuscript.
References
*Indicates a study included in the meta-analysis
Bamberger, Y., & Tal, T. (2008). Multiple outcomes of class visits to natural history museums: The students’ view. Journal of Science Education and Technology, 17(3), 274–284.
*Barata, P. N. A., Ribeiro Filho, M., & Nunes, M. V. A. (2015). Consolidating learning in power systems: Virtual reality applied to the study of the operation of electric power transformers. IEEE Transactions on Education, 58(4), 255–261.
Beilock, S. L., Rydell, R. J., & McConnell, A. R. (2007). Stereotype threat and working memory: Mechanisms, alleviation, and spillover. Journal of Experimental Psychology: General, 136(2), 256.
*Cai, S., Wang, X., & Chiang, F. K. (2014). A case study of augmented reality simulation system application in a chemistry course. Computers in Human Behavior, 37, 31–40.
*Chang, F., Luo, M., Walton, G., Aguilar, L., & Bailenson, J. (2019). Stereotype threat in virtual learning environments: Effects of avatar gender and sexist behavior on women’s math learning outcomes. Cyberpsychology, Behavior, and Social Networking, 22(10), 634–640.
Coan, H. A., Goehle, G., & Youker, R. T. (2020). Teaching biochemistry and molecular biology with virtual reality-lesson creation and student response. Journal of Teaching and Learning, 14(1), 71–92.
Dinsmore, D. L., Fryer, L. K., & Parkinson, M. M. (Eds.). (2020). Handbook of strategies and strategic processing. Routledge.
Dunnagan, C. L., Dannenberg, D. A., Cuales, M. P., Earnest, A. D., Gurnsey, R. M., & Gallardo-Williams, M. T. (2020). Production and evaluation of a realistic immersive virtual reality organic chemistry laboratory experience: Infrared spectroscopy. Journal of Chemical Education, 97, 258–262.
*Habig, S. (2020). Who can benefit from augmented reality in chemistry? Sex differences in solving stereochemistry problems using augmented reality. British Journal of Educational Technology, 51(3), 629–644.
Howard, M. C. (2019). Virtual reality interventions for personal development: A meta-analysis of hardware and software. Human-Computer Interaction, 34(3), 205–239.
*Huang, K. T., Ball, C., Francis, J., Ratan, R., Boumis, J., & Fordham, J. (2019). Augmented versus virtual reality in education: An exploratory study examining science knowledge retention when using augmented reality/virtual reality mobile applications. Cyberpsychology, Behavior, and Social Networking, 22(2), 105–110.
*Jong, M. S. Y., Tsai, C. C., Xie, H., & Kwan-Kit Wong, F. (2020). Integrating interactive learner-immersed video-based virtual reality into learning and teaching of physical geography. British Journal of Educational Technology, 51(6), 2064–2079.
Kalyuga, S. (2014). The expertise reversal principle in multimedia learning. In R.E. Mayer (Ed.). Cambridge Handbook of Multimedia Learning. Cambridge University Press.
*Kim, S., Heo, R., Chung, Y., Kim, J. M., Kwon, M. P., Seo, S. C., ... & Kim, M. K. (2019). Virtual reality visualization model (VRVM) of the tricarboxylic acid (TCA) cycle of carbohydrate metabolism for medical biochemistry education. Journal of Science Education and Technology, 28(6), 602–612.
*Klingenberg, S., Jørgensen, M. L., Dandanell, G., Skriver, K., Mottelson, A., & Makransky, G. (2020). Investigating the effect of teaching as a generative learning strategy when learning through desktop and immersive VR: A media and methods experiment. British Journal of Educational Technology, 51(6), 2115–2138.
*Klippel, A., Zhao, J., Jackson, K. L., La Femina, P., Stubbs, C., Wetzel, R., ... & Oprean, D. (2019). Transforming earth science education through immersive experiences: Delivering on a long held promise. Journal of Educational Computing Research, 57(7), 1745–1771.
Kulik, J. A., Kulik, C. L. C., & Bangert-Drowns, R. L. (1985). Effectiveness of computer-based education in elementary schools. Computers in Human Behavior, 1(1), 59–74.
Kyriakou, P., & Hermon, S. (2019). Can I touch this? Using natural interaction in a museum augmented reality system. Digital Applications in Archaeology and Cultural Heritage, 12, e00088.
*Lee, E. A., & Wong, K. W. (2014). Learning with desktop virtual reality: Low spatial ability learners are more positively affected. Computers & Education, 79, 49–58.
Makransky, G., & Mayer, R. E. (2022). Benefits of taking a virtual field trip in immersive virtual reality: Evidence for the immersion principle in multimedia learning. Educational Psychology Review, 34(1), 71–92.
Makransky, G., & Petersen, G. B. (2021). The Cognitive Affective Model of Immersive Learning (CAMIL): A theoretical research-based model of learning in immersive virtual reality. Educational Psychology Review, 33(3), 937–958. https://doi.org/10.1007/s10648-020-09586-2
*Makransky, G., Borre-Gude, S., & Mayer, R. E. (2019a). Motivational and cognitive benefits of training in immersive virtual reality based on multiple assessments. Journal of Computer Assisted Learning, 39(6), 691–707.
*Makransky, G., Wismer, P., & Mayer, R. E. (2019b). A gender matching effect in learning with pedagogical agents in an immersive virtual reality science simulation. Journal of Computer Assisted Learning, 35(3), 349–358.
Mayer, R. E. (1996). Learning strategies for making sense out of expository text: The SOI model for guiding three cognitive processes in knowledge construction. Educational Psychology Review, 8(4), 357–371.
Merchant, Z., Goetz, E. T., Cifuentes, L., Keeney-Kennicutt, W., & Davis, T. J. (2014). Effectiveness of virtual reality-based instruction on students’ learning outcomes in K-12 and higher education: A meta-analysis. Computers & Education, 70, 29–40.
*Merchant, Z., Goetz, E. T., Keeney-Kennicutt, W., Kwok, O. M., Cifuentes, L., & Davis, T. J. (2012). The learner characteristics, features of desktop 3D virtual reality environments, and college chemistry instruction: A structural equation modeling analysis. Computers & Education, 59(2), 551–568.
*Meyer, O. A., Omdahl, M. K., & Makransky, G. (2019). Investigating the effect of pre-training when learning through immersive virtual reality and video: A media and methods experiment. Computers & Education, 140, 103603.
Park, B., Korbach, A., & Brünken, R. (2015). Do learner characteristics moderate the seductive-details-effect? A cognitive-load-study using eye-tracking. Journal of Educational Technology & Society, 18(4), 24–36.
*Parong, J., & Mayer, R. E. (2018). Learning science in immersive virtual reality. Journal of Educational Psychology, 110(6), 785.
Parong, J., & Mayer, R. E. (2021). Cognitive and affective processes for learning science in immersive virtual reality. Journal of Computer Assisted Learning, 37(1), 226–241.
*Petersen, G. B., Klingenberg, S., Mayer, R. E., & Makransky, G. (2020). The virtual field trip: Investigating how to optimize immersive virtual learning in climate change education. British Journal of Educational Technology, 51(6), 2099–2115.
Pressley, M., & Harris, K. R. (2006). Cognitive strategies instruction: From basic research to classroom instruction. In P. A. Alexander & P. H. Winne (Eds). Handbook of Educational Psychology. Routledge.
Radianti, J., Majchrzak, T. A., Fromm, J., Stieglitz, S., & Vom Brocke, J. (2021). Virtual reality applications for higher educations: A market analysis. Hawaii International Conference on System Sciences 2021. (HICSS-54).
Shackelford, L., Huang, D. W., Craig, A., Merrill, C., & Chen, D. (2019). Relationships between motivational support and game features in a game-based virtual reality learning environment for teaching introductory archaeology. Educational Media International, 56(3), 183–200.
*Stull, A. T., Hegarty, M., & Mayer, R. E. (2009). Getting a handle on learning anatomy with interactive three-dimensional graphics. Journal of Educational Psychology, 101(4), 803–816.
Suh, A., & Prophet, J. (2018). The state of immersive technology research: A literature analysis. Computers in Human Behavior, 86, 77–90.
Viechtbauer, W. (2010). Conducting meta-analyses in R with the metafor package. Journal of Statistical Software, 36(3), 1–48.
Villena-Taranilla, R., Tirado-Olivares, S., Cozar-Gutierrez, R., & González-Calero, J. A. (2022). Effects of virtual reality on learning outcomes in K-6 education: A meta-analysis. Educational Research Review, 100434. https://doi.org/10.1016/j.edurev.2022.100434
Weech, S., Kenny, S., & Barnett-Cowan, M. (2019). Presence and cybersickness in virtual reality are negatively related: A review. Frontiers in Psychology, 10, 158.
Wickens, C. D., Helton, W. S., Hollands, J. G., & Banbury, S. (2021). Engineering Psychology and Human Performance (5th Ed). Routledge.
*Wu, B., Hu, Y., & Wang, M. (2020a). How do head-mounted displays and planning strategy influence problem-solving-based learning in introductory electrical circuit design? Educational Technology & Society, 23(3), 40–52.
Wu, B., Yu, X., & Gu, X. (2020b). Effectiveness of immersive virtual reality using head-mounted displays on learning performance: A meta-analysis. British Journal of Educational Technology, 51(6), 1991–2005.
*Zinchenko, Y. P., Khoroshikh, P. P., Sergievich, A. A., Smirnov, A. S., Tumyalis, A. V., Kovalev, A. I., ... & Golokhvast, K. S. (2020). Virtual reality is more efficient in learning human heart anatomy especially for subjects with low baseline knowledge. New Ideas in Psychology, 59, 100786.
*Zhao, J., Lin, L., Sun, J., & Liao, Y. (2020). Using the summarizing strategy to engage learners: Empirical evidence in an immersive virtual reality environment. The Asia-Pacific Education Researcher. 1–10.
Funding
This work was supported by the US National Science Foundation under Award #1661231, Meta‐Analysis to Support an Integrated Theory of Multimedia Learning, to the University of Illinois at Urbana-Champaign.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Ethics Approval
Not applicable to a literature review; published studies comprise the data analysed in this manuscript.
Consent Statement
Not applicable.
Conflict of Interest
The authors declare no competing interests.
Disclaimer
The sponsor played no role in the design of the research, the decision to publish, or the content of this submission.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Cromley, J.G., Chen, R. & Lawrence, L. Meta-Analysis of STEM Learning Using Virtual Reality: Benefits Across the Board. J Sci Educ Technol 32, 355–364 (2023). https://doi.org/10.1007/s10956-023-10032-5
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10956-023-10032-5