Abstract
The use of augmented reality (AR) technology in the science curriculum has the potential to assist students in comprehending abstract and complex concepts or unobservable phenomena, as well as to better explain knowledge regarding science content by superimposing virtual objects over genuine items or environments in a multidimensional approach. However, the overall effects on students’ academic achievement of using AR technology in scientific courses and the key factors that influence such effects are still unclear. Therefore, we performed a meta-analysis in this work to systematically review 35 empiric trials (with 39 effect sizes) that used experimental or quasi-experimental approaches to determine the academic achievement of using AR techniques in science-related courses. In addition, we explored possible moderators such as differences in disciplines, educational stages, types of AR (marker-based, markerless-based, or location-based), display devices (mobiles, tablets, computers, or headsets), intervention duration, group size, and instructional strategies. The results revealed that the overall mean effect size (with AR into instruction vs without AR into instruction) was 0.737 under the random effects model, indicating a medium-to-large significant positive effect on students’ academic achievement. The disciplines had significant moderating effects, types of AR had marginally significant effects, while educational stages, display devices, intervention duration, group size, and strategies used had insignificant influence. The impact of AR technology on scientific education was discussed in connection to the above seven moderators.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
References marked with an asterisk indicate studies included in the meta-analysis.
*Abdusselam, M. S., & Karal, H. (2020). The effect of using augmented reality and sensing technology to teach magnetism in high school physics. Technology, Pedagogy and Education, 29(4), 407–424. https://doi.org/10.1080/1475939X.2020.1766550
Akçayır, M., & Akçayır, G. (2017). Advantages and challenges associated with augmented reality for education: A systematic review of the literature. Educational Research Review, 20, 1–11. https://doi.org/10.1016/j.edurev.2016.11.002
*Akçayır, M., Akçayır, G., Pektaş, H. M., & Ocak, M. A. (2016). Augmented reality in science laboratories: The effects of augmented reality on university students’ laboratory skills and attitudes toward science laboratories. Computers in Human Behavior, 57, 334–342. https://doi.org/10.1016/j.chb.2015.12.054
Al-Mashaqbeh, I., & Al Shurman, M. (2015). The adoption of tablet and e-textbooks: First grade core curriculum and school administration attitude. Journal of Education and Practice, 6(21), 188–194. https://doi.org/10.1016/j.compedu.2019.103647
Arici, F., Yildirim, P., Caliklar, Ş, & Yilmaz, R. M. (2019). Research trends in the use of augmented reality in science education: Content and bibliometric mapping analysis. Computers & Education. https://doi.org/10.1016/j.compedu.2019.103647
Borenstein, M., Hedges, L. V., & Rothstein, H. R. (2009). Introduction to meta-analysis. John Wiley & Sons.
Borenstein, M., Hedges, L., Higgins, J., & Rothstein, H. (2013). Comprehensive meta-analysis version 3 [Computer software]. Biostat Inc.
Bowden, J., Davey Smith, G., & Burgess, S. (2015). Mendelian randomization with invalid instruments: Effect estimation and bias detection through Egger regression. International Journal of Epidemiology, 44(2), 512–525. https://doi.org/10.1093/ije/dyv080
Cai, S., Chiang, F.-K., Sun, Y., Lin, C., & Lee, J. J. (2017). Applications of augmented reality-based natural interactive learning in magnetic field instruction. Interactive Learning Environments, 25(6), 778–791. https://doi.org/10.1080/10494820.2016.1181094
*Cai, S., Chiang, F.-K., & Wang, X. (2013). Using the augmented reality 3D technique for a convex imaging experiment in a physics course. International Journal of Engineering Education, 29(4), 856–865.
*Cai, S., Liu, E., Shen, Y., Liu, C., Li, S., & Shen, Y. (2020). Probability learning in mathematics using augmented reality: Impact on student’s learning gains and attitudes. Interactive Learning Environments, 28(5), 560–573. https://doi.org/10.1080/10494820.2019.1696839
Cai, S., Wang, X., & Chiang, F.-K. (2014). A case study of augmented reality simulation system application in a chemistry course. Computers in Human Behavior, 37, 31–40. https://doi.org/10.1016/j.chb.2014.04.018
*Carrera, C. C., & Asensio, L. A. B. (2017). Landscape interpretation with augmented reality and maps to improve spatial orientation skill. Journal of Geography in Higher Education, 41(1), 119–133. https://doi.org/10.1080/03098265.2016.1260530
Chang, H.-Y., Liang, J.-C., & Tsai, C.-C. (2020). Students’ context-specific epistemic justifications, prior knowledge, engagement, and socioscientific reasoning in a mobile augmented reality learning environment. Journal of Science Education and Technology, 29(3), 399–408. https://doi.org/10.1007/s10956-020-09825-9
*Chang, R.-C., Chung, L.-Y., & Huang, Y.-M. (2016). Developing an interactive augmented reality system as a complement to plant education and comparing its effectiveness with video learning. Interactive Learning Environments, 24(6), 1245–1264. https://doi.org/10.1080/10494820.2014.982131
*Chang, R.-C., & Yu, Z.-S. (2018). Using augmented reality technologies to enhance students’ engagement and achievement in science laboratories. International Journal of Distance Education Technologies, 16(4), 54–72. https://doi.org/10.4018/IJDET.2018100104
*Chang, S.-C., & Hwang, G.-J. (2018). Impacts of an augmented reality-based flipped learning guiding approach on students’ scientific project performance and perceptions. Computers & Education, 125, 226–239. https://doi.org/10.1016/j.compedu.2018.06.007
*Chen, C.-H. (2020). Impacts of augmented reality and a digital game on students’ science learning with reflection prompts in multimedia learning. Educational Technology Research and Development, 68(6), 3057–3076. https://doi.org/10.1007/s11423-020-09834-w
Chen, C.-H., & Yang, Y.-C. (2019). Revisiting the effects of project-based learning on students’ academic achievement: A meta-analysis investigating moderators. Educational Research Review, 26, 71–81. https://doi.org/10.1016/j.edurev.2018.11.001
Chen, C., & Wang, C.-H. (2015). Employing augmented-reality-embedded instruction to disperse the imparities of individual differences in Earth science learning. Journal of Science Education and Technology, 24(6), 835–847. https://doi.org/10.1007/s10956-015-9567-3
Cheng, K.-H., & Tsai, C.-C. (2013). Affordances of augmented reality in science learning: Suggestions for future research. Journal of Science Education and Technology, 22(4), 449–462. https://doi.org/10.1007/s10956-012-9405-9
Cheung, A. C. K., & Slavin, R. E. (2013). The effectiveness of educational technology applications for enhancing mathematics achievement in K-12 classrooms: A meta-analysis. Educational Research Review, 9, 88–113. https://doi.org/10.1016/j.edurev.2013.01.001
*Chiang, T. H. C., Yang, S. J. H., & Hwang, G.-J. (2014). An augmented reality-based mobile learning system to improve students’ learning achievements and motivations in natural science inquiry activities. Educational Technology and Society, 17(4), 352–365. https://www.jstor.org/stable/pdf/jeductechsoci.17.4.352.pdf
*Chien, Y.-C., Su, Y.-N., Wu, T.-T., & Huang, Y.-M. (2019). Enhancing students’ botanical learning by using augmented reality. Universal Access in the Information Society, 18(2), 231–241. https://doi.org/10.1007/s10209-017-0590-4
Cohen, J. D. (1988). Statistical power analysis for the behavioral sciences. Lawrence Erlbaum Associates.
Dange, J. K. (2018). Mobile-assisted-learning approach in enhancing the student teacher’s vocabulary and usage of mobile phone. In J. Keengwe (Eds.), Handbook of research on mobile technology, constructivism, and meaningful learning (pp. 316–330). IGI Global. https://doi.org/10.4018/978-1-5225-3949-0.ch017
*Dehghani, M., Mohammadhasani, N., Ghalevandi, M. H., & Azimi, E. (2020). Applying AR-based infographics to enhance learning of the heart and cardiac cycle in biology class. Interactive Learning Environments. https://doi.org/10.1080/10494820.2020.1765394
*Demitriadou, E., Stavroulia, K. E., & Lanitis, A. (2020). Comparative evaluation of virtual and augmented reality for teaching mathematics in primary education. Education and Information Technologies, 25(1), 381–401. https://doi.org/10.1007/s10639-019-09973-5
Diegmann, P., Schmidt-Kraepelin, M., Van den Eynden, S., & Basten, D. (2015). Benefits of augmented reality in educational environments – A systematic literature review. Proceedings of the 12th International Conference on Wirtschaftsinformatik, article 103 (pp. 1542–1556).
Duval, S., & Tweedie, R. (2000). Trim and fill: A simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics, 56(2), 455–463. https://doi.org/10.1111/j.0006-341X.2000.00455.x
Elford, D., Lancaster, S. J., & Jones, G. A. (2022). Exploring the effect of augmented reality on cognitive load, attitude, spatial ability, and stereochemical perception. Journal of Science Education and Technology, 31(3), 322–339. https://doi.org/10.1007/s10956-022-09957-0
Enyedy, N., Danish, J. A., Delacruz, G., & Kumar, M. (2012). Learning physics through play in an augmented reality environment. International Journal of Computer Supported Collaborative Learning, 7, 347–378. https://doi.org/10.1007/s11412-012-9150-3
*Erbas, C., & Demirer, V. (2019). The effects of augmented reality on students’ academic achievement and motivation in a biology course. Journal of Computer Assisted Learning, 35(3), 450–458. https://doi.org/10.1111/jcal.12350
*Faridi, H., Tuli, N., Mantri, A., Singh, G., & Gargrish, S. (2021). A framework utilizing augmented reality to improve critical thinking ability and learning gain of the students in Physics. Computer Applications in Engineering Education, 29(1), 258–273. https://doi.org/10.1002/cae.22342
*Fidan, M., & Tuncel, M. (2019). Integrating augmented reality into problem based learning: The effects on learning achievement and attitude in physics education. Computers & Education. https://doi.org/10.1016/j.compedu.2019.103635
*Fokides, E., & Mastrokoukou, A. (2018). Results from a study for teaching human body systems to primary school students using tablets. Contemporary Educational Technology, 9(2), 154–170. https://doi.org/10.30935/cet.414808
Furió, D., González-Gancedo, S., Juan, M.-C., Seguí, I., & Rando, N. (2013). Evaluation of learning outcomes using an educational iPhone game vs. traditional game. Computers & Education, 64, 1–23. https://doi.org/10.1016/j.compedu.2012.12.001
Garzón, J., & Acevedo, J. (2019). Meta-analysis of the impact of augmented reality on students’ learning gains. Educational Research Review, 27, 244–260. https://doi.org/10.1016/j.edurev.2019.04.001
Garzón, J., Kinshuk, Baldiris, S., Gutiérrez, J., & Pavón, J. (2020). How do pedagogical approaches affect the impact of augmented reality on education? A meta-analysis and research synthesis. Educational Research Review, 31, 100334. https://doi.org/10.1016/j.edurev.2020.100334
*Gecu-Parmaksiz, Z., & Delialioglu, O. (2019). Augmented reality-based virtual manipulatives versus physical manipulatives for teaching geometric shapes to preschool children. British Journal of Educational Technology, 50(6), 3376–3390. https://doi.org/10.1111/bjet.12740
Gerard, L. F., Varma, K., Corliss, S. B., & Linn, M. C. (2011). Professional development for technology-enhanced inquiry science. Review of Educational Research, 81(3), 408–448. https://doi.org/10.3102/0034654311415121
Gnidovec, T., Žemlja, M., Dolenec, A., & Torkar, G. (2020). Using augmented reality and the structure–behavior–function model to teach lower secondary school students about the human circulatory system. Journal of Science Education and Technology, 29(6), 774–784. https://doi.org/10.1007/s10956-020-09850-8
Goff, E. E., Mulvey, K. L., Irvin, M. J., & Hartstone-Rose, A. (2018). Applications of augmented reality in informal science learning sites: A review. Journal of Science Education and Technology, 27(5), 433–447. https://doi.org/10.1007/s10956-018-9734-4
*Gopalan, V., Zulkifli, A. N., & Bakar, J. A. A. (2016). Conventional approach vs augmented reality textbook on learning performance: A study in science learning among secondary school students. Revista de La Facultad de Ingeniería, 31(5), 19–26. https://doi.org/10.21311/002.31.5.03
Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003). Measuring inconsistency in meta-analyses. BMJ, 327(7414), 557–560. https://doi.org/10.1136/bmj.327.7414.557
*Hsiao, H.-S., Chang, C.-S., Lin, C.-Y., & Wang, Y.-Z. (2016). Weather observers: A manipulative augmented reality system for weather simulations at home, in the classroom, and at a museum. Interactive Learning Environments, 24(1), 205–223. https://doi.org/10.1080/10494820.2013.834829
Hu, Y., Chen, C.-H., & Su, C.-Y. (2021). Exploring the effectiveness and moderators of block-based visual programming on student learning: A meta-analysis. Journal of Educational Computing Research, 58(8), 1467–1493. https://doi.org/10.1177/0735633120945935
Huang, K.-L., Chen, K.-H., & Ho, C.-H. (2014). Enhancing learning outcomes through new e-textbooks: A desirable combination of presentation methods and concept maps. Australasian Journal of Educational Technology, 30(5), 600–618. https://doi.org/10.14742/ajet.538
*Huang, Y.-M., & Lin, P.-H. (2017). Evaluating students’ learning achievement and flow experience with tablet PCs based on AR and tangible technology in u-learning. Library Hi Tech, 35(4), 602–614. https://doi.org/10.1108/LHT-01-2017-0023
Ibáñez, M. B., Di Serio, Á., Villarán, D., & Delgado Kloos, C. (2014). Experimenting with electromagnetism using augmented reality: Impact on flow student experience and educational effectiveness. Computers & Education, 71, 1–13. https://doi.org/10.1016/j.compedu.2013.09.004
Juan, C. M., Toffetti, G., Abad, F., & Cano, J. (2010). Tangible cubes used as the user interface in an augmented reality game for edutainment. 2010 10th IEEE International Conference on Advanced Learning Technologies, pp 599–603. https://doi.org/10.1109/ICALT.2010.170
Juan, M.-C., Mendez-Lopez, M., Perez-Hernandez, E., & Albiol-Perez, S. (2014). Augmented Reality for the Assessment of Children’s Spatial Memory in Real Settings. https://doi.org/10.1371/journal.pone.0113751
*Karagozlu, D. (2018). Determination of the impact of augmented reality application on the success and problem-solving skills of students. Quality and Quantity, 52(5), 2393–2402. https://doi.org/10.1007/s11135-017-0674-5
*Kirikkaya, E. B., & Başgül, M. Ş. (2019). The effect of the use of augmented reality applications on the academic success and motivation of 7th grade students. Journal of Baltic Science Education, 18(3), 362–378. https://doi.org/10.33225/jbse/19.18.362
Kulik, C. L. C., & Kulik, J. A. (1991). Effectiveness of computer-based instruction: An updated analysis. Computers in Human Behavior, 7(1), 75–94. https://doi.org/10.1016/0747-5632(91)90030-5
Lin, H.-C.K., Chen, M.-C., & Chang, C.-K. (2015). Assessing the effectiveness of learning solid geometry by using an augmented reality-assisted learning system. Interactive Learning Environments, 23(6), 799–810. https://doi.org/10.1080/10494820.2013.817435
*Lin, T.-J., Duh, H.-B.L., Li, N., Wang, H.-Y., & Tsai, C.-C. (2013). An investigation of learners’ collaborative knowledge construction performances and behavior patterns in an augmented reality simulation system. Computers & Education, 68, 314–321. https://doi.org/10.1016/j.compedu.2013.05.011
Linn, M. (2003). Technology and science education: Starting points, research programs, and trends. International Journal of Science Education, 25(6), 727–758. https://doi.org/10.1080/09500690305017
Lipsey, M. W., & Wilson, D. B. (2001). Applied social research methods series. Sage Publications Inc.
*Lu, S.-J., Liu, Y.-C., Chen, P.-J., & Hsieh, M.-R. (2020). Evaluation of AR embedded physical puzzle game on students’ learning achievement and motivation on elementary natural science. Interactive Learning Environments, 28(4), 451–463. https://doi.org/10.1080/10494820.2018.1541908
Ozdemir, M., Sahin, C., Arcagok, S., & Demir, M. K. (2018). The effect of augmented reality applications in the learning process: A meta-analysis Study. Eurasian Journal of Educational Research, 18(74), 165–186. https://doi.org/10.14689/ejer.2018.74.9
*Özerbaş, D. S. (2019). The effect of marker-based augmented reality (MBAR) applications on academic achievement and permanence. Universal Journal of Educational Research, 7(9), 1926–1932. https://doi.org/10.13189/ujer.2019.070911
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., Chou, R., Glanville, J., Grimshaw, J. M., Hróbjartsson, A., Lalu, M. M., Li, T., Loder, E. W., Mayo-Wilson, E., McDonald, S., & Moher, D. (2021). The PRISMA 2020 Statement: An updated guideline for reporting systematic reviews. BMJ. https://doi.org/10.1136/bmj.n71
Pellas, N., Fotaris, P., Kazanidis, I., & Wells, D. (2019). Augmenting the learning experience in primary and secondary school education: A systematic review of recent trends in augmented reality game-based learning. Virtual Reality, 23(4), 329–346. https://doi.org/10.1007/s10055-018-0347-2
Radu, I. (2014). Augmented reality in education: A meta-review and cross-media analysis. Personal and Ubiquitous Computing, 18(6), 1533–1543. https://doi.org/10.1007/s00779-013-0747-y
Rossano, V., Lanzilotti, R., Cazzolla, A., & Roselli, T. (2020). Augmented reality to support geometry learning. IEEE Access, 8, 107772–107780. https://doi.org/10.1109/ACCESS.2020.3000990
*Sahin, D., & Yilmaz, R. M. (2020). The effect of augmented reality technology on middle school students’ achievements and attitudes towards science education. Computers & Education. https://doi.org/10.1016/j.compedu.2019.103710
Santos, M. E. C., Chen, A., Taketomi, T., Yamamoto, G., Miyazaki, J., & Kato, H. (2014). Augmented reality learning experiences: Survey of prototype design and evaluation. IEEE Transactions on Learning Technologies, 7(1), 38–56. https://doi.org/10.1109/TLT.2013.37
Saundarajan, K., Osman, S., Kumar, J., Daud, M., Abu, M., & Pairan, M. (2020). Learning algebra using augmented reality: A preliminary investigation on the application of photomath for lower secondary education. International Journal of Emerging Technologies in Learning, 15(16), 123–133.
Silén, C., & Uhlin, L. (2008). Self-directed learning – A learning issue for students and faculty! Teaching in Higher Education, 13(4), 461–475. https://doi.org/10.1080/13562510802169756
*Singh, G., Mantri, A., Sharma, O., Dutta, R., & Kaur, R. (2019). Evaluating the impact of the augmented reality learning environment on electronics laboratory skills of engineering students. Computer Applications in Engineering Education, 27(6), 1361–1375. https://doi.org/10.1002/cae.22156
*Sirakaya, M., & Cakmak, E. K. (2018). The effect of augmented reality use on achievement, misconception and course engagement. Contemporary Educational Technology, 9(3), 297–314. https://doi.org/10.30935/cet.444119
*Sun, K. T., & Chen, M. H. (2019). Utilizing free augmented reality app for learning geometry at elementary school in Taiwan: Take volumetric measurement of compound body for example. International Journal of Distance Education Technologies, 17(4), 36–53. https://doi.org/10.4018/IJDET.2019100103
Sung, Y.-T., Chang, K.-E., & Liu, T.-C. (2016). The effects of integrating mobile devices with teaching and learning on students’ learning performance: A meta-analysis and research synthesis. Computers & Education, 94, 252–275. https://doi.org/10.1016/j.compedu.2015.11.008
Suprapto, N., Nandyansah, W. & Mubarok, H. (2020). An evaluation of the “picsar” research project: An augmented reality in physics learning. International Journal of Emerging Technologies in Learning, 15(10), 113–125. https://www.learntechlib.org/p/217045/
*Tarng, W., Ou, K.-L., Yu, C.-S., Liou, F.-L., & Liou, H.-H. (2015). Development of a virtual butterfly ecological system based on augmented reality and mobile learning technologies. Virtual Reality, 19(3–4), 253–266. https://doi.org/10.1007/s10055-015-0265-5
*Thees, M., Kapp, S., Strzys, M. P., Beil, F., Lukowicz, P., & Kuhn, J. (2020). Effects of augmented reality on learning and cognitive load in university physics laboratory courses. Computers in Human Behavior. https://doi.org/10.1016/j.chb.2020.106316
*Turan, Z., Meral, E., & Sahin, I. F. (2018). The impact of mobile augmented reality in geography education: Achievements, cognitive loads and views of university students. Journal of Geography in Higher Education, 42(3), 427–441. https://doi.org/10.1080/03098265.2018.1455174
Walczak, K., Wojciechowski, R., & Cellary, W. (2006). Dynamic interactive VR network services for education. Proceedings of the ACM Symposium on Virtual Reality Software and Technology, 277–286.
*Weng, C., Otanga, S., Christianto, S. M., & Chu, R. J. C. (2020). Enhancing students’ biology learning by using augmented reality as a learning supplement. Journal of Educational Computing Research, 58(4), 747–770. https://doi.org/10.1177/0735633119884213
Wigfield, A., & Cambria, J. (2010). Students’ achievement values, goal orientations, and interest: Definitions, development, and relations to achievement outcomes. Developmental Review, 30(1), 1–35. https://doi.org/10.1016/j.dr.2009.12.001
Wojciechowski, R., & Cellary, W. (2013). Evaluation of learners’ attitude toward learning in ARIES augmented reality environments. Computers & Education, 68, 570–585. https://doi.org/10.1016/j.compedu.2013.02.014
Wu, H.-K., Lee, S.W.-Y., Chang, H.-Y., & Liang, J.-C. (2013). Current status, opportunities and challenges of augmented reality in education. Computers & Education, 62, 41–49. https://doi.org/10.1016/j.compedu.2012.10.024
*Yoon, S., Anderson, E., Lin, J., & Elinich, K. (2017). How augmented reality enables conceptual understanding of challenging science content. Educational Technology and Society, 20(1), 156–168.
Acknowledgements
The authors would like to thank Mr. En Hu for his support with data analysis.
Funding
This research was supported by the Startup Research Grant Scheme of Hangzhou Normal University (No. RWSK20201015) and the Provincial Advantageous and Characteristic Discipline Cultivation Project of Hangzhou Normal University (No. 20JYXK030).
Author information
Authors and Affiliations
Contributions
Wen-Wen Xu: conceptualization, methodology, investigation, data analysis, draft writing. Chien-Yuan Su: conceptualization, writing, editing and reviewing, supervision. Yue Hu: methodology, validation, supervision. Cheng-Huan Chen: methodology, reviewing.
Corresponding author
Ethics declarations
Informed Consent
Not applicable.
Conflict of Interest
The authors declare no competing interests.
Research Involving Human Participants and/or Animals
Not applicable.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Xu, WW., Su, CY., Hu, Y. et al. Exploring the Effectiveness and Moderators of Augmented Reality on Science Learning: a Meta-analysis. J Sci Educ Technol 31, 621–637 (2022). https://doi.org/10.1007/s10956-022-09982-z
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10956-022-09982-z