Abstract
Bibliometric mapping is widely used in educational technology research to visualize research field development (e.g. the current status and trend). However, there has been limited research examining the present state, challenges, and potential applications of bibliometric mapping techniques in the field of educational technology. In an effort to bridge this knowledge gap, this study conducted a systematic review of 71 articles on bibliometric mapping sourced from 24 journals specializing in educational technology. This review serves as a comprehensive analysis (i.e. a meta-review) of existing reviews in the field. The review focused on productivity, research topics, and research norms. The following key findings were obtained in the study: (1) The field has seen rapid development, with notable author groups, core journals, and major publishing countries; (2) Bibliometric mapping is mainly used for quantitative analysis in five research topics, including specific journals, emerging technologies, learning environments, online and distance learning, and subject concepts; (3) Statistics and evaluations of tools including Bibliometrix package of R language and VOSviewer, databases such as WoS and Scopus, as well as the procedural aspects of the research undertaken, were all considered. Additionally, the study investigated suggested benchmarks for these methods – investigating the availability of recognized reporting guidelines like PRISMA or others, as well as the presence of specific criteria for determining what should be included or excluded when utilizing bibliometric mapping techniques. The study proposed standards for the application of bibliometric mapping techniques in research, accompanied by relevant examples. This study not only reveals the specific value and current applications of bibliometric mapping techniques in educational technology research but also provides clarity on the specific methodologies for their implementation and identifies potential areas for further exploration. Finally, this study puts forth a number of recommendations aimed at fostering the reasoned utilization of bibliometric mapping techniques in the field of educational technology.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Data availability
The datasets generated during and/or analyzed during the current study are available from the corresponding author on reasonable request.
References
Al Mamun, M. A., Azad, M. A. K., & Boyle, M. (2022). Review of flipped learning in engineering education: Scientific mapping and research horizon. Education and Information Technologies, 27(1), 1261–1286. https://doi.org/10.1007/s10639-021-10630-z
Arici, F., Yildirim, P., Caliklar, Ş, & Yilmaz, R. M. (2019). Research trends in the use of augmented reality in science education: Content and bibliometric mapping analysis. Computers & Education, 142, 103647. https://doi.org/10.1016/j.compedu.2019.103647
Barrot, J. S. (2021). Scientific mapping of social media in education: A decade of exponential growth. Journal of Educational Computing Research, 59(4), 645–668. https://doi.org/10.1177/0735633120972010
Basilotta-Gómez-Pablos, V., Matarranz, M., Casado-Aranda, L. A., & Otto, A. (2022). Teachers’ digital competencies in higher education: A systematic literature review. International Journal of Educational Technology in Higher Education, 19(1), 1–16. https://doi.org/10.1186/s41239-021-00312-8
Batanero, J. M. F., Rebollo, M. M. R., & Rueda, M. M. (2019). Impact of ICT on students with high abilities. Bibliographic review (2008–2018). Computers & Education, 137, 48–58. https://doi.org/10.1016/j.compedu.2019.04.007
Bond, M., Zawacki-Richter, O., & Nichols, M. (2019). Revisiting five decades of educational technology research: A content and authorship analysis of the British Journal of Educational Technology. British Journal of Educational Technology, 50(1), 12–63. https://doi.org/10.1111/bjet.12730
Bozkurt, A. (2019). Intellectual roots of distance education: A progressive knowledge domain analysis. Distance Education, 40(4), 497–514. https://doi.org/10.1080/01587919.2019.1681894
Bozkurt, A., & Zawacki-Richter, O. (2021). Trends and patterns in distance education (2014–2019): A synthesis of scholarly publications and a visualization of the intellectual landscape. International Review of Research in Open and Distributed Learning, 22(2), 19–45. https://doi.org/10.19173/irrodl.v22i2.5381
Chang, C. Y., & Yang, J. C. (2022). Concept mapping in computer-supported learning environments: A bibliometric analysis. Interactive Learning Environments, 1–18. https://doi.org/10.1080/10494820.2022.2043385
Chang, C. C., Hwang, G. J., & Tu, Y. F. (2022). Roles, applications, and trends of concept map-supported learning: A systematic review and bibliometric analysis of publications from 1992 to 2020 in selected educational technology journals. Interactive Learning Environments, 1–22. https://doi.org/10.1080/10494820.2022.2027457
Chen, X., Xie, H., Wang, F. L., Liu, Z., Xu, J., & Hao, T. (2018). A bibliometric analysis of natural language processing in medical research. BMC Medical Informatics and Decision Making, 18, 1–14. https://doi.org/10.1186/s12911-018-0594-x
Chen, X., Zou, D., & Xie, H. (2020). Fifty years of British Journal of Educational Technology: A topic modeling based bibliometric perspective. British Journal of Educational Technology, 51(3), 692–708. https://doi.org/10.1111/bjet.12907
Chen, M. R. A., Hwang, G. J., Majumdar, R., Toyokawa, Y., & Ogata, H. (2021a). Research trends in the use of E-books in English as a foreign language (EFL) education from 2011 to 2020: A bibliometric and content analysis. Interactive Learning Environments, 1–17. https://doi.org/10.1080/10494820.2021.1888755
Chen, X., Zou, D., Xie, H., & Cheng, G. (2021b). Twenty years of personalized language learning: Topic Modeling and Knowledge Mapping. Educational Technology & Society, 24(1), 205–222. https://www.jstor.org/stable/26977868. Accessed 10 June 2023
Chen, X., Zou, D., & Xie, H. (2022a). A decade of learning analytics: Structural topic modeling based bibliometric analysis. Education and Information Technologies, 27(8), 10517–10561. https://doi.org/10.1007/s10639-022-11046-z
Chen, X., Zou, D., Xie, H., Chen, G., Lin, J., & Cheng, G. (2022b). Exploring contributors, collaborations, and research topics in educational technology: A joint analysis of mainstream conferences. Education and Information Technologies, 1–36. https://doi.org/10.1007/s10639-022-11209-y
Chen, X., Zou, D., Xie, H., Cheng, G., & Liu, C. (2022c). Two decades of artificial intelligence in education: Contributors, collaborations, research topics, challenges, and future directions. Educational Technology & Society, 25(1), 28–47. https://www.jstor.org/stable/48647028. Accessed 10 June 2023
Cheng, B., Wang, M., Mørch, A. I., Chen, N. S., & Spector, J. M. (2014). Research on e-learning in the workplace 2000–2012: A bibliometric analysis of the literature. Educational Research Review, 11, 56–72. https://doi.org/10.1016/j.edurev.2014.01.001
Cobo, M., Lopez-Herrera, A., Herrera-Viedma, E., & Herrera, F. (2011). Science mapping software tools: Review, analysis, and cooperative study among tools. Journal of the American Society for Information Science and Technology, 62(7), 1382–1402. https://doi.org/10.1002/asi.21525
Cobo, M. J., Martínez, M. A., Gutiérrez-Salcedo, M., Fujita, H., & Herrera-Viedma, E. (2015). 25 years at knowledge-based systems: A bibliometric analysis. Knowledge-Based Systems, 80, 3–13. https://doi.org/10.1016/j.knosys.2014.12.035
Dao, L. T., Tran, T., Van Le, H., Nguyen, G. N., & Trinh, T. P. T. (2022). A bibliometric analysis of Research on Education 4.0 during the 2017–2021 period. Education and Information Technologies, 1–17. https://doi.org/10.1007/s10639-022-11211-4
De Bellis, N. (2009). Bibliometrics and citation analysis (1st ed.). The Scarecrow Press, Inc.
Ding, X., & Yang, Z. (2022). Knowledge mapping of platform research: A visual analysis using VOSviewer and CiteSpace. Electronic Commerce Research, 22, 787–809. https://doi.org/10.1007/s10660-020-09410-7
Donthu, N., Kumar, S., Mukherjee, D., Pandey, N., & Lim, W. M. (2021). How to conduct a bibliometric analysis: An overview and guidelines. Journal of Business Research, 133, 285–296. https://doi.org/10.1016/j.jbusres.2021.04.070
Dubé, A. K., & Wen, R. (2022). Identification and evaluation of technology trends in K-12 education from 2011 to 2021. Education and Information Technologies, 27(2), 1929–1958. https://doi.org/10.1007/s10639-021-10689-8
Garfield, E. (2006). The history and meaning of the journal impact factor. Journal of American Medical Association, 295(1), 90–93. https://doi.org/10.1001/jama.295.1.90
Gaur, A., & Kumar, M. (2018). A systematic approach to conducting review studies: An assessment of content analysis in 25 years of IB research. Journal of World Business, 53(2), 280–289. https://doi.org/10.1016/j.jwb.2017.11.003
Grant, M. J., & Booth, A. (2009). A typology of reviews: An analysis of 14 review types and associated methodologies. Health Information & Libraries Journal, 26(2), 91–108. https://doi.org/10.1111/j.1471-1842.2009.00848.x
Guo, S., Zhang, G., & Guo, Y. (2016). Social network analysis of 50 years of international collaboration in the research of educational technology. Journal of Educational Computing Research, 53(4), 499–518. https://doi.org/10.1177/0735633115611114
Hallinger, P. (2020). Science mapping the knowledge base on educational leadership and management from the emerging regions of Asia, Africa and Latin America, 1965–2018. Educational Management Administration & Leadership, 48(2), 209–230. https://doi.org/10.1177/1741143218822772
Heradio, R., De La Torre, L., Galan, D., Cabrerizo, F. J., Herrera-Viedma, E., & Dormido, S. (2016). Virtual and remote labs in education: A bibliometric analysis. Computers & Education, 98, 14–38. https://doi.org/10.1016/j.compedu.2016.03.010
Huang, X., Zou, D., Cheng, G., Chen, X., & Xie, H. (2023). Trends, research issues and applications of artificial intelligence in language education. Educational Technology & Society, 26(1), 112–131. https://www.jstor.org/stable/48707971. Accessed 10 June 2023
Hwang, G. J., & Tu, Y. F. (2021). Roles and research trends of artificial intelligence in mathematics education: A bibliometric mapping analysis and systematic review. Mathematics, 9, 584. https://doi.org/10.3390/math9060584
Hwang, G. J., Tu, Y. F., & Tang, K. Y. (2022). AI in online-learning research: Visualizing and interpreting the journal publications from 1997 to 2019. International Review of Research in Open and Distributed Learning, 23(1), 104–130. https://doi.org/10.19173/irrodl.v23i1.6319
Jing, Y. H., Zhao, L. Y., Zhu, K. K., Wang, H. M., Wang, C. L., & Xia, Q. (2023). Research landscape of adaptive learning in education: A bibliometric study on research publications from 2000 to 2022. Sustainability. https://doi.org/10.3390/su15043115
Koon, V. Y. (2022). Mobile learning and humanistic education: A science mapping approach. Interactive Learning Environments, 1–18. https://doi.org/10.1080/10494820.2022.2061010
Kumar, S., Sahoo, S., Lim, W. M., Kraus, S., & Bamel, U. (2022). Fuzzy-set qualitative comparative analysis (fsQCA) in business and management research: A contemporary overview. Technological Forecasting and Social Change, 178, 121599. https://doi.org/10.1016/j.techfore.2022.121599
Kushairi, N., & Ahmi, A. (2021). Flipped classroom in the second decade of the Millenia: A Bibliometrics analysis with Lotka’s law. Education and Information Technologies, 26(4), 4401–4431. https://doi.org/10.1007/s10639-021-10457-8
Lesnikowski, A., Belfer, E., Rodman, E., Smith, J., Biesbroek, R., Wilkerson, J. D., Ford, D. J., & Berrang-Ford, L. (2019). Frontiers in data analytics for adaptation research: topic modeling. Wiley Interdisciplinary Reviews: Climate Change, 10, e576. https://doi.org/10.1002/wcc.576
Liu, Z., Moon, J., Kim, B., & Dai, C. P. (2020). Integrating adaptivity in educational games: A combined bibliometric analysis and meta-analysis review. Educational Technology Research and Development, 68(4), 1931–1959. https://doi.org/10.1007/s11423-020-09791-4
Liu, C., Zou, D., Chen, X., Xie, H., & Chan, W. H. (2021). A bibliometric review on latent topics and trends of the empirical MOOC literature (2008–2019). Asia Pacific Education Review, 22(3), 515–534.
López-Belmonte, J., Moreno-Guerrero, A. J., López-Núñez, J. A., & Hinojo-Lucena, F. J. (2020). Augmented reality in education. A scientific mapping in Web of Science. Interactive Learning Environments, 1–15. https://doi.org/10.1080/10494820.2020.1859546
Lopez-Belmonte, J., Moreno-Guerrero, A. J., Pozo-Sanchez, S., & Marin-Marin, J. A. (2021). Co-word analysis and academic performance from the Australasian Journal of Educational Technology in Web of Science. Australasian Journal of Educational Technology, 37(6), 119–140. https://doi.org/10.14742/ajet.6940
Martí-Parreño, J., Méndez-Ibáñez, E., & Alonso-Arroyo, A. (2016). The use of gamification in education: A bibliometric and text mining analysis. Journal of Computer Assisted Learning, 32(6), 663–676. https://doi.org/10.1111/jcal.12161
McCormick, B. H., DeFanti, T. A., & Brown, M. D. (1987). Visualization in scientific computing| a synopsis. IEEE Computer Graphics and Applications, 7(7), 61–70.
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., PRISMA Group. (2009). Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. Annals of internal medicine, 151(4), 264–269. https://doi.org/10.7326/0003-4819-151-4-200908180-00135
Mostafa, M. M. (2022). Three decades of interactive learning environments: a retrospective bibliometric network analysis. Interactive Learning Environments, 1–20. https://doi.org/10.1080/10494820.2022.2057548
Norris, M., & Oppenheim, C. (2007). Comparing alternatives to the Web of Science for coverage of the social sciences’ literature. Journal of Informetrics, 1(2), 161–169. https://doi.org/10.1016/j.joi.2006.12.001
Orbay, M., Karamustafaoğlu, O., & Miranda, R. (2021). Analysis of the journal impact factor and related bibliometric indicators in education and educational research category. Education for Information, 37(3), 315–336. https://doi.org/10.3233/EFI-200442
Otlet, P. (1934). Traité de documentation: Le livre sur le livre. Paris, France: Éditions des maisons des sciences de l’homme associées.
Ozyurt, O., & Ozyurt, H. (2022). A large-scale study based on topic modeling to determine the research interests and trends on computational thinking. Education and Information Technologies, 1–23. https://doi.org/10.1007/s10639-022-11325-9
Ozyurt, O., & Ayaz, A. (2022). Twenty-five years of education and information technologies: Insights from a topic modeling based bibliometric analysis. Education and Information Technologies, 27, 11025–11054. https://doi.org/10.1007/s10639-022-11071-y
Pan, X., Yan, E., Cui, M., & Hua, W. (2018). Examining the usage, citation, and diffusion patterns of bibliometric mapping software: A comparative study of three tools. Journal of Informetrics, 12(2), 481–493. https://doi.org/10.1016/j.joi.2018.03.005
Paul, J., Lim, W. M., O’Cass, A., Hao, A. W., & Bresciani, S. (2021). Scientific procedures and rationales for systematic literature reviews (SPAR-4-SLR). International Journal of Consumer Studies, 45(4), 1147–1147. https://doi.org/10.1111/ijcs.12736
Pei, B., Xing, W., & Wang, M. (2021). Academic development of multimodal learning analytics: A bibliometric analysis. Interactive Learning Environments, 1–19. https://doi.org/10.1080/10494820.2021.1936075
Pessin, V. Z., Yamane, L. H., & Siman, R. R. (2022). Smart bibliometrics: An integrated method of science mapping and bibliometric analysis. Scientometrics, 127, 3695–3718. https://doi.org/10.1007/s11192-022-04406-6
Polanin, J. R., Tanner-Smith, E. E., & Hennessy, E. A. (2016). Estimating the difference between published and unpublished effect sizes: A meta-review. Review of Educational Research, 86(1), 207–236. https://doi.org/10.3102/0034654315582067
Raman, R., Achuthan, K., Nair, V. K., & Nedungadi, P. (2022). Virtual Laboratories-A historical review and bibliometric analysis of the past three decades. Education and Information Technologies, 27, 11055–11087. https://doi.org/10.1007/s10639-022-11058-9
Roberts, M. E., Stewart, B. M., & Tingley, D. (2019). Stm: An R package for structural topic models. Journal of Statistical Software, 91, 1–40. https://doi.org/10.18637/jss.v091.i02
Schöbel, S., Saqr, M., & Janson, A. (2021). Two decades of game concepts in digital learning environments–A bibliometric study and research agenda. Computers & Education, 173, 104296. https://doi.org/10.1016/j.compedu.2021.104296
Shadiev, R., & Li, D. (2022). A review study on eye-tracking technology usage in immersive virtual reality learning environments. Computers & Education, 104681. https://doi.org/10.1016/j.compedu.2022.104681
Shen, C. W., & Ho, J. T. (2020). Technology-enhanced learning in higher education: A bibliometric analysis with the latent semantic approach. Computers in Human Behavior, 104, 106177. https://doi.org/10.1016/j.chb.2019.106177
Shih, M., Feng, J., & Tsai, C. C. (2008). Research and trends in the field of e-learning from 2001 to 2005: A content analysis of cognitive studies in selected journals. Computers & Education, 51(2), 955–967. https://doi.org/10.1016/j.compedu.2007.10.004
Small, H. (1999). A passage through science: Crossing disciplinary boundaries. Library Trends, 48(1), 72–108.
Tamim, R. M., Bernard, R. M., Borokhovski, E., Abrami, P. C., & Schmid, R. F. (2011). What forty years of research says about the impact of technology on learning: A second-order meta-analysis and validation study. Review of Educational Research, 81(1), 4–28. https://doi.org/10.3102/0034654310393361
Tang, K. Y., Chen, C. C., Hwang, G. J., & Tu, Y. F. (2022). Did library learners benefit from m-learning strategies? Research-based evidence from a co-citation network analysis of the literature. Educational Technology Research and Development, 70(5), 1719–1753. https://doi.org/10.1007/s11423-022-10136-6
Tibaná-Herrera, G., Fernández-Bajón, M. T., & Moya-Anegón, D. (2018). Categorization of E-learning as an emerging discipline in the world publication system: A bibliometric study in SCOPUS. International Journal of Educational Technology in Higher Education, 15(1), 1–23. https://doi.org/10.1186/s41239-018-0103-4
Tlili, A., Huang, R., Shehata, B., Liu, D., Zhao, J., Metwally, A. H. S., ... & Burgos, D. (2022). Is Metaverse in education a blessing or a curse: A combined content and bibliometric analysis? Smart Learning Environments, 9(1), 1–31. https://doi.org/10.1186/s40561-022-00205-x
Valtonen, T., López-Pernas, S., Saqr, M., Vartiainen, H., Sointu, E. T., & Tedre, M. (2022). The nature and building blocks of educational technology research. Computers in Human Behavior, 128, 107123. https://doi.org/10.1016/j.chb.2021.107123
Van Eck, N., & Waltman, L. (2010). Software survey: VOSviewer, a computer program for bibliometric mapping. Scientometrics, 84(2), 523–538. https://doi.org/10.1007/s11192-009-0146-3
Veletsianos, G., & Shepherdson, P. (2015). Who studies MOOCs? Interdisciplinarity in MOOC research and its changes over time. International Review of Research in Open and Distributed Learning, 16(3), 1–17.
Vošner, H. B., Kokol, P., Bobek, S., Železnik, D., & Završnik, J. (2016). A bibliometric retrospective of the Journal Computers in Human Behavior (1991–2015). Computers in Human Behavior, 65, 46–58. https://doi.org/10.1016/j.chb.2016.08.026
Wahid, R., Ahmi, A., & Alam, A. S. A. (2020). Growth and collaboration in massive open online courses: A bibliometric analysis. International Review of Research in Open and Distributed Learning, 21(4), 292–322. https://doi.org/10.19173/irrodl.v21i4.4693
Wang, C. L., Dai, J., & Xu, L. J. (2022). Big data and data mining in education: a bibliometrics study from 2010 to 2022, in Proceedings of 2022 7th International Conference on Cloud Computing and Big Data Analytics (Chengdu: IEEE), 507–512. https://doi.org/10.1109/ICCCBDA55098.2022.9778874
Xiao, Y., & Watson, M. (2019). Guidance on conducting a systematic literature review. Journal of Planning Education and Research, 39(1), 93–112.
Yan, D. (2023). Impact of ChatGPT on learners in a L2 writing practicum: An exploratory investigation. Education and Information Technologies, 1–25. https://doi.org/10.1007/s10639-023-11742-4
Zancanaro, A., Todesco, J. L., & Ramos, F. (2015). A bibliometric mapping of open educational resources. International Review of Research in Open and Distributed Learning, 16(1), 1–23. https://doi.org/10.19173/irrodl.v16i1.1960
Zawacki-Richter, O., & Naidu, S. (2016). Mapping research trends from 35 years of publications in Distance Education. Distance Education, 37(3), 245–269. https://doi.org/10.1080/01587919.2016.1185079
Zhang, L., Carter, R. A., Jr., Qian, X., Yang, S., Rujimora, J., & Wen, S. (2022). Academia’s responses to crisis: A bibliometric analysis of literature on online learning in higher education during COVID-19. British Journal of Educational Technology, 53(3), 620–646. https://doi.org/10.1111/bjet.13191
Zou, D., Huang, X., Kohnke, L., Chen, X., Cheng, G., & Xie, H. (2022). A bibliometric analysis of the trends and research topics of empirical research on TPACK. Education and Information Technologies, 27(8), 10585–10609. https://doi.org/10.1007/s10639-022-10991-z
Funding
This research was supported by the 2022 National Social Science Foundation Education Youth Project "Research on the Strategy of Creating Learning Space Value and Empowering Classroom Teaching under the background of 'Double Reduction'" (Grant No. CCA220319).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
All authors of this manuscript declare that we have no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Jing, Y., Wang, C., Chen, Y. et al. Bibliometric mapping techniques in educational technology research: A systematic literature review. Educ Inf Technol (2023). https://doi.org/10.1007/s10639-023-12178-6
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10639-023-12178-6