Abstract
This study offers a comprehensive analysis of COVID-19 research in education. A multi-methods approach was used to capture the full breadth of educational research. As such, a bibliometric analysis, structural topic modeling, and qualitative synthesis of top papers were combined. A total of 4,201 articles were retrieved from Scopus, mostly published from 2019 to 2021. In this work special attention is paid to analyzing and synthesizing findings about: (i) status of research about COVID-19 regarding frequencies, venues, publishing countries, (ii) identification of main topics in the COVID-19 research, and (iii) identification of the major themes in most cited articles and their impact on the educational community. Structural topic modeling identified three main groups of topics that related to education in general, moving to online education, or diverse topics (e.g., perceptions, inclusion, medical education, engagement and motivation, well-being, and equality). A deeper analysis of the papers that received most attention revealed that problem understanding was the dominating theme of papers, followed by challenges, impact, guidance, online migration, and tools and resources. A vast number of papers were produced. However, thoughtful, well-planned, and meaningful research was hard to conceptualize or implement, and a sense of urgency led to a deluge of research with thin contributions in a time of dire need to genuine insights.
Similar content being viewed by others
Explore related subjects
Find the latest articles, discoveries, and news in related topics.Avoid common mistakes on your manuscript.
1 Introduction
The last months of 2019 have witnessed an unprecedented situation that humanity has not seen in a hundred years. The initial reactions of disbelief, hesitance and denial have wasted precious opportunities to prepare or at least to take much needed calculated steps [1,2,3]. Perhaps, the way the situation developed at a staggering speed has made planning practically impossible. Universities around the world, in response to the global pandemic, were forced to cancel their face-to-face classes and shift to online education. Such a decision was taken overnight leading students, teachers, and families to a reality they had to accommodate with the wherewithal at hand [1,2,3,4].
Online learning has become the crucial tool for the online transition, lectures were delivered though real-time video conferences, e.g., Zoom, Hangouts and Teams [5]. Several other forms were also adopted, e.g., video recordings, asynchronous forum discussions, or messaging through emails [3]. Such rapid changes, in the way learning was delivered, has influenced student satisfaction, mental well-being and a willingness to accept the “new normal” [5]. Teachers had to develop learning materials in new digital forms leading to a large increase in workload and possibly time trying to learn necessary digital skills or use new software [2]. Furthermore, teachers had to develop initiatives that help mitigate the unfolding situation, overcome the limitations of virtual teaching and possibly improve interactions with students [6, 7]. Families had to be involved in the teaching process, facilitate home schooling and help their children with the stressful situation [8]. Universities created—or we better say improvised– guidelines that detail how to respond to emergency in various shapes or forms, e.g., “Emergency Management Plan (EMP)”, “Crisis Management Plan,” or “Business Continuity Plan (BCP)” containing essentially the four phases of emergency management: preparedness, response, recovery and mitigation [9].
The accelerating situation has led to new realities where the educational community needed novel insights about different aspects, e.g., students, teachers, pedagogy, tools, and implementations. Therefore, researchers have been racing to offer their insights regarding their experience, students’ perceptions, tools, and ways to optimize learning and teaching, to mention a few [1, 4, 10]. Funding agencies have also tried to help researchers with fast-track grants targeting education during the pandemic, for instance some Erasmus + calls were launched in 2020. To that end, a large volume of research has been produced across vast and diverse areas that requires a synthesis. In this paper, we take a mixed methods approach combining (1) in-depth qualitative analysis of the top 54 cited papers, (2) bibliometric analysis of the publication meta-data, and (3) Structural Topic Models (STM) to make sense of the large number of publications and compile the published research into “topics” which we analyze and offer a concise analysis of the articles content.
Bibliometric analysis offers an overarching quantitative view of scientific research through the analysis of meta-data [11, 12]. Bibliometrics have been used widely across several fields to map scientific productivity, assess impact, dissemination, collaborative patterns, and research trends [13]. This approach relies on several analytical techniques, e.g., visualization, network analysis and statistical methods. However, bibliometrics is commonly criticized for the lack of qualitative and nuanced analysis [14]. Therefore, we augment our approach with qualitative analysis of the top 54 cited papers as well as STM for the analysis of research themes [15].
Despite the recency of STM as a technique, STM has gained an increasing role as a valuable tool for studying textual data across social sciences [16, 17]. Using STM, researchers are able to “mine” latent (often referred to as hidden) topics automatically from the large corpora of text using “unsupervised methods” [18]. That is, topics are inferred from the text without a priori assignment or manual coding of the data into predefined categories (“supervised methods”) [19]. The inferred topics represent themes within the dataset that have semantic associations. Two types of models exist, single membership models where each document belongs to a single topic and mixed membership where a document represents a mixture of topics which is used in our study. The use of STM could augment bibliometric analysis through discovery of the research themes and the “hidden topics” [16, 17]. In doing so, STM has an advantage over traditional keyword analysis which are usually dominated by most frequent keywords undermining several important themes within the corpus under study. STM has been used across several studies to reveal predominant research themes, e.g., [20,21,22].
Few bibliometrics studies have tried to cover research about the pandemic, e.g., [21, 22]. Yet, such studies have focused mostly on online education, used a limited dataset or lacked a nuanced qualitative analysis that synthesizes the results beyond the metrics and indicators, e.g., [23]. Our study aims to bridge such gaps. The research questions of this study are:
-
RQ1: What is the status of research about COVID-19 regarding frequencies, dissemination venues, and publishing countries?
-
RQ2: What are the main topics of research in the COVID-19 research and how such topics were discussed?
-
RQ3: What are the major themes in most cited articles and how such themes have informed the educational community about living with the pandemic?
The rest of the paper is structured as follows: the following section presents the methods employed in the study, followed by a section devoted to detailed description of the obtained results regarding each research question with extensive discussion. Finally, conclusions and remarks are presented in the last section.
2 Methods
The search was performed on Scopus database since it has a robust well-curated collection of articles that included almost all of Web of Science with a broader coverage for social science topics relevant to our study [24]. The search keywords were chosen to capture all variations of the Pandemic keyword as well as the education and teaching to reflect the context and therefore we choose the following keywords:
-
(covid OR covid19 OR covid-19 OR CORONA VIRUS OR “SARS-CoV-2") in the title and keywords of all articles and (“Education*” OR “Teach*”) in title, keywords, and abstracts of all articles.
The search for the pandemic keywords involved only titles, keywords, and Scopus categorized keywords. Several iterations of search with different keywords were assessed, in which a sample of articles were assessed for relevance and accuracy. The final search was decided with consensus among researchers that the keywords bring most relevant results and avoids adding “noise.” A decision was made to exclude abstracts from the search for the pandemic keywords since initial searches with abstracts included a large number of irrelevant articles, and thereupon we decided to include articles which authors explicitly stated COVID-19 (or variations of the keyword) relevance through expressing it in the title or the keywords. On the other hand, the education and teaching keywords were searched in article abstracts, keywords, and titles. The keyword learning was also excluded since it brought lots of irrelevant articles, such as articles related to machine learning. The search was performed on 15th of February 2022 and the meta-data was retrieved, processed, and prepared for analysis.
To answer RQ1: Bibliometric analysis was performed using Bibliometrix package [25], which is an open source R package that provides a toolset for analysis of bibliographic meta-data. Frequencies of citations, article statistics and top articles were computed and plotted using R statistical language with the help of Bibliometrix.
To answer RQ2: We used structural topic modeling (STM). STM has gained an increasing role as a valuable tool for studying textual data across social sciences [16, 17]. Using STM, researchers are able to “mine” latent (often referred to as hidden) topics automatically from the large corpora of text using “unsupervised methods” [18]. That is, topics are inferred from the text without a priori assignment or manual coding of the data into predefined categories (“supervised methods”) [15, 18]. The inferred topics represent themes within the dataset that have semantic associations. Two types of models exist, single membership models where each document belongs to a single topic and mixed membership where a document represents a mixture of topics which is used in our study. The use of STM could augment bibliometric analysis through discovery of the research themes and the “hidden topics” [16, 17]. In doing so, STM has an advantage over traditional keyword analysis which are usually dominated by most frequent keywords undermining several important themes within the corpus under study. STM has been used across several studies to reveal predominant research themes, e.g., for the analysis of education technology topics [18].
To identify the main themes of research through structural topic modeling we used R package stm which provides methods for probabilistic topic models, STM in our case. A topic is defined as a mixture of words where each word belongs to a topic with a certain probability. A document could have a mixture of topics, i.e., several topics could describe a single document with a certain probability. The stm package implements Latent Dirichlet Allocation (LDA) and uses a variational Expectation–Maximization algorithm to estimate the models and their parameters. The topics were modeled using the article's meta-data (title, abstract, keywords) as input [19]. The abstract and title were cleaned from stop words. Since different keywords may represent the same meaning and could result in erroneous results, we performed an exhaustive cleaning process where we combined similar keywords together using Google Openrefine [12, 26]. For instance, Learning Management system, LMS and learning management systems were combined together. The cleaning also removed keywords that are used to indicate COVID-19 (e.g., covid, covid19, covid-19 pandemic, Corona Virus) since they were among our search keywords. The estimation of the topic modeling was performed after the cleaning step.
An essential step of topic modeling is in choosing the number of topics. However, there is no optimum way to identify such numbers [27, 28]. Several methods exist to assist in this process, the most recommended of which are semantic coherence, exclusivity, and human judgment, which we applied in our study [15]. Semantic coherence is a criterion that is maximized when the most probable words co-occur together and correlates with human judgment. Nevertheless, as noticed by [19], semantic coherence is often dominated by frequent and common keywords, e.g., education and students in our case. Therefore, a measure for the specificity and uniqueness of the keyword was conceptualized to better separate different topics. Exclusivity, as the name suggests, reflects how exclusive the word is in a given topic [29]. Semantic coherence and exclusivity, while offering valuable guidance they “offer no particular statistical guarantees and should not be seen as estimating the “true” number of topics” [19], or as a substitute for careful examination, validation and extensive evaluation by human judgment [27]. Therefore, we followed the guidelines by augmenting the statistical parameters with consensus from experts about the most appropriate number of topics.
We estimated 40 models, the smallest of which had five topics and the largest had 45 topics. The semantic coherence and exclusivity were plotted and examined; ten topics had favorable yet close values. The topics were then examined by four experts who had to rank the best number of topics based on the following criteria [15]:
-
1.
the meaningfulness of the topic keywords forming a single theme.
-
2.
no significant overlap with other topics
-
3.
no significant dissonance of the representative words.
Each of the experts judged these criteria and the top three topics were examined, discussed and a consensus was reached among the experts that the number of topics that brings unified themes together, with least overlap and dissonance was sixteen topics.
To answer RQ3: The top 70 articles were retrieved according to the number of citations. While our intention was to report on all the 70 articles, we found that some of these articles were very short (less than a full page or just an extended abstract) and had no methods or results sections. Therefore, a quality assessment was performed so that very short articles (single page articles), articles without methods or results section, or articles with very small sample size (e.g., n = 3) were flagged. The quality criteria were agreed by the three researchers and applied to each of the analyzed papers, when a paper was flagged as a candidate to be excluded by one of the researchers the rest of the authors checked it also in order to make the proper decision and reach a census to exclude the paper. A total of 16 articles were rejected based on a consensus of the three authors and meeting the exclusion criteria. The remaining articles were qualitatively coded according to the themes representing the content of these articles by three researchers. The themes were developed using an inductive or grounded theory approach, i.e., developing the themes directly from the articles [28]. Three authors met and coded the articles and reached an agreement after several iterations on the following themes as representative of the main themes in the topics: challenges, guidance, impact, problem understanding, online migration, and tools and resources. In addition, during this classification the target group that the articles were dealing with was also considered, i.e., teachers, students.
3 Results and discussion
3.1 RQ1: The status of research about COVID-19
The dataset included 4,201 articles, most of which were published in 2021. Three articles were published in 2019, 958 (23%) were published in 2020 and 2,861 were published in 2021. Most of the articles were journal articles 3,310 (78%) with a comparatively low number of conference articles 329 (8%). A total of 12,998 authors contributed to those articles and the majority of them appeared only a single time (93%). Most of the articles in our dataset were collaborative with an average of three authors per document. The USA was on the top of our list of most productive countries in terms of number of articles (21), followed by the United Kingdom with around 7, India 5, Spain, China, and Australia with around 4 of the articles (Fig. 1). Yet, the total citations did not mirror the list of top productive countries completely, where we see Spain, Canada in higher positions Table 1.
3.2 Publication venues
The dataset contained 1,098 different unique publication venues, i.e., different journals and conferences. Some 553 (49%) of the venues published only a single article about COVID, 196 (18%) published two articles and 104 (9%) published three articles. This diversity in publication venues may reflect the emergent situation where no journals or publications venues were devoted or specialized in such an unprecedented situation. The top publishers in the dataset were open access publishers, some of them have short publication processes [29], and so were the journals that were on the top of our list. Sustainability and Education Sciences from MDPI (Multidisciplinary Digital Publishing Institute) were the top journals publishing around 7% of all articles and had around 10% of all citations. Frontiers in Education published around 2 of all articles and had only 1% of all citations. The rest of the list were dominated by medical education journals, e.g., BMC Medical Education, Medical Science Educator, Journal of Dental Education, Academic Medicine. JMIR Medical Education, Advances in Medical Education and Practice and Journal of Surgical Education. The high representation of medical education journals may reflect the fact that medical education involved significant practical work that required students to be in hospitals where the dangers are paramount [6, 30]. Table 2 presents the full list of the top journals that published the papers that were considered in this analysis.
3.3 RQ2: The main topics of research in the COVID-19 research
A total of 16 topics were identified by the STM, each topic was labeled according to the most probable keywords and the theme representing the topic. The resulting topics were grouped into three main groups of topics: education related, distance/online education and diverse issues. The topics are summarized in detail with the most frequent words in Table 3, Fig. 2. Below is a concise overview with the representative keywords from each topic.
Several topics were general, or education related, and these include University, Higher education, Education, Higher education institutions. These topics addressed the broader context of pandemic and education, the role for higher educational institutions, understanding the “new normal” while also thinking of possibilities for a future pandemic or biological hazards and their impact. Several issues were discussed, e.g., internet and infrastructure weaknesses, coping with difficulties, academic career stability, university's financial stability, the complexity of some applied disciplines, student's mental health, costs of fast transformation, and tackling the financial challenges [31, 32].
Distance/online education were among our most discussed topics in the reviewed literature. School closure was discussed mainly in the context of the effects of the pandemic on learning and teaching [34,35,35]. Researchers have highlighted the key role of digital teacher competence in transitioning to online teaching [33] and delivering remote education as a crisis-response [36]. The crisis situation required an emergency response for immediate execution [39]. Please see the results of RQ3 for a more elaborate coverage of online education, guidelines for tackling the pandemic including tools and recommendations.
Several diverse issues have emerged as a reaction to the pandemic. It was obvious that the impact of the pandemic has been unevenly distributed where students with special needs, either physical or psychological needs, were hit the hardest [37, 38], therefore, Inclusion and equality have been a concern. Many institutions encountered online teaching/learning for the first time where technical infrastructure, quality of the network, computer availability and teachers' competences had a significant role in the successful transition from offline to digital mediums [41]. While digital infrastructure played a vital role in facilitating the transition in developed countries, students and teachers from undeveloped, remote, and rural areas had problems with poor Internet connectivity, network speed or even a lack of electricity [40,41,41]. Such challenges resulted in a more pronounced impact, lack of equality and inclusion [37, 42].
Students’ perception of school closures and the large-scale introduction of online learning, in general, was initially positive [43]. However, research revealed that most students had learning barriers as a consequence of the pandemic, despite the introduced transition instructional techniques [44]. Students’ perceptions have also revealed that a mismatch could happen between students’ expectations and teachers' managing online learning [45].
As distance learning prevailed during the times of rising infection rates, students’ engagement and motivation was an issue. Studying from home required greater self-discipline to follow through with online lessons. On the other hand, lecturers’ unfamiliarity with the new mode of delivery sometimes burdened their students with study materials and assignments. The lack of social interactions, lockdown and restricted physical activities were not easy for the young generations [46]. Such a heavy psychological toll has prompted several scholars to investigate issues of students' well-being and mental health during the pandemic. Research has shown that most students were under mental and psychological stress [47]. Several articles have investigated the factors that help students handle the unusual situation [48], or how to offer mental and psychological support to students during the pandemic [49]. Such mental support was investigated across all stakeholders, e.g., students, teachers and families [49]. The online transformation of education helped forge a stronger connection between teachers and parents than ever before [50].
Medical education (including dental and nursing education) was among the most discussed topics, and medical education journals dominated the list of our top venues. Several articles discussed the dilemma of the need to train future healthcare professionals in hospitals (where the risk of infection is high) while still protecting the students, teachers and patients [6, 30]. The issue was discussed widely across the world, e.g., in the United Kingdom [51], in China [52] and in the USA. Other articles discussed medical students’ contributions to the delivery of care where healthcare services were restrained [53].
3.4 RQ3: Top cited papers
From the top 70 most cited papers, only 54 passed our quality check and were classified according to 6 different themes: challenges, guidance, impact, problem understanding, online migration, and tools and resources. The category problem understanding had 26 contributions, which was the highest number of all other themes. Challenges and impact had 16 contributions each, while guidance, online migration and tools and resources had 14, 13, and 10 contributions, respectively. Table 4 presents most common findings in the analyzed most cited papers for each category.
The research carried out covers several issues that are related among them. The first one, “problem understanding” was present in most of the evaluated research. The problems were addressed from a local perspective [41, 56, 63, 67, 90], to a global point of view [5], passing through regional or local approaches [31, 33, 47, 49, 54, 55, 58,59,59, 61, 65,66,66, 68]. They deal with the stakeholders perspectives [5, 31, 41, 47, 52, 54, 56, 58, 59, 61, 68] and other deals with varied topics related to the context or the conditions in which the activity is carried out [5, 47, 49, 53, 61,62,63,64,65,66,66, 90, 91] or the methodologies or solutions employed [52, 55, 58, 63, 67, 68, 86].
Regarding the explored “challenges”, there were great variations. We can summarize them as how COVID-19 requires changes in educational processes [4, 6, 42, 48, 61, 64, 68, 72,73,73, 75] and how prepared for this are students, teachers, and other stakeholders [4,5,6, 34, 42, 48, 63, 70,71,71, 74]. All the stakeholders are required to develop computer skills [63] and need the infrastructure [42, 61, 64, 75] to conduct the teaching and learning in an online way.
The COVID-19 “impacts” were considered at several levels. In the compatibility between the academic and personal life [5, 47, 54, 60, 69, 70], in how teaching is carried out [41, 47, 49, 70, 76] and the associated workload [32, 62], in the transformation of online education [62, 78, 79] and in how universities must adapt to the new context [5] and distance education [59].
Another important issue to be explored in this review is the “online migration.” This issue depends on the context as described above. Some discuss the interventions carried out [42, 55, 58, 74, 92] while others focused more on the implications of this change [4, 34, 56, 61, 63, 78, 81].
Regarding the “guidance” proposed in several cases, some of the guidance was related to teaching materials and methodologies [53, 68, 81, 82], the interaction with students and parents [3, 32, 52, 53, 68, 71, 72, 75, 82,83,83], ways to provide practical training [3, 68, 79, 82], assessments [32, 79, 83], ways of dealing with the stress [84] and institutional support development [77, 85].
Finally, when exploring the tools and resources used during COVID-19, it is important to take into account that they can depend on the context. For instance, in medical training it could be necessary to take into account how to maintain patient contact, contact with medical experts, develop peer-mentoring techniques, etc. [71, 72]. But in general contexts, the most relevant tools and resources are related to interaction strategies with students [74, 78, 89], the type of resources used during the classes [75], assessment tools [77, 84], and educational platforms [76, 88].
4 Reflections and conclusions
We conducted this study with the aim of offering an overarching synthesis of COVID-19 research from the pandemic onslaught till now. A mixed methods approach was used, where we combined quantitative analysis of research productivity with pandemic statistics, structural topic modeling and qualitative synthesis of papers with most attention from the educational community. There are several key findings that warrant reflections.
The analysis has shown that the process of knowledge production about COVID-19 was less skewed compared to educational research in general [12, 93], with a large global participation of 137 different countries in research productivity. Whereas, research was concentrated in large and resourceful countries such as United States [35, 57, 67, 68], China [77], India [49], Germany [33], United Kingdom [51]; we also see several studies that addressed local and non-western contexts, e.g., Philippines [61], Rural South Africa [65], Jordan [63], Romania [56], Indonesia [66]. In fact, a global perspective [46, 64], with wide participation from different countries has helped in understanding the full breadth of impact of the pandemic [39, 41, 63]. In doing so, issues such as inequalities among different students’ subpopulations, as well as disparities in infrastructure and access to internet in, e.g., rural areas, received global attention and were prioritized [37, 42].
Several papers targeted teachers and teacher education [58, 61, 70], others have addressed students [49, 56, 63], yet, very few have researched the perspective of the families, despite that families were heavily involved in the process [50, 68]. Notable also that research was rather skewed toward some research fields, where medical [51, 63, 67, 68], engineering and mathematics education [45, 66, 92] received significant attention from researchers. A finding that could be explained by the idea that such disciplines may require practical face-to-face teaching which was an issue of concern during the pandemic [6, 30].
School closure, the consequences, and the alternative solutions occupied the public discourse as well as the research communities. Yet, schools have gone through several stages. Initially, many countries rushed to school closure which peaked around April 2020. About 1.3 billion students (81.8% of all enrolled) were instructed to stay home; a year later, where the pandemic was more rampant, school closure affected only 12.7% of students, reaching 2.7% as per the last recording in February 2022. Perhaps, the loss of learning time, the heavy toll on learners’ well-being as well as the remarkable burden vulnerable students had to endure [8, 48], has led to a policy where schools “were last to close and first to open” to avoid what the UNESCO called “a generational catastrophe.” Such a potential catastrophe would have resulted in stark inequalities of learning opportunities but also other aspects that school provides, e.g., school meals, physical activities and social interaction [37, 40,41,41]. Of course, such decisions were aided by prioritizing teacher vaccination, health measures and infection tracing [39, 47].
If anything the pandemic is known for, it is the “impact,” an issue that has been studied from all points of views and perspectives. Therefore, researchers intensively studied the impact of pandemic on workload [34], academic work and personal lives [5, 56], student satisfaction [4, 76], confidence [51], quality of teaching and learning [43, 51], and on vulnerable groups [5, 62]. The impact on mental health and well-being has been a central theme in the pandemic research [8, 47, 49]. Along with the impact, came a long list of articles of recommendations and guidance regarding how to mitigate the impact, or address the challenges. For instance, we saw discussion about technical infrastructure [33, 40], online learning initiatives [4, 80], and sustainable online learning [36].
The rush to move online was accompanied by an accelerating stream of articles about the pandemic [94]. Thoughtful, well-planned, and meaningful research was hard to conceptualize or implement, and a sense of urgency led to a deluge of research with thin contributions in a time of dire need to genuine insights [94,95,96]. Perhaps, as it has been argued by [94, 97], some may have found an opportune time to jump on the bandwagon of COVID-19 and the possibilities for research funding to capitalize on the need for research about the pandemic, a phenomenon that later became known as Covidization of research [94, 97].
We have used two methods for the analysis: STM and thematic analysis of the top cited papers. While STM is well-established for summarizing the general themes of a large textual dataset, such summarizing power should not be confused with retrieving the “true” content of the documents. As [27] points out, automated text analysis should not substitute careful and thoughtful text examination. Therefore, such methods are “best thought of as amplifying and augmenting careful reading and thoughtful analysis” [27]. Thereupon, a qualitative thematic analysis was performed, which revealed related but also varying themes. Of those themes, some may be hard to pick with a summarizing automatic text analysis, e.g., problem understanding, implications of the change and challenges. As such, we suggest that a careful qualitative analysis may be helpful to draw the full picture of text analysis.
Our article is not without limitations. Our search using keywords—which is the standard in all systematic reviews and bibliometrics—may have missed some articles that did not explicitly mention the pandemic keywords. Our results should not be viewed as encompassing all literature, but a large collection of articles based on systematic search. Using citations as measures of article impact is not ideal, yet it remains to be the most followed practice in the literature. To compensate for such shortcoming, we used structural topic modeling to gather all relevant topics and insights from the literature. One should not expect that synthesizing a few thousands of papers in a single article can be exhaustive, comprehensive, or complete. Nonetheless, our results should be viewed as a summary of the “important” take-home messages from these articles. Bibliometrics methods have known deficiencies such as over-reliance on metrics and skewed quantification of research which we tried to avoid in our article by combining several methods. The recency of the pandemic does not allow an accurate estimation of the impact of research or a temporal timeline and therefore, our estimation of such aspects remains to be verified in future research. Last, relying on a single database may have missed some articles that are not indexed in Scopus. Nevertheless, we had to choose one database to avoid erroneous mixing of citation counts between databases, and we selected Scopus since it has a wide coverage. Another limitation for our study is reliance on a database with poor selection of articles from the global south, a problem that all databases suffer from.
5 Conclusions
This work provides synthesis of COVID-19 research published by the educational community. A combination of quantitative analysis of research productivity with pandemic statistics, structural topic modeling and qualitative synthesis of papers with most attention from the educational community was used. A large volume of knowledge has been produced in education over the past couple of years that addressed various aspects of the pandemic, the majority of which had been published in open access journals, and few were in well-established publication outlets. From all papers that were taken into account, three main groups of topics were identified: (i) topics related to education in general, (ii) topics dealing with migration to online education, and (iii) diverse topics, e.g., perceptions, inclusion, medical education, engagement and motivation, well-being, and equality. A deeper analysis of the most cited papers revealed that problem understanding was the dominating theme of papers, followed by challenges, impact, guidance, online migration and tools and resources. While the conducted analysis may not be viewed as all encompassing, as some papers may have been missed by using one database, it does give an important synthesis of the findings in a large volume of knowledge as the insights were drawn from multiple perspectives and using different methods.
Data availability
The data in this manuscript are available with reasonable request given the licenser approval.
References
Saqr, M., Wasson, B.: COVID-19: lost opportunities and lessons for the future. Int. J. Health Sci. 14, 4–6 (2020)
Lemay, D.J., Bazelais, P., Doleck, T.: Transition to online learning during the COVID-19 pandemic. Comput. Hum. Behav. Rep. 4, 100130 (2021)
Daniel, S.J.: Education and the COVID-19 pandemic. Prospects 49, 91–96 (2020)
Watermeyer, R., Crick, T., Knight, C., Goodall, J.: COVID-19 and digital disruption in UK universities: afflictions and affordances of emergency online migration. High. Educ. 81, 623–641 (2021)
Aristovnik, A., Keržič, D., Ravšelj, D., Tomaževič, N., Umek, L.: Impacts of the COVID-19 pandemic on life of higher education students: a global perspective. Sustainability 12, 8438 (2020)
Iyer, P., Aziz, K., Ojcius, D.M.: Impact of COVID-19 on dental education in the United States. https://doi.org/10.1002/jdd.12163 (2020)
Onyema, E.M., Eucheria, N.C., Obafemi, F.A., Sen, S., Atonye, F.G., Sharma, A., Alsayed, A.O.: Impact of coronavirus pandemic on education. J. Educ. Pract. 11, 108–121 (2020)
Davis, C.R., Grooms, J., Ortega, A., Rubalcaba, J.A.-A., Vargas, E.: Distance learning and parental mental health during COVID-19. Educ. Res. 50, 61–64 (2021)
Izumi, T., Sukhwani, V., Surjan, A., Shaw, R.: Managing and responding to pandemics in higher educational institutions: initial learning from COVID-19. Int. J. Disaster Resilience Built. Environ. 12, 51–66 (2020)
Mishra, L., Gupta, T., Shree, A.: Online teaching-learning in higher education during lockdown period of COVID-19 pandemic. Int. J. Educ. Res. Open 1, 100012 (2020)
Saqr, M., Ng, K., Oyelere, S.S., Tedre, M.: People, ideas, milestones: a scientometric study of computational thinking. ACM Trans. Comput. Educ. 21, 1–17 (2021)
Valtonen, T., López-Pernas, S., Saqr, M., Vartiainen, H., Sointu, E.T., Tedre, M.: The nature and building blocks of educational technology research. Comput. Human Behav. 128, 107123 (2022)
van Raan, A.: Measuring science: basic principles and application of advanced bibliometrics. In: Glänzel, W., Moed, H.F., Schmoch, U., Thelwall, M. (eds.) Springer handbook of science and technology indicators, pp. 237–280. Springer International Publishing, Cham (2019)
Hicks, D., Wouters, P., Waltman, L., de Rijcke, S., Rafols, I.: Bibliometrics: the Leiden Manifesto for research metrics. Nature 520, 429–431 (2015)
Chen, X., Zou, D., Cheng, G., Xie, H.: Detecting latent topics and trends in educational technologies over four decades using structural topic modeling: a retrospective of all volumes of Computers & Education. Comput. Educ. 151, 103855 (2020)
Vayansky, I., Kumar, S.A.P.: A review of topic modeling methods. Inf. Syst. 94, 101582 (2020)
Roberts, M.E., Stewart, B.M., Tingley, D., Lucas, C., Leder-Luis, J., Gadarian, S.K., Albertson, B., Rand, D.G.: Structural topic models for open-ended survey responses. Am. J. Pol. Sci. 58, 1064–1082 (2014)
Roberts, M.E., Stewart, B.M., Airoldi, E.M.: A model of text for experimentation in the social sciences. J. Am. Stat. Assoc. 111, 988–1003 (2016)
Roberts, M.E., Stewart, B.M., Tingley, D.: STM: an R package for structural topic models. J. Stat. Softw. (2019). https://doi.org/10.18637/jss.v091.i02
Corell-Almuzara, A., López-Belmonte, J., Marín-Marín, J.-A., Moreno-Guerrero, A.-J.: COVID-19 in the field of education: state of the art. Sustainability. 13, 5452 (2021)
Karakose, T., Demirkol, M.: Exploring the emerging COVID-19 research trends and current status in the field of education: a bibliometric analysis and knowledge mapping. Educ. Proc. Int. J. (2021). https://doi.org/10.22521/edupij.2021.102.1
Zhang, L., Carter, R.A., Jr., Qian, X., Yang, S., Rujimora, J., Wen, S.: Academia’s responses to crisis: a bibliometric analysis of literature on online learning in higher education during COVID-19. Br. J. Educ. Technol. 53, 620–646 (2022)
Norris, M., Oppenheim, C.: Comparing alternatives to the Web of Science for coverage of the social sciences’ literature. J. Informet. 1, 161–169 (2007)
Aria, M., Cuccurullo, C.: bibliometrix: an R-tool for comprehensive science mapping analysis. J. Informetr. 11, 959–975 (2017)
R Core Team: R: A Language and Environment for Statistical Computing. https://www.r-project.org (2018)
López-Pernas, M., Saqr, M., Apiola, M.: Scientometrics: a concise introduction and a detailed methodology for the mapping of the scientific field of computing education. In: Apiola, M., López-Pernas, S., Saqr, M. (eds.) Past, Present and Future of Computing Education Research. Springer, Berlin (2022)
Grimmer, J., Stewart, B.M.: Text as data: the promise and pitfalls of automatic content analysis methods for political texts. Polit. Anal. 21, 267–297 (2013)
Skjott Linneberg, M., Korsgaard, S.: Coding qualitative data: a synthesis guiding the novice. Qual. Res. J. 19, 259–270 (2019)
Siler, K.: Demarcating spectrums of predatory publishing: Economic and institutional sources of academic legitimacy. J. Assoc. Inf. Sci. Technol. 71, 1386–1401 (2020)
Dewart, G., Corcoran, L., Thirsk, L., Petrovic, K.: Nursing education in a pandemic: academic challenges in response to COVID-19. Nurse Educ. Today. 92, 104471 (2020)
Al-Baadani, A.A., Abbas, M.: The impact of coronavirus (covid19) pandemic on higher education institutions (HEIs) in Yemen: challenges and recommendations for the future. Eur. J. Educ. Stud. 7, 1 (2020). https://doi.org/10.46827/ejes.v7i7.3152
Hayat, A.A., Keshavarzi, M.H., Zare, S., Bazrafcan, L., Rezaee, R., Faghihi, S.A., Amini, M., Kojuri, J.: Challenges and opportunities from the COVID-19 pandemic in medical education: a qualitative study. BMC Med. Educ. 21, 247 (2021)
König, J., Jäger-Biela, D.J., Glutsch, N.: Adapting to online teaching during COVID-19 school closure: teacher education and teacher competence effects among early career teachers in Germany. Eur. J. Teach. Educ. 43, 608–622 (2020)
Kaden, U.: COVID-19 School closure-related changes to the professional life of a K–12 teacher. Educ. Sci. 10, 165 (2020)
Lee, S.J., Ward, K.P., Chang, O.D., Downing, K.M.: Parenting activities and the transition to home-based education during the COVID-19 pandemic. Child Youth Serv. Rev. 122, 105585 (2021)
Adedoyin, O.B., Soykan, E.: Covid-19 pandemic and online learning: the challenges and opportunities. Interact. Learn. Environ. 1–13 (2020)
Page, A., Charteris, J., Anderson, J., Boyle, C.: Fostering school connectedness online for students with diverse learning needs: inclusive education in Australia during the COVID-19 pandemic. Eur. J. Spec. Needs Educ. (2021). https://doi.org/10.1080/08856257.2021.1872842
Czerniewicz, L., Agherdien, N., Badenhorst, J., Belluigi, D., Chambers, T., Chili, M., de Villiers, M., Felix, A., Gachago, D., Gokhale, C., Ivala, E., Kramm, N., Madiba, M., Mistri, G., Mgqwashu, E., Pallitt, N., Prinsloo, P., Solomon, K., Strydom, S., Swanepoel, M., Waghid, F., Wissing, G.: A wake-up call: equity, inequality and Covid-19 emergency remote teaching and learning. Postdigital Sci. Educ. (2020). https://doi.org/10.1007/s42438-020-00187-4
Owusu-Fordjour, C., Koomson, C.K., Hanson, D.: The impact of covid-19 on learning—the perspective of the Ghanaian student. Eur. J. Educ. Stud. (2020). https://doi.org/10.46827/ejes.v0i0.3000
Sahu, P.: Closure of universities due to coronavirus disease 2019 (COVID-19): impact on education and mental health of students and academic staff. Cureus. 12, e7541 (2020)
Kapasia, N., Paul, P., Roy, A., Saha, J., Zaveri, A., Mallick, R., Barman, B., Das, P., Chouhan, P.: Impact of lockdown on learning status of undergraduate and postgraduate students during COVID-19 pandemic in West Bengal. India. Child. Youth Serv. Rev. 116, 105194 (2020)
Corbera, E., Anguelovski, I., Honey-Rosés, J., Ruiz-Mallén, I.: Academia in the time of COVID-19: towards an ethics of care. Plan. Theory Pract. 21, 1 (2020). https://doi.org/10.1080/14649357.2020.1757891
Demuyakor, J.: Coronavirus (COVID-19) and online learning in higher institutions of education: a survey of the perceptions of Ghanaian international students in China. Online J. Commun. Media Technol. 10, e202018 (2020)
Gillis, A., Krull, L.M.: COVID-19 remote learning transition in spring 2020: class structures, student perceptions, and inequality in college courses. Teach. Sociol. 48, 283–299 (2020)
Syauqi, K., Munadi, S., Triyono, M.B.: Students’ perceptions toward vocational education on online learning during the COVID-19 pandemic. Int. J. Eval. Res. Educ. (IJERE). 9, 881–886 (2020)
Chiu, T.K.F.: Applying the self-determination theory (SDT) to explain student engagement in online learning during the COVID-19 pandemic. J. Res. Technol. Educ. 54, S14–S30 (2022)
Collins, C., Mahuron, K., Bongiovanni, T., Lancaster, E., Sosa, J.A., Wick, E.: Stress and the surgical resident in the COVID-19 pandemic. J. Surg. Educ. 78, 422–430 (2021)
Holzer, J., Lüftenegger, M., Korlat, S., Pelikan, E., Salmela-Aro, K., Spiel, C., Schober, B.: Higher education in times of COVID-19: University Students’ basic need satisfaction, self-regulated learning, and well-being. AERA Open (2021). https://doi.org/10.1177/23328584211003164
Chaturvedi, K., Vishwakarma, D.K., Singh, N.: COVID-19 and its impact on education, social life and mental health of students: a survey. Child. Youth Serv. Rev. 121, 105866 (2021)
Iivari, N., Sharma, S., Ventä-Olkkonen, L.: Digital transformation of everyday life—how COVID-19 pandemic transformed the basic education of the young generation and why information management research should care? Int. J. Inf. Manag. 55, 102183 (2020)
Choi, B., Jegatheeswaran, L., Minocha, A., Alhilani, M., Nakhoul, M., Mutengesa, E.: The impact of the COVID-19 pandemic on final year medical students in the United Kingdom: a national survey. BMC Med. Educ. 20, 206 (2020)
Yang, D.-Y., Cheng, S.-Y., Wang, S.-Z., Wang, J.-S., Kuang, M., Wang, T.-H., Xiao, H.-P.: Preparedness of medical education in China: lessons from the COVID-19 outbreak. Med. Teach. 42, 787–790 (2020)
Klasen, J.M., Vithyapathy, A., Zante, B., Burm, S.: “The storm has arrived”: the impact of SARS-CoV-2 on medical students. Perspect. Med. Educ. 9, 181–185 (2020)
Carrillo, C., Flores, M.A.: COVID-19 and teacher education: a literature review of online teaching and learning practices. Eur. J. Teach. Educ. 43, 466–487 (2020)
Kim, J.: Learning and teaching online during covid-19: experiences of student teachers in an early childhood education practicum. Int. J. Early Childhood 52, 145–158 (2020)
Coman, C., Țîru, L.G., Meseșan-Schmitz, L., Stanciu, C., Bularca, M.C.: Online teaching and learning in higher education during the coronavirus pandemic: students’ perspective. Sustainability 12, 10367 (2020)
Johnson, N., Veletsianos, G., Seaman, J.: US faculty and administrators’ experiences and approaches in the early weeks of the COVID-19 pandemic. Online Learn. 24, 6–21 (2020)
Cutri, R.M., Mena, J., Whiting, E.F.: Faculty readiness for online crisis teaching: transitioning to online teaching during the COVID-19 pandemic. Eur. J. Teach. Educ. 43, 523–541 (2020)
García-Peñalvo, F.J., Corell, A., Abella-García, V., Grande-de-Prado, M.: Recommendations for mandatory online assessment in higher education during the COVID-19 pandemic. In: Burgos, D., Tlili, A., Tabacco, A. (eds.) Radical solutions for education in a crisis context: COVID-19 as an opportunity for global learning, pp. 85–98. Springer Singapore, Singapore (2021)
Scull, J., Phillips, M., Sharma, U., Garnier, K.: Innovations in teacher education at the time of COVID19: an Australian perspective. J. Educ. Teach. 46, 497–506 (2020)
Alea, L.A., Fabrea, M.F., Roldan, R.D.A., Farooqi, A.Z.: Teachers’ Covid-19 Awareness, distance learning education experiences and perceptions towards institutional readiness and challenges. Int. J. Learn. Teach. Educ. Res. 19, 127–144 (2020)
Al Lily, A.E., Ismail, A.F., Abunasser, F.M., Alhajhoj Alqahtani, R.H.: Distance education as a response to pandemics: Coronavirus and Arab culture. Technol. Soc. 63, 101317 (2020)
Al-Balas, M., Al-Balas, H.I., Jaber, H.M., Obeidat, K., Al-Balas, H., Aborajooh, E.A., Al-Taher, R., Al-Balas, B.: Distance learning in clinical medical education amid COVID-19 pandemic in Jordan: current situation, challenges, and perspectives. BMC Med. Educ. 20, 341 (2020)
Dwivedi, Y.K., Hughes, D.L., Coombs, C., Constantiou, I., Duan, Y., Edwards, J.S., Gupta, B., Lal, B., Misra, S., Prashant, P., Raman, R., Rana, N.P., Sharma, S.K., Upadhyay, N.: Impact of COVID-19 pandemic on information management research and practice: transforming education, work and life. Int. J. Inf. Manag. 55, 102211 (2020)
Dube, B.: Rural online learning in the context of COVID 19 in South Africa: evoking an inclusive education approach. REMIE Multidiscipl. J. Educ. Res. 10, 135–157 (2020)
Mailizar, A., Abdulsalam, M., Suci, B. (2020) Secondary school mathematics teachers’ views on e-learning implementation barriers during the COVID-19 pandemic: the case of Indonesia. Eurasia J. Math. Sci. Technol. Educ. 1–9
Byrnes, Y.M., Civantos, A.M., Go, B.C., McWilliams, T.L., Rajasekaran, K.: Effect of the COVID-19 pandemic on medical student career perceptions: a national survey study. Med Educ Online 25, 1798088 (2020)
Aziz, H., James, T., Remulla, D., Sher, L., Genyk, Y., Sullivan, M.E., Sheikh, M.R.: Effect of COVID-19 on surgical training across the United States: a national survey of general surgery residents. J Surg Educ 78, 431–439 (2021)
Tang, T., Abuhmaid, A.M., Olaimat, M., Oudat, D.M., Aldhaeebi, M., Bamanger, E.: Efficiency of flipped classroom with online-based teaching under COVID-19. Interact. Learn. Environ. 1–12 (2020)
Assunção Flores, M., Gago, M.: Teacher education in times of COVID-19 pandemic in Portugal: national, institutional and pedagogical responses. J. Educ. Teach. 46, 507–516 (2020)
Sangster, A., Stoner, G., Flood, B.: Insights into accounting education in a COVID-19 world. Acc. Educ. 29, 431–562 (2020)
Rahiem, M.D.H.: The emergency remote learning experience of university students in Indonesia amidst the COVID-19 crisis. Int. J. Learn. Teach. Educ. Res. 19, 1–26 (2020)
Chick, R.C., Clifton, G.T., Peace, K.M., Propper, B.W., Hale, D.F., Alseidi, A.A., Vreeland, T.J.: Using technology to maintain the education of residents during the COVID-19 pandemic. J. Surg. Educ. 77, 729–732 (2020)
Wilcha, R.-J.: Effectiveness of virtual medical teaching during the COVID-19 crisis: systematic review. JMIR Med Educ. 6, e20963 (2020)
Azorín, C.: Beyond COVID-19 supernova. Is another education coming? J. Prof. Cap. Commun. 5, 381–390 (2020)
Moorhouse, B.L.: Adaptations to a face-to-face initial teacher education course ‘forced’ online due to the COVID-19 pandemic. J. Educ. Teach. 46, 609–611 (2020)
Huang, R., Tlili, A., Chang, T.-W., Zhang, X., Nascimbeni, F., Burgos, D.: Disrupted classes, undisrupted learning during COVID-19 outbreak in China: application of open educational practices and resources. Smart Learn. Environ. 7, 19 (2020)
Chen, T., Peng, L., Jing, B., Wu, C., Yang, J., Cong, G.: The impact of the COVID-19 pandemic on user experience with online education platforms in China. Sustainability 12, 7329 (2020)
Shahzad, A., Hassan, R., Aremu, A.Y., Hussain, A., Lodhi, R.N.: Effects of COVID-19 in E-learning on higher education institution students: the group comparison between male and female. Qual. Quant. 55, 805–826 (2021)
Mhlanga, D., Moloi, T.: COVID-19 and the digital transformation of education: what are we learning on 4IR in South Africa? Educ. Sci. 10, 180 (2020)
Gordon, M., Patricio, M., Horne, L., Muston, A., Alston, S.R., Pammi, M., Thammasitboon, S., Park, S., Pawlikowska, T., Rees, E.L., Doyle, A.J., Daniel, M.: Developments in medical education in response to the COVID-19 pandemic: a rapid BEME systematic review: BEME Guide No. 63. Med. Teach. 42, 1202–1215 (2020)
Mok, K.H., Xiong, W., Ke, G., Cheung, J.O.W.: Impact of COVID-19 pandemic on international higher education and student mobility: student perspectives from mainland China and Hong Kong. Int. J. Educ. Res. 105, 101718 (2021)
Rapanta, C., Botturi, L., Goodyear, P., Guàrdia, L., Koole, M.: Online university teaching during and after the Covid-19 crisis: refocusing teacher presence and learning activity. Postdigital Sci. Educ. 2, 923–945 (2020)
Hall, A.K., Nousiainen, M.T., Campisi, P., Dagnone, J.D., Frank, J.R., Kroeker, K.I., Brzezina, S., Purdy, E., Oswald, A.: Training disrupted: practical tips for supporting competency-based medical education during the COVID-19 pandemic. Med. Teach. 42, 756–761 (2020)
Mahmood, S.: Instructional strategies for online teaching in COVID-19 pandemic. Human Behav. Emerg. Technol. 3, 199–203 (2021)
MacIntyre, P.D., Gregersen, T., Mercer, S.: Language teachers’ coping strategies during the Covid-19 conversion to online teaching: correlations with stress, wellbeing and negative emotions. System 94, 102352 (2020)
Ashokka, B., Ong, S.Y., Tay, K.H., Loh, N.H.W., Gee, C.F., Samarasekera, D.D.: Coordinated responses of academic medical centres to pandemics: Sustaining medical education during COVID-19. Med. Teach. 42, 762–771 (2020)
Teräs, M., Suoranta, J., Teräs, H., Curcher, M.: Post-Covid-19 education and education technology ‘solutionism’: a Seller’s market. Postdigital Sci. Educ. 2, 863–878 (2020)
Murphy, M.P.A.: COVID-19 and emergency eLearning: consequences of the securitization of higher education for post-pandemic pedagogy. Contemp. Secur. Policy. 41, 492–505 (2020)
Raza, S.A., Qazi, W., Khan, K.A., Salam, J.: Social Isolation and Acceptance of the Learning Management System (LMS) in the time of COVID-19 pandemic: an expansion of the UTAUT model. J. Educ. Comput. Res. 59, 183–208 (2021)
Sobaih, A.E.E., Hasanein, A.M., Abu Elnasr, A.E.: Responses to COVID-19 in higher education: social media usage for sustaining formal academic communication in developing countries. Sustainability 12, 6520 (2020)
Mulenga, E.M., Marbán, J.M.: Is COVID-19 the gateway for digital learning in mathematics education? Contemp. Educ. Technol. 12, ep269 (2020)
Saqr, M., Poquet, O., Lopez-Pernas, S.: Networks in education: a travelogue through five decades. IEEE Access. 1–1 (2022)
Pai, M.: Covidization of research: what are the risks? Nat. Med. 26, 1159 (2020)
Khatter, A., Naughton, M., Dambha-Miller, H., Redmond, P.: Is rapid scientific publication also high quality? Bibliometric analysis of highly disseminated COVID-19 research papers. Learn. Publ. 34, 568–577 (2021)
Dinis-Oliveira, R.J.: COVID-19 research: pandemic versus “paperdemic”, integrity, values and risks of the “speed science.” Forensic Sci. Res. 5, 174–187 (2020)
Ioannidis, J.P.A., Bendavid, E., Salholz-Hillel, M., Boyack, K.W., Baas, J.: Massive covidization of research citations and the citation elite. Proc. Natl. Acad. Sci. USA 119, e2204074119 (2022)
Funding
Open access funding provided by University of Eastern Finland (UEF) including Kuopio University Hospital. Research presented in this paper is supported by the project “Improving online and blended learning with educational data analytics” ILEDA—2021–1-BG01-KA220-HED-000031121, financially supported by the European Commission. The paper is co-funded by the Academy of Finland for the project TOPEILA, Decision Number 350560 which was received by the first author.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors have nothing to declare.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Saqr, M., Raspopovic Milic, M., Pancheva, K. et al. A multimethod synthesis of Covid-19 education research: the tightrope between covidization and meaningfulness. Univ Access Inf Soc (2023). https://doi.org/10.1007/s10209-023-00989-w
Accepted:
Published:
DOI: https://doi.org/10.1007/s10209-023-00989-w