Abstract
The Learning Management Systems (LMS) have garnered attention in Higher Education due to their significant potential as a robust learning tool; however, their mere existence does not guarantee adoption and acceptance. The objective of this study was to analyze quantitative research on the intention and usage of LMS among university professors. The method employed was a systematic review following PRISMA guidelines. Databases such as Scopus, WOS, EBSCOhost, and SciElo were explored from 2013 to 2023. The results indicated that (a) the most frequent objective was to determine factors influencing LMS usage, (b) the average number of participants was 239, (c) the highest productivity (61%) was observed in Asia, (d) the most common limitation about the sample, (e) the most frequently used theoretical model (69%) was the Technology Acceptance Model, (f) the models also included other variables grouped into personal, technological, social, and institutional factors; (g) The predictive power of the models on LMS usage intention was moderate, while for current LMS usage, it ranged from small to moderate; (h) measurements were self-reported; (i) ultimately, the majority measured only the intention of LMS usage (54%), 15% measured only the current usage of LMS, and 31% measured both. In conclusion, limitations, future research directions, and recommendations for the integration and consolidation of LMS usage by faculty are presented.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
Introduction
The education landscape in the 21st century unfolds within a social context permeated by digital technologies, specifically those so-called “technologies of the fourth industrial revolution”, among which artificial intelligence, the internet of things, 3D printing, or educational robotics stand out (Ahmad et al., 2022). The pervasive influence of these technologies on daily lives is undeniable, and nowhere is this more needed to deepen and understand them properly than in the realm of education, under the careful considerations of what is commonly referred to as “Education 4.0” (Ciolacu et al., 2021).
As mentioned by Verma and Singh (2021), the profound changes brought about by these technologies necessitate a deeper exploration and a keen understanding to ensure that they are effectively integrated to enhance teaching and learning experiences. By doing so, educators and learners can be empowered to navigate the digital age with confidence and competence, ultimately shaping a brighter future for education in the 21st century. Regarding the above, the integration of technology into education has evolved beyond being a mere trend; it has become an imperative, underscored by the urgency revealed in recent global events. The seismic impact of the global pandemic and other societal phenomena, which have significantly curtailed in-person interactions, has made this need abundantly clear (Fidalgo-Blanco et al., 2022; Latinovic & Sikman, 2023). In the wake of these unprecedented challenges, educators and educational institutions have faced the daunting task of swiftly adapting to digital tools. This transformation, driven by the necessity for social distancing and the transition to remote learning, has unfolded against a backdrop of both opportunities and challenges.
According to Bizami et al. (2023), the opportunities are evident in the newfound flexibility and accessibility that digital tools provide, allowing education to persist even in the face of physical constraints. However, these opportunities are accompanied by a host of challenges, including issues related to digital equity, the necessity for effective online pedagogies, and the significance of maintaining the quality of education in virtual environments (Shenkoya & Kim, 2023). As educators navigate this digital frontier, it becomes increasingly vital for them not only to seize the opportunities presented by technology but also to address the associated challenges with innovation and resilience. By doing so, they can continue to provide high-quality education while preparing learners for the dynamic and technology-driven landscape of the future.
In the context of education, the effective incorporation of technology is a multifaceted challenge that extends beyond the mere introduction of digital tools into classrooms (Huk, 2021). It involves navigating a complex web of interconnected factors, each influencing the other in a delicate articulation of pedagogy, technology, institutional culture, teacher training, and individual preferences (Chituc, 2022). As mentioned by Dymek (2023), pedagogically, technology should not be treated as an add-on but as an enabler of enriched learning experiences. It demands a thoughtful consideration of instructional design, the alignment of technology with educational goals, and the creation of engaging digital learning environments.
In relation to the previous points, it’s important to highlight that educators need digital literacy skills to effectively utilize technological tools. Simultaneously, institutions should invest in robust infrastructure and support mechanisms (Ramírez-Montoya et al., 2021). The institutional culture plays a crucial role in shaping technology adoption, with policies and attitudes toward innovation impacting the overall digital learning environment. Additionally, accommodating the diverse preferences and needs of both educators and students is essential for ensuring equitable access and a seamless user experience (Sangole et al., 2022). To further elaborate on the previous statements, achieving successful educational integration of technologies, as emphasized by Kommers (2000), necessitates a harmonious alignment of human, institutional, and technological elements. Instructors must possess the necessary digital literacy skills, and students may have varying levels of digital competence and access to technology, impacting their engagement with digital learning resources (Schmid & Petko, 2019). Furthermore, institutional culture and policies play a pivotal role in shaping the adoption and use of technology in education. They influence decisions related to infrastructure, training, support, and the overall digital learning environment (Blashki & Isaias, 2014; Hrytsenchuk & Trubachev, 2021). Consequently, the commitment of educational institutions to invest in technology and promote a culture of innovation can significantly impact the success of technology integration.
In the context of higher education, Chaka (2022) and Asad and Malik (2023) point out that the technologies employed to support teaching and learning must be carefully selected and implemented with a keen eye on their pedagogical suitability and their potential to enhance the overall learning experience. Also, in this context, the digital-promoted transformation has brought about profound changes in the way instructors and students interact with course materials, engage in collaborative activities, and assess learning outcomes. So, traditional classroom settings have been complemented, and in some cases supplanted, by virtual learning environments where technology plays a central role (Ayub et al., 2019).
Within the realm of educational technology, there exists a vast array of tools and resources that professors can use to enhance their teaching and engage students. These tools encompass a broad spectrum, ranging from simple web-based applications to sophisticated learning management systems (Díaz et al., 2020). As an example, they may choose to integrate video conferencing platforms or virtual reality applications into their teaching, or they may leverage social media platforms, online discussion forums, or content creation tools to enrich the learning experience (Cherrstrom et al., 2019). The selection of these tools is often influenced by the specific learning objectives, the nature of the subject matter, and the preferences of both teachers and students.
Within the diverse spectrum, Learning Management Systems (LMS) have emerged as one of the most extensively utilized resources in higher education. This is owing to their functionalities, which enable the provision of a virtual environment facilitating interaction, sharing, and monitoring of academic progress among educators and students (Zhao, 2018). Additionally, they contribute the greater promise of flexibility and accessibility, making them particularly valuable in a world where remote and blended learning has become more and more frequent in the educational environment at all levels (Bervell et al., 2020). Moreover, these platforms have become integral to the educational landscape, providing a centralized and digitally accessible space for course materials, communication, and assessment (Mohd et al., 2021).
Given the central role of LMS platforms in higher education, it is not surprising that they have garnered significant attention from researchers. Numerous studies have explored various aspects of LMS usage, including adoption rates, pedagogical practices, student engagement, and the impact on learning outcomes. Research on LMS platforms in higher education began in the late 90s and has steadily grown throughout the new century. While the number of articles produced per year may not be notably significant, research in this area has remained ongoing (Fig. 1).
From a practical standpoint, research has shed light on the challenges teachers encounter when using LMS platforms, encompassing technical difficulties, time constraints, and concerns about the pedagogical effectiveness of online tools (Lazarinis et al., 2011). Additionally, studies like Pardamean et al. (2021) and Kuk et al. (2016), have examined the strategies employed by instructors to overcome these challenges and enhance their use of LMS platforms.
Furthermore, research has explored the perspectives of students regarding the use of LMS platforms, student satisfaction, engagement, and perceptions of the impact of LMS usage on their learning experiences. According to Kats (2013), despite the increasing adoption of LMS platforms in higher education institutions, numerous challenges persist, mainly related to their use by both educators and students. To attain a comprehensive understanding of these challenges and to identify suitable solutions, it is crucial to delve into the theoretical models that underlie the use of these platforms by higher education teachers (AL-Nuaimi et al., 2022; Malanga et al., 2022).
Regarding the above, Zareravasan and Ashrafi (2019) mention that the successful integration of technology into higher education hinges on understanding and addressing diverse complexities, and this is where theoretical models come into play. In this sense, theoretical models provide a structured framework for comprehending the multifaceted interactions among pedagogy, technology, culture, and individuals in the context of education (Jiang et al., 2022). Moreover, these models offer a lens through which one can analyze and interpret the adoption and use of technology in higher education. They help in identifying the factors that influence instructors’ decisions to use LMS platforms, the challenges they encounter, and the strategies they employ to overcome these challenges (Nilo & Pinto, 2022).
Furthermore, the application of theoretical models allows for a systematic examination of the factors contributing to the effective integration of LMS platforms in higher education. By identifying and analyzing these models, insights into the underlying dynamics of technology adoption and utilization among university instructors can be gained (Ashrafi et al., 2022).
Considering all the aforementioned factors, there arises a practical urgency for conducting this review. This urgency is based on the increasingly prominent role that LMS platforms play in higher education, alongside the persistent challenges faced by instructors, teachers, and institutions in effectively utilizing these platforms. As the digital transformation of education progresses unabated, gaining a deep understanding of the theoretical underpinnings that shape LMS adoption and utilization becomes imperative.
Method
The review has been conducted following the phases initially proposed by Kitchenham and Charters (2007), which have subsequently been reviewed and expanded by other experts in the field, such as Clear in 2015. Following their approach, these stages have been summarized and organized into three broad categories: the Review Planning stage, the Review Execution stage, and the Results Dissemination stage, which details can be observed in Fig. 2.
For the Review Execution stage, the method of Systematic Literature Review (hereafter referred to as SLR) was employed, following the guidelines and directives of PRISMA (Page et al., 2021).
Review Planning
In the initial phase of the research, the central purpose of the review was outlined, which focuses which revolves around identifying the factors influencing the use of Learning Management Systems (LMS) by university instructors. To achieve this objective, three fundamental guiding questions were proposed:
RQ1. What are the characteristics of studies on the intention or use of LMS by university professors concerning objectives, sample and limitations?
RQ2. What theoretical models are used by studies to explore the determinants of the use of LMS by university instructors?
RQ3. What specific factors are included in the empirical models for the intention or use of LMS?
RQ4. What type of instruments are used to measure the intention and use of LMS?
RQ5. What are the future lines of research suggested in the studies?
To address these questions, several keyword searching strings were proposed and applied in the most recognized academic databases such as WOS, Scopus, EBSCOhost, and SciElo.
To address the search for “use of LMS,” the following terms were used: “usability of Learning Management Systems” OR “adoption of learning management systems” OR “adoption of LMS” OR “usability of LMS” OR “acceptance of Learning management systems” OR “acceptance of LMS” OR “use learning management systems” OR “use LMS” OR “use a learning management system” OR “accepting learning management system” OR “LMS adoption” OR “LMS acceptance.” Furthermore, to address the search for “university instructors”, “higher education” OR “university” OR “universities” OR “post-secondary” OR “tertiary education” OR “university” OR “professor” OR “instructor” OR “teacher” was utilized. To ensure the relevance and adequacy of the selection of these keywords, 3 strategies were considered (a) algorithms of previous systematic reviews on this topic were reviewed; (b) synonyms of these words in Thesaurus were identified; and (c) a validation of the selected keywords was carried out by two experts in this line of research.
Review execution
Subsequently, filters accessible in the respective databases were implemented, refining the search and generating a syntax that facilitates the replicability of the entire study identification process (see Table 1). The research period covered studies from 2013 to 2023, with the final search conducted on September 18, 2023. All identified records were exported to the Rayyan Software ().
Also in this phase, using the Rayyan software, 21 duplicates were identified, meaning those records that were repeated in more than one database, were eliminated. Therefore, out of the original 113 records, after removing the 21 duplicates, 92 unique records remained. In the screening or eligibility process, a review of the titles and abstracts of the selected unique records was conducted to ensure they were directly related to the objectives of this SLR.
For this purpose, some keywords were considered to facilitate the decision to include (university professor, professor, empirical, quantitative, mixed design) or exclude the study (secondary school, theoretical review, narrative review, review, systematic review, meta-analysis, student, freshman, undergraduate student, qualitative research). For this procedure, the filter available in the Rayyan software utilized these words, detecting records containing the specified words. 66 records that contained at least one of the exclusion words were eliminated, resulting in 26 remaining records. Subsequently, the PDFs of the selected studies were downloaded to complete a full reading and apply exclusion criteria, which in this case are 3 (Reason (1) Qualitative studies; Reason (2) Descriptive and correlational quantitative designs; Reason (3) Sample differs from university professors). After completing this stage, 13 research studies were chosen (see Table 2).
Finally, to control and evaluate the review’s bias, an independent reviewer was included to validate the final sample of included studies.
Results dissemination
Once the list of included studies in this SLR was available, the systematic extraction of information from each study proceeded. To address the established objectives, a data extraction matrix was constructed with the following columns: (1) ID, (2) citation, (3) Aims, (4) Variable measuring intention and/or use, (5) Theoretical model, (6) Measurement of intention and/or use of LMS, (6) Empirical model variables, (6) Sample, (7) Participant variables, (8) Explained variance of behavioral Intention (BI), and (9) limitations.
Data examination occurred through two simultaneous and complementary procedures. The first involved data categorization based on their similarity or direct connection, with the application of the term normalization or standardization. The second process encompassed descriptive statistical analysis, including counts, frequency analysis, percentages, and graphical representations.
Results
Result of RQ1. Characteristics of the studies included in this systematic review regarding objectives, sample, and limitations
Results on the objectives of the analyzed studies
Regarding the stated objectives in the analyzed studies, the most frequently declared was to determine the factors influencing LMS usage (n = 8 studies). The next most declared objective was to expand the TAM model by adding determining factors in LMS usage (n = 2 studies). One study had a similar objective related to expanding the UTAUT model, another sought to determine how anxiety influences LMS usage, and finally, another study proposed a new perspective for LMS usage (professional identity) using the theoretical framework of change management (Meyer et al., 2007) (see Fig. 3).
Results on the characteristics of the participants included in the studies (sample size and world region)
Concerning the sample, the average was 239 teachers, with the smallest sample consisting of 70 teachers and the largest comprising 560 teachers. Regarding the continent where these studies were conducted, considering Turkey as part of Asia, this continent contributes to 61.5% of the studies. On the other hand, it is observed that in America, only the United States contributes to one study, and no studies were found in Latin America (see Table 3).
Result of the declared limitations in the studies
Regarding the limitations stated by the authors of the analyzed studies, 12 out of 13 studies specified limitations. The most reiterated limitation was the sample, mentioned in 10 studies. This limitation was associated, for example, with teachers being from only one university, the use of convenience sampling, or having a small sample. Another limitation was the omission of sociodemographic variables such as age, gender, experience, etc. (n = 6 studies). Moreover, none of the studies used moderating effects to assess the usage or intention to use the LMS. Other limitations included the use of a cross-sectional design (n = 5 studies), the use of self-reporting in measurement (n = 4 studies), and even for measuring the current use of the LMS. Finally, other limitations declared only once in the studies were the predictive power of the model, the theoretical model used, the existence of other unmeasured factors influencing LMS usage, reliance on a specific LMS, failure to consider mediation effects, and the type of data analysis conducted (see Fig. 4).
Results of RQ2. Theoretical models used in studies to explore determining factors of LMS usage by university teachers
To address the first question guiding this article, which pertains to the theoretical framework authors employed for the predictive models in their studies, 9 of them declared using the Technology Acceptance Model (TAM) as their foundational basis. Additionally, 2 studies stated using the Unified Theory of Acceptance and Use of Technology (UTAUT), 1 study utilized Change Management theory, and another study employed the Technology Related Stimulus-Response (TR-SR-TF) theory (see Fig. 5).
It is also important to highlight the variables that these models include, which are described and conceptualized in Table 4.
Although four different models were identified, the TAM model was the most recurrently included in the studies (69%), which originated from the Theory of Reasoned Action (TRA) (see Fig. 6). TRA explains behaviors, in this case, those of teachers, based on their beliefs and subjective norms (Ajzen & Fishbein, 1980). Thus, Davis (1989) employed TRA and stated that the use of a specific technology (in this case, the LMS) depended primarily on the mediation of the perception of ease of use and the perception of usefulness. These factors influence the attitude toward usage, which, in turn, determines the intention to use and ultimately, the actual use of the LMS.
Results of RQ3. Variables included in empirical models on the intention or adoption of LMS
Concerning the variables used in the models, considering all those measured, including usage, intention to use, or both, six studies considered using 6 variables, three studies considered 8 and 9 variables, respectively, and one study considered 11 variables.
In addition to the variables corresponding to the TAM model (AU, BI, PE, PEOU, ATT), researchers included other determining factors related to the use or intention to use the LMS. These were grouped according to classifications made in previous studies corresponding to: Personal Factors, Technological Factors, Social Factors, and Institutional (Abdallah et al., 2016; Ziraba et al., 2020). Specifically, to predict the intention to use or the usage of the LMS, all 13 studies considered personal factors, 11 studies considered technological factors, 7 studies considered social factors, and 6 studies considered institutional factors (see Fig. 7).
Concerning the predictive power of the models tested in the studies, the predictive capability for intention to use (BI) and actual usage (AU) was separately analyzed. On average, the explained variance for BI was r2 = 0.55, with the study with the lowest explained variance at r2 = 0.41 and the one with the highest explained variance at r2 = 0.73. The explained variance for AU was r2 = 0.33, with the study with the lowest explained variance at r2 = 0.21 and the study with the highest explained variance at r2 = 0.54 (see Fig. 8).
Results of RQ4. Type of instruments used to measure the intention and usage of LMS
Regarding how measurements of determining factors are conducted, all analyzed studies applied Likert-type self-report scales for assessment. Concerning the dependent variable when evaluating LMS usage, 7 studies assessed only the intention to use the LMS, 2 studies assessed only the current usage of the LMS, and 4 studies assessed both (intention of use and current usage of the LMS) (see Fig. 9).
Results of RQ5. Future lines of research declared in the studies
From the 13 articles analyzed, 34 recommendations for future research were identified and grouped into 9 categories. The most frequent mentioned in 62% of the articles was to advance in the improvement of the models by including other factors (ID: 2, 3, 6, 8, 9, 10, 11, 13). The next suggestion for future lines of research was to broaden the characteristics of the sample, with a frequency of 39% (ID: 1, 2, 6, 9, 12). Three other suggestions were to replicate the studies to confirm the findings (ID: 2, 3, 6, 10); Include moderating variables in the models that influence teachers’ intention to use LMS (ID: 1, 2, 6, 8); and propose new models on teacher adoption of LMS (ID: 5, 8, 9, 12) which had a frequency of 31% in the studies. Two other suggestions had a frequency of 23% in the studies, corresponding to conducting longitudinal studies (ID: 4, 5, 6) and implementing qualitative or mixed designs (ID: 10, 11, 12). With a frequency of 15% of the studies, it was suggested that progress be made in improving the instruments for measuring the actual use of the LMS (ID: 3, 7); and finally, 8% of the studies suggested considering mediation effects in the models (ID: 2).
Discussion
Hereafter, we present the discussion of the results associated with the four research questions of the studies. Additionally, limitations and future research directions in area of LMS acceptance by university teachers are presented.
Discussion of the results of RQ1. Characteristics of the studies regarding objectives, sample, and limitations
The most reiterated objectives of the studies were to determine the factors influencing the usage of LMS by university professors. Undoubtedly, this represents a significant advancement in research as it enables researchers to identify variables that are determinative and influence the adoption and usage of LMS. However, as some researchers have pointed out, there is a need to progress towards experimental studies, such as the development of interventions that promote the effective use of LMS in everyday teaching. This should go beyond the current usage primarily referring to a material repository and progress to other uses that involve maximizing its potential and benefits in teaching (Lobos et al., 2022; Mella-Norambuena et al., 2022).
Regarding the characteristics of the participants included in the studies, the average was 239 teachers, which could be considered a limitation of the studies. This aligns with the most frequently declared limitation by authors in the studies analyzed in this RSL. This is noteworthy considering the potential inference of findings to the population, as it could lead to unstable and inaccurate parameter estimates in the models. While various approaches (such as Monte Carlo methods) exist to estimate sample sizes, researchers still caution that studies often employ insufficient sample sizes for optimal estimation of predictive models (Sim et al., 2022).
Concerning the continent where these studies were conducted, Asia contributes the most productivity (61.5%), while no studies were identified in Latin America. This aligns with prior research indicating that South Korea is one of the pioneering countries in this field (Altinpulluk & Kesim, 2021).
Discussion of RQ2. Theoretical models used in studies to explore determinants of LMS usage in university professors
This review identified that the analyzed studies considered four different models as a basis for explaining the acceptance of technologies by faculty, with TAM being the most frequently used (69%) due to its simplicity and high validity. However, this model exhibits some limitations: (a) it focuses on predicting the use of technologies rather than the enhancement of user performance; (b) its ability to predict the actual use of technology has been questioned, considering that studies are based on self-report, assuming the limitations of instruments based on user self-perceptions; (c) research has been conducted by measuring TAM variables in relatively homogenous groups, limiting the possibility of generalizing results to real environments that tend to be more heterogeneous; (d) the predominantly quantitative nature of studies related to the model; (e) difficulty in reliably quantifying behavior in an observed investigation; (f) incapacity to address issues such as cost and structural imperatives that drive users to adopt innovation; (g) controversial heuristic value, and (h) limited practical value (Chuttur, 2009; Malatji et al., 2020). Consequently, its founders have attempted to reexplain it on numerous occasions, and various extensions (TAM 1, TAM 2, TAM3) have been developed, with continuous progress in revealing and incorporating new factors into the model’s core variables.
Finally, it is essential to highlight that this review identified that 57% of the studies tested a model to explain the intention to use the LMS and not the actual usage. In specialized literature, various theories have sought to explain human behavior, with the predominant focus being on the conscious cognitive aspect of this behavior (formation of intentions) and its impact on subsequent technology usage behavior, almost to the exclusion of other factors (Bosnjak et al., 2020; Lai, 2017). However, empirical evidence reveals that the effect size of this association is between low and moderate, an inconsistency termed the “intention-behavior gap” (Bhattacherjee & Sanford, 2009). A study focused on predicting technology usage behavior aimed to highlight an alternative perspective to the intention-to-use variable, emphasizing the equally important role of the automatic response known as a habit (Limayem et al., 2001). The authors suggest that people’s intentions during the early stages of adopting a particular technology may not have the same effect over time because it is habits, not intentions, that “govern” a person’s behavior. Therefore, it would be crucial to advance by considering other factors that explain behavior or directly measuring it.
Discussion of RQ3. Variables included in empirical models on the intention or adoption usage of LMS
This review systematized a variety of personal, technological, social, and institutional factors used in models to attempt to predict the intention to use or the usage of LMS. This aligns with findings from other studies; for instance, a study on university professors in Ghana concluded that institutional factors (responsibility of university authorities in providing ICT infrastructure), personal factors (periodic training), social factors (other incentives for faculty to appreciate and engage with the electronic learning environment) are crucial for the successful adoption of educational technologies like LMS (Asad & Malik, 2023). Another systematic literature review aimed at examining factors influencing instructors in the use and adoption of the Moodle platform for teaching university courses analyzed 58 publications, revealing that technological factors, social factors, human factors, and reinforcement factors were determinants in understanding this phenomenon (Ziraba et al., 2020).
The result of this review identified that all studies used structural equation modeling (SEM) for predictive models. SEM models have traditionally been used in the social sciences to test theories. Given the growing development and importance of predictive analysis and the capacity of SEM models to maintain theoretical plausibility in the context of predictive modeling, researchers have demonstrated the high predictive performance of estimators in SEM models (Evermann & Tate, 2016). Therefore, modeling through SEM data analysis techniques has gained popularity, and researchers have described its strengths and limitations (Tomarken & Waller, 2005). This provides a balanced perception of its characteristics. Among its strengths, SEM models enable the development of innovative analysis techniques such as latent growth, multilevel models, approaches to handle missing data, and those for normality, standing out as a broad framework for data analysis with flexible and unique capabilities. On the other hand, it is important to recognize potential limitations of SEM, such as the problem of omitted variables, the importance of lower-order components of the model, possible difficulties when considering well-fitted models, the inaccuracy of some commonly used empirical rules, and the importance of study design and its data (Sharma et al., 2021; Tarka, 2018). However, it is crucial to mention that this type of analysis has proven effective for predictive models, specifically for the intention to use LMS by teachers. Nonetheless, researchers may consider other data analysis techniques to predict actual usage, extracting data from the same LMS to account for usage behavior trajectories. In this case, data mining analyses, which allow for extracting pedagogically significant information from tracking data generated by the LMS, would be relevant (Macfadyen & Dawson, 2010).
Another noteworthy aspect of the presented results is that no study considered sociodemographic variables within predictive models. According to available literature, this might be due to the generalization of approaches in studies with large samples or substantial amounts of data. Methods cover not only normal continuous variables but also non-normal continuous and dichotomous variables. However, while methods considering the complex structures and characteristics of samples exist, traditionally, those for continuous data are predominantly used (Muthén & Satorra, 1995).
Discussion of RQ4. Type of instruments used to measure the intention and usage of LMS
All analyzed studies that measured intention to use, actual usage, or both used self-report scales, and no studies presented empirical measures (LMS analytics). Data obtained in research are an essential element in science communication, making it important to reflect on the limitations involved when using self-report instruments. Various procedures and validation standards have been proposed for tests measuring different constructs (Brutus et al., 2013). Nevertheless, a significant limitation of self-report measures relates to potential biases in the responses of study participants, in this case, university professors, due to social desirability (Bensch et al., 2019; Vésteinsdóttir et al., 2019).
A systematic literature review and meta-analysis addressed discrepancies between recorded digital media usage and self-report usage (Parry et al., 2021). The authors note that, in line with the results of this study, researchers primarily use self-report measures over more objective measures such as the quantity or duration of media usage, even though the validity of these self-reports remains unclear. The meta-analysis aimed to evaluate the agreement between these measures and based on 106 effect sizes, demonstrated that self-reported media usage correlates only moderately with recorded measures, self-reports were rarely an exact reflection of recorded media usage, and measures of problematic media usage show an even weaker association with usage records. These results cast doubt on the validity of findings based solely on self-reported measures of technological media usage.
Therefore, the findings highlight a significant discrepancy between self-reports on media usage and equivalent measures obtained through usage tracking techniques. The authors’ conclusion signals a clear limitation regarding the validity of self-report measures on media usage. In response to this, the authors suggest that those interested in measuring media usage face the question of how to measure media usage and how to proceed. Based on this, they offer the following recommendations: (a) researchers should stop assuming that self-reports are accurate indicators of actual usage behavior and adjust their inferences and conclusions accordingly; (b) the use of measures that closely approximate the targeted behavior, such as using tracking or logging services to measure media usage, is encouraged; (c) assuming error when research can identify factors influencing media usage.
Discussion of RQ5. Future lines of research declared in the studies
In the studies that were analyzed, although 9 categories of recommendations for future research were identified, the ones with the highest frequency reported in the studies (< 30%) were 5. First, the authors suggest the incorporation of other factors or dimensions as predictors within the models that may affect the acceptance of LMS, for example, flexibility of LMS use, support for LMS use, attitudes towards technology, previous experience with technology-based distance learning, system quality, perceived self-efficacy, facilitating conditions, personal innovation, access to technology, anxiety with the use of technologies, among other new variables; This coincides with recent studies that have pointed out the emphasis of further investigating the dominant factors that predict teachers’ adoption and use of LMS (Asamoah et al., 2024). Secondly, broadening the characteristics of the sample, for example, it would be interesting for future studies to consider integrating professors from private and public universities, full-time and part-time, teaching in conventional and distance modalities, experienced and inexperienced teachers in the use of LMS, from different countries and from different disciplinary areas. This future line has relevance with respect to the generalization of findings, a process that involves making inferences from particular observations, and, therefore, is recognized as a quality standard in quantitative research and the detailed consideration of participant characteristics is valued (Polit & Beck, 2010). Thirdly, researchers suggest replication of the studies, considering other technological contexts, other educational levels, other LMS and other countries. Coincidentally, scientific research in general has reinforced the idea that replicability is a prerequisite for determining valid conclusions, testing hypotheses with some unique contextual variants to evidence similar or dissimilar results (Borgsted & Scholz, 2021). The fourth future line highlighted by the authors, consisted of the suggestion to include moderating variables in the models that seek to predict the use of LMS, for example, the variables gender, the course taught by the teachers, age and experience of the teacher. This future line has been highlighted by expert researchers in methodology, since, the main objective of a moderation analysis, is to evidence the existence of differential effects of the independent variable on the dependent variable according to the moderator included, allowing more accurate explanations of the study phenomenon (Memon et al., 2019).
Limitations and future directions based on the findings of this study
The review was conducted considering specific methodological aspects, including the search period (from 2013 to 2023), and databases such as Scopus, WOS, EBSCOhost, and ERIC were explored. Additionally, studies in both English and Spanish were included. Therefore, it’s possible that studies included in other databases, outside the time range of this review, and articles developed in other languages could have been excluded. Furthermore, the conclusions are limited to those of theoretical scope.
Regarding future lines of research, this review identified various factors affecting the adoption and use of LMS. Therefore, it is recommended that researchers, with the necessary training, focus on promoting the use of LMS considering the identified factors. Additionally, there is a need to increase research productivity in Latin America, as this review did not find any studies from this region. Furthermore, addressing the limitations identified in the studies, particularly the sample sizes, is crucial. Future studies should consider the minimum required sample sizes for predictive models using techniques such as Monte Carlo simulations under different conditions, including simulations related to effect sizes, the number of indicators, the magnitude of factor loadings, and the proportion of missing data (Sim et al., 2022). For further research and deeper understanding of the phenomenon, both quantitative and qualitative studies should be conducted to investigate the impact of LMS on learning and user perceptions. Building upon the synthesis of studies that have analyzed the factors influencing the intention and use of LMS, interventions could be proposed to promote the use of this important technological tool among faculty in their everyday teaching.
Recommendations of good teaching practices to effectively integrate LMS platforms in teaching
Based on the findings and discussion of this study, the practices recommended to effectively integrate LMS into teaching are the following: (a) Design a syllabus that integrates combined and articulated activities between the LMS and those that are carried out with the teacher during classes, or in the modality that the course is being implemented (e-learning, b-learning, other); (b) Selecting an LMS tool that is relevant to the curricular activity, this practice is very useful because the teacher will find a valuable resource to improve student learning in accordance with the characteristics of the subject, contents and students, for example, a discussion forum will be useful for some pedagogical purposes, while for others a test with automated feedback will be more pertinent; and (c) Progression of the use of the LMS by the teacher, this is a practice that allows discovering and improving the use of the resources, for example, starting by applying formative evaluations in the LMS until reaching the use of more sophisticated tools.
Policy recommendations based on the findings of this review
Regarding policy recommendations at the institutional level, first, it is required to provide a solid structure of technological resources to ensure proper functioning and use of LMS, avoiding system failures that generate demotivation, frustration of teachers, and even lead them to give up using the LMS. For this, it is essential to periodically evaluate the LMS to meet the growing demands of teaching and ensure that it meets the functionality of the learning environment (Alshira’h, 2021). Secondly, a support system for teachers as users of the LMS is required, for example, a team of specialists to provide support to teachers on the use of the LMS; it can also be a checklist or list of frequently asked questions, useful to solve general or common doubts among users (Wade et al., 2024); or also generate new supports using artificial intelligence, such as chatbots to generate immediate responses to teacher queries related to the use of LMS, offering explanations and providing additional resources, they are even considered as virtual teaching assistants (Labadze et al., 2023). Thirdly, it is imperative that those responsible in educational institutions constantly offer training for teachers on the use of LMS, showing the potential they have, and it is desirable that these trainings include the application of some tool in the LMS of some curricular activities that each teacher is performing, thus providing a real experience (Putra et al., 2023; Turnbull et al., 2020). Fourth, it is recommended that educational institutions provide an LMS architecture with a simple navigation interface, with diverse didactic resources, facilitating communication and interaction, evaluation, feedback, flexibility, data analysis and meeting the needs of a quality pedagogical approach (Kilag, 2023; Oliveira et al., 2016). Fifth, that institutions incorporate into their policies the use of teaching and learning analytics generated by the digital footprint left by the use of the LMS, allowing the generation of dashboards for both teachers and students, which will allow the identification of study behaviors and process feedback for timely decision making. As a final note, in Higher Education Institutions it is recognized that educational paradigms are constantly changing and demands for new flexible, challenging, accessible and engaging learning experiences persist, and therefore it is required to successfully navigate the current landscape where the strengths of technology and pedagogy inevitably converge, for the same purpose, improves student learning performance (Granić, 2023), and quality of education (Kilag, 2023). In this context, universities are challenged in designing an innovative educational plan or framework on how to integrate the use of LMS to enhance teaching (Mershad et al., 2020). Consider an internal diagnosis that identifies the main hindrances to the use of LMS that includes phases to advance to achieve maximum efficiency in the implementation and use of LMS by their professors (Oliveira et al., 2016).
Conclusion
The background information presented in this study leads to the conclusion that: (a) There is a need to increase research that considers ‘real use’ and is not limited to investigating only the ‘intention to use’ this technological tool by university teachers; (b) Although there is consensus on the use of the TAM, its level of prediction warns of the need to propose new models to advance predictive power and challenges researchers to explore the integration of other possible factors and/or new proposals for theoretical models; (c) It is also necessary to specify models that differentiate the type of use of the LMS by the teacher, since they are platforms that group together different tools for communication, evaluation, repository, among others; (d) Undoubtedly, it is also necessary to advance in institutional proposals that support teachers by identifying profiles and promoting policies for their permanent and effective use, enhancing the success of their implementation in their subjects. All these aspects become essential, considering that many universities are rapidly migrating or installing blended learning and/or online teaching modalities, where the effective use of the LMS of these courses will be needed, as a protagonist scenario of the teaching and learning processes.
Data availability
The datasets generated during and analysed during the current study are available from the corresponding author upon reasonable request.
References
Abdallah, N., Ahlan, A., & Abdullah, O. (2016). Factors affecting instructors’ adoption of learning management systems: A theoretical framework. International Conference on Information and Communication Technology for The Muslim World, 13–18. https://doi.org/10.1109/ICT4M.2016.016.
Ahmad, I., Sharma, S., Singh, R., Gehlot, A., Priyadarshi, N., & Twala, B. (2022). MOOC 5.0: A Roadmap to the future of learning. Sustainability, 14(18), 11199. https://doi.org/10.3390/su141811199.
Ajzen, S., & Fishbein, M. (1980). Understanding attitudes and predicting social behavior. Prentice-Hall.
AL-Nuaimi, M., Al Sawafi, O., Malik, S., Al-Emran, M., & Selim, Y. (2022). Evaluating the actual use of learning management systems during the COVID-19 pandemic: An integrated theoretical model. Interactive Learning Environments, 1–26. https://doi.org/10.1080/10494820.2022.2055577.
Alshira’h, M. (2021). Usability evaluation of learning management systems (LMS) based on user experience. Turkish Journal of Computer and Mathematics Education, 12(11), 6431–6441. https://doi.org/10.17762/turcomat.v12i11.7031.
Altinpulluk, H., & Kesim, M. (2021). A systematic review of the tendencies in the use of learning management systems. Turkish Online Journal of Distance Education, 22(3), 40–54. https://doi.org/10.17718/tojde.961812.
Andrés Chiappe.
Aqlan, A., Al-Hakimi, W., Grada, M., Abdulrab, M., Al-Mamary, Y., & Alquhaif, A. (2021). Factors affecting behavioral intention to use learning management systems by instructors. Dimensión Empresarial, 19(2). https://doi.org/10.15665/dem.v19i2.2728.
Asad, M., & Malik, A. (2023). Cybergogy paradigms for technology-infused learning in higher education 4.0: A critical analysis from global perspective. Education + Training, 65(6), 871–890. https://doi.org/10.1108/ET-08-2022-0324.
Asamoah, M., Oheneba-Sakyi, Y., & Tagoe, M. (2024). Faculty acceptance of the utilization of learning management systems in teaching. E-Learning and Digital Media, 21(4), 346–366. https://doi.org/10.1177/204275302311561.
Ashrafi, A., Zareravasan, A., Rabiee Savoji, S., & Amani, M. (2022). Exploring factors influencing students’ continuance intention to use the learning management system (LMS): A multi-perspective framework. Interactive Learning Environments, 30(8), 1475–1497. https://doi.org/10.1080/10494820.2020.1734028.
Associate Professor at La Universidad de La Sabana Colombia, researcher at the Faculty of Education at La Universidad de La Sabana, he is a Specialist in Research and University Teaching, a Master’s in Educational Technology and a Doctor in Educational Sciences.
Ayub, E., Wei, G., Luaran, J., Keppell, M., Leong, L., & Mohamad, S. (2019). A Design and Development Research Approach to Redesigning an Online Module for Education 4.0. 2019 IEEE Conference on E-Learning, e-Management & e- Services (IC3e), 1–6. https://doi.org/10.1109/IC3e47558.2019.8971787.
Bensch, D., Paulhus, D., Stankov, L., & Ziegler, M. (2019). Teasing apart overclaiming, overconfidence, and socially desirable responding. Assessment, 26, 351–363. https://doi.org/10.1177/10731911177002.
Bervell, B., & Umar, I. (2018). Utilization decision towards LMS for blended learning in distance education: Modeling the effects of personality factors in exclusivity. Knowledge Management & E-Learning: An International Journal, 10(3), 309–333. https://doi.org/10.34105/j.kmel.2018.10.018.
Bervell, B., & Umar, I. (2020). Blended learning or face-to-face? Does Tutor anxiety prevent the adoption of Learning Management Systems for distance education in Ghana? Open Learning: The Journal of Open Distance and e-Learning, 35(2), 159–177. https://doi.org/10.1080/02680513.2018.1548964.
Bervell, B., Nyagorme, P., & Arkorful, V. (2020). LMS-Enabled blended learning Use intentions among Distance Education Tutors: Examining the mediation role of attitude based on technology-related stimulus-response theoretical Framework (TR-SR-TF). Contemporary Educational Technology, 12(2), ep273. https://doi.org/10.30935/cedtech/8317.
Bhattacherjee, A., & Sanford, C. (2009). The intention–behaviour gap in technology usage: The moderating role of attitude strength. Behaviour & Information Technology, 28(4), 389–401. https://doi.org/10.1080/01449290802121230.
Bizami, N., Tasir, Z., & Kew, S. (2023). Innovative pedagogical principles and technological tools capabilities for immersive blended learning: A systematic literature review. Education and Information Technologies, 28(2), 1373–1425. https://doi.org/10.1007/s10639-022-11243-w.
Blashki, K., & Isaias, P. (Eds.). (2014). Emerging Research and trends in Interactivity and the human-computer interface. IGI Global. https://doi.org/10.4018/978-1-4666-4623-0.
Borgstede, M., & Scholz, M. (2021). Quantitative and qualitative approaches to generalization and replication–A representationalist view. Frontiers in Psychology, 12, 605191. https://doi.org/10.3389/fpsyg.2021.605191.
Bosnjak, M., Ajzen, I., & Schmidt, P. (2020). The theory of planned behavior: Selected recent advances and applications. Europe’s Journal of Psychology, 16(3), 352. https://doi.org/10.5964/ejop.v16i3.3107.
Brutus, S., Aguinis, H., & Wassmer, U. (2013). Self-reported limitations and future directions in scholarly reports: Analysis and recommendations. Journal of Management, 39(1), 48–75. https://doi.org/10.1177/0149206312455245.
Chaka, C. (2022). Is education 4.0 a sufficient innovative, and disruptive Educational Trend to Promote Sustainable Open Education for Higher Education institutions? A review of Literature trends. Frontiers in Education, 7, 824976. https://doi.org/10.3389/feduc.2022.824976.
Cherrstrom, C. A., Robbins, S. E., Boden, C. J., & Bixby, J. (2019). Need tech? Nontraditional student perceptions of Educational Technology Tools. The Journal of Continuing Higher Education, 67(2), 109–122. https://doi.org/10.1080/07377363.2019.1680266.
Chituc, C. M. (2022). An Analysis of Technical Challenges for Education 4.0 and Digital Education Ecosystems. 2022 IEEE German Education Conference (GeCon), 1–5. https://doi.org/10.1109/GeCon55699.2022.9942758.
Chuttur, M. (2009). Overview of the Technology Acceptance Model: Origins, Developments and Future Directions. Sprouts: Working Papers on Information Systems, 9(37). http://sprouts.aisnet.org/9-37.
Ciolacu, M., Haderer, B., Berl, A., & Svasta, P. (2021). Education 4.0: Innovation Learning Lab for AI-Analysis and Concept proposal. 2021 IEEE 27th International Symposium for Design and Technology in Electronic Packaging (SIITME), 45–50. https://doi.org/10.1109/SIITME53254.2021.9663426.
Clear, T. (2015). «Follow the moon» development: Writing a systematic literature review on Global Software Engineering Education. ACM International Conference Proceeding Series, 19-22-Nov-2015, 1–4. https://doi.org/10.1145/2828959.28350190.
Davis, F. (1989). Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly, 319–340. https://doi.org/10.2307/249008.
Díaz, M., De Lourdes, M., Sánchez-Madrid, S., & Olais-Govea, J. (2020). Rethinking the teaching-learning process managing Educational Technology Tools in a Distance Education Model. 2020 3rd International Conference on Education Technology Management, 14–20. https://doi.org/10.1145/3446590.3446593.
Dymek, P., & Dariusz (2023). Towards Education 4.0: Challenges and opportunities. Supporting higher education 4.0 with Blockchain. Routledge.
Evermann, J., & Tate, M. (2016). Assessing the predictive performance of structural equation model estimators. Journal of Business Research, 69(10), 4565–4582. https://doi.org/10.1016/j.jbusres.2016.03.050.
Fathema, N., Shannon, D., & Ross, M. (2015). Expanding the Technology Acceptance Model (TAM) to examine faculty use of Learning Management systems (LMSs) in higher education institutions. Journal of Online Learning & Teaching, 11(2), 210–232. https://jolt.merlot.org/Vol11no2/Fathema_0615.pdf.
Fearnley, M., & Amora, J. (2020). Learning Management System Adoption in Higher Education using the Extended Technology Acceptance Model. Journal of Education, 8(2), 89–106. https://files.eric.ed.gov/fulltext/EJ1265695.pdf.
Fidalgo-Blanco, Á., Sein-Echaluce, M., & García-Peñalvo, F. (2022). Método basado en Educación 4.0 para mejorar El Aprendizaje: Lecciones Aprendidas De La COVID-19. RIED-Revista Iberoamericana De Educación a Distancia, 25(2). https://doi.org/10.5944/ried.25.2.32320.
Findik, D., & Ozkan, S. (2013). A model for instructors’ adoption of learning management systems: Empirical validation in higher education context. Turkish Online Journal of Educational Technology-TOJET, 12(2), 13–25. https://files.eric.ed.gov/fulltext/EJ1015409.pdf.
Granić, A. (2023). Enhancing online participation in education: Quarter century of research. Journal of Computers in Education, 10(4), 663–687. https://doi.org/10.1007/s40692-022-00238-8.
Hrytsenchuk, O., & Trubachev, S. (2021). Creation and development of the Digital Learning Environment in Educational Institutions. Digital Humanities Workshop, 156–160. https://doi.org/10.1145/3526242.3526257.
Huk, T. (2021). From education 1.0 to education 4.0-challenges for the contemporary school. The New Educational Review, 66, 36–46. https://doi.org/10.15804/tner.2021.66.4.03.
Jiang, H., Wang, J., Yang, J., Wang, R., & Luo, H. (2022). Interplay of learning platform Affordances, Acceptance, and blended Learning Engagement: An SEM Approach. 2022 4th International Conference on Computer Science and Technologies in Education (CSTE), 189-193. https://doi.org/10.1109/CSTE55932.2022.00041.
Kats, Y. (Ed.). (2013). Challenges of LMS Implementation in a Multi-Cultural Context. In Learning Management Systems and Instructional Design: Best Practices in Online Education, 72–88. IGI Global. https://doi.org/10.4018/978-1-4666-3930-0.
Kilag, O., Obaner, E., Vidal, E., Castañares, J., Dumdum, J., & Hermosa, T. (2023). Optimizing education: Building blended learning curricula with LMS. Excellencia: International Multi-disciplinary Journal of Education, 1(4), 238–250.
Kitchenham, B., & Charters, S. (2007). Guidelines for performing Systematic Literature Reviews in software engineering (Version 2.3; EBSE Technical Report, pp. 1–65). Kelle University and University of Durham.
Kommers, P. (2000). Information and Communication Technology (ICT) for education: Research and Development for the Educational Integration of Technology in Eastern European Countries. Educational Technology Research and Development, 48(3), 103–111. https://www.jstor.org/stable/30220271.
Kuk, K., Rančić, D., Pronić-Rančić, O., & Ranđelović, D. (2016). Intelligent agents and Game-based learning modules in a Learning Management System. In G. En, Y-H-J. Jezic, R. J. Chen-Burger, Howlett, & L. C. Jain (Eds.), Agent and Multi-agent systems: Technology and Applications (Vol. 58, pp. 233–245). Springer International Publishing. https://doi.org/10.1007/978-3-319-39883-9_19.
Labadze, L., Grigolia, M., & Machaidze, L. (2023). Role of AI chatbots in education: Systematic literature review. International Journal of Educational Technology in Higher Education, 20(1), 1–17. https://doi.org/10.1186/s41239-023-00426-1.
Lai, P. (2017). The literature review of technology adoption models and theories for the novelty technology. Journal of Information Systems and Technology Management, 14, 21–38. https://doi.org/10.4301/S1807-17752017000100002.
Latinovic, T., & Sikman, L. (2023). Impact of COVID 19 on the Information Technology for Online Education, Education 4.0, Challenges and Solutions. In N. Ademović, E. Mujčić, M. Mulić, J. Kevrić, & Z. Akšamija (Eds.), Advanced Technologies, Systems, and Applications VII (Vol. 539, pp. 707–716). Springer International Publishing. https://doi.org/10.1007/978-3-031-17697-5_54.
Lavidas, K., Komis, V., & Achriani, A. (2022). Explaining faculty members’ behavioral intention to use learning management systems. Journal of Computers in Education, 9, 707–725. https://doi.org/10.1007/s40692-021-00217-5.
Lavidas, K., Papadakis, S., Filippidi, A., Karachristos, C., Misirli, A., Tzavara, A., Komis, V., & Karacapilidis, N. (2023). Predicting the Behavioral Intention of Greek University Faculty members to Use Moodle. Sustainability, 15(7), 1–12. https://doi.org/10.3390/su15076290.
Lazarinis, F., Green, S., & Pearson, E. (Eds.). (2011). Developing and Utilizing E-Learning Applications: IGI Global. https://doi.org/10.4018/978-1-61692-791-2.
Limayem, M., Hirt, S., & Chin, W. (2001). Intention does not always matter: The contingent role of habit on IT usage behavior. ECIS 2001 Proceedings, 56, 274–286. https://aisel.aisnet.org/cgi/viewcontent.cgi?article=1070&context=ecis2001
Liu, Q., & Geertshuis, S. (2021). Professional identity and the adoption of learning management systems. Studies in Higher Education, 46(3), 624–637. https://doi.org/10.1080/03075079.2019.1647413.
Lobos, K., Mella-Norambuena, J., Bruna, C., & Fernández, C. (2022). Analíticas De aprendizaje para la toma de decisiones pedagógicas en educación superior. Formación Universitaria, 15(4), 33–48. https://doi.org/10.4067/S0718-50062022000400033.
Macfadyen, L., & Dawson, S. (2010). Mining LMS data to develop an early warning system for educators: A proof of concept. Computers & Education, 54(2), 588–599. https://doi.org/10.1016/j.compedu.2009.09.008.
Malanga, A., Bernardes, R., Borini, F., Pereira, R., & Rossetto, D. (2022). Towards integrating quality in theoretical models of acceptance: An extended proposed model applied to e-learning services. British Journal of Educational Technology, 53(1), 8–22. https://doi.org/10.1111/bjet.13091.
Malatji, W., Eck, R., & Zuva, T. (2020). Understanding the usage, modifications, limitations and criticisms of technology acceptance model (TAM). Advances in Science Technology and Engineering Systems Journal, 5(6), 113–117. https://doi.org/10.25046/aj050612.
Mella-Norambuena, J., Badilla-Quintana, M., & Angulo, Y. (2022). Modelos predictivos basados en uso de analíticas de aprendizaje en educación superior: Una revisión sistemática. Texto Livre, 15, e36310. https://doi.org/10.35699/1983-3652.2022.36310.
Memon, M., Cheah, J., Ramayah, T., Ting, H., Chuah, F., & Cham, T. (2019). Moderation analysis: Issues and guidelines. Journal of Applied Structural Equation Modeling, 3(1), 1–11.
Mershad, K., Damaj, A., Wakim, P., & Hamieh, A. (2020). LearnSmart: A framework for integrating internet of things functionalities in learning management systems. Education and Information Technologies, 25, 2699–2732. https://doi.org/10.1007/s10639-019-10090-6.
Meyer, J., Srinivas, E., Lal, J., & Topolnytsky, L. (2007). Employee commitment and support for an organizational change: Test of the three-component model in two cultures. Journal of Occupational and Organizational Psychology, 80(2), 185–211. https://doi.org/10.1348/096317906X118685.
Mohamed, I., & Muhammed, U. (2022). Adoption of a learning management system among educators of advanced technological institutes in Sri Lanka. Asian Association of Open Universities Journal, 17(2), 161–177. https://doi.org/10.1108/AAOUJ-03-2022-0032.
Mohd, F., Hussain, M., Mohamed, H., Mohd, M., & Abdul, N. (2021). Student satisfaction in using a Learning Management System (LMS) for blended learning courses for Tertiary Education. Asian Journal of University Education, 17(4), 442. https://doi.org/10.24191/ajue.v17i4.16225.
Mokhtar, S., Katan, H., & Hidayat-ur-Rehman, I. (2018). Instructors’ behavioural intention to use learning management system: An integrated TAM perspective. TEM Journal, 7(3), 513. https://doi.org/10.18421/TEM73-07.
Muthén, B., & Satorra, A. (1995). Complex sample data in structural equation modeling. Sociological Methodology, 25, 267–316. https://doi.org/10.2307/271070.
Nilo, S., & Pinto, A. (2022). Implementation of a Learning Management System (LMS) in an Angolan higher education institution: A systematic literature review. 2022 17th Iberian Conference on Information Systems and Technologies (CISTI), 1–8. https://doi.org/10.23919/CISTI54924.2022.9820406.
Oliveira, P., Cunha, C., & Nakayama, M. (2016). Learning Management systems (LMS) and e-learning management: An integrative review and research agenda. Journal of Information Systems and Technology Management, 13(2), 157–180. https://doi.org/10.4301/S1807-17752016000200001.
Page, M., McKenzie, J., Bossuyt, P., Boutron, I., Hoffmann, T., Mulrow, C., & Moher, D. (2021). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. International Journal of Surgery, 88, 105906. https://doi.org/10.1016/j.ijsu.2021.105906.
Pardamean, B., Suparyanto, T., Cenggoro, T., Sudigyo, D., Anugrahana, A., & Anugraheni, I. (2021). Model of Learning Management System based on Artificial Intelligence in Team-based Learning Framework. 2021 International Conference on Information Management and Technology (ICIMTech), 37-42. https://doi.org/10.1109/ICIMTech53080.2021.9535088.
Parry, D., Davidson, B., Sewall, C., Fisher, J., Mieczkowski, H., & Quintana, D. (2021). A systematic review and meta-analysis of discrepancies between logged and self-reported digital media use. Nature Human Behaviour, 5(11), 1535–1547. https://doi.org/10.1038/s41562-021-01117-5.
Polit, D., & Beck, C. (2010). Generalization in quantitative and qualitative research: Myths and strategies. International Journal of Nursing Studies, 47(11), 1451–1458. https://doi.org/10.1016/j.ijnurstu.2010.06.004.
Putra, B., Soeprijanto, & Daryanto (2023). Evaluation of the utilization of the Learning Management System (LMS) using the CIPP model. Global Synthesis in Education Journal, 6(2), 19–27. https://doi.org/10.61667/dp8q3757.
Ramírez-Montoya, M., Loaiza-Aguirre, M., Zúñiga-Ojeda, A., & Portuguez-Castro, M. (2021). Characterization of the Teaching Profile within the Framework of Education 4.0. Future Internet, 13(4), 91. https://doi.org/10.3390/fi13040091.
Sangole, R., Desai, D., & Jain, A. (2022). Selection of Digital Learning Platforms for Future Education 4.0 in India. IEEE Pune Section International Conference (PuneCon), 1–7. https://doi.org/10.1109/PuneCon55413.2022.10014894.
Schmid, R., & Petko, D. (2019). Does the use of educational technology in personalized learning environments correlate with self-reported digital skills and beliefs of secondary-school students? Computers & Education, 136, 75–86. https://doi.org/10.1016/j.compedu.2019.03.006.
Sharma, V., Ramachandran, M., Chinnasamy, S., & Saravanan, V. (2021). A review on structural equation modeling and its classification. REST Journal on Emerging Trends in Modelling and Manufacturing, 7(4), 135–142.
Shenkoya, T., & Kim, E. (2023). Sustainability in Higher Education: Digital Transformation of the Fourth Industrial Revolution and its impact on Open Knowledge. Sustainability, 15(3), 2473. https://doi.org/10.3390/su15032473.
Sim, M., Kim, S., & Suh, Y. (2022). Sample size requirements for simple and complex mediation models. Educational and Psychological Measurement, 82(1), 76–106. https://doi.org/10.1177/001316442110032.
Tarka, P. (2018). An overview of structural equation modeling: Its beginnings, historical development, usefulness and controversies in the social sciences. Quality & Quantity, 52, 313–354. https://doi.org/10.1007/s11135-017-0469-8.
Thach, P., & Lai, P. (2021). Lecturer attitudes and behavioural intentions to use learning management systems in Vietnam. Journal of Open Flexible and Distance Learning, 25(2), 35–54. https://doi.org/10.3316/informit.348337730108367.
Tomarken, A., & Waller, N. (2005). Structural equation modeling: Strengths, limitations, and misconceptions. Annual Review of Clinical Psychology, 1, 31–65. https://doi.org/10.1146/annurev.clinpsy.1.102803.144239.
Turnbull, D., Chugh, R., & Luck, J. (2020). Learning management systems, an overview. Encyclopedia of Education and Information Technologies, 1052–1058. https://doi.org/10.1007/978-3-030-10576-1_248.
Venkatesh, V., Morris, M., Davis, G., & Davis, F. (2003). User acceptance of information technology: Toward a unified view. MIS Quarterly, 425–478. https://doi.org/10.2307/30036540.
Verma, A., & Singh, A. (2021). New Era Of Technology Empowered Education: Education 4.0 A Systematic Review. 9th International Conference on Reliability, Infocom Technologies and Optimization (Trends and Future Directions) (ICRITO), 1–7. https://doi.org/10.1109/ICRITO51393.2021.9596245.
Vésteinsdóttir, V., Joinson, A., Reips, U., Danielsdottir, H., Thorarinsdottir, E., & Thorsdottir, F. (2019). Questions on honest responding. Behavior Research Methods, 51, 811–825. https://doi.org/10.3758/s13428-018-1121-9.
Wade, B., Dianatti, S., Searle, B., & Sankey, M. (2024). Navigating an LMS Review process: Harnessing Next-Generation Digital Learning through evidence-based decision-making. Journal of University Teaching & Learning Practice, 21(7), 1–27. https://doi.org/10.53761/ynndrw32.
Waris, I., & Hameed, I. (2022). Modeling teachers acceptance of learning management system in higher education during COVID-19 pandemic: A developing country perspective. Journal of Public Affairs, 23(1), 1–13. https://doi.org/10.1002/pa.2821.
Zareravasan, A., & Ashrafi, A. (2019). Influencing factors on students’ continuance intention to use Learning Management System (LMS). Proceedings of the 9th International Conference on Information Communication and Management, 165–169. https://doi.org/10.1145/3357419.3357429.
Zhao, Y. (2018). Analysis of Current Situation of LMS Application in the Digital era. 2018 1st International Cognitive Cities Conference (IC3), 314–316. https://doi.org/10.1109/IC3.2018.00089.
Ziraba, A., Akwene, G., & Lwanga, S. (2020). The adoption and use of Moodle learning management system in higher institutions of learning: A systematic literature review. American Journal of Online and Distance Learning, 2(1), 1–21. https://doi.org/10.47672/ajodl.489.
Zwain, A. (2019). Technological innovativeness and information quality as neoteric predictors of users’ acceptance of learning management system: An expansion of UTAUT2. Interactive Technology and Smart Education, 16(3), 239–254. https://doi.org/10.1108/ITSE-09-2018-0065.
Acknowledgements
This article is part of a thesis presented in fulfillment of the Doctorate in Education at the Universidad Católica de la Santísima Concepción, Chile. These postgraduate studies are financed by the national doctoral scholarship N° 21212274 of the National Research and Development Agency of Chile (ANID-Chile). In addition, we want to thank the contributions to the preparation of this text from the Doctorate in Educational Innovation with the use of ICT (doctoral internship), from the Universidad de La Sabana, through the EDUPHD-20-2022 project.
(Described in Title Page)
Funding
Open Access funding provided by Colombia Consortium
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
All authors declare no conflict of interest.
Ethics approval and consent to participate
We hereby declare that this manuscript is the result of the authors’ creation. Except for the cited contents, this manuscript does not contain any research achievements that have been published or written by other people or groups. The legal responsibility for this declaration will be borne by the authors of this manuscript.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Mella-Norambuena, J., Chiappe, A. & Badilla-Quintana, M.G. Theoretical and empirical models underlying the teaching use of LMS platforms in higher education: a systematic review. J. Comput. Educ. (2024). https://doi.org/10.1007/s40692-024-00336-9
Received:
Revised:
Accepted:
Published:
DOI: https://doi.org/10.1007/s40692-024-00336-9