Abstract
During the 2020 COVID-19 lockdown, edX launched an initiative, called the Remote Access Program, to give access to free certificates for its Massive Open Online Courses (MOOCs) to the communities of its partners. This paper describes the experience of a Higher Education (HE) institution in Europe participating in this initiative as a strategic action to spread MOOCs, not just as a resource to open the university educational offer but also to improve the professional development possibilities of its community. This case study explores general data about the participation of over 7,700 people (23,4% of the Universitat Politècnica de Valencia’s community) in these courses and data from participants (1,515) about their initiative perceptions. The data obtained evaluates how a university community integrates MOOCs into their day-to-day life under certain conditions and their perception of the quality and usefulness of the courses. Data shows most of the community did not have experience or knowledge about MOOCs (73%), they used it (they obtained 5,202 certificates, a 33% completion rate), they value the course quality (4.1/5) and are happy with the initiative (4.7/5), and they think MOOCs will be useful for their career (3.67/5) and will take more MOOCs in the future (98%, with 71% thinking it is worth paying for the certificate). These results remark the importance of thinking about MOOCs in HE Institutions not just as a punctual resource but as a strategic investment affecting the university teaching offer, the professional development of its community, and their social compromise.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
1 Introduction
Ten years after the first xMOOCs –the most instructivist version of the Massive Open Online Courses (MOOC)– were launched, many questions remain regarding the importance and opportunity of this educational phenomenon (Margaryan et al., 2015; Rolfe, 2015; Toven-Lindsey et al., 2015, among others). Some of these questions are related to the need for more critical visions on the interpretation of the role of MOOC in the Higher Education (HE) portrait (Bulfin et al., 2014) and others to the pedagogical implications of those “massive” teaching models (Bartolomé-Pina & Steffens, 2015).
Many universities worldwide started experimenting with MOOC courses years ago (Shah, 2013). Nevertheless, one of the big questions surrounding the universities’ commitment to developing MOOCs is to what extent these courses—their creation and use—can contribute to developing the aims of HE (Papadimitriou, 2020) and not only to its Uberification (Adell, Castañeda & Esteve-Mon, 2018).
When COVID-19 hit the world at the beginning of 2020, many countries enforced massive lockdowns to stop the spreading of the disease, most including school and university closures (Hale et al., 2021). In this scenario, MOOCs were an excellent option to address the need for quality online material for HE institutions (Ponce Ceballos and Ruelas Mexía, 2021; Duan, 2021).
The pandemic became a litmus test for MOOCs and their potential, not just as free resources for complementing formal education, but as strategical learning resources for professional development inside and outside institutions worldwide.
There were experiences of universities granting academic credit for MOOCs from other universities before the COVID-19 pandemic unleashed in 2021. Some integrate MOOC in blended courses (Khan, 2019), others accept micro master credentials as part of one of their masters (edX, 2017; MIT, 2021), some use them in interuniversity networks as a virtual exchange program (Delft University, 2021), and others let the students create a module of their bachelor studies using MOOCs (NUS, 2021).
When COVID-19 forced a lock-down in many countries, MOOCs were used to train teachers for the sudden transition to online learning (Boltz et al., 2021; Mays et al., 2021) or prepare sanitary personnel for COVID-19 (Quijano-Escate et al., 2020; Seale et al., 2021; Utunen et al., 2020).
Questions about what MOOCs bring to HE, once we have passed—albeit partially—that moment of “emergence”, are still there, and we need to take advantage of the experiences of these implementation moments to answer these questions or at least to coin them as experiences that will enrich our future work.
This paper describes the experience of Universitat Politècnica de València (UPV) using the Remote Access Program Initiative (RAP) from edX to spread the use of MOOCs as an alternative training possibility among its community members during COVID-19 lockdowns in 2020.
The data obtained evaluate how a university community integrates MOOC in their day-to-day life under the conditions of the COVID-19 lockdown, their participation, and their perception of the quality and usefulness of the courses. Some findings have exciting implications for educators and policymakers about how to integrate and use MOOCs as alternative learning resources.
2 MOOC in HE, the fast trip until here
MOOC, the acronym for Massive Open Online Courses, was coined in 2008 by David Cormier and Bryan Alexander to refer to the course created by Stephen Downes and George Siemens, ‘Connectivism and Connective Knowledge/2008’ (CCK8), in which 2,200 students worked and learned actively (Siemens, 2012). It was popularised in late 2011 when Stanford University launched courses with over 100 thousand enrolments each (Rodriguez, 2012).
The considerable success of these first MOOC experiences brought media attention to MOOCs and was amplified, so 2012 was called, by some media, the year of the MOOC (Pappano, 2012). Some articles said MOOCs were the most important educational technology in 200 years (Regalado, 2012).
Nevertheless, the format used in this Standford’s courses, later called xMOOC, was different. It prioritised the use of videos explaining content and content review mechanisms in the form of self-correcting quizzes (Lugton, 2012) and some authors have characterised it as instructivist and individualist (Fidalgo-Blanco et al., 2016).
Soon, critics commented that MOOCs were nothing more than an incremental evolution of the educational technologies already available and that the dominant x-MOOC model introduced no pedagogical innovation, even stating the first MOOC was created in 1922 with open courses at the University of New York broadcasted using a radio station (Bartolomé-Pina, 2013). Some even considered that MOOCs were near the peak of inflated expectations of the Gartner Cycle (Schmidt, 2012).
Despite this, using MOOCs in HE followed a slow but steady path that accelerated in 2018. In those years, some of the most critical challenges for MOOCs were achieving self-sustainability and finding sources of revenue and ways to keep costs low (Conole, 2014; Schuwer et al., 2015; Shah, 2016). Some articles also pointed to four big barriers MOOCs had to overcome: developing revenue models to make the concept self-sustaining; delivering valuable signifiers of completion such as credentials, badges, or acceptance into accredited programs; increasing course completions; and creating ways to authenticate students, so it could satisfy accrediting institutions or hiring companies (Hill, 2012).
EdX started offering Micromasters in 2016 (micro-credentials that give access to academic credit), and Coursera followed in 2018 with Master tracks (McIntyre, 2018). During these years, the prominent MOOC platforms had been drifting from the “open” model, putting part of their content after a paywall (first the certificates, later the graded assignments) (Shah, 2017). The MOOC model in the big platforms has shifted towards a well-established business model of online postgraduate and continuing education, and most offer academic credit-bearing micro-credentials (Pickard et al., 2018).
With this level of success and development, it is hardly surprising the term MOOC has been the object of study in an impressively high number of literature reviews ranging from 2013 (e.g., Liyanagunawardena et al., 2013) until more recent times (e.g., Babori, 2020). Most of those works coincide to a point that seems the original problems have not been solved, and MOOCs are still struggling with low completion rates and the fact that most of its learners are educated individuals from the world’s most affluent countries rather than initial learners (Reich & Ruipérez-Valiente, 2019), making less clear than ever the real role of MOOCs in HE and if the effort is worth it.
Nevertheless, the MOOC movement has continued its almost exponential expansion, and at the end of 2020, there were over 16,300 courses from 950 universities worldwide with over 180 million enrolments (Shah, 2020), with thousands of platforms offering MOOCs (Open edX, 2018), ranging from country platform to small niche ones (Open edX, 2021).
3 Case study context: The UPV and the edX remote access programme
UPV is a mid-sized public university that has committed over the last decade to use MOOC as one of its strategic levers to digital transformation, not only as digital resources to complement its educational offer but also as part of its social engagement (Despujol, Castañeda & Turro, 2018).
UPV joined edX –one of the leading MOOC worldwide platforms with over 160 partners, 3000 courses and 35 million users– at the end of 2014, and now this institution is the leader in its Spanish speaking offer, with over 100 courses and 3.5 million enrolments when writing this paper (edX, 2021).
In March 2020, when massive lockdowns started to be enforced worldwide to contain the spread of the COVID-19 pandemic, edX created a partner community where members could access the courses and programs of any other member at no cost. This initiative was called the “Remote Access Program” (RAP) (Randall, 2020a).
In a few days, over 60 edX partners from all over the world joined RAP (Randall, 2020b). UPV joined the programme understanding it as an opportunity to help other edX partners communities with the UPV generated MOOCs and as an excellent opportunity to offer external high-quality educational content to the UPV local community.
The free access was achieved using promotional codes that edX sent in CSV format text files to each customer institution by mail. All RAP participating members could ask edX for an unlimited number of codes during the initiative –through June 30 of 2020–as edX sent more codes when the institutions asked for them. These codes had to be distributed to the users of the customer institution. They could be redeemed when purchasing the certificates of the courses included in each initiative to get them for free.
UPV distributed 24,613 codes to 7,712 of its students, faculty and workers (own sources, from the statistics of the app used to distribute the codes), so around 23.4% of its 33,042 community members (UPV had 29,009 students, 2,579 faculty and 1,454 staff (U.P.V., 2021a, b)) asked for at least one code.
4 Study
This study explores an innovative experience of using MOOCs as the primary learning resources (RAP) for a whole university community in the context of a HE Institution (UPV) during the COVID-19 crisis lockdowns. The study’s primary goal is to evaluate the experience and its potential consequences on the use of MOOCs in HE in a massive way.
For doing it, this study formulates the following research questions:
-
RQ 1: Who participated in the experience?
-
RQ2: What kind of courses do participants choose and from what institutions?
-
RQ3: Does the experience increase the knowledge about the potential of MOOCs among the university community?
-
RQ4: Is the use of MOOCs in a massive open way a satisfactory experience for participants?
-
RQ5: Under what conditions would participants use MOOCs and certifications in the future?
The exploration has been structured as a case study, as it is a research approach to generate an in-depth, multi-faceted understanding of a complex issue in its real-life context (Crowe et al., 2011). This case study is considered evaluative but with a descriptive approach (Cohen et al., 2017).This means it explains and judges how the implementation of the MOOCs happened –evaluating it–, but providing a narrative account of the process –with a descriptive approach–, rather than a comparative one.
This study includes the narrative from the team that developed the institutional implementation of the experience, as described in the previous section of the study content, using three data sources: a survey to obtain a detailed description of participants' perceptions about their experience, the database of code requests, with the emails of the users, and the summary of the learning analytics of the initiative, provided by edX, to get the total number of codes redeemed and the total number of certificates obtained.
The survey included the collection of:
-
Demographic information (age, gender, residence place, current job status and level of studies)
-
Information about the initiative
-
satisfaction level, with a scale from 0 to 5 where 0 is the minimum
-
number of requested codes
-
number of used codes
-
number of obtained certificates
-
-
Information about the motivations to participate
-
About MOOCs
-
Previous knowledge about MOOC
-
Intention to take MOOC in the future
-
Reasons to choose a MOOC
-
Willingness to pay for MOOC certificates
-
Reasons to pay for MOOC certificates
-
-
Some information about each one of the MOOCs taken (institution, name of MOOC, quality of the MOOC from 0 to 5, contribution to the professional career from 0 to 5, finalisation of the MOOC)
The structure and content of the survey were validated using a content and face validation (Holden, 2010) process that guarantee the appropriateness and relevance of the items as they appear to the persons answering the survey (Connell et al., 2018).
4.1 Procedure
1,515 people from the 7,712 who asked for at least a code answered the survey (19.4%). The survey was sent at the end of September 2020, almost three months after the RAP initiative ended. Even if it is not a randomised sample, the percentage of the population and the range of ages and profiles included (data will be shown in the results part) makes them incredibly valuable for understanding the experience (Hibberts et al., 2012).
The data provided by edX shows that 15,744 of the codes provided to UPV were redeemed and that 5,202 certificates from different institutions were obtained (a 33% completion rate). It also shows that around 27% of UPV codes were used to get certificates for UPV courses.
Quantitative information has been analysed, calculating the averages and standard deviation of every answer of the survey. It has been studied differentiating university students and workers (including part-time students, alumni and university staff).
Also, the statistical inference values have been analysed (as p-values or size effect), testing if the hypothesis that the average of students’ and workers’ distributions are the same can be rejected, and it has been confirmed that p-values are smaller than 0.001 in the cases studied. Therefore, it theoretically confirms there is a difference between the average of both distributions (workers and students). Nevertheless, this study is not reporting the p-values obtained, considering the sample is not a random sample, so the “inference becomes tricky or outright impossible” (Hirschauer et al., 2021: 1), and researchers have preferred to maintain the importance of the size of the sample, rather than artificially randomising it.
Regarding comments on the survey, they were analysed under an analysis of content technique that classified and coded them as positive, neutral, or negative (Saldaña, 2015).
5 Results
In this section, data and results are shown. Data have been organised using the Research Questions order.
5.1 RQ 1: Who participated in the experience?
There were two main collectives involved in the initiative, University students and employees. But, even as the initiative was communicated only to the active members of the community, any email account from the upv.es domain was able to ask for codes of the initiative; therefore, former students, members of the alumni association –with an email from the alumni.upv.es domain–, could also participate. So, according to the email domain that requested codes, participation in the initiative among the community members groups was 77.4% students, 18.4% employees, and 4.2% alumni.
Regarding data collected with the survey, 60% of the responders were male and 40% female, and the average age was 29.4 years, with a peak in 22 years and another smaller and flatter peak in 50 years.
Concerning the maximum level of education achieved by the respondents to the survey, we find two big groups, the ones that in the moment of the initiative were studying a bachelor, a master or a PhD (48.19%) and the ones that already had it (41.5%). Moreover, as is shown in Fig. 1, some people with primary or secondary education (10.31%) as their maximum level of education also participated in the initiative:
Concerning the employment status of participants, the answers in the survey show that 54.3% of participants define themselves as students or interns, 24% as working at UPV, 12.1% as working for other institutions, 8.45% as looking for a job, 1.6% as self-employed, 0.25% as working and studying and 0.07% as housekeeping as seen in Fig. 2.
Considering the anonymity of the survey –we do not have access to the respondents’ email–, the analysis of those answers regarding employment status using the level of education answers can give a more global perspective about the profile of respondents. Therefore, since 22.4% of respondents have answered they are working for other institutions, looking for a job, self-employed and/or housekeeping, using data from their level of education, we see that some are studying a bachelor, a master or a PhD, what identifies them as students that are working and studying part-time, and the rest are alumni. Therefore, considering the other answers regarding the employment status, 7.2% of this 22.4% can be considered students and 14.2% alumni. So, 61.75% of the responders were students (54.3 + 7.2 + 0.25), 24% UPV employees and 14.2% alumni.
The answers from these groups will be included in the same group as the working for UPV group when looking for differences between working people and students’ responses, given their working experience.
Most users (87.4%) resided in Comunitat Valenciana (the Spanish region where UPV is located), up to 95.2% including other regions of Spain, and the rest in different countries of Latin America and Europe (Ecuador 1%, Colombia 0.65%, México 0.42%, Germany 0.42%, Denmark 0.3%, UK 0.24%, Perú 0.24% or France 0.18%, for example).
5.2 RQ2: What kind of courses do participants choose and from what institutions?
The answers to the survey include 3,237 ratings of 690 courses from 67 edX member institutions.
The data provided by edX indicates 27% of the codes granted to UPV were used to get certificates from UPV courses. This figure is similar to the 28.7% obtained from the survey data and shown in Figs. 3.
As presented in Table 1, the most popular courses reported by users in the survey focus primarily on Excel (5), Python (7) and R(2), applied to data analysis, and the other 6 most popular courses cover Office 365 (1), engineering simulations (1), introduction to computer science (1), project management (1), Android programming (1) and stock investment (1), indicating that software tools for data analysis was the topic that most interested the participants.
5.3 RQ3: Does the experience increase the knowledge about the potential of MOOCs among the university community?
Regarding the survey answers, almost 41% of the respondents knew nothing about MOOCs before they participated in the initiative, and 32% knew about them but had not taken any, for a total, 73% of the users, as is evident in Fig. 4.
Differentiating students and workers' data, as shown in Fig. 5, 49.7% of students did not know about MOOCs before they participated in the initiative, and 30.2% knew about them but had not enrolled in any (a total of 79.9%). In the case of workers, 26% did not know about MOOCs in advance, and 35.4% knew about them but had not enrolled in one (a total of 51.4%).
5.4 RQ4: Is the use of MOOCs in a massive open way a satisfactory experience for participants?
For understanding the participants’ level of satisfaction with the experience, the study explores not only how many used their codes but how many obtained the final certification. Additionally, at the survey, participants were asked about their level of satisfaction with the courses and how useful they perceive the courses they have taken to develop their careers.
As the data in Table 2 remark, the average number of codes requested by a user was 3.84 with a standard deviation (sd) of 2.3 (there was a considerable dispersion, with users requesting from 1 to 25 codes). Most users (38%) asked for five codes, but there were 76 users (4.4%) that asked for more than five. The average number of codes used was 3.2 (sd 2.19). The average number of certificates achieved by a user was 1.8 (sd 1.91), but the courses could be finished several months after the initiative was closed, so the users were still taking courses when the survey was sent. The average number of certificates still in process per user was 1 (sd 1.40).
Looking at the total data provided by edX, it can be seen that 15,744 of the codes provided to UPV were redeemed and that 5,202 certificates from different institutions were obtained (a 33% completion rate).
In the survey, users affirmed to have obtained an average of 1.8 certificates (sd 1.91), and 84% got at least one certificate (71%) or were in the process to obtain one or more certificates (13%). Around a third of respondents (446 participants, 29%) declared they had finished no MOOC, and more than a half of them (242 participants, 16% of the total respondents) said that they were not in progress of getting one (the other 204 reported that they were still in the process of getting one or more certificates).
1,515 participants answered the survey question about rating their satisfaction with the initiative from zero to five, and the average satisfaction was 4.7/5 with a small dispersion (sd of 0.7). Satisfaction among students was 4.73/5 (sd 0.67) and among workers 4.64/5 (sd 0.73).
The participants were asked to score the quality of each of the MOOCs they had taken, and the average score among respondents was 4.1/5 (sd 1.04). The average given by students is 4.09/5 (sd 1.05), and the average from workers’ answers is 4.14/5 (sd 1.01).
The survey had an open response field for comments, and 296 participants (15.99% of respondents) left their comments. Tagging the answers as positive, negative or neutral in a qualitative coding process, 220 (74.3%) were positive –most thanking for the initiative and asking for its continuation–, 40 (13.5%) were neutral –asking for more time, more codes or making comments about diverse aspects– and 36 (12.1%) negative–some complaining about the deadlines of the courses, others about the quality of a specific course and some about the use of MOOCs to cover for internships-.
The survey also asked users to rate from 0 to 5 how useful they thought that each of the MOOCs they had taken could be for their professional career. The average rating is 3.67/5 with a sd of 1.26. The rating given by students is 3.71/5 (sd 1.24) and by workers 3.59/5 (sd 1.3).
5.5 RQ5: Under what conditions participants would use MOOCs and certifications in the future?
The study asked participants why they joined the initiative to explore the possibility they will use MOOCs in the future for their professional development and under what conditions they would do it. Also, we have asked them if they will use MOOCs in the future, and if they think it is worth paying for MOOC certificates, and what are the reasons that would make them willing to pay for the certificates.
Regarding the reason to join the initiative, participants were asked to score from 0 to 5 some options with the results shown in Table 3.
Differences between students and workers are negligible, with “gaining new professional skills” as the main interest and “learning new things” as the second. The workers are more interested in learning new things and the students in improving their resumes.
98% of all respondents say they will take a MOOC in the future. For the students, the figure is 98.2%, and for the workers, 97.5%
71% of all respondents say they think it is worth paying for the verified certificate of a MOOC. For the students, the figure is 71.4%, and for the workers, 70.7%.
Participants were asked to score from 0 to 5 on these options as the reason to make a MOOC, and the results can be seen in Table 4:
Differences between students and workers are negligible, with “Subject” as the main reason to pay for a course and the institution that created the MOOC as the second, as seen in Fig. 6.
6 Discussion
This paper presents an analysis of the UPV community experience using the RAP edX initiative during the 2020 lockdown. The experience (free access certificates for most MOOCs edX catalogue) and the 7,712 participants, around 23.4% of the total university community, make this study case an example of the use of MOOCs in a technological HE institution in the western world that is worth being studied.
The analysis leads to the conclusions presented and discussed below.
The distribution of the different groups in the emails of the code requesters and the answers to the survey reflect that employee participation was higher than its quota in the university (they accounted for 18.4% of the requests when they represent around 11.5%, following the current university composition).
Considering the demographic data gathered in the survey, the initiative was participated by a population that reflects the composition of the UPV university community, at least in terms of gender and age. The distribution of gender of the respondents (60% male and 40% female) corresponds almost perfectly with the 38,5% of female students in UPV (Generalitat Valenciana, 2021) and the 40% of women in the UPV workforce (U.P.V., 2021a, b). The distribution of age is also coherent with the three populations (students, employees and alumni) of the universities from the same region (Generalitat Valenciana, 2021).
More employees and alumni answered the survey than students in percentage (14.2% of respondents were alumni when they represented 4.2% of the code requests, and 24% of respondents were employees when they were 18.4% of the code requesters). In addition, the data of the level of education achieved show 41% of degree holders, which is coherent with the 38.2% of answers from employees and alumni.
The significant conclusion about participation shows participation in this local initiative, with these pandemic conditions, has well-reflected the age distribution of universities but has been more frequent among educated people (University staff and alumni), which is similar to participation in MOOCs in other general initiatives. For instance, in the first four years of MOOCs at Harvard and MIT (2012 to 2016), the median age was 29 years, and the percentage of bachelor’s degree holders was 73% (Chuang & Ho, 2016). By its part, in the Macro MOOC learning analytics of global and regional providers (Ruipérez-Valiente et al., 2020), the most common age range across MOOC platforms is 25–35 years, and the percentage of men and people with a bachelor or higher degree of education is even higher for most of the MOOC platforms than the ones we found. Finally, in the Guo and Reinecke (2014) study –4 edX MOOCs with 140,546 students–, they found the mean age was 28, and the most common highest educational level for students was a bachelor’s degree (38%).
Therefore, even if this was a local initiative focussed on a particular population, the MOOCs revalidate its character of resource for educated people.
It is interesting as well to remark that data from the UPV experience regarding gender reflects the composition of its local community; nevertheless, the gender differences are similar to most general MOOC experiences, as the one reflected by Chuang and Ho (2016), where the percentage of female was 33%, or the one of Guo and Reinecke (2014), where most students were men (between 86 and 56% for all four courses). So, the gender gap, studied for technical degrees all over the world (and reflected in the gender composition of the UPV community) is similar to the gender gap in access to MOOCs, as has been studied in Jiang et al. (2018).
The UPV community chose mainly courses from its university (28%) and some of the most prestigious institutions in the world (Harvard, MIT, IBM, Microsoft), followed by courses in Spanish by Spanish-speaking institutions. Most of the favourite courses are focused on Excel and programming languages, like Python and R to work with data, and programming languages, tools very in demand in the business world. These courses are similar to the most popular courses mentioned in the 2021 Coursera Impact report (Yu et al., 2021). Excel and computer programming appear in the first positions of trending skills in several categories.
Data reveal most of the UPV community members had no knowledge or experience with MOOCs. Considering that several emails informing about the initiative were sent to all university community members and that around 23% of the community members participated in the initiative, data concludes the experience increased the awareness of MOOC potential in the community.
This ignorance about MOOCs is similar to what previous studies had reported. In a survey sent to human resource staff of 103 North Carolina (USA) organisations by RTI and Duke University, only 31% answered that they had heard of MOOCs before the survey (Radford et al., 2015). In a survey in Georgia (the country) in 2014, 61% of the students had never heard about MOOCs or taken one of them (Muzafarova & Kaya, 2015). A 2016 study from Nepal reports that 78% of students had never heard about MOOCs (Shakya et al., 2016).
This reality points out one of the main problems of MOOCs: they are unknown by the general public. If these courses were so unknown among the UPV community –the biggest Spanish speaker provider of MOOCs on edX–, the situation in other institutions with less participation in MOOCs and outside HE could be worse.
A 33% completion rate in the UPV experience exceeds over 4 times the 7% average completion rate reported by Khalil and Ebner (2014), or the 7,7% average completion rate for HarvardX and MITx courses reported by Chuang and Ho (2016) and is almost 7 times the 4.65% completion rate of the course studied by Ruipérez-Valiente et al. (2017).
The completion rate is not as high as the 60% completion rate for certificate paying students reported by Chuang and Ho (2016) for edX courses or the 56,7% reported by Goli et al. (2022) for Coursera. Still, it is of the same order of magnitude as the 47% completion rate of certificate track for a MOOC on edX, where free coupons for certificates were offered, and the 41% completion rate for the certificate-paying students of other MOOCs, both reported by Littenberg-Tobias et al. (2020).
According to qualitative (73.6% of positive comments) and quantitative data (average satisfaction with the initiative of 4.7/5 and with course quality of 4.1/5), we can conclude the initiative was perceived as valuable for the University’s community and their satisfaction is similar to the 4.7/5 course rating reported by the biggest MOOC platform, Coursera, in 2021 (Yu et al., 2021). Users were very satisfied with it and rated high the quality of the courses.
UPV community also believes the knowledge they acquire with MOOCs will be valuable for their professional career (3.67/5), which is in line with the 71% of learners from Coursera that report career benefits (Yu et al., 2021).
The vast majority of the UPV community that participated in the survey declared they will take a MOOC in the future, and they think it is worth paying for the verified certificate of a MOOC. The main reason to join the initiative was to gain a new professional skill. The main factors that would make them pay for a MOOC are the course subject and the institution that created the MOOC.
It is noticeable that the main reason to take the courses is the same reported by Breslow et al. (2013) –in their study regarding the first MOOC offered by MIT on edX– and Bayeck (2016) in an exploratory study of MOOC learner’s demographics. But in their study about MOOC use among those who cannot afford formal education, Dillahunt et al. (2014) found the main reason for taking MOOCs was general interest in the topic, with around 80% of the answers of their survey mentioning it. With around 60% of the answers, professional development was “just” in the second position.
7 Conclusion
The final reflection of the participation of the UPV community in this initiative is mainly positive. UPV members were very happy with the initiative of providing them free certificates for the MOOCs; they consider the quality of the MOOCs they took as very good and think they will help improve their professional careers. MOOCs are perceived as good tool for professional training.
This study has at least two evident limitations mentioned in the paper. First, it reports the experience of only one institution, and second, even if participation well represents the institution and other similar institutions, the impossibility of a randomised sample in the data collection makes some analysis tricky. Despite these and other limitations, the case study results indicate MOOCs are a highly appreciated tool for professional education in HE, and users value the certificates.
It is important to remark the immense ignorance about the existence of these courses, which would be at the base of some problems cited frequently about MOOCs. They are being used by already educated people (Hansen & Reich , 2015). This situation and the gap in gender in MOOCs access that mirrors the gap in gender in technical universities –at least following the Spanish figures–, remark the importance of doing general campaigns for making broader and more democratic the real access to MOOCs.
Given the success of the UPV courses among the UPV community members, and, as edX gives its members the possibility to offer free codes for their courses to their communities, UPV set up a follow-up initiative to distribute codes UPV courses to UPV members. The university has created a new website using the same system used on the initiative, in which the community members can ask for up to 5 codes for edX courses. When writing this article, one year after setting up the new service, 3,048 codes had been sent to UPV students, staff and faculty, and 774 certificates had been granted (from own records obtained from the edx.org platform and the code distribution app).
UPV has also joined a follow-up initiative of edX called RAP, which offers free certificates of 145 courses to HE institutions around the world until July 2022 (edX, 2020). The mechanism of this new edition is different; edX provides a license to each participant that gives access to the certificates of all included courses. At the moment of writing this article, 2,324 licenses have been distributed by UPV, and participants have obtained 1024 certificates with them (from their own records obtained from the app provided by edX).
Our results emphasise the importance of thinking on MOOCs –as in any initiative regarding the digital transformation of universities or educational institutions– not just as a punctual resource but as a strategical investment (Castañeda, Esteve_Mon & Postigo_Fuentes, In press) that would not only impact the institutional teaching offer but in professionally developing its staff, and on the social compromise of the institutions (Papadimitriou, 2020; Adell Segura, Castañeda Quintero & Esteve Mon, 2018), for critical moments as the COVID-19 crisis, but also beyond them. Governments could finance the certificates of MOOCs to help close the digital gap inside the working institutions and the retraining of the workforce needed (Illanes et al., 2018). Still, there is a need to invest in spreading the word about them to the general public.
Despite the data we present, there is still a lack of educational and institutional research around MOOCs. Higher Education represents one area that has been challenged by the disruption of EdTech (the Educational Technology sector) as a market, and today, it is more important than ever to highlight what we have learnt about scalability in Higher Education from our extensive experience using MOOCs.
In further research, we will address the problems that scalability introduces when dealing with the complex goals of HE and its social justice perspective.
Availability of data and materials
The data presented in this study are available on request from the corresponding author. The data are not publicly available due to privacy regulations.
References
Adell Segura, J., Castañeda Quintero, L. J., & Esteve Mon, F. M. (2018). ¿ Hacia la Ubersidad?: Conflictos y contradicciones de la universidad digital. RIED. Revista Iberoamericana de Educación a Distancia. https://doi.org/10.5944/ried.21.2.20669
Bartolomé-Pina, A. (2013). Qué se puede esperar de los MOOC. Comunicación y Pedagogía, 269–270, 49–56. (http://goo.gl/VhG7zs). Accesed 20 Sept 2021
Bartolomé-Pina, A. R., & Steffens, K. (2015). Are MOOCs promising learning environments? Comunicar, 22(44), 91–99. https://doi.org/10.3916/C44-2015-10
Bayeck, R. (2016). Exploratory study of MOOC learners’ demographics and motivation: The case of students involved in groups. Open Praxis, 8(3), 223–233.
Boltz, L. O., Yadav, A., Dillman, B., & Robertson, C. (2021). Transitioning to remote learning: Lessons from supporting K-12 teachers through a MOOC. British journal of educational technology, 52, 1377–1393. https://doi.org/10.1111/bjet.13075
Breslow, L., Pritchard, D. E., DeBoer, J., Stump, G. S., Ho, A. D., & Seaton, D. T. (2013). Studying learning in the worldwide classroom research into edX’s first MOOC. Research and practice in assessment, 8, 13–25. https://files.eric.ed.gov/fulltext/EJ1062850.pdf. Accesed 20 Sept 2021
Bulfin, S., Pangrazio, L., & Selwyn, N. (2014). Making MOOCs: The construction of a new digital higher education within news media discourse. The international review of research in open and distributed learning, 15(5), 290–305. https://doi.org/10.19173/irrodl.v15i5.1856
Castañeda, L., Esteve-Mon, F., & Postigo_Fuentes, A. (s. f.). Digital teaching competence development in higher education: Key elements for an institutional strategic approach. En R. Sharpe, S. Bennett, & T. Varga-Atkins (Eds.), Handbook for digital higher education. Edward Elgar Publishing Ltd.
Chuang, I., & Ho, A. (2016). HarvardX & MITx: Four years of open online courses-fall 2012-summer 2016. https://doi.org/10.2139/ssrn.2889436
Cohen, L., Manion, L., & Morrison, K. (2017). Research methods in education (eight edition). Abingdon, Oxon. ISBN 9781138209886
Connell, J., Carlton, J., Grundy, A., Taylor Buck, E., Keetharuth, A. D., Ricketts, T., Barkham, M., Robotham, D., Rose, D., & Brazier, J. (2018). The importance of content and face validity in instrument development: Lessons learnt from service users when developing the recovering quality of life measure ReQoL. Quality of life research, 27(7), 1893–1902. https://doi.org/10.1007/s11136-018-1847-y
Conole, G. (2014). A new classification schema for MOOCs. The international journal for innovation and quality in learning, 2(3), 65–77. https://goo.gl/bL4GwN. Accesed 20 Sept 2021
Crowe, S., Cresswell, K., Robertson, A., Huby, G., Avery, A., & Sheikh, A. (2011). The case study approach. BMC Medical research methodology, 11(1), 100. https://doi.org/10.1186/1471-2288-11-100
Delft University (2021). Virtual exchange program. Retrieved from https://www.tudelft.nl/studenten/onderwijs/virtual-exchange . Accessed 25 May 2021
Despujol, I., Castañeda, L., & Turro, C. (2018). Developing A MOOC Initiative: Lessons Learned from the Universitat Politècnica de València Experience. Turkish online journal of distance education, 19(1), 215–233.
Dillahunt, T. R., Wang, B. Z., & Teasley, S. (2014). Democratising higher education: Exploring MOOC use among those who cannot afford a formal education. International review of research in open and distance learning, 15(5). http://www.irrodl.org/index.php/irrodl/article/view/1841. Accesed 23 Sept 2021
Duan, P. (2021). The social presence of online education: How MOOC platforms in China cope with collective trauma during COVID-19. Asian journal of communication, 31(5), 436–451. https://doi.org/10.1080/01292986.2021.1941152
edX (2017). Top 4 FAQ about the MicroMasters Credential. https://blog.edx.org/top-4-faq-micromasters-credential. Accesed 23 Sept 2021
edX. (2020). Unlock the potential of every student for free with edX online campus essentials. https://campus.edX.org/essentials. Accesed 23 Sept 2021
edX. (2021). edX catalogue. https://www.edx.org/search?tab=course. Accesed 23 Sept 2021
Fidalgo-Blanco, Á., Sein-Echaluce, M. L., & García-Peñalvo, F. J. (2016). From massive access to cooperation: Lessons learned and proven results of a hybrid xMOOC/cMOOC pedagogical approach to MOOCs. International journal of educational technology in higher education, 13(1). https://doi.org/10.1186/s41239-016-0024-z
Generalitat Valenciana. (2021). Estadística de estudiantes universitarios, principales resultados. https://pegv.gva.es/es/temas/sociedad/educacion/estadistica-de-estudiantes-universitarios. Accesed 25 Sept 2021
Goli, A., Chintagunta, P.K., & Sriram, S. (2022). Effects of Payment on User Engagement in Online Courses. Journal of Marketing Research, 59(1), 11–34. https://doi.org/10.1177/00222437211016360
Guo, P., & Reinecke, K. (2014). Demographic differences in how students navigate through MOOCs. L@S ’14: Proceedings of the first ACM conference on learning @ scale conference, 21–30,. https://doi.org/10.1145/2556325.2566247
Hale, T., Angrist, N., & Goldszmidt, R. (2021). A global panel database of pandemic policies (Oxford COVID-19 government response tracker. Nature human behaviour, 5, 529–538. https://doi.org/10.1038/s41562-021-01079-8
Hansen, J. D., & Reich, J. (2015). Democratising education? Examining access and usage patterns in massive open online courses. Science, 350(6265), 1245–1248. https://dash.harvard.edu/handle/1/23928053. Accesed 25 Sept 2021
Hibberts, M., Burke Johnson, R., & Hudson, K. (2012). Common Survey Sampling Techniques. En L. Gideon (Ed.), Handbook of survey methodology for the social sciences (pp. 53–74). Springer. https://doi.org/10.1007/978-1-4614-3876-2_5
Hill, P. (2012). Four barriers that MOOCs must overcome to become sustainable model. https://eliterate.us/four-barriers-that-moocs-must-overcome-to-become-sustainable-model/. Accesed 25 Sept 2021
Hirschauer, N., Grüner, S., Mußhoff, O., Becker, C., & Jantsch, A. (2021). Inference using non-random samples? Stop right there! Significance, 18(5), 20–24. https://doi.org/10.1111/1740-9713.01568
Holden, R. R. (2010). Face Validity. En The Corsini Encyclopedia of Psychology (pp. 1–2). https://doi.org/10.1002/9780470479216.corpsy0341
Illanes, P., Lund, S., Mourshed, M., Rutherford, S., & Tyreman. (2018). Retraining and reskilling workers in the age of automation. McKinsey Global institute. https://www.mckinsey.com/featured-insights/future-of-work/retraining-and-reskilling-workers-in-the-age-of-automation. Accesed 25 Sept 2021
Jiang, S., Schenke, K., Eccles, J. S., Xu, D., & Warschauer, M. (2018). Cross-national comparison of gender differences in the enrollment in and completion of science, technology, engineering, and mathematics Massive Open Online Courses. PLoS ONE, 13(9), 0202463. https://doi.org/10.1371/journal.pone.0202463
Khalil, H., & Ebner, M. (2014). MOOCs completion rates and possible methods to improve retention a literature review. World Conference on Educational Multimedia, Hypermedia and Telecommunications, 1, 1305–1313.
Khan, A. (2019). Disrupting The Higher Education In Pakistan – A Case Study From ITU. http://blogs.dunyanews.tv/25317/. Accesed 30 Sept 2021
Littenberg-Tobias, J., Ruipérez-Valiente, J. A., & Reich, J. (2020). Studying Learner Behavior in Online Courses With Free-Certificate Coupons: Results From Two Case Studies. The international review of research in open and distributed learning, 21(1), 1–22. https://doi.org/10.19173/irrodl.v20i5.4564
Liyanagunawardena, T. R., Adams, A. A., & Williams, S. A. (2013). MOOCs: A systematic study of the published literature 2008–2012. The international review of research in open and distributed learning, 4(3), 202–227.
Lugton, M. (2012). What is a MOOC? What Are the Different Types of MOOCs? XMOOCs and cMOOCs. Reflections. http://goo.gl/9Szd6o. Accesed 30 Sept 2021
Margaryan, A., Bianco, M., & Littlejohn, A. (2015). Instructional quality of massive open online courses MOOCs. Computers and Education, 80, 77–83. https://doi.org/10.1016/j.compedu.2014.08.005
Mays, T. J., Ogange, B., Naidu, S., & Perris, K. (2021). Supporting teachers moving online, using a MOOC, during the COVID-19 pandemic. Journal of learning for development, 8(1), 27–41. https://eric.ed.gov/?id=EJ1294984. Accesed 30 Sept 2021
McIntyre, C. (2018). EdX MicroMasters vs Coursera MasterTrack—A Comparison. https://www.mooclab.club/resources/edX-micromasters-vs-coursera-mastertrack-a-comparison.598/. Accesed 30 Sept 2021
M.I.T. (2021). Pathways to Graduate Programs. https://micromasters.mit.edu/pathways-graduate-programs/. Accesed 30 Sept 2021
Muzafarova, T., & Kaya, E. (2015). Survey of awareness of massive open online courses (MOOC)–A case of international black sea university students. Georgia Journal of Education, 3(2), 15–19. https://jebs.ibsu.edu.ge/jms/index.php/je/article/view/100/108. Accesed 30 Sept 2021
Nus (2021). Design Your Own Module. Retrieved from https://www.nus.edu.sg/registrar/academic-information-policies/undergraduate-students/design-your-own-module . Accessed 25 May 2021
Open edX (2018). Global Open edX deployments. https://twitter.com/OpenEdX/status/989594697290174465. Accesed 30 Sept 2021
Open edX (2021). Sites powered by Open edX platform. https://openedX.atlassian.net/wiki/spaces/COMM/pages/162245773/Sites+powered+by+Open+edX+Platform. Accesed 30 Sept 2021
Papadimitriou, A. (2020). Beyond rhetoric: Reinventing the public mission of higher education. Tertiary Education and Management, 26, 1–4. https://doi.org/10.1007/s11233-019-09046-9
Pappano, L. (2012). The Year of the MOOC”. The New York Times. https://www.nytimes.com/2012/11/04/education/edlife/massive-open-online-courses-are-multiplying-at-a-rapid-pace.html. Accesed 30 Sept 2021
Pickard, L., Shah, D., & De Simone J., J. (2018). Mapping Microcredentials Across MOOC Platforms (pp. 17–21,). https://doi.org/10.1109/LWMOOCS.2018.8534617
Ponce Ceballos, S., & Ruelas Mexía, P. Y. (2021). Beneficios de los MOOC en estudiantes universitarios durante la emergencia académica por la COVID-19. Práxis Educativa, 16, 1–24. https://doi.org/10.5212/PraxEduc.v.16.18097.072
Quijano-Escate, R., Rebatta-Acuña, A., Garayar-Peceros, H., Gutierrez-Flores, K. E., & Bendezu-Quispe, G. (2020). Aprendizaje en tiempos de aislamiento social: Cursos masivos abiertos en línea sobre la COVID-19. Revista Peruana de Medicina Experimental y Salud Pública, 37(2), 375–377. https://doi.org/10.17843/rpmesp.2020.372.5478
Radford, A. W., Coningham, B., & Horn, L. (2015). MOOCs: Not just for college Students—How organisations can use MOOCs for professional development. Employment relations today, 41(4), 1–15. https://doi.org/10.1002/ert.21469
Randall, A. (2020a). Reflecting on the overwhelming response from the edX partner community on our coronavirus response. https://blog.edX.org/reflecting-overwhelming-response-edX-partner-community-coronavirus-response. Accesed 15 Sept 2021
Randall, A. (2020b). EdX Global University partner community joins forces to help students impacted by coronavirus. http://blog.edX.org/edX-global-university-partner-community-joins-forces-help-students-impacted-coronavirus. Accesed 15 Sept 2021
Regalado, A. (2012). The most important education technology in 200 years. MIT technology review. https://www.technologyreview.com/2012/11/02/181925/the-most-important-education-technology-in-200-years/. Accesed 15 Sept 2021
Reich, J., & Ruipérez-Valiente, J. A. (2019). The MOOC Pivot. Science, 363(6423), 130–131. https://joseruiperez.me/papers/journals/2019_Science_MOOCPivot_postprint.pdf. Accesed 15 Sept 2021
Rodriguez, C. O. (2012). MOOCs and the AI-Stanford like courses: Two successful and distinct course formats for massive open online courses. European Journal of Open, Distance and E-Learning, 15(2). http://files.eric.ed.gov/fulltext/EJ982976.pdf. Accesed 15 Sept 2021
Rolfe, V. (2015). A systematic review of the socio-ethical aspects of massive online open courses. European Journal of Open, Distance and E-Learning, 18(1), 52–71. http://www.eurodl.org/?p=current and sp=full and article=670. Accesed 15 Sept 2021
Ruipérez-Valiente, J. A., Cobos, R., Muñoz-Merino, P. J., Andujar, Á., & Delgado Kloos, C. (2017). Early Prediction and Variable Importance of Certificate Accomplishment in a MOOC. En C. Delgado Kloos, P. Jermann, P.-S. M., D. Seaton, and S. White (Eds.), Digital Education: Out to the World and Back to the Campus. EMOOCs 2017. Lecture Notes in Computer Science (Vol. 10254). Springer. https://doi.org/10.1007/978-3-319-59044-8_31
Ruipérez-Valiente, J. A., Jenner, M., T., S., Li, X., Rohloff, T., Halawa, S., Turro, C., Cheng, Y., Zhang, J., Despujol, I., & Reich, J. (2020). Macro MOOC learning analytics: Exploring trends across global and regional providers. LAK ’20: Proceedings of the Tenth International Conference on Learning Analytics & Knowledge. https://doi.org/10.1145/3375462.3375482
Saldaña, J. (2015). The Coding Manual for Qualitative Researchers (3rd ed.). SAGE Publications Ltd.
Schmidt, L. (2012). MOOCs: Near the peak of inflated spectations. http://www.americalearningmedia.com/edicion-017/194-innovacion/2382-moocs-cerca-del-pico-maximo-de-expectativas-infladas. Accesed 15 Sept 2021
Schuwer, R., Jaurena, I. G., Aydin, C. H., Costello, E., Dalsgaard, C., Brown, M., & Teixeira, A. (2015). Opportunities and threats of the MOOC movement for higher education: The European perspective. The International Review of Research in Open and Distributed Learning, 16(6). https://doi.org/10.19173/irrodl.v16i6.2153
Seale, A. C., Ibeto, M., Gallo, J., Waroux, O. le P. de, Glynn, J. R., & Fogarty, J. (2021). Learning from each other in the COVID-19 pandemic (5:105). Wellcome Open Research. https://doi.org/10.12688/wellcomeopenres.15973.2
Shah, D. (2017). MOOCs Started out Completely Free. Where are they now? https://www.edsurge.com/news/2017-04-20-moocs-started-out-completely-free-where-are-they-now. Accesed 28 Sept 2021
Shah, D. (2013). By the numbers: MOOCs in 2013. Class central. https://www.classcentral.com/moocs-year-in-review-2013. Accesed 28 Sept 2021
Shah, D. (2016). Monetisation over massiveness: A review of MOOC stats and trends in 2016. Class Central. https://www.classcentral.com/report/moocs-stats-and-trends-2016/. Accesed 28 Sept 2021
Shah, D. (2020). By the numbers: MOOCs in 2020. Class central. https://www.classcentral.com/report/mooc-stats-2020/. Accesed 28 Sept 2021
Shakya, M., Shrestha, S., & Manandhar, R. (2016). Awareness of MOOC among college students: A study of far western region of Nepal. International Conference on IT4D. https://www.researchgate.net/profile/Manoj-Shakya/publication/306057436_Awareness_of_MOOC_Among_College_Students_A_Study_Of_Far_Western_Region_of_Nepal/links/57acb04a08ae7a6420c30bb5/Awareness-of-MOOC-Among-College-Students-A-Study-Of-Far-Western-Region-of-Nepal.pdf. Accesed 28 Sept 2021
Siemens, G. (2012). What is the theory that underpins our moocs? Elearnspace. http://www.elearnspace.org/blog/2012/06/03/what-is-thetheory-that-underpins-our-moocs/. Accesed 28 Sept 2021
Toven-Lindsey, B., Rhoads, R. A., & Lozano, J. B. (2015). Virtually unlimited classrooms: Pedagogical practices in massive open online courses. The Internet and Higher Education, 24, 1–12. https://doi.org/10.1016/j.iheduc.2014.07.001
U.P.V. (2021a). Datos estadísticos de personal UPV, distribución de personal por colectivo y sexo. En Universitat Politècnica de València (UPV. https://upvtransparent.upv.es/dataset/numero-de-personal-por-colectivo-y-sexo/resource/114257b1-833f-4aa0-8691-c0e7a9f7c006. Accesed 28 Sept 2021
U.P.V. (2021b). Memoria del curso académico 2019–2020 [Informe Anual. En Universitat Politècnica de València (UPV. https://www.upv.es/entidades/SG/infoweb/sg/info/U0891086.pdf. Accesed 28 Sept 2021
Utunen, H., Ndiaye, N., Piroux, C., George, R., Attias, M., & Gamhewage, G. (2020). Global Reach of an Online COVID-19 Course in Multiple Languages on OpenWHO in the First Quarter of 2020: Analysis of Platform Use Data. Journal of Medical Internet Research, 22(4), e19076. https://doi.org/10.2196/19076
Yu, X., Karsten, E., Kenney, D., Sinha, A., & Brunamonti, C. (2021). 2021 Coursera impact report. https://about.coursera.org/press/wp-content/uploads/2021/11/2021-Coursera-Impact-Report.pdf. Accesed 5 Nov 2021
Funding
Open Access funding provided thanks to the CRUE-CSIC agreement with Springer Nature. This projects partially supported this research: “Competencies for Universities—using Technology in Education” CUTE, an ERASMUS + Strategic Partnership (KA203-867FE04B), funded by the European Union.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
None.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Despujol, I., Castañeda, L. & Turró, C. MOOCs as a massive learning resource for a Higher Education Community. The Universitat Politècnica de València experience using the EdX remote access program. Educ Inf Technol 27, 12999–13020 (2022). https://doi.org/10.1007/s10639-022-11140-2
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10639-022-11140-2