Introduction

On the 5th of March 2020, the first case of COVID-19 was confirmed in South Africa [1]. Subsequently, the South African Government announced a national lockdown starting on the 26th of March 2020. In response to this announcement and considering the unique realities facing higher education students, which include limited access to computers, devices and high-quality internet off-campus, the University of the Free State (UFS), located in central South Africa, launched various support initiatives for academic staff and students. Academic staff members who are responsible for student training (learning, teaching and assessment) had to quickly adapt teaching and learning activities and assessments for emergency remote teaching to ensue. Despite these initiatives, students and academic staff members experienced disruption in all aspects of their academic and personal life through this sudden transition.

Medical education relies mainly on face-to-face and some blended learning (e.g. clinical skills training and work-based learning). Migration to a purely online mode is not simple, as not all immersive learning activities are suited for the online environment. Online educational approaches using learning management systems, e.g. Blackboard, have been shown to be acceptable with varying perspectives among students and staff [2] and may be dependent on academic staff members’ experience and attitudes [3]. Online learning promotes student self-regulation, life-long learning, and other graduate attributes, but it may be more demanding. Coupled with social isolation as required during COVID-19, it may be a less comprehensive learning experience unless carefully planned [4]. Students do not adapt seamlessly to online learning [4]. The digital divide among students with varied socio-economic backgrounds in the South African higher education landscape further affects students’ learning experience and academic progress.

The sudden transition to online teaching, learning and assessment in higher education has influenced undergraduate students and academic staff members responsible for learning, teaching and assessment in the Faculty of Health Sciences in numerous ways. While a challenge is always a door to opportunity and innovation, the disruptive effects of the global pandemic may also be disastrous for some [5]. The COVID-19 pandemic has tested healthcare professionals, health sciences students and all those involved in training future healthcare professionals in every aspect of professional and personal life [6].

This study aimed to investigate academic staff members’ experiences of online learning and teaching in the undergraduate medical programme at the UFS during the COVID-19 pandemic lockdown in 2020. Understanding how lecturers dealt with a critical global disruptor should inform future planning and management.

Method

We used a mixed-methods approach in the form of a sequential exploratory design in two phases [7]. The rationale for using mixed-methods flows from a pragmatist paradigm [8]. The advantage of mixed-methods research is that it draws on the strengths of quantitative and qualitative approaches [7]. The disruptive impact following the COVID-19 pandemic lockdown in 2020 can best be understood using diverse and comprehensive methods, especially in the complex medical education environment. Quantitative data from the questionnaire survey (phase 1) described the population and their experiences. These data were triangulated and complemented with qualitative data obtained from more than one source (responses to open questions in the questionnaire survey and reflective essays (phase 2) to contribute to the validity of findings and depth of understanding.

The undergraduate medical programme (MBChB) at the UFS is divided into three phases. Phase I (semester 1) and phase II (semesters 2–5) comprise preclinical and phase III (semesters 6–10) clinical training, respectively. The UFS uses the Blackboard online learning management system. The UFS Centre for Teaching and Learning (CTL) provides training and support for academic staff members responsible for student training (learning, teaching and assessment), using face-to-face and online training platforms. All the full-time employed academic staff members involved in the undergraduate MBChB programme in the Faculty of Health Sciences were included in the sample population. Faculty academic staff members include those appointed at the UFS and the joint employment establishment (UFS and Free State Department of Health). Faculty academic staff have medical or scientific qualifications (for example, general medical practitioners, medical specialists, and biomedical scientists) and are responsible for lecturing and clinical training.

The total population was estimated at 70. Academic staff members who were not involved in the transition to online teaching, learning and assessment in the MBChB programme during COVID-19 were excluded from the study population.

In phase 1 of the study (conducted from July to August 2020), academic staff members in the Faculty of Health Sciences involved in student training in the MBChB programme (undergraduate medical programme) were invited to complete anonymous online questionnaires distributed electronically via e-mail using the Evasys online automated survey platform (https://evasys.de/en/). The questionnaire included closed and open questions obtaining quantitative and qualitative data, investigating academic staff members’ experiences of online teaching, learning and assessment during the COVID-19 pandemic lockdown period. The e-mail invitation included information about the study. Consent was inferred through the completion of the questionnaire. The questionnaire was available for 2 weeks initially; after that, a further reminder was sent, and the questionnaire was available for an additional 2 weeks.

Phase 2 took place 3 months after phase 1 (November 2020). We investigated academic staff members’ personal experiences of online teaching, learning and assessment in the MBChB programme during the 2020 COVID-19 pandemic lockdown through an online anonymous reflective essay (maximum 500 words). A link to an Evasys survey platform was provided to academic staff in an e-mail invitation to ensure anonymous submission. No personal identifiers were requested from participants besides indicating in what phase of the programme they are involved.

The e-mail invitation was sent to all academic staff members once a week for 4 weeks, with a submission deadline set for one 1 after the final reminder date. All reflective essays submitted during 5 weeks were included for analysis. Consent was assumed through voluntary participation.

All data were handled with strict confidentiality. Statistical analysis of quantitative data was done by one of the researchers, using SAS Version 9.4. Descriptive statistics, namely frequencies and percentages of categorical data, were reported. The statistical significance of differences in responses regarding training and activities before and during the COVID-19 lockdown period was assessed using McNemar’s test for paired data. Internal validity was addressed by ensuring a well-structured questionnaire and doing a pilot study. Qualitative data were analysed using thematic analysis. Through an inductive process, themes were established from the data. The themes were determined by reading the qualitative data (responses to open questions and reflective essays) and developing a coding scheme. One researcher identified themes in an initial round of analysis, while a second researcher subsequently read the qualitative data and themes to further refine the analysis. Two researchers in the team agreed on the final codes and themes. Thematic analysis allows for identifying patterns (themes) in the data and provides breadth and depth to understanding and interpreting underlying issues [9]. Thematic analysis of narrative reflections provides rich descriptions of personal experiences [10, 11].

The Health Sciences Research Ethics Committee of the University of the Free State approved the study (UFS-HSD2020/1112/2909) and relevant UFS Gatekeepers’ approval was obtained.

Results

We report general results, including the characteristics of participants (academic staff members), descriptive statistics of quantitative data (phase 1) and thematic analysis of qualitative data (phases 1 and 2).

Characteristics of Participants

Of the target population of 70 academic staff members, 36 full-time employed academic staff members participated in phase 1 of the study (response rate 51.4%), while 12 participated in phase 2 by writing online reflections (response rate 17.1%). One participant who responded in phase 2 but did not write a reflection was excluded from the analysis. In phase 1, 20 participants (55.6%) were employed by the UFS, and 16 (44.4%) were employed on the joint employment of two establishments (UFS and Free State Department of Health). Fifteen (41.7%) participants indicated that they had occupied the current position for 11 years or longer, while 16 (44.4%) indicated that they had been in the position for 5 years or less. In phase 2, similar background information was not requested.

In phase 1, nine (25.0%) academic staff members indicated involvement in phase I, 23 (63.9%) in phase II, and 22 (61.1%) in phase III of the MBChB programme (ranging between one and eight modules). Most participants (n = 31, 88.6%) fulfilled administrative roles in two or more modules. In phase 2, six academic staff members were involved in teaching and learning in phase II of the MBChB programme, three in phase III, and one in phase I. Five academic staff members were involved in teaching and learning in other Schools in the Faculty of Health Sciences (excluding the MBChB programme).

Quantitative Data: Phase 1

Questions determined academic staff members’ use of various online training activities before and during the COVID-19 lockdown period (illustrated in Table 1). Twenty-four participants (66.7%) indicated that they had received training on the use of Blackboard administrative functions before the lockdown period, and 11 (30.6%) received training during the 8 months since the commencement of the lockdown period in March 2020 (p < 0.001). Statistically significantly more participants reported receiving training in online teaching (n = 23, 63.9%; p = 0.001), formative (n = 21, 58.3%; p = 0.018) and summative assessment (n = 20, 55.6%; p = 0.001) during the lockdown compared to before the lockdown. Significantly more participants indicated that they had already received training in online assessment modalities before lockdown (QuestionMark: n = 18, 50.0%; p = 0.003).

Table 1 Participants’ Blackboard and online assessment training before and during the COVID-19 lockdown

Table 2 indicates that academic staff members increased the use of all Blackboard activities during the 2020 COVID-19 lockdown period. Blackboard class announcements increased from 24 (66.7%) before to 28 (77.8%) during the lockdown (p = 0.157), while Blackboard Collaborate use for presenting lectures increased from five (13.9%) to 33 (91.2%), p < 0.001. Academic staff members using summative assessment (6 (16.7%) to 11 (30.6%); p = 0.096) doubled and the increase in use of formative assessments from (10 (27.8%) to 21 (58.3%); p = 0.002), and grading on Blackboard (10 (27.8%) to 20 (55.6%); p = 0.002) were statistically significant. A few academic staff members indicated that they started using other activities (journals, discussion boards, blogs) during the lockdown, but these percentages were not statistically significantly higher than before the lockdown. No academic staff members reported using Wikis before or during the lockdown.

Table 2 Blackboard activities utilised by participants before and during the COVID-19 lockdown

Table 3 indicates academic staff members’ experience of implementing online teaching and learning activities during the lockdown. Most academic staff members indicated that they found it easy or average to do activities including build their module page online, source material for online teaching, engage with students on the learning platform, bring prior learning into the learning environment, upload material to meet the learning needs of students, scaffold learning materials and activities for students, use Blackboard Collaborate, set up assignments, set up formative assessments, use the Grade function, and have 80% response to assignments. Most academic staff members found it average or difficult to have 80% online participation of students or 80% response to tests/assignments. Most academic staff members reported that using learning activities, e.g. journals, discussion boards and blogs, self-reflection, and peer evaluation was not applicable to them.

Table 3 Implementation of online teaching and learning activities during the COVID-19 lockdown

Thematic Analysis: Phases 1 and 2

Analysis of qualitative data collected from phase 1 (responses to open questions) and phase 2 (online reflective essays) was done concurrently, providing corroboration of findings. The data are available in Appendices A and B.

Qualitative data collected during phase 1 (36 participants) included responses to open questions. These included “What were the major challenges for you to transition to online teaching?” (34 responses, two missing), “What were your most positive experiences of the transition to online teaching?” (32 responses, four missing), and “What are your suggested training needs?” (28 responses, eight missing). Qualitative data collected during phase 2 (11 participants) were in the form of a reflective essay on their experience of transitioning to online learning during the COVID-19 lockdown in 2020.

Five themes and related categories emerged from qualitative analysis. These included Teaching and Learning (Engagement, Online approach, Responsibility), Assessment (Integrity, Convenience), Technology (Access, Support), Communication (Platforms, Frequency), and Personal experience (Remote setting, Growth, Adaptability). Illustrative quotes are provided from the responses to open questions in the survey (S + participant number) and reflective essay (R + participant number).

Teaching and Learning

Engagement emerged as a prominent category in the theme Teaching and Learning. Academic staff members acknowledged that adapting from highly interactive face-to-face settings to an online format was challenging and that the training provided by the CTL was useful to equip them:

Engagement with the students – at times I feel I am talking to myself (S3)

Despite all this effort – student engagement with regards to BBCFootnote 1discussions was minimal at best even with polling and MCQsFootnote 2being availed throughout the sessions….I could not tell if the majority were even ‘in’ the session – or had just simply logged in for the attendance register and left the room to attend to other activities. (S28)

Academic staff members expressed the need for training in improving student engagement online, e.g. “I need further assistance in conforming my lectures to be more interactive” (S9).

Another category, the online approach, revealed that while this approach offered opportunities for enhanced teaching and learning, it was also limited by academic staff members’ perceptions:

Having to move over to a completely online environment …. has been quite a challenge. This has however also provided the opportunity for growth and learning on how to adapt to using the online platform to support students and facilitate learning in a way that is acceptable and understandable to students. (R5)

This is illustrated by quotes such as “very impersonal and not conducive to training” (S24), “my modules are better learned physically than online” (S17), and “I am yet to be convinced that practical clinical skills can be better taught online rather than in-person” (S8). Even the positive aspects of online learning and teaching (“unrestricted access to the learning material” (S28), “you only have to give a lecture once” (S30), and “students tend to receive more individual attention when using the online teaching platform” (S21)) and the fact that “online learning benefits the students who are very self-motivated to learn” (S13) may be negated in the light of it being “an obstacle for those students who benefit from the sense of community that face-to-face learning offers” (S13).

The responsibility of lecturers and students was highlighted as another category in this theme. Lecturers felt that online sessions encouraged only students who were genuinely interested in engaging. While some felt that it reduced students’ responsibility for their learning (“I think most of the time the lectures over-communicated to the student and it made them lazy to read instructions and the phase guide. They wanted to be spoon feed even more” (R2)) others indicated that students “took more responsibility for their own learning” (S7) although students’ familiarity with the online approach limited their progress (“I do worry that because students aren’t used to online studying they stay behind even with all our efforts” (R11)).

Assessment

Integrity emerged as a category in the theme Assessment. Lecturers mentioned that students used “digitally assisted platforms to complete online tests and that many students would subsequently lack foundational theoretical knowledge to thrive under high-pressure face-to-face situations” (R1) and cheated by using notes and other resources so that maintaining test security was a challenge. While there was less work marking with online assessments, it took more time to prepare and set up online assessments. Although some lecturers indicated especially preclinical students having better marks with online assessments, others stated a decline in student achievement (“Marks have fallen dramatically” (S29)), and concern about foundational knowledge acquisition as shown above. There was a need for increased training in setting up online tests and assessments (“I would like more personal interaction with blackboard personal in the way to set up online tests and assessments- the broad outlines were not helpful for me in the way that I need to evaluate the students” (S12)) and methods to “appraise and audit online tools” (S15).

Technology

Under this theme, access for both students and academic staff to use the variety of online options emerged as a category. Connectivity and technical issues and variable degrees of familiarity when using electronic media or the learning management system impacted on the use of technology (“In the beginning was uncertain, not sure if it was effective worried about all the IT and techno problems that might occur during an online class” (R2)). In some cases, lecturers supported students by providing access or resources (“I felt like I was doing my work and expected to do that of the students as well- as students were also indicating that they did not have access to various resources off campus- so I had to bridge that gap for them” (S28)) and reported concern that students would be “left behind” (R12) without the necessary access and support.

Another category in the theme Technology was support. Lecturers expressed concerns about the initial rollout of support for students in the early stage of the lockdown:

Although the university tried to develop systems of communication and connectivity a lot of students especially from disadvantaged backgrounds could not get access and were ‘left behind’. The Global Protect App did not work students did not get the data that was promised. The roll out of computers did not go well. NSFASFootnote 3promised to provide students with laptops but up until now that has not happened. Not being able to get access the campus was very difficult because lecturers and students had left their resources behind. (R12)

Lecturers also expressed appreciation for the support provided by the institutional CTL and the Faculty of Health Sciences to academic staff and students during the transition. This is illustrated in statements such as “amount of training made available to make this transition easier” (S32), “The immense support offered by CTL to assist staff in creating the online platform” (S23) and “In this strange times I believe that the students were assisted in the best way possible. Congratulations to the Health Faculty” (R9). Lecturers expressed the need for continuous and further training, especially in using the online learning platform and optimising interaction with students. This is supported by statements such as “Continuous training in Blackboard features—I am only using a very small part of what it actually provides. I am probably not even aware of all the possibilities.” (S5).

Communication

Many academic staff members alluded to the sense of impaired communication due to the unfamiliarity of the online platform as opposed to seeing students in person. Statements like “Familiarizing myself with the concept of not seeing the student faces while giving a lecture. Not being sure if my point is going across as intended” (S5) and “Not able to evaluate the body language of the students – or to directly interact with students” (S16) as well as a sense of being unprepared for the sudden transition raised concerns about educational efficacy, lecturer-student relationships, and student wellbeing. Challenges were mentioned, including “To gauge where the students were academically and emotionally. To maintain the teacher-student bond” (S33).

As part of this theme, the frequency of communication and using alternative methods, e.g. e-mail and text messaging, emerged. One lecturer cautioned against the effect of over-communication in decreasing students taking responsibility for their learning:

…Although there were no issues it was not enjoyable. Prefer to see the students face-to-face. I think most of the time the lectures over-communicated to the student, and it made them lazy to read instructions and the phase guide. They wanted to be spoon feed, even more, my impression. (R2)

Although lecturers welcomed the engagement and positive feedback from students on e-mail communication, they also noted being inundated with “The ‘million’ e-mails and questions. I think it is much easier for students to ask questions behind an ‘unknown identity’” (S22) adding to their already full work schedules.

Using alternative communication platforms, e.g. WhatsApp, afforded flexibility and opened channels to stay in touch with students, and some lecturers preferred these platforms to the learning management system (“I found Blackboard difficult and cumbersome to navigate- not always sure whether what I planned would happen. sting announcements is much more complicated than just sending a whatsap [sic] message on a group for example” (S10)).

Personal Experience

Many academic staff members indicated how the changes due to the lockdown impacted their personal lives and experience of an uncertain new environment (“the feeling of not being in control” (S24)). This is illustrated in quotes such as “However- one had to stay self-motivated and constantly remind yourself that you are an essential piece of a puzzle and your contribution was needed” (S28) and “Challenging times but allowing for a lot of personal growth and reflection” (R7).

The remote setting emerged as a category under the theme Personal experience. Although some academic staff members experienced the transition to online teaching as positive due to the convenience and flexibility of working remotely through creative, innovative methods (“we can successfully work from home in any case” (R11) and “being creative and innovative” (S3), and “I could teach from the comfort of my home. I could be contacted online anywhere at any time” (S12)), others experienced isolation and frustration. This is illustrated in quotes such as “It was very challenging to set up a work space connectivity and routine” (R11), “More often than not- I was working from 8:00 to 23:00- because one could simply not switch off working from home- constantly surrounded by work and an endless stream of e-mails from students- and work-related deadlines” (S28), and “my experience was the exact opposite and was made more difficult by feelings of isolation as someone who lives on their own” (S28).

Furthermore, the category personal growth and adaptability was identified through academic staff members mentioning how they dealt with the changing, unpredictable environment (“But this is the new reality and I will adapt” (R3)), seeing this as an opportunity for growth, reflection, development and innovation (“Learning new online teaching skills – and feeling more confident and empowered in that regard” (S15) and “new experiences and broadening of my horizon in online teaching” (S16)). The downside was mentioned in terms of time management, drained personal resources (“online teaching required me to fish out more money from my personal pocket to buy data to work online” (S9)) and increased responsibilities that did not yield recognition:

It took a lot of additional time to listen to podcasts attend webinars and seek examples to ensure that the teaching and learning, as well as assessments, were good quality. Unfortunately, the additional time spent on all these activities did not necessarily reflect on our performance management and research outputs. (R7)

Overall, despite acknowledging challenges, personal growth was evidenced through statements such as “resilience and being optimistic are character traits I have learnt master” (S28). One lecturer summarised their experience in this way:

In general the university and the faculty did its best under the difficult circumstance to support staff and students. There is no doubt everybody did their best to deliver quality teaching and support students. There was a lot of innovation and creativity. Although the period was emotionally draining there was resilience among staff and students. (R12)

Discussion

COVID-19 lockdown in 2020 had an unprecedented impact on the world and the continuum of medical education, requiring rapid adjustments and most likely enduring educational developments [12]. At the UFS, the continuation of the undergraduate medical programme included adopting online educational delivery and transitioning to a blended learning approach with synchronous and asynchronous online theoretical training, in-person clinical placements and practical skills training adapted to COVID-19 regulations, and a combination of face-to-face and online assessments. This is congruent with descriptions of adaptations to clinical learning reported in a recent systematic review [13] and a scoping review on the impact of COVID-19 on medical education [5].

Academic staff members’ experience at the UFS highlighted the catalytic impact of the crisis to fast-track change and drive innovation [14]. While most academic staff members indicated familiarity with the Blackboard learning management system administrative functions through training and use, the transition to online learning sped up training interest, implementation of online teaching and assessment activities, and innovative, creative and practical problem-solving to ensure continuity in training and student support. Academic staff members utilised different training opportunities to familiarise themselves with the online environment and improve their skills. Although quantitative data indicated that academic staff members increasingly implemented online teaching and assessment activities and were comfortable doing so, triangulation of these findings with qualitative data exposed a more nuanced perspective, including concerns about the stability, feasibility, and accountability of enforced change. This is supported by literature calling for equity in socially just learning environments and fostering a growth mindset among healthcare professionals [14].

In a post-pandemic educational environment, we should reflect on the lessons learnt to optimise what is best about online approaches rather than merely sustaining the status quo [15]. Findings from this study revealed that regarding teaching and learning, student engagement, the online learning approach and shared responsibility among students and academic staff were essential considerations, as well as the integrity and convenience of assessments. Sound pedagogical approaches need meticulous planning, implementation review and oversight, all of which require time and expertise that were unavailable during the COVID-19 pandemic response [15]. However, paying attention to the evidence and issues highlighted by those at the “coalface” of implementing forced crisis-driven change should inform educational approaches.

Leveraging technology in learning cannot be done without addressing the inequality in access to and availability of essential resources, including infrastructure, devices, connectivity, data, and expertise. The findings from this study gave a thick description of the complex reality academic staff and students face in a resource-constrained environment and concur with the needs in lower- and middle-income countries highlighted by Connolly and Abdallah [5]. Furthermore, this study also emphasised that innovative and creative solutions to communication in the educational environment and fostering collaborative relationships between academic staff and students are necessary to ensure optimal delivery of medical education to prepare the next generation of healthcare workers for an increasingly volatile, uncertain, complex and ambiguous world [16].

Finally, the study yielded a layered understanding of academic staff members’ personal experience of growth and adaptability during a time of unprecedented uncertainty and emergent change. The COVID-19 pandemic will be recorded as a historical inflection point that not only tested global resources and resolve [14] but has underlined numerous skills necessary to be flexible and adaptable to change [16].

Limitations

Although 51.4% of the academic staff members participated in the questionnaire survey, the low number of participants (n = 36) limits meaningful comparisons between and across groups as well as the generalisability of the findings. The low response rate to the online reflective essay in the second phase (17.1%) and the fact that these reflections were very short (median word count 113 words, range 14–396 words) were mitigated by concurrent thematic analysis of the rich qualitative data emerging from responses to open questions from 33 participants in phase 1.

Conclusions

Overall, academic staff members responsible for learning, teaching and assessment of undergraduate medical students had positive experiences of online learning during the COVID-19 pandemic lockdown period, and it was perceived as challenging yet valuable. Concerns about students’ access to technology and adaptation to online learning were expressed. In-depth understanding of academic staff members’ experiences was identified in the themes Teaching and Learning, Assessment, Technology, Communication and Personal Experience.

The training needs and challenges identified from these findings should guide future strategic imperatives for medical education. By recognising and reinforcing resilient, transformative responses to this global disruptor, future generations can build on our lessons learnt.