Abstract
During the COVID-19 pandemic, distance learning became the predominant teaching method at most universities, exposing students and teachers alike to novel and unexpected challenges and learning opportunities. Our study is situated in the context of higher physics education at a large Swedish university and adopts a mixed-methods approach to explore how students perceive shifts to distance learning. Quantitative student survey responses comparing distance learning during the pandemic with previous in-person learning are analyzed with k-means cluster analysis and with a random-intercept multilevel linear model. Combined analyses produce a consistent picture of students who report having experienced the greatest challenges. They are on average younger, report being less autonomous in their learning, and find it harder than peers to ask questions to the instructor. They are also less likely to have access to a place where they can study without interruptions. Variation across courses is small with students being largely subjected to the same set of challenges. Qualitative data from semi-structured focus group interviews and open-ended questions supports these findings, provides a deeper understanding of the struggles, and reveals possibilities for future interventions. Students report an overall collapse of structure in their learning that takes place along multiple dimensions. Our findings highlight a fundamental role played by informal peer-to-peer and student-instructor interactions, and by the exchange of what we refer to as “structural information.” We discuss implications for teachers and institutions regarding the possibility of providing support structures, such as study spaces, as well as fostering student autonomy.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
Introduction
“(...) At night I take two steps back and go to bed.”
Distance learning (DL)Footnote 1 moves learning from the physical classroom to a technology-moderated space of communication and information exchange. During the COVID-19 pandemic, instruction was moved online with very short notice, presenting teachers and students alike with novel challenges. A growing body of literature explores this shift to DL. The lack of face-to-face interaction with teachers and peers is emphasized as a particularly critical factor in multiple national and disciplinary contexts, such as higher education in Pakistan (Adnan & Anwar, 2020), Germany (Hoss et al., 2021), the USA (Serhan, 2020), and Turkey (Yazgan, 2022), as well as chemistry higher education in the USA (Jeffrey & Bauer, 2020) and physics higher education in Italy (Marzoli et al., 2021). A lack of interaction negatively affected engagement, interest, and motivation of students and even changed students’ attitudes towards the subject itself (e.g., Marzoli et al, 2021). Meta-studies highlight the importance of supporting students’ social needs and guaranteeing the continuity of education (Bozkurt et al., 2022). As the pandemic has accelerated the trend of making DL more mainstream, teachers and institutions are now presented with the question of which of the enacted changes in education delivery should be kept in non-pandemic times (Sharaievska et al., 2022).
Students display mixed reactions to the shift to DL, with negative attitudes, on average, being more prominent than positive attitudes (Hoss et al., 2021; Sharaievska et al., 2022; Yazgan, 2022). Not all students respond to the transition in the same way, prompting the question on why some groups respond more positively than others (Sharaievska et al., 2022). While student attitudes and perceptions in general have been intensely investigated, Bond et al. (2021) highlight a lack of consideration for marginalized and vulnerable populations. Identifying potentially vulnerable students is therefore crucial to ensure that nobody is left behind. Evidence shows that international students (Whatley & Castiello-Gutiérrez, 2022), black students and students from ethnic minorities (Arday & Jones, 2022; Donham et al., 2022; Lederer et al., 2021), and students with disabilities (Bartz, 2020) are particularly vulnerable. At the level of individual students, several factors have been reported to affect responses to DL, such as autonomy and self-regulation (Broadbent & Poon, 2015; Pintrich, 2004; Zimmerman, 2002). Motivation, self-efficacy, and use of technology are linked to better engagement and increased academic performance (Aguilera-Hermida, 2020). Students who have access to, and higher competence using, computers also display more positive attitudes to DL (Terzi et al., 2021). First-year students have been recognized to struggle with self-regulation, self-organization, and communication skills (Klein et al., 2021). Other studies find that education level and seniority correlate with student attitudes (Malkawi et al., 2021).
With DL being an umbrella term encompassing very different implementations, it is important to attend to which structures, practices, and tools lead to better outcomes for different groups of students. Among the studies that investigate this issue in the context of the pandemic, the difference between synchronous and asynchronous online teaching appears to be particularly relevant (Guo, 2020). Synchronous collaborative tools have been found to be common in studies conducted during the first year of the pandemic (Bond et al., 2021). Several studies have argued that teaching methods such as flipped classroomsFootnote 2 (Lage et al., 2000) alleviated some of the negative aspects of the shift to DL (Divjak et al., 2022). From a constructivist perspective on learning, instructors shape learning environments, yet students are responsible for their learning (Bransford et al., 2000). Tanner (2013) highlights the importance of providing structure that invites all students to participate in learning and to shape an inclusive classroom environment, providing another angle from which different implementations of DL can be assessed.
In this study, we combine perspectives on affordances and challenges of the shift to DL with a focus on which student groups are particularly vulnerable and which methods students understand to positively affect their experiences. Grounded in the framework of Community of Inquiry (CoI), we employ a mixed-methods approach to build on and reach beyond findings of previous studies. In the context of higher education in Physics and Engineering at a large Swedish university which transitioned to DL in the spring of 2020, we center students’ experiences and attitudes and ask:
-
1.
Which specific challenges do students report in the shift to DL?
-
2.
Which student groups are particularly affected by these challenges?
-
3.
Which teaching methods and practices are associated with better outcomes?
Theoretical framework
In order to address the complexity of students’ DL experiences from multiple perspectives, we draw on the CoI as a robust theoretical foundation (Castellanos-Reyes, 2020; Garrison et al., 2010). The CoI framework recognizes three interconnected elements for higher-order learning: cognitive, teaching, and social presence (Garrison & Arbaugh, 2007; Garrison et al, 2000). Social presence is defined as “the ability of participants in a CoI to project themselves socially and emotionally as real people” (Garrison et al., 2000,89). It stands in contrast to the potential deficit of social interaction in a DL context and is characterized in terms of “the participants identifying with the community, communicating purposefully in a trusting environment, and developing interpersonal relationships” (Garrison et al, 2010,7). The positive relationship between CoI presences and self-efficacy, motivation, and student relationships has already been pinpointed in the context of the pandemic (Harrison, 2021; Donham et al., 2022). Scott et al. (2016) also find that students value and engage in online informal learning spaces, showing high levels of social presence, as well as cognitive, learning, and teaching presences. Additionally, Shea & Bidjerano (2010) propose the CoI to be augmented to cover learning presence as an additional pillar, explicitly including and highlighting learners’ active role in technology-mediated environments.
While grounded in the CoI framework, we also draw from the broader concept of learning communities, which West & Williams (2017) define along access, relationships, visions, and functions. Feeling part of a community of learners is positively related to engagement, learning, and educational outcomes (Akyol & Garrison, 2011; Arbaugh, 2008). Students’ understanding of their learning communities during the pandemic can be understood in terms consistent with West and Williams’ model, also highlighting the impact of isolation and lack of informal interaction in and beyond the classroom on community creation (Prodgers et al., 2022). Community building has been recognized as a necessary step in addressing vulnerability (Powietrzynska et al., 2021), leading to a call on institutions to play a role in alleviating the social challenges students face (Branchu & Flaureau, 2022).
Methodology
We adopt a mixed-methods approach (Johnson & Onwuegbuzie, 2016) that combines a quantitative student survey, an open-ended question, a semi-structured focus-group interview, and the collection of course-specific information from instructors (see Fig. 1).
Quantitative and qualitative data are triangulated and contribute equally to addressing the first research question. We draw primarily on quantitative data when answering the second and third questions. In addressing the second research question, we employ cluster analysis (Antonenko et al, 2012; Everitt et al., 2011) as an exploratory analytic tool to divide respondents in homogeneous groups according to their response to the shift to DL. Cluster analysis is a commonly used method to identify hidden patterns, structures, and relationships within a data set, by revealing groups of similar data points (see, e.g., McNally et al., 2017). Addressing the last research question necessitates the collection of course-specific information. Given its multilevel structure (by course and individual student), this data was analyzed using a random-intercept multilevel linear model (Snijders & Bosker, 2012).
Participants and setting
At the Swedish university’s Department of Physics and Astronomy, all teaching was moved online in March 2020, while some in-person teaching (e.g., laboratory work) was resumed consecutively. As Sweden never experienced a strict lockdown, students had access to campus facilities, albeit with restrictions. Students and teachers were, however, encouraged to work remotely.
Students from all courses offered by the department between the onset of the pandemic and the end of spring 2021 were invited to participate in the survey through emails distributed by course coordinators. The majority of students in our study are enrolled in an Engineering or Physics program, ranging from first-year undergraduate to second-year master level. The survey had 571 individual responses (293 male, 172 female, and three gender non-binary students). 396 students started their undergraduate education at a Swedish university, 71 at non-Swedish universities. Ages ranged from 18 to 69 years (mean = 23.4 years). We excluded responses in which no specific DL course was mentioned or when students referred to courses from outside the department, resulting in 540 participants included. 361 answered the open-ended questions. Of the 540 student answers, 413 could be used for cluster analysis, after removing answers from students who already had answered the survey for another course and incomplete answers. 470 responses were complete enough to be used in the multilevel analysis, for a total of 89 different courses. Among these, specific information could be collected from instructors and cross-referenced for 50 courses. 24 courses were mostly synchronous, 10 mostly asynchronous, and 12 had a mixed format. Among the methods employed, 25 courses involved in-class group work, 16 used flipped classrooms, and nine just-in-time teaching. Less common strategies include think-pair-share and scheduling extra time for students to meet without the teacher.
All students who answered the survey were invited to the focus-group interview. Eight students responded to the call, and we invited six students, ensuring to represent different programs, courses, and genders. Four students (three men, one woman) joined the online semi-structured focus group interview (Longhurst, 2003), which was conducted by two of the authors who were not involved in the students’ teaching.
Swedish universities do not have formal requirements on ethical approval for research that does not involve physical interventions on people, human tissues, or the collection and processing of sensitive personal data (as classified by the Swedish law 2003:460 and the General Data Protection Regulation of the European Union, gender and age are considered non-sensitive data). Participants were informed about the purpose of the study, voluntarity of their participation, protection of their identities through anonymization, and processing and storage of the data collected, and provided their informed consent. We use pseudonyms to preserve participants’ anonymity.
Quantitative survey
The quantitative portion of the student survey was divided into three parts. Aside from age, gender, and international-student status, the first part included questions designed to identify the extent to which the respondent reports being able to learn autonomously. Drawing from our theoretical framework, we also included questions aimed to probe the extent to which the respondent relies on social interaction with peers for learning and feels a sense of belonging (cf. Akyol & Garrison, 2011; Arbaugh, 2008; Branchu & Flaureau, 2022; Powietrzynska et al., 2021). Furthermore, students were asked several stand-alone questions (see Table 1).
The second part of the survey compares students’ perception of DL to their previous experience with in-person teaching without reference to a specific course (see Table 2). This comparison is similar to the one in McNally et al. (2017), where flipped classrooms were compared to regular teaching. These questions are designed to explore various aspects of learning and are analyzed with k-means cluster analysis,Footnote 3 assuming the students could be grouped into two or more clusters based on how they rate their experience with DL, and using the silhouette method to assess the number of clusters that best describes the data. Answers to the first part of the survey are then compared using the Welch’s t test to identify differences between clusters.Footnote 4 We note that cluster analysis has already been employed to divide students in different groups based on their response to the shift to DL (Biwer et al., 2021; Toumpalidou & Konstantoulaki, 2023).
In the third part of the survey, students were asked to identify and refer to a specific course taught with DL. They were asked to compare 12 different aspects of their learning experience with previous courses they had taken in person. Based on the open-ended answers, eight of the 12 items were selected as corresponding to major factors affecting the shift to DL (see Table 3). Among these, items 1–7 were grouped to construct a course-specific outcome variable, while item 8 was treated separately, since it correlated weakly with the others. Information about specific courses was cross-referenced with a teacher survey and also complemented with information taken from the courses’ websites regarding enrollment and presence of specific instruction methods. Given its multilevel structure, this data was analyzed using a random-intercept multilevel linear model. The possibility of cross checking level-one variables in the multilevel model with the results of cluster analysis was designed to provide a robustness test on the identification of individual student factors affecting responses to DL.
Open-ended question and focus group interview
In the survey, students are asked in an open-ended question to name three major factors that affected their learning in comparison with previous semesters and to explain how. Answers were analyzed using thematic analysis (Braun & Clarke, 2006), identifying the most common themes and whether they were referred to positively, negatively, or neutrally. The coding was done by two of the authors independently at first and re-coded after agreeing on a common set of themes.
The semi-structured focus-group interview (Longhurst, 2003) was structured along: learning; students’ autonomy; role of peer interactions; teachers’ role and interactionsFootnote 5; and structure and clarity (the interview schedule is in the supplemental material). We, for instance, asked students what kind of teaching they experienced with DL and how it was different from experiences before the pandemic and posed follow-up questions expanding on given answers and to ensure comprehension. Particular attention was paid to equal distribution of speaking time and the opportunity for all participants to contribute. The interview was conducted in English. After closing the interview, the two interviewers reflected together on what they considered the main themes as inspired by reflexive ethnography (Davies, 2008). Interview recordings were transcribed using AI-based transcription software and revised and anonymized by one of the interviewers. All research-group members conducted a thematic analysis on the interview transcript (Braun & Clarke, 2006), and themes were iteratively discussed in the research group.
Following the iterative process on the focus group data, we jointly analyzed the open-ended question and the focus group transcript applying preliminary themes and refining them into seven final themes. These themes were furthermore triangulated with the quantitative data, identifying Likert questions in the survey that are relevant for each theme and using descriptive statistics (see the supplemental material).
Results
This section merges responses from the open-ended survey question and the focus group interview and presents results from the quantitative part of the survey. We triangulate the qualitative analysis with quantitative findings, identifying complex relationships between the various themes. More information about the students can be found in the supplemental material.
The collapse of structure
We describe seven intertwined themes: interaction with other students, interaction with the teacher, environment, autonomy, collecting and sharing information, motivation, and understanding the content. While these themes can stand for themselves, they are all strongly interwoven with one another and, as we will show, tied together by one identifier, a collapse of structure. This sentiment becomes visible in Magnus’ title quote:
Every morning I take two steps from my bed to my desk, and sit down at my computer. At night, I take two steps back and go to bed. Time no longer has meaning. I have not met anyone my age in forever. Everything is gray. (…) I don’t feel like I have study time and I don’t feel like I have free time. I only feel like I have time. (Magnus)
In the following, we will map out the different themes, how themes are intertwined with each other, and how they contribute to the collapse of structure.
Interaction with other students
A prominent theme is the social presence of peers. This includes formal and spontaneous conversations and interactions. Students describe that interactions with other students became more difficult, which made it harder to have group discussions and ask for and receive help.
Cecilia misses to “discuss with the others in the same course” and states that everyone is “so, yeah, all over, all over the country”. Johan feels isolated, too. He shares, “It was hard to chat with other students. I got the feeling that I was the only one thinking the material was difficult, and thus I dared not ask questions.” At the same time, other students mentioned positive effects of investing less energy into social interactions. Esben shows the multidimensionality of social presence and describes strategies to compensate for the lack of interactions with other students in DL,
I mean, the social part is really important. And we had a lot of isolation in the beginning, I would say, in my class. So we actively started studying together (…) and just having each other on (…) speaker, not even doing the same assignments, just having someone there. You can hear the person breathing. You know, if there is a question, you just say it out there to the room, basically, but you get the answer at least. (Esben)
Interaction with teachers
Similarly to interactions with other students, having interactions and conversations with instructors is perceived as more difficult. This includes the formal dimension of, e.g., asking questions during class, but also having informal conversations.
Our findings indicate that students used to rely on diverse structures created through the presence of teachers. Aside from formal discussions of content and guidance from the teacher(s), informal conversations about course material also supported students in their learning. Kajsa states that, in DL, there were no spontaneous interactions with instructors, “It is almost impossible to make small-talk during for example breaks with instructors about the subjects discussed in class, especially when you do not have an explicit question about a certain concept but might need some help organizing your thoughts.”
Tom highlights that he feels disconnected from both peers and the instructors and that interactions in a DL setting might be more important than with in-person teaching. He shares, “I think that’s really important to bear in mind in such a transition that teachers need to be as present, if not even more present.” He connects a lack of presence and interactions to a lack of guidance:
And I mean, I have almost, if not daily, at least weekly contact with my teacher. But I think far from everyone has that. I've sort of stopped having any social contact with anyone in that class. And so I think that's not a very helpful resource from a teacher just giving out notes. Then you could just read a book by yourself. I mean, the point of having a teacher is to be sort of a guidance to guide you as a group through something. (Tom)
Students remark on the lack of informal interactions in which they can ask questions. In the words of one student (Karl): “generally I would like to have a talk with [the] lecturer and clarify some bigger or more fundamental questions after lecture, but with DL, it’s more difficult to do so.”
Environment
The impact of the environment on the students is twofold. Firstly, a lack of change in the environment made it harder for students to focus, as learning spaces and life merged into one. Secondly, students reported that they did not have access to study spaces that allowed for uninterrupted and focused study time.
Similarly to Magnus, who provided the quote used in our title, Maja describes that, “It is hard to stay focused when you are not in an environment where you are supposed to learn. I study, eat, entertain myself and relax at the same desk in my 19 sqm room.” While that shows the difficulty of separating learning and studying spaces, Gustav shares that it was hard to find spaces in which he “didn’t get interrupted”. Esben not only describes those challenges, but also that they lead to being frustrated “due to a lot of distractions around in your own apartment.”
A significant part (14.9%) of the survey respondents report to not have access to good study spaces, while 15.5% takes a neutral stance. Access to good study spaces is one of the strongest quantitative predictors of the difficulty experienced in the shift to DL. A lack of physical structures, learning spaces, and life spaces merging negatively impacted students’ focus, motivation, and perceived learning success.
Autonomy
Another theme was grappling with autonomy, especially in relation to time management and study structure. While increased autonomy in combination with access to low-distraction study spaces provided some students with more time to study, many struggled with increased autonomy and a lack of structure when managing their time and information.
While Lovisa, as a 6th year student, has developed skills to work independently, she also highlights the ambiguity of increased autonomy in relation to spaces. She shares,
Not having to leave the house to study and attend classes was both good and bad. The lines between free time and studies were very blurred, which has made it a little difficult to take time to rest, but I somehow also feel a lot less stressed out. Taking exams at home, in a safe and comfortable space also helped with stress. (Lovisa)
Peter describes how perception on time is different because of a lack of structure and time management. He says,
I mean, like I don’t feel like I have time, that it’s like study time and I don’t feel I have free time. I only have, like, time and since all the lectures are recorded, if I don’t feel like taking a lecture now, I take it later. And that’s like, it gets more stressful, you know. To always have that availability to stop it and demand it. (Peter)
Collecting and sharing information
A fifth theme caught our attention. Students reported that more course information and material was available to them, and though helpful, it required structure both from the instructors’ and from the students’ side to make efficient use of the information. In analyzing student responses, we find it useful to differentiate between course content, and what we call “structural information,” namely information about, e.g., deadlines and material, which in a DL setting is less readily available. Erik shares,
While studying on campus, I did not plan very much and simply went with the flow. Most [teachers] reminded us of important hand-ins and when documents have been updated on Studentportalen.Footnote 6 When not, there were always some people in class who kept up with work, sometimes me, sometimes others. Together we made sure everyone was on track with what was due. This disappeared entirely while studying [remotely]. (Erik)
It is here this theme strongly intersects with the social aspect of learning and teaching in person. Esben makes this entanglement more explicit and reflects, “you meet people and you talk and you plan your work. And if you have missed something, then you’ll hear about it (…). So everyone is each other’s social net and also like study net.” He continues,
But now you have to keep track of everything yourself. So I find that I start my day by going into Studentportalen and see what’s new and if something has been updated, there have been cases where a lot of documents have been updated where we haven't done the information about it. You have to check that your documents are up to date. You know, there’s so much energy going into planning and (…) how to study. And so less time is actually going into studying. (Esben)
In the words of Selma, it was
harder to know if you are keeping up okay with the course, since you don’t daily interact with other students and talk about the courses. Some parts were barely mentioned but seemed essential on the exams. This was partly due to lack of information and important information embedded in otherwise useless information. (Selma)
The inability to differentiate between important and accessory information can be interpreted as another manifestation of the overarching loss of structure.
Motivation
While often shared implicitly, struggling with decreased motivation was mentioned explicitly by multiple students. Rebecka feels understimulated and shares that it is hard to keep both one’s mood and one’s motivation up when not being able to interact with peers in the same room. She continues, “You feel very lonely sometimes and bored because not much happens.” Sven mentions, “My motivation was lacking because of all distractions, otherwise pretty much the same.” While distractions and loneliness were mentioned as causing a lack of motivation, Anders describes that the lack of motivation is also caused by a general feeling of disconnectedness from learning spaces and practices, “In a rational sense it’s obvious that I’m studying, but unconsciously it feels like I am on study leave. Imagine that you go to the Bahamas for a sun bathing trip and then a colleague sends you some emails of things they want you to do.”
Understanding content
In line with the sentiment of a lack of structure, with spaces and practices merging into one, causing disconnectedness and a lack of motivation, students also highlighted how that sentiment leads to difficulties understanding the content. Edvin shares, “Now I frequently forget things even though I studied it alot; it sort of just becomes part of everything else that is exactly the same as everything else.” Similarly, Klas reflects on how disconnectedness and loneliness made it difficult to understand content. He writes, “Also the loneliness from not meeting other students and study with them made it harder to understand everything.”
The interconnection between cognitive and social presence is illustrated by Louise, who highlights,
Not having the same opportunity to talk to my classmates about course work or other matters made me think of my work more narrowly. I spent more time memorizing rather than thinking of the coursework more deeply. (Louise)
Cluster analysis and multilevel models
A silhouette analysis suggests that two clusters best represent responses to questions in Table 2 (see the supplemental material). These contain 238 and 175 data points and are dubbed “more affected” and “less affected” students, respectively. Students in the two clusters differ with respect to some of the factors probed in the first part of the survey, as displayed in Table 4. Cronbach’s alphas for the social and autonomy scales were 0.73 and 0.77, respectively.
Random-intercepts models were used to fit an outcome variableFootnote 7 constructed from responses to questions in Table 3 using the residual maximum likelihood method. These models are presented in Table 5. Model 1 only includes student-level explanatory variables. Model 2 also includes course-level variables.
Students experiencing the largest challenges
Students in the more affected cluster, as well as students with a lower value of the outcome variable for the multilevel models, score lower on the autonomy scale, are younger in age, find it generally more difficult to ask questions to the instructor, and are less likely to report that they feel more comfortable taking part in the courses without being seen and that they have access to a place where they can study without interruptions. We do not observe any significant difference regarding previous experience with DL, time from the beginning of the pandemic, gender, or international-student status. Notably, we observe a negative correlation between the outcome variable and both average reported grade and social-learner scale in the multilevel models, but not in the cluster analysis.
Variation across courses and choice of methods
Intraclass correlation coefficients give an estimate of the ratio between inter- and intracourse variance of the outcome variable and take remarkably small values (0.035 and 0.047 for the two models). Model 2 allows us to probe course-specific factors and methods and address our research question 3. Aside from the aforementioned factors at level one, we observe positive effects from reported use of the flipped-classrooms method and from the instructors reporting having access to the equipment needed. Conversely, size of the course, asynchronous or synchronous lecturing, time elapsed since the beginning of the pandemic, and pedagogical methods used (with the exception of flipped classrooms) do not bear any statistically significant effect on the outcome variable.Footnote 8
Discussion and implications
This study explores students’ reactions to the shift to DL in courses offered by the Physics and Astronomy department at a major Swedish university in the first year of the COVID-19 pandemic. While individual courses presented a significant variation regarding, e.g., number of students, level, synchronous and asynchronous moments, and pedagogical methods employed, students report a consistent and common set of challenges, and we find that what instructors did at the level of individual courses had a comparatively small impact. The themes we identified in the thematic analysis are all connected by the common thread of the collapse of structure, especially of structure that we propose to have been taken for granted in pre-pandemic times. This collapse has multiple dimensions. The sudden reduction of peer and instructor interactions can be seen as an erosion of the social-presence pillar in a CoI (Garrison et al., 2010), affecting students emotionally and intellectually, leading to feeling disconnected. Students are no longer able to use their interactions with peers to shape their learning, contributing to the collapse of the other CoI pillars. The physical environment, with a blurred separation between study and private spaces, as well as study and leisure times, provides another dimension. A third dimension is related to the loss of ability to differentiate between important and non-essential course material and information.
Given these results, we should ask: How is structure created? A first answer could focus on externally provided structure from the instructor, traditionally associated with the teaching-presence CoI pillar. In the focus group, students argued that more structure, and even more mandatory hand-in exercises, would help them. They also asked for more informal teaching moments in which they can meet the teacher and ask questions. In the quantitative data, we see that a reported use of flipped classrooms is correlated with better outcomes, which can be explained by the attempt of regulating and providing structured activities outside the classroom. Simultaneously, students themselves contribute to shaping and structuring their learning, in ways that appear to have been taken for granted before the shift to distance learning. To disentangle these mechanisms of structure creation, we differentiate between course content and meta-level information dubbed “structural information”. While this is seen through the lenses of the CoI framework as a manifestation of the social presence pillar, the role of information exchanges here assumes a dimension that was not previously recognized: students draw an explicit connection between lack of informal face-to-face interaction and increased difficulties accessing structural information. This is also in line with observations in the literature that students found it harder to understand expectations and standards of work due to lack of a social network during the period of DL (e.g., Elmer et al., 2020; Neuwirth et al., 2020; Warfvinge et al., 2022). Non-content language used by instructors in classrooms has recently been recognized as a key for better understanding classroom dynamics (e.g., Harrison et al., 2019; Seidel et al., 2015). Here, we argue that such language plays an equally important role in student–student interaction. Structural information also plays a role in functional cohesion of a learning community as defined by West & Williams (2017).
We can see that some students coped better with the DL conditions. In fact, the comparatively small variation in outcome observed across courses has its counterpart in a large variation at the level of individuals. Tanner (2013) highlights the diversity of students’ needs and the importance for structuring the classroom in a way that fosters engagement and inclusivity. This observation can be used to draw a direct line between the observed collapse of structure and the vulnerability of some groups of students. We find that the students who are most vulnerable in the transition to DL are the ones who are most dependent on the externally provided structure. They, on average, are younger, score lower on our measure of student autonomy, report finding it more difficult to ask questions to the instructor, and are less likely to have access to a suitable place to study. Age may correlate with increased experience studying in a higher education setting, while our measure of student autonomy, as well as ease interacting with the instructor, may also have a mitigating effect on the collapse of structure we have observed.
Limitations
There are factors that may affect response to DL we did not investigate in our study. Most prominently, the students’ ethnic background, as well as (dis)ability, and socioeconomic status were not included in the questionnaire. The literature has already identified students from underrepresented groups (Arday & Jones, 2022; Donham et al., 2022; Lederer et al., 2021) and students with disabilities (Bartz, 2020) as particularly vulnerable groups. Our finding that availability of appropriate study spaces strongly correlates with better outcomes indirectly highlights how students with lower socioeconomic status might have experienced particular challenges. We regard not including a more detailed and intersectional perspective as one of the main limitations of our study. In addition, recruitment of study participants might implicitly overrepresent the perspectives of students more adapted to a DL setting since the survey and focus group were both conducted online. Several questions were based on students’ self-reporting and recollection, for example concerning their understanding of the material. The identification of courses using flipped classrooms was based on teachers' self-reporting.
Implications for teachers and institutions
Our results suggest that teachers developing DL implementations should address the increased need for structure, as well as facilitate information exchanges among students. While flipped classrooms appear to be correlated with better outcomes, we interpret this as a result of a method aiming to regulate and structure students’ activities outside of the classroom. Some students also report favorably on a course offering spaces in which students can interact informally. However, the small value of the intraclass correlation highlights that what happened outside of the virtual classrooms has been as important as what happened inside, if not more. Aside from factors linked to individual students, we need to recognize the fundamental role played by institutions in responding to the shift to DL. The identification of vulnerable students can play a role in informing and directing the action of universities faced with similar challenges in the future, as well as more conventional implementations of DL. For example, universities may wish to prioritize options for in-person learning, if these are available, for academically younger students. Student autonomy emerges as one of the fundamental factors that determine the adjustment to DL. Universities should take measures to support students in developing robust study techniques, for example by offering courses on learning methods. The study has emphasized that the lack of a proper physical study environment affects many students, in agreement with similar results (Neuwirth et al., 2020). It is therefore essential that support structures such as study spaces are offered. We suggest that institutions invest resources in, and pay particular attention to, providing students with sufficient virtual and physical spaces for informal interaction to further enhance their sense of community (Branchu & Flaureau, 2022). This is in line with the reconceptualization of the notion of vulnerability proposed by work that argues to adopt a relational view of vulnerability rather than insisting on individual features and dispositions (e.g., Jackson, 2018). Instead of advocating for giving more resources to individuals, Jackson (2018) proposes to address the problem on a structural level, e.g., by building trust and communication with students. It is also essential to promote acceptance of vulnerabilities and cultivation of resilience (Powietrzynska et al., 2021).
Implications for theory
Our study can be understood as a setting in which the CoI social-presence pillar is drastically reduced. The fact that our measure of student autonomy is associated with better outcomes favors variations of the CoI that incorporate a fourth pillar for learning presence, such as the one suggested by Shea & Bidjerano (2010). Our findings can be understood in the context of the CoI framework, where the overarching collapse of structure has its counterpart in a deterioration of all three pillars. Mechanisms for structure creation and, in particular, the pivotal role played by structural-information exchanges among students did not receive adequate attention in the past and have the potential to add further nuance both to the social presence and teaching presence categories. Some authors have already observed that student–student communication is characterized by a high level of teaching presence (Scott et al., 2016), while our results indicate a deterioration of the teacher’s own social presence. Interestingly, this blurs the lines between CoI pillars, enlarging the importance of the learning presence. Ultimately, further investigation is warranted on the mechanisms underlying structural information exchanges.
Data Availability
Anonymized data can be made available on reasonable request.
Notes
With flipped classrooms, students asynchronously view and prepare material outside of class, while active and collaborative learning is prioritized in synchronous moments.
k-means clustering is a commonly used algorithm in unsupervised machine learning to partition a given data set into k groups. Each cluster is represented by its center, determined by the mean of the points assigned to the cluster.
It is debated whether parametric methods like k-means clustering and the Welch’s t test could be applied to Likert data, which is generally considered to be ordinal. A common approach is to consider individual Likert items with few points as ordinal and items with many points, or scales consisting of several items, as interval data (Wu & Leung, 2017). To account for this, a non-parametric approach, using K-modes clustering and the Mann-Whitney U test, is reported in the supplemental material. These results agree with the parametric analysis.
In our study, “teacher” and “instructor” are used to indicate university teachers at all levels, including professors, lecturers, and researchers with instructional responsibilities.
The learning management system.
The outcome variable is constructed combining questions 1–7 in Table 3. While answers to these questions correlate strongly, with correlation coefficients ranging between 0.29 and 0.63 and Cronbach’s alpha = 0.84, time spent looking for information correlates weakly only with some of the other questions, indicating that all students have on average spent more time regardless of other factors. For this reason, question 8 is not included in the outcome variable.
A Jarque Bera test was conducted to confirm that the residuals are normally distributed. Homogeneity of variance was also confirmed with Levene’s test. See the supplemental material for additional checks.
References
Adnan, M., & Anwar, K. (2020). Online learning amid the COVID-19 pandemic: students’ perspectives. Journal of Pedagogical Sociology and Psychology, 2(1), 45–51. https://doi.org/10.33902/JPSP.2020261309
Aguilera-Hermida, A. P. (2020). College students’ use and acceptance of emergency online learning due to COVID-19. International Journal of Educational Research Open, 1, 1–8. https://doi.org/10.1016/j.ijedro.2020.100011
Akyol, Z., & Garrison, D. R. (2011). Understanding cognitive presence in an online and blended community of inquiry: Assessing outcomes and processes for deep approaches to learning. British Journal of Educational Technology, 42(2), 233–250. https://doi.org/10.1111/j.1467-8535.2009.01029.x
Antonenko, P. D., Toy, S., & Niederhauser, D. S. (2012). Using cluster analysis for data mining in educational technology research. Educational Technology Research and Development, 60, 383–398. https://doi.org/10.1007/s11423-012-9235-8
Arbaugh, J. B. (2008). Does the Community of Inquiry Framework Predict Outcomes in Online MBA Courses?. The International Review of Research in Open and Distributed Learning, 9(2). https://doi.org/10.19173/irrodl.v9i2.490
Arday, J., & Jones, C. (2022). Same storm, different boats: The impact of COVID-19 on Black students and academic staff in UK and US higher education. Higher Education, 25, 1–22. https://doi.org/10.1007/s10734-022-00939-0
Bartz, J. (2020). All Inclusive?! Empirical insights into individual experiences of students with disabilities and mental disorders at German universities and implications for inclusive higher education. Education Sciences, 10(9), 223. https://doi.org/10.3390/educsci10090223
Biwer F, Wiradhany W, oude Egbrink M, Hospers H, Wasenitz S, Jansen W and de Bruin A (2021) Changes and Adaptations: How University Students Self-Regulate Their Online Learning During the COVID-19 Pandemic. Frontiers in Psychology 12, 642593. https://doi.org/10.3389/fpsyg.2021.642593
Bond, M., Bedenlier, S., Marín, V.I., & Händel, M., (2021). Emergency remote teaching in higher education: mapping the first global online semester. International Journal of Educational Technology in Higher Education 18, 50. https://doi.org/10.1186/s41239-021-00282-x
Bozkurt, et al. (2020). A global outlook to the interruption of education due to COVID-19 pandemic: Navigating in a time of uncertainty and crisis. Asian Journal of Distance Education, 15(1), 1–126. https://doi.org/10.5281/zenodo.3878572
Bozkurt A, Karakaya K, Turk M, Karakaya Ö, Castellanos-Reyes D. (2022) The impact of COVID-19 on education: a meta-narrative review. TechTrends, 66(5), 883–896. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9255479/
Branchu, C., & Flaureau, E. (2022). “I’m not listening to my teacher, I’m listening to my computer”: Online learning, disengagement, and the impact of COVID-19 on French university students. Higher Education. https://doi.org/10.1007/s10734-022-00854-4
Bransford, J. D., Brown, A. L., & Cocking, R. R. (2000). How people learn (Vol. 11). National academy press.
Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77–101.
Broadbent, J., & Poon, W. L. (2015). Self-regulated learning strategies and academic achievement in online higher education learning environments: A systematic review. The Internet and Higher Education, 27, 1–13. https://doi.org/10.1016/j.iheduc.2015.04.007
Castellanos-Reyes, D. (2020). 20 years of the community of inquiry framework. TechTrends, 64, 557–560. https://doi.org/10.1007/s11528-020-00491-7
Davies, C. A. (2008). Reflexive ethnography: A guide to researching selves and others. Routledge.
Divjak, B., Rienties, B., Iniesto, F., Vondra, P., & Žižak, M. (2022). Flipped classrooms in higher education during the COVID-19 pandemic: findings and future research recommendations. International Journal of Educational Technology in Higher Education 19, 9. https://doi.org/10.1186/s41239-021-00316-4
Donham, C., Barron, H. A., Alkhouri, J. S., Kumarath, M. C., Alejandro, W., Menke, E., & Kranzfelder, P. (2022). I will teach you here or there, I will try to teach you anywhere: perceived supports and barriers for emergency remote teaching during the COVID-19 pandemic. International Journal of STEM Education 9(19). https://doi.org/10.1186/s40594-022-00335-1
Elmer, T., Mepham, K., & Stadtfeld, C. (2020). Students under lockdown: Comparisons of students’ social networks and mental health before and during the COVID-19 crisis in Switzerland. PLoS ONE, 15(7), e0236337. https://doi.org/10.1371/journal.pone.0236337
Everitt, B., Landau, S., Leese, M., & Stahl, D. (2011). Cluster analysis. Wiley. https://doi.org/10.1002/9780470977811.ch7
Garrison, D. R., & Arbaugh, J. B. (2007). Researching the community of inquiry framework: Review, issues, and future directions. The Internet and Higher Education, 10(3), 157–172. https://doi.org/10.1016/j.iheduc.2007.04.001
Garrison, D. R., Anderson, T., & Archer, W. (2000). Critical inquiry in a text-based environment: Computer conferencing in higher education model. The Internet and Higher Education, 2(2–3), 87–105. https://doi.org/10.1016/S1096-7516(00)00016-6
Garrison, D. R., Anderson, T., & Archer, W. (2010). The first decade of the community of inquiry framework: A retrospective. The Internet and Higher Education, 13(1–2), 5–9. https://doi.org/10.1016/j.iheduc.2009.10.003
Guo, S. (2020). Synchronous versus asynchronous online teaching of physics during the COVID-19 pandemic. Physics Education, 55(6), 065007. https://doi.org/10.1088/1361-6552/aba1c5
Harrison, C. D., et al. (2019). Investigating instructor talk in novel contexts: widespread use, unexpected categories, and an emergent sampling strategy. CBE—Life Sciences Education, 18, 3.
Harrison, C. D. (2021) Student perceptions of community of inquiry in blended developmental courses during the COVID-19 pandemic. Walden Dissertations and Doctoral Studies, 9743. https://scholarworks.waldenu.edu/dissertations/9743
Hodges, C., Moore, S., Lockee, B., Trust, T., & Bond, A. (2020). The difference between emergency remote teaching and online learning. EDUCAUSE Review, March 27 2020.
Hoss, T., Ancina, A., & Kaspar, K. (2021). Forced remote learning during the COVID-19 pandemic in Germany: A mixed-methods study on students’ positive and negative expectations. Frontiers in Psychology, 12, 642616. https://doi.org/10.3389/fpsyg.2021.642616
Jackson, L. (2018). Reconsidering vulnerability in higher education. Tertiary Education and Management, 24(3), 232–241. https://doi.org/10.1080/13583883.2018.1439999
Jeffrey, K. A., & Bauer, C. F. (2020). Students’ responses to emergency remote online teaching reveal critical factors for all teaching. Journal of Chemical Education, 97(9), 2472–2485. https://doi.org/10.1021/acs.jchemed.0c00736
Johnson, R. B., & Onwuegbuzie, A. J. (2016). Mixed methods research: A research paradigm whose time has come. Educational Researcher, 33(7), 14–26. https://doi.org/10.3102/0013189X033007014
Klein, P., Ivanjek, L., Dahlkemper, M. N., Jeličić, K., Geyer, M. A., Küchemann, S., & Susac, A. (2021). Studying physics during the COVID-19 pandemic: Student assessments of learning achievement, perceived effectiveness of online recitations, and online laboratories. Physical Review Physics Education Research, 17(1), 010117. https://doi.org/10.1103/PhysRevPhysEducRes.17.010117
Lage, M. J., Platt, G. J., & Treglia, M. (2000). Inverting the classroom: A gateway to creating an inclusive learning environment. The Journal of Economic Education, 31(1), 30–43.
Lederer, A. M., Hoban, M. T., & Lipson, S. K. (2021). More than inconvenienced: the unique needs of U.S. college students during the COVID-19 pandemic. Health Education & Behavior, 48(1), 14–19. https://doi.org/10.1177/1090198120969372
Longhurst, R. (2003). Semi-structured interviews and focus groups. In N. Clifford, M. Cope, T. Gillespie, & S. French (Eds.), Key methods in geography (3rd ed., pp. 143–156). Sage Publications.
Malkawi, E., Bawaneh, A. K., & Bawa’aneh, M. S. (2021). Campus off, education on: UAEU students’ satisfaction and attitudes towards e-learning and virtual classes during COVID-19 pandemic. Contemporary Educational Technology, 13(1), ep283. https://doi.org/10.30935/cedtech/8708
Marzoli, I., Colantonio, A., Fazio, C., Giliberti, M., di Uccio, U. S., & Testa, I. (2021). Effects of emergency remote instruction during the COVID-19 pandemic on university physics students in Italy. Physical Review Physics Education Research, 17(2), 020130. https://doi.org/10.1103/PhysRevPhysEducRes.17.020130
McNally, B., Chipperfield, J., Dorsett, P., et al. (2017). Flipped classroom experiences: Student preferences and flip strategy in a higher education context. Higher Education, 73, 281–298. https://doi.org/10.1007/s10734-016-0014-z
Neuwirth, L. S., Jovic, S., & Mukherji, B. R. (2020). Reimagining higher education during and post-COVID-19: Challenges and opportunities. Journal of Adult and Continuing Education, 27(2), 141–156. https://doi.org/10.1177/1477971420947738
Pintrich, P. R. (2004). A conceptual framework for assessing motivation and self-regulated learning in college students. Educational Psychology Review, 16, 385–407. https://doi.org/10.1007/s10648-004-0006-x
Powietrzynska, M., Noble, L., O’Loughlin-Boncamper, S., & Azeez, A. (2021). Holding space for uncertainty and vulnerability: Reclaiming humanity in teacher education through contemplative equity pedagogy. Cultural Studies of Science Education., 16, 951–964. https://doi.org/10.1007/s11422-021-10035-x
Prodgers, L., Travis, E., & Pownall, M. (2022). “It’s hard to feel a part of something when you’ve never met people”: Defining “learning community” in an online era. Higher Education. https://doi.org/10.1007/s10734-022-00886-w
Scott, K. S., Sorokti, K. H., & Merrell, J. D. (2016). Learning “beyond the classroom” within an enterprise social network system. The Internet and Higher Education, 29, 75–90. https://doi.org/10.1016/j.iheduc.2015.12.005
Seidel, S. B., Reggi, A. L., Schinske, J. N., Burrus, L. W., & Tanner, K. D. (2015). Beyond the biology: a systematic investigation of noncontent instructor talk in an introductory biology course. CBE—Life Sciences Education, 14(4), ar43. https://doi.org/10.1187/cbe.15-03-0049
Serhan, D. (2020). Transitioning from face-to-face to remote learning: students’ attitudes and perceptions of using Zoom during COVID-19 pandemic. International Journal of Technology in Education and Science, 4(4), 335–342. https://doi.org/10.46328/ijtes.v4i4.148
Sharaievska, I., McAnirlin, O., Browning, M. H. E. M., Larson, L. R., Mullenbach, L., Rigolon, A., D´Antonio, A., Cloutier, S., Thomsen, J., Metcalf, E. C., & Reigner, N. (2022). “Messy transitions”: students’ perspectives on the impacts of the COVID-19 pandemic on higher education. Higher Education. https://doi.org/10.1007/s10734-022-00843-7
Shea, P., & Bidjerano, T. (2010). Learning presence: Towards a theory of self-efficacy, self-regulation, and the development of a communities of inquiry in online and blended learning environments. Computers & Education, 55(4), 1721–1731. https://doi.org/10.1016/j.compedu.2010.07.017
Snijders, T. & Bosker, R. (2012). Multilevel Analysis: an introduction to basic and advanced multilevel modeling, second edition. Sage Publishers.
Tanner, K. (2013). Structure matters: twenty-one teaching strategies to promote student engagement and cultivate classroom equity. CBE—Life Sciences Education, 12(3), 322–31. https://doi.org/10.1187/cbe.13-06-0115
Terzi, B., Azizoğlu, F., & Özhan, F. (2021). Factors affecting attitudes of nursing students towards distance education during the COVID-19 pandemic: A web-based cross-sectional survey. Perspectives in Psychiatric Care, 57(4), 1765–1773. https://doi.org/10.1111/ppc.12747
Toumpalidou, S. A., & Konstantoulaki, K. (2023). Education in the pandemic economy: Attitudes towards distance learning as a drive of university students’ decision making. International Journal of Organizational Analysis, 31(1), 50–62. https://doi.org/10.1108/IJOA-09-2021-2965
Warfvinge, P., Löfgreen, J., Andersson, K., Roxå, T., & Åkerman, C. (2022). The rapid transition from campus to online teaching – how are students’ perception of learning experiences affected? European Journal of Engineering Education, 47(2), 211–229. https://doi.org/10.1080/03043797.2021.1942794
West, R. E., & Williams, G. S. (2017). “I don’t think that word means what you think it means”: a proposed framework for defining learning communities. Educational Technology Research and Development, 65, 1569–1582. https://doi.org/10.1007/s11423-017-9535-0
Whatley, M., & Castiello-Gutiérrez, S. (2022). Balancing finances, politics, and public health: International student enrollment and reopening plans at US higher education institutions amid the COVID-19 pandemic. Higher Education, 84, 299–320. https://doi.org/10.1007/s10734-021-00768-7
Wu, H., & Leung, S. O. (2017). Can Likert scales be treated as interval scales?—a simulation study. Journal of Social Service Research, 43(4), 527–532. https://doi.org/10.1080/01488376.2017.1329775
Yazgan, Ç. Ü. (2022). Attitudes and interaction practices towards distance education during the pandemic. Education and Information Technologies, 27, 5349–5364. https://doi.org/10.1007/s10639-021-10843-2
Zimmerman, B. J. (2002). Becoming a self-regulated learner: An overview. Theory into Practice, 41(2), 64–70. https://doi.org/10.1207/s15430421tip4102_2
Acknowledgements
We are thankful to the Centre for Discipline-Based Education Research in Mathematics, Engineering, Science and Technology (MINT) at Uppsala University for supporting this research and fostering a stimulating environment for education research. We thank Anna Eckerdal, Felix Ho, Cassandra Engeman, Rie Malm, and Bor Gregorcic for insightful comments on our draft. We are also grateful to the three anonymous referees for providing very valuable feedback.
Funding
Open access funding provided by Uppsala University.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Chiodaroli, M., Freyhult, L., Solders, A. et al. “Every morning I take two steps to my desk…”: students’ perspectives on distance learning during the COVID-19 pandemic. High Educ (2024). https://doi.org/10.1007/s10734-023-01179-6
Accepted:
Published:
DOI: https://doi.org/10.1007/s10734-023-01179-6