Abstract
Technology creates variant learning experiences which are context specific. This study examined the comparative potential of multimodal and text-based Computer Mediated Communication (CMC) in fostering learner autonomy, learner engagement and learner e-satisfaction as well as learner writing quality. To this end, 40 Iranian male and female EFL (English as foreign language) students were selected on the basis of their writing proficiency and were randomly assigned into text-based and multimodal CMC research groups. Learner autonomy was investigated using Van Nguyen and Habók ‘s learner autonomy questionnaire, which had 40 items rated on 5 point likert scale, both before and after the treatment. Student engagement was tracked by analyzing transcription of stored conversations of Moodle and Discussion logs of an online writing forum, using a coding scheme to identify cognitive, emotional, and behavioral student engagement. The potential of text-based CMC and Multimodal CMC in fostering writing quality was examined by comparing students’ writing before and after treatment. Finally, students were asked to write reflective essays on their evaluation of efficacy of the learning environments. Content analysis was conducted on the open and axial coding of indicators of student satisfaction. The results of between group comparison indicated that students were more autonomous in text-based modality than in multimodal CMC. Chi-square analysis indicated that text-based CMC group outperformed multimodal CMC group in terms of behavioral and cognitive engagement. Yet, multimodal CMC group reported higher emotional and social engagement. One-way ANCOVA results also indicated that the students in text-based CMC group outperformed Multimodal CMC group in terms of writing quality. Learner e-satisfaction was examined by network mapping of open codes of student reflective essays. The study identified four categories that reflected students’ e-satisfaction: learner dimension (including learners’ attitude, learner internet self-efficacy), teacher dimension (including teacher presence, teacher digital competences), curriculum dimension (including curriculum flexibility, course quality, flexibility in interaction support system) and internet dimension (including internet quality and support system). However, internet dimension received negative judgments from both groups. The implications of the study and suggestions for further research are discussed.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
1 Introduction
With the advent of new technologies, learners are faced with unprecedented opportunities to conduct independent learning (Zhong, 2018) often viewed as effective in promoting autonomy in the context of the growing presence of ICT in educational systems (de Brito Lima et al., 2021). This has prompted renewed interest in identifying the features of online learning environments which students value in academic development and attainment (Barile et al., 2022). Cognitive load theory of multimedia learning proposes that human brain has a limited capacity for processing information through auditory and visual channels. This makes different learning resources to differ in the cognitive load they create and hence differ in their potential in optimizing higher quality learning (Paas et al., 2016). The pedagogical value of computer mediated learning lies in its features in expanding students views of literacy with increased semiotic resources beyond language and optimizing communication environment in the digital era (Shin et al., 2020). While previous research on the pedagogical value of features of computer mediated communication (CMC) mainly focused on the impact of CMC modalities on academic performance and gain scores confirming positive association between them (Dascalu et al., 2021; Mogus et al., 2012; Mohamadi, 2018a, 2018b), scant attention has been given to how online learning modalities moderate learner psychological attributes such as learner autonomy and student engagement. (Salikhova et al., 2020). This research, therefore, is intended to investigate the potential of text-based and multimodal CMCs in not only fostering achievement gain scores but also in promoting students’ autonomy and engagement and in turn student e-satisfaction.
As technology advances in all aspects of education, it provides plenty of opportunities for independent and self-regulated learning (Zhong, 2018). Autonomous learning entails self-generated thoughts and actions that are cyclically planned as a result of individuals’ evaluation, reflection and monitoring to enhance ones engagement in strategies to achieve personal goals (Schneider & Preckel, 2017). Learner autonomy is very context specific and can be shaped and influenced by different learning environments (Broadbent et al., 2021)Technology mediated learning resources have different potentials in leading autonomous learning (Broadbent & Poon, 2015; Broadbent et al., 2021). However, research has mainly focused on comparing online learning environments with actual class environment (Dang, 2012; Ghazali, 2020) with acknowledging supportive role of online learning platforms in promoting learner autonomy and thus leaving the analysis of potentials of different online learning modalities in fostering autonomous learning open for research.
The growing popularity of multimodal resources in technology mediated learning and teaching has highlighted learner competences and awareness of affordances available to learners in engaging them in tasks and hence exercising enhanced level of autonomy (Hauck et al., 2021).
The key to learner autonomy is learner engagement which is learners’ ability in promoting their psychological commitment to stay engaged in the learning process, to acquire knowledge and build his or her critical thinking (Dixson, 2015). Student engagement has long received educational researchers’ attention due to inconsistencies in its related research findings. Inconsistencies in research findings become more when it comes to student engagement in online learning platforms. Researchers lay emphasis on the analysis of platform access logs such as clicks, logins, and active sessions which works for classic online classes. Literature on student engagement in activity based hybrid multimodal technology enhanced learning environments is very limited (Rajabalee & Santally, 2021). Besides, research demonstrates that quality of student engagement in online courses remains mixed (Kahn et al., 2017). For example, Swartzwelder et al. (2019) indicated a positive effect of text based CMC on higher order thinking, and reflection but low learner engagement whereas multimodal CMC resulted more in learner engagement but low rate of retention. Learner satisfaction and learner engagement are interwoven (Rajabalee & Santally, 2021). Learner engagement varies as learners’ level of satisfaction varies (Martin & Bolliger, 2018). The quality and acceptance of e-learning depend largely on learner satisfaction and experiences. Students in online classes, encompass a range of difficulties such as digital literacy, technical issues, support system which if not responded properly may result in decreased learner engagement (Gillett-Swan, 2017). Students’ positive or negative perception effects how students apply knowledge and plan learning and achieve outcome and direct autonomous learning (Abdous, 2019; Mihanović et al., 2016). Therefore, the interplays between satisfactions, learner engagement and learner autonomy are crucial to be investigated to have an efficient coherent online learning curriculum.
Technology, a prevailingly used artifact, create variant learning experiences through varying cognitive, emotional and social supports they offer (Binali et al., 2021; Galikyan et al., 2021).This study examines how multimodal and text-based computer mediated conversation modalities (CMCs) affect learner autonomy, learner engagement and learner e-satisfaction.
2 Literature review
2.1 Computer mediated conversation modalities and language learning
For their potentials in promoting joint construction of knowledge, computer mediated modalities and platforms are considered as fundamental learning environments (Salloum et al., 2019). Collaboration is a distinctive and necessary component for learning especially in virtual environments (Garrison, 2006). Many learning theories such as social constructivism, activity theory, situated shared cognition have already approved collaborative learning (Munoz-Carril, Hernández-Sellés, Fuentes-Abeledo, & González-Sanmamed, 2021).The connecting potentail of computers can facilitate creation of learning communities that contibute to the construction of shared meaning.
However, different computer modalities have different potentials in promoting effective collaboration. Modality is defined as the medium or channel through which communicative intent is expressed (Pereira (2010). Modalities can be classified with respect to the type of image or temporality of it. With respect to image type, modality is “semiotic realization of one mode” (p. 510), or the way specific information is encoded (e.g., the images transmitted with a webcam in videoconferencing realize a visual modality). Modalities are further classified with respect to temporality of the message such as synchronous which entails simultaneous sending and receiving messages (e.g., when two writers composing in Google Docs simultaneously) and asynchronous in which transmission of the message takes place at different times (e.g., when a writer’s posted texts in weblog are read years later).
Technological and electronic developments have made online CMC equipped with both text and audio modalities (Stockwell, 2007). Modalities have the potential to direct L2 learners' attention to a variety of performance outcomes (Cho, 2018, Colpaert & Spruyt, n.d.). Concerning L2 learning, it is suggested that text chat may help increase students’ verbal participation and increase a higher frequency of student-to-student exchanges since it allows students to overcome their hesitance for learning as the modality is perceived as ‘face-saving’ (Hoffman, 1996) relieving students of their inhibitions and allowing free expression (Freiermuth, 2001) and thus, enhancing students’ willingness to communicate (Freiermuth & Jarrell, 2006). While the majority of studies have focused on text chat as the only verbal communication modality, developments in computer technology made online communication modalities to become multimodal often including text and audio modalities (Stockwell, 2007). It is suggested that multimodal nature of online communication allows more effective collaborative learning than in one dimensional online environment (Dalgarno & Lee, 2010). However, some studies indicated that multimodal nature of online environment may overload learners since they receive both verbal and non-verbal information. For example, the study by Vetter and Chanier (2006) indicated that EFL beginners communicated more than twice as much in the text chat than in the voice chat because they needed to manage both verbal and nonverbal signals at the same time. Some other studies showed positive effects of multimodal CMCs as multimodal online CMC allows more effective collaborative L2 learning than in one-dimensional online modalities (Dalgarno & Lee, 2010) since multimodal entails bodily movements, face tracking, affective sensors (Spikol et al., 2017). The reported inconsistencies on CMC modalities’ efficacy invited further research on their benefits in L2 learning context.
2.2 Computer mediated collaborative writing
Writing skill has always been a challenge for students to acquire since it is postponed till school age. But it has always been an informative subject for researchers because studying it helps to understand developmental processes that cause students choices in prioritizing some aspects of writing over others as a result of moderating factors (Zenouzagh, 2018).
Writing activity has been viewed as a solitary act performed mostly in classroom context. But, constructivist theories of learning and advancement of technology aided learning brought attention to collaborative computer mediated writing (Zenouzagh, 2020). Collaborative writing can be seen as shift from a traditional teacher-directed class to a more interactive and student-centered class where learners actively take part in their class learning (Lin & Maarof, 2013). Collaborative writing is described in terms of social negotiations between several writers in which they construct knowledge and convey it through interaction (Challob et al., 2016). The key concepts related to collaborative learning studies such as learner talk, negotiation of meaning and interaction are revisited by researchers (Twiner et al., 2014). Although computer-mediated writing and its benefits on language development has been extensively examined, online learning modality as a critical component was overlooked (Mohamadi Zenouzagh, 2022).
Informed by social semiotics theory, multimodal writing are texts that communicate meaning via multiple modes of “socially made and culturally shared” semiotic resources (Kress, 2009). The pedagogical value of multimodal writing lies in its ability to expose students to expanded views of literacy with increased semiotic resources beyond language (Shin, Cimasko, Yi, 2020), which epitomizes the communication environment in the digital era. The existence of multiple modes and semiotic resources in multimodal writing leave plenty of room for negotiating of meaning, which is fully realized when learners collaborate with each other to construct multimodal texts. As such, writing is inherently a social activity and technology is the catalyst in this process (Cheung, 2022). While the scope of modality is comprehensive, the scope of discussion in this study will be limited to channels of communication (Multimodal vs. text-based modalities). Although research has shown the benefits of textual and multimodal writing on linguistic aspects of writing such as syntactic complexity (Mohammadi, 2017; Zenouzagh, 2020), little research has considered the potentials of writing modality on other aspects of student learning such as learner autonomy and engagement and satisfaction.
2.3 Learner autonomy and online learning environment
Computer-assisted language learning has been approved to promote learner autonomy as it includes elements of autonomous learning by giving control to students in taking responsibility for their own learning, such as choosing the materials, managing their contact with various genres and types of interaction, often in authentic contexts, and evaluating their own progress, measured through their success in understanding and conveying meanings (Wach, 2012). As the definition suggests, learner autonomy is learners' taking the responsibility of learning at all stages of objective setting, controlling learning processes and setting evaluation criteria (Mohammadi Zenouzagh, 2022). Learner autonomy is a psychological capacity typified as an ability to make decisions requiring capacities of metacognitive knowledge of self, subject and context, knowledge and reflection on learning requiring metacognitive strategies of planning, goal setting, monitoring and evaluation (Van Nguyen & Habók, 2021).
Learner autonomy has taken a center stage as the advancement of technology creates more opportunities for independent learning. Scholars have investigated the enormous potential that different technologies have for autonomous learning where learners can take individual and joint responsibilities with each other for knowledge construction and exercise control on their own learning (Eneau & Develotte, 2012; Ribbe & Bezanilla, 2013). Technologies can also help to train more active learners and expose them to digital, social environments where learners can engage in real world and meaningful interactions with language users. Technologies such as video-conferencing software make geographically separated individuals to communicate in real time. Other related online tools such as discussion forums and online chat environments can help learners engage in social, collaborative and authentic learning opportunities (Zhong, 2018).
Online learning environments require higher levels of learner autonomy among learners. Learner online autonomy requires exhibition of control on monitoring and managing cognitive abilities (Cho & Heron, 2015). It also requires other aspects of learning such as emotion and enjoyment regulation through self, co, and socially regulations to achieve group level engagement in shared regulation processes including joint planning, monitoring, and evaluating (Zhang et al., 2021). A meta-analytic review by Broadbent and Poon (2015) indicated that learners differ in their autonomous learning and the frequencies of their use with strong relation to academic achievement in online classes. The frequently used strategies were metacognitive, time management, critical thinking and effort regulation strategies which were strong predictors of academic success compared to traditional classes. Strategy utilization preferences may also reflect the constraints of learning environment (Broadbent et al., 2021). Online learning may take place with various formats such as synchronous, asynchronous, uni-modal, and multimodal delivery of instruction. This variety may result in different learning experiences (Colson & Hirumi, 2018). This can help teaching practitioners to direct students’ potential to varying instructional objectives (Olsen et al., 2020).
2.4 Learner engagement and online learning environment
Online learning provides learners with ubiquitous learning opportunities and makes the learning processes more learner-centered (Dwivedi et al., 2019). To investigate the effectiveness of online learning, researchers not only use knowledge-based tests to assess learners' academic performances, but also pay more attention to the learners' learning engagement during online learning (Bagheri & Zenouzagh, 2021; Mohamadi, 2017; Wang et al., 2022).
Learner engagement has long intrigued educational researchers due to the inconsistencies in its definition and its measurement (Ayouni et al., 2021). Learner engagement has been conceptualized as students' active involvement in purposeful learning (Buijs & Admiraal, 2013; Galikyan & Admiraal, 2019) and it is seen as the predicting factor in student learning (Guo et al., 2021). Most studies rely on student self-reports and utilize surveys and questionnaires such as National Survey of Student Engagement (Kuh, 2003), Classroom Survey of Student Engagement (Smallwood, 2006) and Student Course Engagement Questionnaire (Handelsman et al., 2005) to tackle student engagement. Research also uses rubrics as instructive tools to measure student engagement through learner experiences and skills participation, emotion and performances (Dixson, 2015; Kahu, 2013).
Most scholars distinguish four dimensions of learner engagement, comprising of behavioral, emotional, cognitive engagement, and social engagement (Bagheri & Zenouzagh, 2021; Deng et al., 2020; Mulia, 2020). In the learning environment, behavioral engagement reflects learning-related activities such as participating in interactions and communications and asking questions. Cognitive engagement is related to mental efforts that learners have to learn a particular skill or acquire intricate knowledge. Emotional engagement deals with students’ positive emotions about their class, peers and teachers, and their online courses (Luan et al., 2020). Relational or social engagement refers to the sense of belonging and the relationships that students develop with their peers, their teachers, and the school. Highly engaged learners are more successful in acquiring knowledge and skills (Martin & Bolliger, 2018). Research confirmed the effect of text-based (Freiermuth & Jarrell, 2006) and multimodal CMC modalities (Collins et al., 2019) on learner engagement.
Research on student engagement in online learning environment mainly focuses on student engagement in uni-modal online learning environment compared to face-to-face classes and thus leaving comparative analysis of student engagement across different online learning environment open to research. Besides, these studies used self-report measures such as surveys and questionnaires in inspecting learner engagement and they fail to unfold the concept of learner engagement from a deeper inspection because learner engagement was investigated using a questionnaire which is subject to risks of reliability of responses and social desirability effect. To fill such a void, the present research investigates the potentials of two online modalities of text and multimodal one in fostering student engagement through conversation analysis techniques of students’ online conversations.
2.5 Learner satisfaction and e-learning environment
The myth of online learning and its acceptance among teachers and learners have been investigated and ascribed to contextual, psychological, social, cultural and demographical factors (Cohen, 2014; Tuyet, 2020). Most of these studies focused on the contextual properties of the learning environment and their effects on acceptance of e-learning environments compared to traditional classes. According to Zhao (2020), unlike most of the dated published studies in the field of education and language learning that investigated success and achievement of the students concerning cliché factors, limited studies published since the start of the COVID-19 pandemic have focused on the particular E-learning related contextual, individual, and psychological variables to determine student satisfaction and acceptance of E-learning courses.
Student satisfaction is a crucial element that contributes to the acceptance and quality of online learning. Students may experience difficulties resulting from wide range of factors such as digital literacy, technical issues, support system and teacher-student interaction. These may result in decreased effectiveness of the curriculum and hence overall student satisfaction. Previous research on different learning environments has suggested a variety of factors affecting user satisfaction with e-learning such as the learner, the curriculum and teacher roles (Sun et al., 2008). However, most of these studies used surveys in which information is organized from researchers’ stand point (Wang, 2003). Besides, in most of these studies, student satisfaction was assessed in one e-learning modality (Kuo et al., 2014) or assessed comparatively with face-to face counterpart (Johnson et al., 2000) and thus leaving comparative investigation of learner e-satisfaction across text-based and multimodal computer assisted learning for research.
2.6 The present study
Most of the studies on CMC are limited to comparisons of online platforms with face-to face classes and therefore, cross comparison between different online modalities is left as potentially an open area for research. Besides, this study contributes and moves the related literature forward since the analysis is built on enacted student performances rather than student self-reports which are subject to reliability issues and inefficacy in depicting related invisible aspects. This study investigates differences between text-based and multimodal computer mediated communication in autonomous learning, learner engagement, and satisfaction. To this end, the following research questions were set to be answered:
-
1.
To what extent do text-based computed mediated writing and multimodal computer mediated writing differ in fostering learner autonomy?
-
2.
To what extent do text-based computer mediated writing and multimodal computer mediated writing differ in fostering learner engagement?
-
3.
To what extent do text-based computer mediated writing and multimodal computer mediated writing differ in fulfilling learner satisfaction?
-
4.
How do text-based computer mediated writing and multimodal computer mediated writing affect students’ writing performance?
3 Method
3.1 Research design
This study is a descriptive mix-method study using both quantitative and qualitative data. The dependent variables were learner autonomy, learner engagement, and student satisfaction as well as writing performances. The independent variables were text and multimodal computer-mediated writing modalities. The learner autonomy and student writing performances were investigated by quantitative data collection procedure via questionnaire and student sample writing and the derived data were treated as a test scores. Student engagement was investigated via conversation analysis of transcription of stored conversation in Moodle and discussion logs of text-based forum and chi-square analysis of student engagement dimensions derived from open and axial coding. Student satisfaction was investigated using quantitative thematic analysis of student reflective essaying using Atlasti software.
3.2 Participants
Participants were 40 EFL male and female intermediate Iranian EFL students from English Centers with the age range of 18–23. They were selected based on their proficiency level measured on Oxford placement test and their computer literacy level measured on self-reports on wide range of computer use. They were randomly assigned to multimodal (N = 20), and text based (N = 20) computer mediated communication research groups. Each research group had 5 subgroups of four students. The forming of groups was left to students’ choice. Table 1 shows demographic information of the participants.
3.3 Data collection procedure
3.3.1 Learner autonomy questionnaire
A Learner autonomy questionnaire developed and validated by Van Nguyen and Habók (2021) was used to measure learner autonomy before and after the research intervention. This questionnaire had 40 items rated on a 5 likert scale tapping into different sub constructs. Table 1 shows information on the attributes of the questionnaire. The reliability of each section of the questionnaire in the present research data set was included in the Table 2.
3.3.2 Learner engagement
Studies on theoretical and operational definitions of different dimensions of student engagement have been reviewed to prepare the scheming coding system of student engagement (Table 3) (Guo et al., 2021; Lee & Hannafin, 2016; Silvola et al., 2021; Stephenson et al., 2020). Transcription analysis of stored conversation and text-based log analysis were coded for learner engagement dimension. The coding unit was defined as students’ contributions that show their involvement in the learning task. For example, students actual talk on task rather that procedure talk, less hesitations, less appeal for help as were taken as signs of behavioral engagement. Students’ self or co-regulating learning problems such as coining words to solve communication problem, using metacognitive linguistic knowledge, suggestions for cross check of multiple resources were identified as cognitive engagement codes. Students’ emotional feedbacks to the learning tasks and students’ desire and invitations for group unity and coherence were coded as emotional and social engagements. The beginning and ending of a coding unit is characterized by turns in which any of indicators in coding system in Table 3 could be identified. 849 codes across all transcriptions in two writing modalities were identified. Inter-rater reliability was calculated using Cohen’s kappa (see Appendix A for details).
3.3.3 Learner e-satisfaction
Students’ perceived satisfaction reported in their reflective essays was studied. Coders inspected reflective essays for both positive and negative values that students attributed to either text-based or multimodal CMC modalities. The coding units are students’ statements that indicate students’ self- evaluation and judgments on quality of their learning experience. For example, students in both groups judge different dimensions of their learning experience using adjectives such as “messy, interesting, new adventure, encouraging, confusing”. Open coding procedure was used to identify indicators of student satisfaction and dissatisfaction by two raters. Then, raters used axial coding procedure to construct linkage between codes. The inter-rater reliability was calculated using Cohens’ Kappa (see Appendix B). Student quotations on learner satisfaction dimensions are provided in Table 4.
3.4 Experimental procedure
Students were asked to write their assignments collaboratively in two online contexts, i.e., text-based CMC group and multimodal CMC group. They participated in a tutorial session to get familiarized with Moodle and Writing Forum platforms, to receive their log-in credentials, and details on the structure of collaborative writing assignment. To assure consistency across groups, everything in both groups were kept constant including the writing tasks and topics, teachers’ explicit teaching and teachers’ scoring method. In both groups, the following procedure was taken: 1) the students chose their partner as they wished; (2) the teachers had the students do brainstorming about the writing topics; (3) the students researched and gathered information using different sources; (4) the students wrote the outline and gave it back to the teacher and the teacher provided pertinent comments; (5) then the students planned and wrote the first draft; (6) the students checked out the first draft according to the checklist provided by the teacher in advance; (7) each student edited the essay individually with different highlight colors so that when they handed in their essays together, they could track each other’s ideas and provide justifications for the required revisions; (8) students handed in their writing to the teacher and the teacher commented on the language, content, and organization of their writings; (9) and finally, students received the teacher’s comments and revised the paper together. Sample student collaborative writing is provided in Appendix C.
Modular object-oriented dynamic learning environment (Moodle) was used as a multimodal CMC. This platform allows synchronous chats and a synchronous discussion for geographically separated users. In Moodle, teachers and students can collaborate in both voice and video modalities, send, and respond files and comments, and can use the tracking and feedback system. Moodle has a wide range of ways in which people can create representations of their knowledge and share them. The course structure itself is a terrific way to construct a shared and active representation of the learning journey that everyone is going through Forums of course are the core of this, providing spaces for discussion and sharing of media and documents (using the media plugin filters, attachments or simply links). Wikis are collaboratively built pages useful for group work and other negotiations. Glossaries are collaboratively built lists of definitions that can then appear throughout the course. Databases are an extension of this idea allowing participants to enter structured media of any type (for example a collection of digital photos or a library of references). The Recent Activity block shows a great deal of information about what has happened recently, and via link you can see reports with more detail. Things that happened include changes to the course and forum posts.
Students in multimodal CMC group used Moodle to negotiate and collaborate as they were doing writing assignments. Students in this group shared the ideas on the topic of the writing task, generated ideas through negotiation with each other and wrote down their first draft e-collaboratively through Skype as audio conference writing. They negotiated and collaborated on the first draft until they reached shared understating on the final draft. Students were informed about how to work with Moodle.
An e-writing forum was launched on http//e-writingforum.ir by the researchers. As a text-based CMC, students used writing, commenting, and responding to comments options of the forum and provided comments on each other’s writing performance. Participants were required to write a writing assignment collaboratively. Students were instructed to create accounts on the website. Students were paired on the website. Students logged into their accounts on the forum and entered the section in which they were grouped with their partners. They were asked to log in to the forum and find the thread posted by the teacher and to post their ideas and respond to their group mate’s ideas via the options available at the tool bar of the forum. The toolbar included options for posting an idea, editing a post, providing comments, replying to the comments, and replying with quotes.
At the end of the treatment, students were asked to write a reflective essay on the extent to which they are satisfied with the learning environment they experienced during the treatment. Students’ first and last writing performances during 14 sessions of treatment was also compared to investigate which CMC modality had higher potentials in improving students’ writing quality.
3.5 Data analysis procedure
To investigate to what extent text-based and multimodal computer mediated writing differ in learner autonomy, students’ responses were treated as test scores adding to their level of learner autonomy. The mean scores were compared using independent sample t-test. Via open and axial coding of transcribed conversations in Moodle and discussion logs in text-based forum, researchers identified student behavioral, cognitive, and emotional engagement dimensions. The chi-square analysis of the identified codes and categories was used to investigate the extent to which text-based and multimodal computer mediated writing differed in promoting learner engagement. Moreover, a one-way analysis of covariance (ANCOVA) was run to compare the multimedia and text-based groups’ means on posttest of writing performance after controlling for the effect of pretest. Besides, the codes derived from the reflective essays were discussed in relation to students’ reflective quotations to indicate on what grounds multimodal and text-based CMCs satisfied students.
4 Results
4.1 Learner autonomy in text-based and multimodal computer mediated writing
An independent-samples t-test was run to compare the multimedia and text-based groups’ means on autonomy to probe the first research question. Table 5 displays the results of the descriptive statistics for the two group on autonomy. The results indicated that the text-based group (M = 163.35, SD = 27.93) had higher mean than the multimedia group (M = 135.80, SD = 35.96) on autonomy.
Table 6 displays the results of the independent-samples t-test. It should be noted that the assumption of homogeneity of variances was retained. As displayed in Table 6, the non-significant results of the Levene’s test (F = 3.91, p > 0.05) indicated that the two groups were homogenous in terms of their variances on autonomy. That was why the first row of Table 6; i.e., “Equal variances assumed” was reported. The results of independent samples t-test; (t (38) = 2.70, p < 0.05, r = 0.401 representing a moderate effect sizeFootnote 1) indicated that the text-based group had a significantly higher mean than the multimedia group on autonomy.
4.2 Learner engagement text-based and multimodal computer mediated writing
To investigate significant differences between the frequencies of student engagement dimensions of behavioral, cognitive, emotional, and social by multimedia and text-based groups, chi-square test was used. Table 7 displays the frequencies, percentages, and standardized residuals (Std. Residual) for the two groups. It should be noted that any Std. Residual higher than ± 1.96 indicates that the frequency is significant beyond/below what was expected.
The results indicated that text-based group employed behavioral (43.6%, Std. Residual = 3 > 1.96) and cognitive (21.8%, Std. Residual = 3.5 > 1.96) engagement strategies significantly more than the multimedia group whose results were (25.6%, Std. Residual = -3.2 > -1.96) for behavioral engagement, and (7.7%, Std. Residual = -3.8 > -1.96) for cognitive engagement. On the other hand, multimedia group employed emotional (20.5%, Std. Residual = 3.4 > 1.96) and social (46.2%, Std. Residual = 3.6 > 1.96) engagement strategies significantly more than the text-based group whose results were (8.5%, Std. Residual = -3.2 > -1.96) for emotional engagement, and (26.1%, Std. Residual = -3.3 > -1.96) for social engagement.
Table 8 displays the results of the analysis of chi-square. The results (χ2 (3) = 92.15, p < 0.05) indicated that there were significant differences between the multimedia and text-based groups’ use of engagement strategies. The results also were indicated in Fig. 1. As it was discussed above, the multimedia group employed emotional and social strategies significantly more than the text-based group, while the latter group used behavioral and cognitive strategies significantly more than the multimedia group. The effect size for the chi-square was 0.329 which represent a moderate effect size (Cramer’s V = 0.329 representing a moderate effect sizeFootnote 2) (Gray and Kinnear, 2012).
4.3 Learner satisfaction in text-based and multimodal CMC writings
Learner satisfaction about learning experiences in two CMC modalities were studied via theme analysis of student reflective essays and coded using open and axial coding procedure to categorize the themes. Student’ satisfaction analysis on 258 quotations in 40 reflective essays of both groups resulted in identification of four categories of codes including learner dimension (learners’ attitude, learner internet self-efficacy), teacher dimension (teacher presence, teacher digital competences), curriculum dimension (curriculum flexibility, course quality, flexibility in interaction support system) and internet dimension (internet quality and support system) (Fig. 2). Only internet dimension received negative judgments from students of both groups. The quotations from student reflective essays are provided in Table 11 in Appendix D.
4.4 Text-based and multimodal computer mediated writing performances
A one-way analysis of covariance (ANCOVA) was run to compare the multimodal and text-based groups’ means on posttest of writing performance after controlling for the effect of pretest. Required assumptions for ANCOVA were checked. One-way ANCOVA has three assumptions, i.e., homogeneity of variances of groups, linearity, and homogeneity of regression slopes. First, t the assumption of homogeneity of variances was retained on posttest of writing test (F (1, 38) = 0.925, p < 0.05) (Table 11, Appendix D). Second, one-way ANCOVA assumes that there is a linear relationship between dependent variable (posttest of writing performance) and covariate (pretest). The linearity assumption was retained, i.e. (F (1, 39) = 12.52, p < 0.05, η2 = 0.288 representing a large effect sizeFootnote 3) (Table 12, Appendix E). And finally; one-way ANCOVA assumes that the linear relationship between pretest and posttest are roughly equal across the two groups; homogeneity of regression slopes. The non-significant interaction between covariate (pretest) and independent variable (types of treatment); i.e. (F (1, 36) = 0.601, p > 0.05, Partial η2 = 0.016 representing a weak effect sizeFootnote 4) was retained (Table 13 in Appendix F). Table 9 displays the descriptive statistics for the multimedia and text-based groups on posttest of writing performance after controlling for the effect of pretest. The results showed that the text-based group (M = 7.51, SE = 0.113) had a higher mean than the multimedia group (M = 6.75, SE = 0.113) after controlling for the effect of pretest.
a. Covariates appearing in the model are evaluated at the following values: Pretest = 5.10.
Table 10 displays the main results of one-way ANCOVA. The results (F (1, 37) = 22.38, p < 0.05, partial η2 = 0.377 representing a large effect size) indicated that the text-based group significantly outperformed the multimedia group on the posttest of writing performance after controlling for the effect of pretest.
5 Discussion
This study aimed at investigating the comparative potential of text-based and multimodal learning modalities. The results indicated that students were more autonomously, behaviorally, and cognitively engaged in text-based modality and more emotionally and socially engaged in multimodal modality. Students reported similar value judgments as far as student satisfaction is concerned. The results revealed that different modalities have different potentials in directing student learning.
5.1 Learner autonomy in text-based and multimodal computer mediated writing environments
As far as learner autonomy is concerned, text-based modality has shown higher potential in increasing learner autonomy. The most probable justification for superiority of text-based modality in fostering learner autonomy is that, students experience more cognitive presence which is achieved through learners’ sustained reflection and discussion in meaning construction (Janssona et al., 2021). Cognitive presence is characterized by triggering event, Exploration, Integration, and Resolution which are key to autonomous learning (Garrison, 2006). The findings align with many studies on the association between text- based computer assisted writing and learner autonomy. For example, the experimental study by Pathan et al. (2021) indicated that text blogging has affected engineering higher education students’ learner autonomy. Research also supported that discussion forums and online text chat environment engaged learners in more collaborative opportunities in which students jointly take the responsibility of learning (Zhong, 2018). Research also indicated that in text-based computer mediated writing, students use more metacognitive and effort regulation strategies that are predictors of autonomous learning, (Broadbent et al., 2021). The results of this study also show contradictions with the existing literature on learner autonomy and online learning. For example, Garrison et al. (2001) indicated that multimodal learning led to more autonomous learning through establishing motivation, creativity and collaboration. Other studies also indicated that multimodal learning results in more autonomous learners since learners’ competencies in interpreting, employing, and interacting with various semiotic resources, of which language is just one were involved. Interactions in multimodal platforms direct more authentic learning context and engage learners more in co-construction of knowledge and cognitive control of learning (Liu & Moeller, 2019). Several other studies reported impact of multimodal learning on learner autonomy (Hafner & Miller, 2011; Seeger, 2019; Villamizar & Mejía, 2019); all confirming positive role. However, they were compared with the traditional campus-based learning.
5.2 Learner engagement in text-based and multimodal computer mediated writing environments
As far as student engagement was concerned, the result of the present research indicated that text-based CMC group outperformed multimodal CMC group in terms of behavioral and cognitive engagement. Yet multimodal CMC group reported higher emotional and social engagement. Why students are more socially and emotionally engaged in multimodal learning can be explained by student’s social presence defined as participants’ tendency to identify, develop inter-personal relationships and communicate with the community (e.g., course of study), in a trusting environment (Janssona et al., 2021). Social presence is characterized by personal/affective category, open communication and group cohesion which are key to student engagement (Garrison & Akyol, 2015). The results corroborate several studies which supported the impact of text-based learning modality on learner engagement and autonomy. For example, the results of the study by Pineda-Báez et al. (2019) indicated that in text-based CMC, students were more cognitively engaged whereas in visual CMC, students were more socially engaged. The superiority of text-based modality in more engaging learners compared to oral modalities were also confirmed in research by Traphagan et al. (2010). Similarly, Swartzwelder et al. (2019) indicated that students felt more engaged and interactive in text-based discussion compared to video-based discussions with native speakers. The results of the present study contradict the existing literature on multimodal learning and learner engagement. Whereas the present research approved higher potential in text-based modality in engaging students compared to multimodal learning, there are several studies that approved the opposite, For example, research indicated more cognitive engagement in multimodal learning compared to text-based modalities (Sankey et al., 2010). Likewise, the study by Taylor and Huang (2011) confirmed the superiority of voice based threads compared to text and video threads in engaging students.
5.3 Writing quality in text-based and multimodal computer mediated writing environments
As far as the quality of writing was concerned, results of this study indicated that both text- based and multimodal CMCs optimized higher quality writing. The results are in accord with several other studies. Similarly, scholars such as Jepson (2005) and Satar and Özdener (2008) stated that both multimodal and text- based CMCs have impacts on optimizing student learning. However, it is assumed that errors in spoken form are often ignored for the sake of fluent interaction whereas in written form they have a more permanent nature and this may put text based CMCs in advantage over multimodal CMCs (Sampson, 2012).
5.4 Student e-satisfaction in text-based and multimodal computer mediated writing environments
With respect to student satisfaction, the results indicated that students’ satisfaction was affected by factors such as learner dimension (learners’ attitude, learner internet self-efficacy), teacher dimension (teacher presence, teacher digital competences), curriculum dimension (curriculum flexibility, course quality, flexibility in interaction support system) and internet dimension (internet quality and support system) reflected students’ e-satisfaction in both groups. However, the designers of e-learning systems are called to combine different analytical and/or stochastic methods in assessing degree of customers’ expectations and their level of satisfaction. A holistic approach based on users’ satisfaction level and the appropriate measurement analysis should give support to the designers in improving existing and designing new more attractive web-based learning models in the contemporary educational blended (Bauk et al., 2014).
6 Conclusion and implications
This study indicated that text-based and multimodal CMCs have different potentials in engaging students, fostering autonomous learning and in turn resulting in learner satisfaction. The results of between group comparison indicated that students were more autonomous in text-based modality than in multimodal CMC. Chi-square analysis indicated that text-based CMC group outperformed multimodal CMC group in terms of behavioral and cognitive engagement. Yet, multimodal CMC group reported higher emotional and social engagement. One-way ANCOVA results also indicated the students in text-based CMC group outperformed Multimodal CMC group in terms of writing quality. Learner e-satisfaction was examined by network mapping of open codes of student reflective essays. Four categories were identified to reflect students' e-satisfaction: a) learner dimension (including learners’ attitude, learner internet self-efficacy), b) teacher dimension (including teacher presence, teacher digital competences), c) curriculum dimension (including curriculum flexibility, course quality, flexibility in interaction support system) and d) internet dimension (including internet quality and support system) reflected students’ e-satisfaction. Only internet dimension received negative judgments from students of both groups. As indicated in this research, the learning environments that foster real time presence to create an atmosphere of trust, feedback and openness among students may increase learner satisfaction (Sharifrazi & Stone, 2019).
Theoretically speaking, the present research findings imply that dual function for social means for communication and cognitive means for co-regulations towards co-regulated learning are deemed highly valuable for L2 development. However, dynamics of interaction is influenced by the mode of interaction. This study also suggests that the multimodal CMCs are deemed as a site with varying levels of functionality in engaging students in autonomous learning.
Practical implications of the findings suggest that teachers can implement text-based CMC when real time on task learner behavior is needed because it engages learners more in actual performance. Multimodal CMC can be implemented when scaffolding through emotions and collaborations is needed. Multimodal CMCs allow richer cues, instant feedback, and use of natural languages. However, text-based CMC users circumvent the constrains of the channel (lack of nonverbal cues) to achieve their communicative goal. Multimodal CMC users may turn off videos which may give this feeling of teaching to voids. Besides, the video options may affect students ‘optimal performance due to their touch on learner self- confidence. This may give an advantage to text-based CMCs as they may contribute to student self-disclose. Text-based CMC can improve teaching quality in terms of creating opportunities for interpretive communication skills and multimodal CMC can enhance direct interpersonal and presentational skills. As far as assessment and measurement are concerned, the text-based modality can better help examiners to evaluate individual learning. And since multimodal learning is more open to student social and emotional engagement, this modality can be more useful for assessment of collaborative performances. The results of student satisfaction imply that irrespective of communication modality, student satisfaction is integral to successful learning. Results also imply that text-based communication modality can better assist writing teachers than multimodal communication modality.
The findings of the research are limited in several ways. First, learner autonomy was assessed in summative fashion via questionnaire. Future research can use formative assessment to assess invisible aspects that could not be detected through summative assessment techniques such as how learning autonomy evolves in different learning contexts. Besides, responses to the questionnaire might be affected by social desirability effect. Future research is needed to design techniques that can minimize this effect. In addition, since student group work skills and individual accountability might affect student performances, future research can assess interactive CMCs that foster group unity and cater for individual accountability and in turn maximize learning opportunities.
Code availability
Atlasti and SPSS entry were used.
Data Availability
The data is available on request by emails.
Notes
The r-effect size should be interpreted based on these criteria; .10 = Weak, .30 = Moderate, and .50 = Large (Field 2018). The r effect size was computed using the following formula; \(r=\sqrt{\frac{t^2}{t^2+df}}\) (Field 2018, p 609).
Cramer’s V = square root of chi-square / total frequency; i.e. Square root of 92.153 / 849 = .329. Cramer’s V “may be interpreted in a manner similar to a correlation” (George and Mallery 2020, p 372). That is to say; .10 = Weak, .30 = Moderate and .50 = Large.
Eta Squared was computed as Sum of Squares Between Groups / Sum of Squares Total; and should be interpreted using these criteria, .01 = Weak, .06 = Moderate, and .14 = Large (Gray and Kinnear 2012, p 244; Field 2018, p 737).
Partial Eta Squared should be interpreted using the following criteria; .01 = Weak, .06 = Moderate, and .14 = Large (Gray and Kinnear 2012, p 323; and Pallant 2016, p 285).
Abbreviations
- CMC:
-
Computer mediated communication
- EFL:
-
English as foreign language
References
Abdous, M. H. (2019). Influence of satisfaction and preparedness on online students’ feelings of anxiety. The Internet and Higher Education, 41, 34–44.
Al Ghazali, F. (2020). Challenges and opportunities of fostering learner autonomy and self-access learning during the COVID-19 pandemic. SiSAL Journal : Studies in Self-Access Learning, 114–127. https://doi.org/10.37237/110302
Ayouni, S., Hajjej, F., Maddeh, M., & Alotaibi, S. (2021). Innovations of materials for student engagement in online environment: An ontology. Materials Today: Proceedings. https://doi.org/10.1016/j.matpr.2021.03.636
Bagheri, M., & Zenouzagh, Z. M. (2021). Comparative study of the effect of face-to-face and computer mediated conversation modalities on student engagement: Speaking skill in focus. Asian-Pacific Journal of Second and Foreign Language Education, 6(1), 1–23.
Barile, L., Elliott, C., & McCann, M. (2022). Which online learning resources do undergraduate economics students’ value and does their use improve academic attainment? A comparison and revealed preferences from before and during the Covid pandemic. International Review of Economics Education, 41, 100253.
Bauk, S., Šćepanović, S., & Kopp, M. (2014). Estimating students’ satisfaction with web based learning system in blended learning environment. Education Research International, 2014. Article ID 731720. https://doi.org/10.1155/2014/731720
Binali, T., Tsai, C.-C., & Chang, H.-Y. (2021). University students’ profiles of online learning and their relation to online metacognitive regulation and internet-specific epistemic justification. Computers & Education, 175, 104315. https://doi.org/10.1016/j.compedu.2021.104315
de Brito Lima, F., Lautert, S. L., & Gomes, A. S. (2021). Contrasting levels of student engagement in blended and non-blended learning scenarios. Computers & Education, 172, 104241. https://doi.org/10.1016/j.compedu.2021.104241
Broadbent, J., & Poon, W. L. (2015). Self-regulated learning strategies & academic achievement in online higher education learning environments: A systematic review. The Internet and Higher Education, 27, 1–13.
Broadbent, J., Sharman, S., Panadero, E., & Fuller-Tyszkiewicz, M. (2021). How does self-regulated learning influence formative assessment and summative grade? Comparing online and blended learners. The Internet and Higher Education, 50, 100805.
Buijs, M., & Admiraal, W. (2013). Homework assignments to enhance student engagement in secondary education. European Journal of Psychology of Education, 28(3), 767–779.
Challob, A. A. I., Bakar, N. A., & Latif, H. (2016). Collaborative Blended Learning Writing Environment: Effects on EFL Students’ Writing Apprehension and Writing Performance. English Language Teaching, 9(6), 229.
Cheung, A. (2022). Verbal and on-screen peer interactions of EFL learners during multimodal collaborative writing: A multiple case-study. Journal of Second Language Writing, 58, 100931.
Cho, M.-H., & Heron, M. L. (2015). Self-regulated learning: The role of motivation, emotion, and use of learning strategies in students’ learning experiences in a self-paced online mathematics course. Distance Education, 36(1), 80–99.
Cho, M. (2018). Task complexity, modality, and working memory in L2 task performance. System, 72, 85–98.
Cohen, A. D. (2014). Strategies in learning and using a second language. Routledge.
Collins, K., Groff, S., Mathena, C., & Kupczynski, L. (2019). Asynchronous video and the development of instructor social presence and student engagement. Turkish Online Journal of Distance Education, 20(1), 53–70.
Colpaert, J., & Spruyt, E. (2023). Conceptualisation of a language task design model for mental acceptance. In Virtual Exchange for Intercultural Language Learning and Teaching (pp. 44–66). Routledge. https://doi.org/10.4324/9781003024620
Colson, R., & Hirumi, A. (2018). A Framework for the Design of Online Competency-Based Education to Promote Student Engagement. In: Student Engagement and Participation: Concepts, Methodologies, Tools, and Applications (pp. 203–220). IGI Global.
Dalgarno, B., & Lee, M. J. (2010). What are the learning affordances of 3-D virtual environments? British Journal of Educational Technology, 41(1), 10–32.
Dang, T. T. (2012). Learner autonomy: A synthesis of theory and practice. The Internet Journal of Language, Culture and Society, 35(1), 52–67.
Dascalu, M.-D., Ruseti, S., Dascalu, M., McNamara, D. S., Carabas, M., Rebedea, T., & Trausan-Matu, S. (2021). Before and during COVID-19: A Cohesion Network Analysis of students’ online participation in moodle courses. Computers in Human Behavior, 121, 106780.
Deng, R., Benckendorff, P., & Gannaway, D. (2020). Learner engagement in MOOCs: Scale development and validation. British Journal of Educational Technology, 51(1), 245–262.
Dixson, M. D. (2015). Measuring student engagement in the online course: The Online Student Engagement scale (OSE). Online Learning, 19(4), n4.
Dwivedi, Y. K., Rana, N. P., Jeyaraj, A., Clement, M., & Williams, M. D. (2019). Re-examining the unified theory of acceptance and use of technology (UTAUT): Towards a revised theoretical model. Information Systems Frontiers, 21(3), 719–734.
Eneau, J., & Develotte, C. (2012). Working together online to enhance learner autonomy: Analysis of learners’ perceptions of their online learning experience. ReCALL, 24(1), 3–19.
Freiermuth, M., & Jarrell, D. (2006). Willingness to communicate: Can online chat help? 1. International Journal of Applied Linguistics, 16(2), 189–212.
Freiermuth, M. R. (2001). Native speakers or non-native speakers: Who has the floor? Online and face-to-face interaction in culturally mixed small groups. Computer Assisted Language Learning, 14(2), 169–199.
Galikyan, I., & Admiraal, W. (2019). Students’ engagement in asynchronous online discussion: The relationship between cognitive presence, learner prominence, and academic performance. The Internet and Higher Education, 43, 100692.
Galikyan, I., Admiraal, W., & Kester, L. (2021). MOOC discussion forums: The interplay of the cognitive and the social. Computers & Education, 165, 104133.
Garrison, D. R. (2006). Online collaboration principles. Journal of Asynchronous Learning Networks, 10(1), 25–34.
Garrison, D. R., & Akyol, Z. (2015). Toward the development of a metacognition construct for communities of inquiry. The Internet and Higher Education, 24, 66–71.
Garrison, D. R., Anderson, T., & Archer, W. (2001). Critical thinking, cognitive presence, and computer conferencing in distance education. American Journal of Distance Education, 15(1), 7–23.
Gillett-Swan, J. (2017). The challenges of online learning: Supporting and engaging the isolated learner. Journal of Learning Design, 10(1), 20–30.
Guo, P., Saab, N., Wu, L., & Admiraal, W. (2021). The Community of Inquiry perspective on students’ social presence, cognitive presence, and academic performance in online project-based learning. Journal of Computer Assisted Learning, 37(5), 1479–1493.
Hafner, C. A., & Miller, L. (2011). Fostering learner autonomy in English for science: A collaborative digital video project in a technological learning environment. Language Learning & Technology, 15(3), 68–86.
Handelsman, M. M., Briggs, W. L., Sullivan, N., & Towler, A. (2005). A measure of college student course engagement. The Journal of Educational Research, 98(3), 184–192.
Hauck, M., Satar, M., Kurek, M. (2021). Where multimodal literacy meets online language learner autonomy: “Digital resources give us wings”. In: Fuchs, C., Hauck, M., Dooly, M. (eds) Language education in digital spaces: Perspectives on autonomy and interaction. Educational Linguistics, 52. Cham: Springer. https://doi.org/10.1007/978-3-030-74958-3_5
Hoffman, R. (1996). Computer networks: Webs of communication for language teaching. In Pennington, M. C. (ed). The Power of CALL. Athelstan Publications 55–78.
Janssona, M., Hrastinski, S., Stenbom, S., & Enoksson, F. (2021). Online question and answer sessions: How students support their own and other students' processes of inquiry in a text-based learning environment. The Internet and Higher Education, 100817. https://doi.org/10.1016/j.iheduc.2021.100817
Jepson, K. (2005). Conversations—and negotiated interaction—in text and voice chat rooms. Langauge Learning & Technology, 9(3), 19–98.
Johnson, S. D., Aragon, S. R., & Shaik, N. (2000). Comparative analysis of learner satisfaction and learning outcomes in online and face-to-face learning environments. Journal of Interactive Learning Research, 11(1), 29–49.
Kahn, P., Everington, L., Kelm, K., Reid, I., & Watkins, F. (2017). Understanding student engagement in online learning environments: The role of reflexivity. Educational Technology Research and Development, 65(1), 203–218.
Kahu, E. R. (2013). Framing student engagement in higher education. Studies in Higher Education, 38(5), 758–773.
Kress, G. (2009). Multimodality: A social semiotic approach to contemporary communication. Routledge.
Kuh, G. D. (2003). What we're learning about student engagement from NSSE: Benchmarks for effective educational practices. Change: The magazine of higher learning, 35(2), 24–32.
Kuo, Y.-C., Walker, A. E., Belland, B. R., Schroder, K. E., & Kuo, Y.-T. (2014). A case study of integrating Interwise: Interaction, internet self-efficacy, and satisfaction in synchronous online learning environments. International Review of Research in Open and Distributed Learning, 15(1), 161–181.
Lee, E., & Hannafin, M. J. (2016). A design framework for enhancing engagement in student-centered learning: Own it, learn it, and share it. Educational Technology Research and Development, 64(4), 707–734.
Lin, O. P., & Maarof, N. (2013). Collaborative writing in summary writing: Student perceptions and problems. Procedia-Social and Behavioral Sciences, 90, 599–606.
Liu, X., & Moeller, A. J. (2019). Promoting learner engagement through interactive digital tools. Faculty Publications: Department of Teaching, Learning and Teacher Education. 310. http://digitalcommons.unl.edu/teachlearnfacpub/310. Available from: https://www.researchgate.net/publication/331889632_Promoting_Learner_Engagement_through_Interactive_Digital_Tools. Accessed 23 Mar 2023.
Martin, F., & Bolliger, D. U. (2018). Engagement matters: Student perceptions on the importance of engagement strategies in the online learning environment. Online Learning, 22(1), 205–222.
Mihanović, Z., Batinić, A. B., & Pavičić, J. (2016). The link between students’satisfaction with faculty, overall students’satisfaction with student life and student performances. Review of Innovation and Competitiveness: A Journal of Economic and Social Research, 2(1), 37–60.
Mogus, A. M., Djurdjevic, I., & Suvak, N. (2012). The impact of student activity in a virtual learning environment on their final mark. Active Learning in Higher Education, 13(3), 177–189.
Mohamadi, Z. (2017). Task engagement: A potential criterion for quality assessment of language learning tasks. Asian-Pacific Journal of Second and Foreign Language Education, 2(1), 1–25.
Mohamadi, Z. (2018a). Comparative effect of online summative and formative assessment on EFL student writing ability. Studies in Educational Evaluation, 59, 29–40.
Mohamadi, Z. (2018). Comparative effect of project-based learning and electronic project-based learning on the development and sustained development of english idiom knowledge. Journal of Computing in Higher Education, 30(2), 363–385. https://doi.org/10.1007/s12528-018-9169-1
Mohamadi Zenouzagh, Z. (2022). Language-related episodes and feedback in synchronous voiced-based and asynchronous text-based computer-mediated communications. Journal of Computers in Education, 9(3), 515–547. https://doi.org/10.1007/s40692-021-00212-w
Mohammadi, Z. (2017). Interactional complexity development, interactional demonstrators and interaction density in collaborative and e-collaborative writing modalities. Journal of Teaching Language Skills, 36(2), 75–102.
Mohammadi Zenouzagh, Z. (2022). Student interaction patterns and co-regulation practices in text-based and multimodal computer mediated collaborative writing modalities. Educational Technology Research and Development, 1–26. https://doi.org/10.1007/s11423-022-10158-0
Mulia, N. A. (2020). Indonesian EFL students’ engagement in online language learning platform. RETAIN, 8(2), 154–163
Olsen, J. K., Sharma, K., Rummel, N., & Aleven, V. (2020). Temporal analysis of multimodal data to predict collaborative learning outcomes. British Journal of Educational Technology, 51(5), 1527–1547.
Paas, F., Tuovinen, J. E., Tabbers, H., & Van Gerven, P. W. M. (2003). Cognitive load measurement as a means to advance cognitive load theory. Educational Psychologist : Official Publication of the Division of Educational Psychology of the American Psychological Association, 38(1), 63–71. https://doi.org/10.1207/S15326985EP3801_8
Pathan, H., Khatoon, S., Raheem, M. A., Mushtaq, F., Mohammad, J. K., & Memon, S. (2021). Blog-mediated learning strategies impacts learner autonomy in the ESL context. Ilkogretim Online, 20(5). 2231–2239. https://doi.org/10.17051/ilkonline.2021.05.242
Pereira, J. (2010). Handbook of Research on Personal Autonomy Technologies and Disability Informatics. IGI Global. New York.
Pineda-Báez, C., Manzuoli, C. H., & Sánchez, A. V. (2019). Supporting student cognitive and agentic engagement: Students’ voices. International Journal of Educational Research, 96, 81–90.
Rajabalee, Y. B., & Santally, M. I. (2021). Learner satisfaction, engagement and performances in an online module: Implications for institutional e-learning policy. Education and Information Technologies, 26(3), 2623–2656.
Ribbe, E., & Bezanilla, M.-J. (2013). Scaffolding learner autonomy in online university courses. Digital Education Review(24), 98–112.
Salikhova, N. R., Lynch, M. F., & Salikhova, A. B. (2020). Psychological aspects of digital learning: A self-determination theory perspective. Contemporary Educational Technology, 12(2). https://doi.org/10.30935/cedtech/8584
Salloum, S. A., Alhamad, A. Q. M., Al-Emran, M., Monem, A. A., & Shaalan, K. (2019). Exploring students’ acceptance of e-learning through the development of a comprehensive technology acceptance model. IEEE Access, 7, 128445–128462.
Sampson, A. (2012). Coded and uncoded error feedback: Effects on error frequencies in adult Colombian EFL learners’ writing. System, 40(4), 494–504.
Sankey, M., Birch, D., & Gardiner, M. (2010). Engaging students through multimodal learning environments: The journey continues. Proceedings ASCILITE 2010: 27th Annual Conference of the Australasian Society for Computers in Learning in Tertiary Education: Curriculum, technology and transformation for an unknown future. Paperhttp://ascilite.org.au/conferences/sydney10/Ascilite%20conference%20proceedings%202010/Sankey-full.pdf
Satar, H., & Özdener, N. (2008). The effects of synchronous CMC on speaking proficiency and anxiety: Text versus voice chat. The Modern Language Journal, 92(4), 595–613.
Schneider, M., & Preckel, F. (2017). Variables associated with achievement in higher education: A systematic review of meta-analyses. Psychological Bulletin, 143(6), 565.
Seeger, I. (2019). Enhancing classroom authenticity, motivation, and learner autonomy through multimodal EFL projects. In: Teaching Literature and Language Through Multimodal Texts. IGI Global, 4(1), 215–236. https://doi.org/10.31703/glr.2019(IV-I).11
Sharifrazi, F., & Stone, S. (2019b). Students perception of learning online: Professor's presence in synchronous versus asynchronous modality. Proceedings of the 2019 5th International Conference on Computer and Technology Applications, Istanbul, Turkey. https://doi.org/10.1145/3323933.3324087
Shin, D.-S., Cimasko, T., & Yi, Y. (2020). Development of metalanguage for multimodal composing: A case study of an L2 writer’s design of multimedia texts. Journal of Second Language Writing, 47, 100714.
Silvola, A., Näykki, P., Kaveri, A., & Muukkonen, H. (2021). Expectations for supporting student engagement with learning analytics: An academic path perspective. Computers & Education, 168, 104192.
Smallwood, B. (2006). Classroom survey of student engagement. University of Northern Florida.
Spikol, D., Ruffaldi, E., Landolfi, L., & Cukurova, M. (2017). Estimation of success in collaborative learning based on multimodal Learning Analytics FeaturesI n; 2017 IEEE 17th International Conference on Advanced Learning Technologies (ICALT), Timisoara, Romania, 2017, 269–273. https://doi.org/10.1109/ICALT.2017.122
Stephenson, C. R., Bonnes, S. L., Sawatsky, A. P., Richards, L. W., Schleck, C. D., Mandrekar, J. N., Beckman, T. J., & Wittich, C. M. (2020). The relationship between learner engagement and teaching effectiveness: A novel assessment of student engagement in continuing medical education. BMC Medical Education, 20(1), 1–8.
Stockwell, G. (2007). A review of technology choice for teaching language skills and areas in the CALL literature. ReCALL, 19(2), 105–120.
Sun, P.-C., Tsai, R. J., Finger, G., Chen, Y.-Y., & Yeh, D. (2008). What drives a successful e-Learning? An empirical investigation of the critical factors influencing learner satisfaction. Computers & Education, 50(4), 1183–1202.
Swartzwelder, K., Murphy, J., & Murphy, G. (2019). The impact of text-based and video discussions on student engagement and interactivity in an online course. Journal of Educators Online, 16(1), n1.
Taylor, L., & Huang, H.-W. (2011). Student engagement in online multimedia communication. Society for Information Technology & Teacher Education International Conference,
Traphagan, T. W., Chiang, Y.-H.V., Chang, H. M., Wattanawaha, B., Lee, H., Mayrath, M. C., Woo, J., Yoon, H.-J., Jee, M. J., & Resta, P. E. (2010). Cognitive, social and teaching presence in a virtual world and a text chat. Computers & Education, 55(3), 923–936.
Tuyet, T. T. (2020). The myth of “The earlier the better.” In Foreign language learning or the age to learn a foriegn or the optimal age to learn a foreign language. VNU Journal of Foreign Studies, 36(1). https://doi.org/10.25073/2525-2445/vnufs.4496
Twiner, A., Littleton, K., Coffin, C., & Whitelock, D. (2014). Meaning making as an interactional accomplishment: A temporal analysis of intentionality and improvisation in classroom dialogue. International Journal of Educational Research, 63, 94–106.
Van Nguyen, S., & Habók, A. (2021). Designing and validating the learner autonomy perception questionnaire. Heliyon, 7(4), e06831.
Vetter, A., & Chanier, T. (2006). Supporting oral production for professional purposes in synchronous communication with heterogenous learners. ReCALL, 18(1), 5–23.
Villamizar, A. G., & Mejía, G. (2019). Fostering learner autonomy and critical reflection through digital video-journals in a university foreign language course. Reflective Practice, 20(2), 187–200.
Wach, A. (2012). Computer-mediated communication as an autonomy-enhancement tool for advanced learners of English. Studies in Second Language Learning and Teaching, 2(3), 367–389.
Wang, Y.-S. (2003). Assessment of learner satisfaction with asynchronous electronic learning systems. Information & Management, 41(1), 75–86.
Wang, Y., Cao, Y., Gong, S., Wang, Z., Li, N., & Ai, L. (2022). Interaction and learning engagement in online learning: The mediating roles of online learning self-efficacy and academic emotions. Learning and Individual Differences, 94, 102128.
Zenouzagh, Z. M. (2018). Multidimensional analysis of efficacy of multimedia learning in development and sustained development of textuality in EFL writing performances. Education and Information Technologies, 23(6), 2969–2989.
Zenouzagh, Z. M. (2020). Syntactic complexity in individual, collaborative and E-collaborative EFL writing: Mediating role of writing modality, L1 and sustained development in focus. Educational Technology Research and Development, 68(6), 2939–2970.
Zhang, Z., Liu, T., & Lee, C. B. (2021). Language learners’ enjoyment and emotion regulation in online collaborative learning. System, 98, 102478.
Zhao, Y. (2020). Tofu Is Not Cheese: rethinking education amid the COVID-19 pandemic. In (Vol. 3, pp. 189–203): SAGE Publications Sage.
Zhong, Q. (2018). The evolution of learner autonomy in online environments: A case study in a New Zealand context. Studies in Self-Access Learning Journal, 9(1), 71–85. https://hdl.handle.net/10652/4417
Funding
This research received grant from Islamic Azad University, Karaj Branch, Karaj, Iran.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Disclosure statement
This is no financial interest or benefit that has arisen from the direct applications of this research.
Conflicting interest
There is no conflicting interest.
Data deposition
Data is available for submission if required through anonymous email.
Ethics approval
Research ethical issues were established and acknowledged in this research.
Informed consent
This research involves Human Participants and Informed consent was recognized and acknowledged in this research.
Consent for publication
Authors adhere to the Journals Copy Right and publication policies.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendices
Appendix A
Displays the Cohen’s Kappa inter-rater reliability indices for the two raters who rated the four types of engagement. The results showed that there were significant agreements between the two raters on the;
-
Behavioral engagement (Kappa = 0.834, Z = 5.40, p < 0.05),
-
Cognitive engagement (Kappa = 0.826, Z = 5.42, p < 0.05),
-
Emotional engagement (Kappa = 0.877, Z = 5.71, p < 0.05), and
-
Social engagement (Kappa = 0.844, Z = 5.40, p < 0.05).
1.1 Cohen’s Kappa Inter-Rater
Engagement | N | Minimum | Maximum |
---|---|---|---|
Behavioral | 0.834 | 5.40 | 0.000 |
Cognitive | 0.826 | 5.42 | 0.000 |
Emotional | 0.897 | 5.71 | 0.000 |
Social | 0.844 | 5.40 | 0.000 |
Appendix B
The following table displays the Cohen’s Kappa inter-rater reliability indices for the two raters who rated the essays using four codes. The results showed that there were significant agreements between the two raters on the;
-
Learner dimension (Kappa = 0.835, Z = 5.29, p < 0.05),
-
Teacher dimension (Kappa = 0.849, Z = 5.39, p < 0.05),
-
Curriculum dimension (Kappa = 0.747, Z = 4.77, p < 0.05), and
-
Internet dimension (Kappa = 0.750, Z = 4.75, p < 0.05).
2.1 Cohen’s Kappa Inter-Rater
Codes | N | Minimum | Maximum |
---|---|---|---|
Learner dimension | 0.835 | 5.29 | 0.000 |
Teacher dimension | 0.849 | 5.39 | 0.000 |
Curriculum dimension | 0.747 | 4.77 | 0.000 |
Internet dimension | 0.750 | 4.75 | 0.000 |
Appendix C
Shots of student writing in online classes.
Appendix D
Table 11
Appendix E
Table 12
Appendix F
Table 13
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Mohammadi Zenouzagh, Z., Admiraal, W. & Saab, N. Learner autonomy, learner engagement and learner satisfaction in text-based and multimodal computer mediated writing environments. Educ Inf Technol 28, 14283–14323 (2023). https://doi.org/10.1007/s10639-023-11615-w
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10639-023-11615-w