Video captioning has been investigated extensively in the Computer-Assisted Language Learning (CALL) literature to aid second language vocabulary acquisition. However, a little is known about how video captioning could foster learners’ pronunciation, which is a component of second language vocabulary acquisition proposed by Nation (Nation, Learning vocabulary in another language, Cambridge University Press, 2001), when attending to video captioning. Therefore, this study aims to investigate the effect of two types of video captioning, namely, full versus partial captioning, on mastery of word pronunciation. Furthermore, we tested the magnitude of the cognitive load imposed by video captioning types using NASA TLX. A total of 55 Arab English as a Foreign Language learners watched videos with full, partial or no captioning. Their perceptions about learning with captioning were also surveyed. Results of the pre–post-tests indicated that the captioning groups’ performance in the pronunciation tests outscored the no captioning group. In turn, the partial captioning group’s scores were slightly higher than those of the full captioning group. However, this difference was statistically insignificant. Cognitive load was found higher in full captioning and no captioning than that in the partial captioning mode. The participants showed highly positive attitudes towards learning with captions.
This is a preview of subscription content, access via your institution.
Buy single article
Instant access to the full article PDF.
Tax calculation will be finalised during checkout.
Subscribe to journal
Immediate online access to all issues from 2019. Subscription will auto renew annually.
Tax calculation will be finalised during checkout.
When the K-S test is greater than .05 it is said the data would be significantly normal (see Field, 2009, p. 146–147).
Aldera, A. S., & Mohsen, M. A. (2013). Annotations in captioned animation: Effects on vocabulary learning and listening skills. Computers & Education, 68, 60–75.
Baltova, I. (1999). Multisensory language teaching in a multidimensional curriculum: The use of authentic bimodal video in core French. The Canadian Modern Language Review, 56(1), 32–48. https://doi.org/10.3138/cmlr.56.1.31.
Bird, S. A., & Williams, J. N. (2002). The effect of bimodal input on implicit and explicit memory: An investigation into the benefits of within–language subtitling. Applied Psycholinguistics, 23(4), 509–533.
Bisson, M. J., Van Heuven, W. J., Conklin, K., & Tunney, R. J. (2014). Processing of native and foreign language subtitles in films: An eye tracking study. Applied Psycholinguistics, 35(2), 399–418.
Feng, M. (2019). The effects of video caption types and advance organizers on incidental L2 collocation learning. Computers & Education. https://doi.org/10.1016/j.compedu.2019.103655.
Field, A. (2009). Discovering statistics using SPSS. . Sage.
Hsu, C. K. (2015). Learning motivation and adaptive video caption filtering for EFL learners using handheld devices. ReCALL, 27(1), 84–103. https://doi.org/10.1017/S0958344014000214.
Hsu, C.-K., Hwang, G.-J., Chang, Y.-T., & Chang, C.-K. (2013). Effects of video caption modes on english listening comprehension and vocabulary acquisition using handheld devices. Educational Technology & Society, 16(1), 403–414.
Huang, W., & Johnson, T. (2008). Instructional game design using cognitive load theory. In R. Ferdig (Ed.), Handbook of research on effective electronic gaming in education. (pp. 1143–1165). Information Science Reference.
Isaacs, T., Trofimovich, P., & Foote, J. A. (2018). Developing a user-oriented second language comprehensibility scale for English-medium universities. Language Testing. https://doi.org/10.1177/0265532217703433.
Lee, C. H., & Kalyuga, S. (2011). Effectiveness of on-screen pinyin in learning Chinese: An expertise reversal for multimedia redundancy effect. Computers in Human Behavior, 27, 11–15. https://doi.org/10.1016/j.chb.2010.05.005.
Leveridge, A., & Yang, J. (2013). Learner perceptions of reliance on captions in EFL multimedia listening comprehension. Computer Assisted Language Learning, 27(6), 545–559. https://doi.org/10.1080/09588221.2013.776968.
Lin, J. J. H., Lee, Y. H., Wang, D. Y., & Lin, S. S. J. (2016). reading subtitles and taking enotes while learning scientific materials in a multimedia environment: cognitive load perspectives on EFL students. Educational Technology & Society, 19(4), 47–58.
Luoma, S. (2004). Assessing speaking. Cambridge University Press.
Mahdi, H. S. (2017). The use of keyword video captioning on vocabulary learning through mobile-assisted language learning. International Journal of English linguistics, 7(4), 1–7.
Mayer, R. (1997). Multimedia learning: Are we asking the right questions? Educational Psychologist, 32(1), 1–19.
Mayer, R. E. (2001). Multimedia learning. . Cambridge University Press.
Mayer, R. E. (2005). Introduction to multimedia learning. In R. Mayer (Ed.), Cambridge handbook of multimedia learning. (pp. 1–16). Cambridge University Press.
Mitterer, H., & McQueen, J. M. (2009). Foreign subtitles help but native-language subtitles harm foreign speech perception. PLoS ONE, 4(11), e7785. https://doi.org/10.1371/journal.pone.0007785.
Mohsen, M. A. (2016a). The use of help options in multimedia listening environments to aid language learning: A review. British Journal of Educational Technology, 47(6), 1232–1242.
Mohsen, M. A. (2016b). Effects of help options in a multimedia listening environment on L2 vocabulary acquisition. Computer Assisted Language Learning, 29(7), 1220–1237.
Mohsen, M. A. (2016c). The use of computer-based simulation to aid comprehension and incidental vocabulary learning. Journal of Educational Computing Research, 54(6), 863–884.
Montero Perez, M., & Desmet, P. (2012). The effect of input enhancement in L2 listening on incidental vocabulary learning: A review. Procedia-Social and Behavioral Sciences, 34, 153–157. https://doi.org/10.1016/j.sbspro.2012.02.031.
Montero Perez, M., Noortgate, W. V. D., & Desmet, P. (2013). Captioned video for l2 listening and vocabulary learning: A meta-analysis. System, 41(3), 720–739.
Montero Perez, M., Peters, E., Clarebout, G. & Desmet, P. (2014). Effects of captioning on video comprehension and incidental vocabulary learning. Language Learning & Technology, 18 (1), 118–141. Retrieved from http://llt.msu.edu/issues/february2014/monteroperezetal.pdf.
Montero Perez, M., Peters, E., & Desmet, P. (2015). Enhancing vocabulary learning through captioned video: aAn eye-tracking study. Modern Language Journal, 99(2), 308–328. https://doi.org/10.1111/modl.12215.
Montero Perez, M., Peters, E., & Desmet, P. (2018). Vocabulary learning through viewing video: The effect of two enhancement techniques. Computer Assisted Language Learning, 31(1–2), 1–26.
Nation, I. S. P. (2001). Learning vocabulary in another language. . Cambridge University Press.
Neuman, S. B., & Koskinen, P. (1992). Captioned television as “comprehensible input”: Effects of incidental word learning from context for language minority students. Reading Research Quarterly, 27, 95–106. https://doi.org/10.2307/747835.
Paas, F., Renkl, A., & Sweller, J. (2003). Cognitive load theory and instructional design: Recent developments. Educational Psychologist, 38, 1–4.
Peters, E., Heynen, E., & Puimège, E. (2016). Learning vocabulary through audiovisual input. The differential effect of L1 subtitles and captions. System, 63, 134–148. https://doi.org/10.1016/j.system.2016.10.002.
Richards, J. C. (2015). Key issues in language teaching. . Cambridge University Press.
Sankey, M. (2005). Multiple representations in multimedia materials: an issue of literacy. Interactive multimedia in education and training. (pp. 135–157). Idea Group Publishing (IGI Global), Hershey.
Schuff, D., Corral, K., & Turetken, O. (2011). Comparing the understandability of alternative data warehouse schemas: An empirical study. Decision Support Systems., 52(1), 9–20. https://doi.org/10.1016/j.dss.2011.04.003.
Second Author. (2017).
Smith, B. (2001). Arabic speakers. In M. Swan & B. Smith (Eds.), Learner English. (pp. 195–213). Cambridge University Press.
Swaffar, J., & Vlatten, A. (1997). A sequential model for video viewing in the foreign language curriculum. The Modern Language Journal, 81(2), 175–188.
Sweller, J. (1994). Cognitive load theory, learning difficulty, and instructional design. Learning and Instruction, 4, 295–312. https://doi.org/10.1016/0959-4752(94)90003-5.
Sweller, J., Ayres, P., & Kalyuga, S. (2011). Cognitive load theory. . Springer.
Syodorenko, T. (2010). Modality of input and vocabulary acquisition. Language learning & technology, 14(2), 50–73.
Szyszka, M. (2017). Pronunciation learning strategies and language anxiety: In search of an interplay. Springer.
Tavakoli, H. (2012). A dictionary of research methodology and statistics in applied linguistics. Rahnama press.
Vanderplank, R. (2010). Déjà vu? A decade of research on language laboratories, television, and video in language learning. Language Teaching, 43, 1–37. https://doi.org/10.1017/S0261444809990267.
Vanderplank, R. (2013). “Effects of” and “effects with” captions: How exactly does watching a tv programme with same-language subtitles make a difference to language learners? Language Teaching, 1–16.
Vanderplank, R. (2016). Captioned media in foreign language learning and teaching: Subtitles for the deaf and hard-of-hearing as tools for language learning. Palgrave Macmillan.
Winke, P., Gass, S., & Syodorenko, T. (2010). The effects of captioning videos used for foreign language listening activities. Language Learning & Technology, 14(1), 65–86.
Winke, P., Gass, S., & Sydorenko, T. (2013). Factors influencing the use of captions by foreign language learners: An eye-tracking study. The Modern Language Journal, 97, 254–275. https://doi.org/10.1111/j.1540-4781.2013.01432.x.
Wisniewska, N. & Mora, J. C. (2018). Pronunciation learning through captioned videos. In J. Levis (Ed.), Proceedings of the 9th Pronunciation in Second Language Learning and Teaching conference, University of Utah, September, 2017 pp. 204–215.
Wisniewska, N., & Mora, J. C. (2020). Can captioned video benefit second language pronunciation? Studies in Second Language Acquisition, 42(3), 599–624.
Yeldham, M. (2018). Viewing L2 captioned videos: What’s in it for the listener? Computer Assisted Language Learning, 31(4), 367–389.
Yuksel, D., & Tanrıverdi, B. (2009). Effects of watching captioned movie clip on vocabulary development of EFL learners. The Turkish Online Journal of Educational Technology—TOJET, 8(2), 48–54.
We would like to thank the participants of the current study.
The authors are thankful to the Deanship of Scientific Research at Najran University for funding this work through grant research code (NU/SHED/17/131).
Conflict of interest
The authors declare that they do not have conflict of interest.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendix A: The target words used in the study
Appendix A: The target words used in the study
About this article
Cite this article
Mohsen, M.A., Mahdi, H.S. Partial versus full captioning mode to improve L2 vocabulary acquisition in a mobile-assisted language learning setting: words pronunciation domain. J Comput High Educ (2021). https://doi.org/10.1007/s12528-021-09276-0
- Full captioning
- Partial captioning
- Mobile-Assisted Language Learning (MALL)
- Vocabulary acquisition