Partial versus full captioning mode to improve L2 vocabulary acquisition in a mobile-assisted language learning setting: words pronunciation domain

Abstract

Video captioning has been investigated extensively in the Computer-Assisted Language Learning (CALL) literature to aid second language vocabulary acquisition. However, a little is known about how video captioning could foster learners’ pronunciation, which is a component of second language vocabulary acquisition proposed by Nation (Nation, Learning vocabulary in another language, Cambridge University Press, 2001), when attending to video captioning. Therefore, this study aims to investigate the effect of two types of video captioning, namely, full versus partial captioning, on mastery of word pronunciation. Furthermore, we tested the magnitude of the cognitive load imposed by video captioning types using NASA TLX. A total of 55 Arab English as a Foreign Language learners watched videos with full, partial or no captioning. Their perceptions about learning with captioning were also surveyed. Results of the pre–post-tests indicated that the captioning groups’ performance in the pronunciation tests outscored the no captioning group. In turn, the partial captioning group’s scores were slightly higher than those of the full captioning group. However, this difference was statistically insignificant. Cognitive load was found higher in full captioning and no captioning than that in the partial captioning mode. The participants showed highly positive attitudes towards learning with captions.

This is a preview of subscription content, access via your institution.

Fig. 1

Notes

  1. 1.

    When the K-S test is greater than .05 it is said the data would be significantly normal (see Field, 2009, p. 146–147).

References

  1. Aldera, A. S., & Mohsen, M. A. (2013). Annotations in captioned animation: Effects on vocabulary learning and listening skills. Computers & Education, 68, 60–75.

  2. Baltova, I. (1999). Multisensory language teaching in a multidimensional curriculum: The use of authentic bimodal video in core French. The Canadian Modern Language Review, 56(1), 32–48. https://doi.org/10.3138/cmlr.56.1.31.

    Article  Google Scholar 

  3. Bird, S. A., & Williams, J. N. (2002). The effect of bimodal input on implicit and explicit memory: An investigation into the benefits of within–language subtitling. Applied Psycholinguistics, 23(4), 509–533.

    Article  Google Scholar 

  4. Bisson, M. J., Van Heuven, W. J., Conklin, K., & Tunney, R. J. (2014). Processing of native and foreign language subtitles in films: An eye tracking study. Applied Psycholinguistics, 35(2), 399–418.

    Article  Google Scholar 

  5. Feng, M. (2019). The effects of video caption types and advance organizers on incidental L2 collocation learning. Computers & Education. https://doi.org/10.1016/j.compedu.2019.103655.

    Article  Google Scholar 

  6. Field, A. (2009). Discovering statistics using SPSS. . Sage.

  7. Hsu, C. K. (2015). Learning motivation and adaptive video caption filtering for EFL learners using handheld devices. ReCALL, 27(1), 84–103. https://doi.org/10.1017/S0958344014000214.

    Article  Google Scholar 

  8. Hsu, C.-K., Hwang, G.-J., Chang, Y.-T., & Chang, C.-K. (2013). Effects of video caption modes on english listening comprehension and vocabulary acquisition using handheld devices. Educational Technology & Society, 16(1), 403–414.

    Google Scholar 

  9. Huang, W., & Johnson, T. (2008). Instructional game design using cognitive load theory. In R. Ferdig (Ed.), Handbook of research on effective electronic gaming in education. (pp. 1143–1165). Information Science Reference.

  10. Isaacs, T., Trofimovich, P., & Foote, J. A. (2018). Developing a user-oriented second language comprehensibility scale for English-medium universities. Language Testing. https://doi.org/10.1177/0265532217703433.

    Article  Google Scholar 

  11. Lee, C. H., & Kalyuga, S. (2011). Effectiveness of on-screen pinyin in learning Chinese: An expertise reversal for multimedia redundancy effect. Computers in Human Behavior, 27, 11–15. https://doi.org/10.1016/j.chb.2010.05.005.

    Article  Google Scholar 

  12. Leveridge, A., & Yang, J. (2013). Learner perceptions of reliance on captions in EFL multimedia listening comprehension. Computer Assisted Language Learning, 27(6), 545–559. https://doi.org/10.1080/09588221.2013.776968.

    Article  Google Scholar 

  13. Lin, J. J. H., Lee, Y. H., Wang, D. Y., & Lin, S. S. J. (2016). reading subtitles and taking enotes while learning scientific materials in a multimedia environment: cognitive load perspectives on EFL students. Educational Technology & Society, 19(4), 47–58.

    Google Scholar 

  14. Luoma, S. (2004). Assessing speaking. Cambridge University Press.

  15. Mahdi, H. S. (2017). The use of keyword video captioning on vocabulary learning through mobile-assisted language learning. International Journal of English linguistics, 7(4), 1–7.

  16. Mayer, R. (1997). Multimedia learning: Are we asking the right questions? Educational Psychologist, 32(1), 1–19.

    Article  Google Scholar 

  17. Mayer, R. E. (2001). Multimedia learning. . Cambridge University Press.

  18. Mayer, R. E. (2005). Introduction to multimedia learning. In R. Mayer (Ed.), Cambridge handbook of multimedia learning. (pp. 1–16). Cambridge University Press.

  19. Mitterer, H., & McQueen, J. M. (2009). Foreign subtitles help but native-language subtitles harm foreign speech perception. PLoS ONE, 4(11), e7785. https://doi.org/10.1371/journal.pone.0007785.

    Article  Google Scholar 

  20. Mohsen, M. A. (2016a). The use of help options in multimedia listening environments to aid language learning: A review. British Journal of Educational Technology, 47(6), 1232–1242.

  21. Mohsen, M. A. (2016b). Effects of help options in a multimedia listening environment on L2 vocabulary acquisition. Computer Assisted Language Learning, 29(7), 1220–1237.

  22. Mohsen, M. A. (2016c). The use of computer-based simulation to aid comprehension and incidental vocabulary learning. Journal of Educational Computing Research, 54(6), 863–884.

  23. Montero Perez, M., & Desmet, P. (2012). The effect of input enhancement in L2 listening on incidental vocabulary learning: A review. Procedia-Social and Behavioral Sciences, 34, 153–157. https://doi.org/10.1016/j.sbspro.2012.02.031.

    Article  Google Scholar 

  24. Montero Perez, M., Noortgate, W. V. D., & Desmet, P. (2013). Captioned video for l2 listening and vocabulary learning: A meta-analysis. System, 41(3), 720–739.

    Article  Google Scholar 

  25. Montero Perez, M., Peters, E., Clarebout, G. & Desmet, P. (2014). Effects of captioning on video comprehension and incidental vocabulary learning. Language Learning & Technology, 18 (1), 118–141. Retrieved from http://llt.msu.edu/issues/february2014/monteroperezetal.pdf.

  26. Montero Perez, M., Peters, E., & Desmet, P. (2015). Enhancing vocabulary learning through captioned video: aAn eye-tracking study. Modern Language Journal, 99(2), 308–328. https://doi.org/10.1111/modl.12215.

    Article  Google Scholar 

  27. Montero Perez, M., Peters, E., & Desmet, P. (2018). Vocabulary learning through viewing video: The effect of two enhancement techniques. Computer Assisted Language Learning, 31(1–2), 1–26.

  28. Nation, I. S. P. (2001). Learning vocabulary in another language. . Cambridge University Press.

  29. Neuman, S. B., & Koskinen, P. (1992). Captioned television as “comprehensible input”: Effects of incidental word learning from context for language minority students. Reading Research Quarterly, 27, 95–106. https://doi.org/10.2307/747835.

    Article  Google Scholar 

  30. Paas, F., Renkl, A., & Sweller, J. (2003). Cognitive load theory and instructional design: Recent developments. Educational Psychologist, 38, 1–4.

    Article  Google Scholar 

  31. Peters, E., Heynen, E., & Puimège, E. (2016). Learning vocabulary through audiovisual input. The differential effect of L1 subtitles and captions. System, 63, 134–148. https://doi.org/10.1016/j.system.2016.10.002.

    Article  Google Scholar 

  32. Richards, J. C. (2015). Key issues in language teaching. . Cambridge University Press.

  33. Sankey, M. (2005). Multiple representations in multimedia materials: an issue of literacy. Interactive multimedia in education and training. (pp. 135–157). Idea Group Publishing (IGI Global), Hershey.

  34. Schuff, D., Corral, K., & Turetken, O. (2011). Comparing the understandability of alternative data warehouse schemas: An empirical study. Decision Support Systems., 52(1), 9–20. https://doi.org/10.1016/j.dss.2011.04.003.

    Article  Google Scholar 

  35. Second Author. (2017).

  36. Smith, B. (2001). Arabic speakers. In M. Swan & B. Smith (Eds.), Learner English. (pp. 195–213). Cambridge University Press.

  37. Swaffar, J., & Vlatten, A. (1997). A sequential model for video viewing in the foreign language curriculum. The Modern Language Journal, 81(2), 175–188.

    Article  Google Scholar 

  38. Sweller, J. (1994). Cognitive load theory, learning difficulty, and instructional design. Learning and Instruction, 4, 295–312. https://doi.org/10.1016/0959-4752(94)90003-5.

    Article  Google Scholar 

  39. Sweller, J., Ayres, P., & Kalyuga, S. (2011). Cognitive load theory. . Springer.

  40. Syodorenko, T. (2010). Modality of input and vocabulary acquisition. Language learning & technology, 14(2), 50–73.

  41. Szyszka, M. (2017). Pronunciation learning strategies and language anxiety: In search of an interplay. Springer.

  42. Tavakoli, H. (2012). A dictionary of research methodology and statistics in applied linguistics. Rahnama press.

  43. Vanderplank, R. (2010). Déjà vu? A decade of research on language laboratories, television, and video in language learning. Language Teaching, 43, 1–37. https://doi.org/10.1017/S0261444809990267.

    Article  Google Scholar 

  44. Vanderplank, R. (2013). “Effects of” and “effects with” captions: How exactly does watching a tv programme with same-language subtitles make a difference to language learners? Language Teaching, 1–16.

  45. Vanderplank, R. (2016). Captioned media in foreign language learning and teaching: Subtitles for the deaf and hard-of-hearing as tools for language learning. Palgrave Macmillan.

  46. Winke, P., Gass, S., & Syodorenko, T. (2010). The effects of captioning videos used for foreign language listening activities. Language Learning & Technology, 14(1), 65–86.

  47. Winke, P., Gass, S., & Sydorenko, T. (2013). Factors influencing the use of captions by foreign language learners: An eye-tracking study. The Modern Language Journal, 97, 254–275. https://doi.org/10.1111/j.1540-4781.2013.01432.x.

    Article  Google Scholar 

  48. Wisniewska, N. & Mora, J. C. (2018). Pronunciation learning through captioned videos. In J. Levis (Ed.), Proceedings of the 9th Pronunciation in Second Language Learning and Teaching conference, University of Utah, September, 2017 pp. 204–215.

  49. Wisniewska, N., & Mora, J. C. (2020). Can captioned video benefit second language pronunciation? Studies in Second Language Acquisition, 42(3), 599–624.‏

  50. Yeldham, M. (2018). Viewing L2 captioned videos: What’s in it for the listener? Computer Assisted Language Learning, 31(4), 367–389.

  51. Yuksel, D., & Tanrıverdi, B. (2009). Effects of watching captioned movie clip on vocabulary development of EFL learners. The Turkish Online Journal of Educational Technology—TOJET, 8(2), 48–54.

    Google Scholar 

Download references

Acknowledgement

We would like to thank the participants of the current study.

Funding

The authors are thankful to the Deanship of Scientific Research at Najran University for funding this work through grant research code (NU/SHED/17/131).

Author information

Affiliations

Authors

Corresponding author

Correspondence to Mohammed Ali Mohsen.

Ethics declarations

Conflict of interest

The authors declare that they do not have conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Appendix A: The target words used in the study

Appendix A: The target words used in the study

  1. 1.

    Advancement

  2. 2.

    Civilians

  3. 3.

    Commitments

  4. 4.

    Concerned

  5. 5.

    Condemned

  6. 6.

    Conflict

  7. 7.

    Constant

  8. 8.

    Construction

  9. 9.

    Contributions

  10. 10.

    Cooperation

  11. 11.

    Empower

  12. 12.

    Environmental

  13. 13.

    Establishment

  14. 14.

    Experimenting

  15. 15.

    Exploitation

  16. 16.

    Fundamental

  17. 17.

    Generation

  18. 18.

    Genocide

  19. 19.

    Globalization

  20. 20.

    Historical

  21. 21.

    Hospitality

  22. 22.

    Inspiration

  23. 23.

    Institutions

  24. 24.

    Launched

  25. 25.

    Patents

  26. 26.

    Principles

  27. 27.

    Promises

  28. 28.

    Purpose

  29. 29.

    Several

  30. 30.

    Successfully

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Mohsen, M.A., Mahdi, H.S. Partial versus full captioning mode to improve L2 vocabulary acquisition in a mobile-assisted language learning setting: words pronunciation domain. J Comput High Educ (2021). https://doi.org/10.1007/s12528-021-09276-0

Download citation

Keywords

  • Full captioning
  • Partial captioning
  • Mobile-Assisted Language Learning (MALL)
  • Pronunciation
  • Vocabulary acquisition