Skip to main content

The Cognitive and Psychological Effects of YouTube Video Captions and Subtitles on Higher-Level German Language Learners

  • Chapter
  • First Online:
Technology and the Psychology of Second Language Learners and Users

Part of the book series: New Language Learning and Teaching Environments ((NLLTE))

Abstract

This chapter reviews the psychological and cognitive role of using videos, YouTube videos and modes of text support in foreign language learning, with a focus on the effect that captioning and subtitling YouTube videos have on intermediate-high and advanced German language learners. The results of the study found that enhanced captioning plays a more positive role on the intermediate-high and advanced German learners’ motivation likely due to more efficient language processing; more specifically the videos are able to provide linguistic integrity, which allows the language learners to focus their incidental attention effectively. The findings provide useful insights into and enthusiasm for the effective use of YouTube videos for the curriculum development of higher-level German courses and hopefully contribute to establishing best practices in this emerging area.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 139.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 179.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 179.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Alderson, J., Clapham, C., & Wall, D. (1995). Language test construction and evaluation. Cambridge: Cambridge University Press.

    Google Scholar 

  • Alimemaj, Z. (2010). YouTube, language learning and teaching techniques. The Magazine of Global English Speaking Higher Education, 2(3), 10–12.

    Google Scholar 

  • Allen, T. E. (1986). Patterns of academic achievement among hearing impaired students: 1974 and 1983. In A. N. Schildroth & M. A. Karchmer (Eds.), Deaf children in America (pp. 161–206). San Diego, CA: College-Hill Press.

    Google Scholar 

  • Al-Seghayer, K. (2001). The effect of multimedia annotation modes on L2 vocabulary acquisition: A comparative study. Language Learning & Technology, 5(1), 202–232.

    Google Scholar 

  • Alwehaibi, H. (2013). The impact of using YouTube in EFL. Proceedings of the Clute International Academic Conference, Paris, France.

    Google Scholar 

  • Ausubel, D. P. (1978). In defense of advance organizers: A reply to the critics. Review of Educational Research, 48(2), 251–257.

    Article  Google Scholar 

  • Baltova, I. (1999). Multisensory language teaching in a multidimensional curriculum: The use of authentic bimodal video in core French. The Canadian Modern Language Review, 56(1), 32–48.

    Article  Google Scholar 

  • Başaran, H., & Köse, G. (2013). The effects of captioning on EFL learners’ listening comprehension. Procedia – Social and Behavioral Sciences, 70, 702–708.

    Article  Google Scholar 

  • Behroozizad, S., & Majidi, S. (2015). The effect of different modes of English captioning on EL2 learners’ general listening comprehension: Full text vs. keyword captions. Advances in Language and Literary Studies, 6(4), 115–121.

    Google Scholar 

  • Berk, R. A. (2009). Multimedia teaching with video clips: TV, movies, YouTube videos, and mtvU in the college classroom. International Journal of Technology in Teaching and Learning, 5(1), 1–21.

    Google Scholar 

  • Bird, S. A., & Williams, J. N. (2002). The effect of bimodal input on implicit and explicit memory: An investigation into the benefits of within-language subtitling. Applied Psycholinguistics, 23(4), 509–533.

    Article  Google Scholar 

  • Borras, I., & Lafayette, R. C. (1994). Effect of multimedia courseware subtitling on the speaking performance of college students of French. The Modern Language Journal, 78, 61–75.

    Article  Google Scholar 

  • Brett, P. (1997). A comparative study of the effects of the use of multimedia on listening comprehension. System, 25, 39–54.

    Article  Google Scholar 

  • Brown, J. S., & Adler, R. P. (2008, January/February). Minds on fire: Open education, the long tail, and learning 2.0. Educause Review, 43(1), 16–32.

    Google Scholar 

  • Brown, J. S., Collins, A., & Duguid, P. (1989). Situated cognition and the culture of learning. Educational Researcher, 18(1), 32–41.

    Article  Google Scholar 

  • Burger, G. (1989). Are TV programs with video subtitles suitable for teaching listening comprehension? Zielsprache Deutsch, 20(4), 10–13.

    Google Scholar 

  • Chung, J. (1999). The effects of using video texts supported with advance organizers and captions on Chinese college students’ listening comprehension: An empirical study. Foreign Language Annals, 32(3), 295–308.

    Article  Google Scholar 

  • Danan, M. (1992). Reversed subtitling and dual coding theory: New directions for foreign language instruction. Language Learning, 42(4), 497–527.

    Article  Google Scholar 

  • Danan, M. (1995). Reversed subtitling and dual coding theory: New directions for foreign language instruction. In B. Harley (Ed.), Lexical issues in language learning (pp. 253–282). Ann Arbor, MI: Language Learning/John Benjamins.

    Google Scholar 

  • Danan, M. (2004). Subtitling and captioning: Undervalued language learning strategies. Meta, 49(1), 67–77.

    Article  Google Scholar 

  • Donchev, D. (2017). YouTube statistics – 2016: Facts and numbers. Retrieved from fortunelords.com/YouTube-statistics

  • Duffy, P. (2008). Engaging the YouTube Google-eyed generation: Strategies for using Web 2.0 in teaching and learning. The Electronic Journal of e-Learning, 6(2), 119–130.

    Google Scholar 

  • Fox, G. (2003). Teaching normal development using stimulus videotapes in psychiatric education. Academic Psychiatry, 27, 283–288.

    Article  Google Scholar 

  • Froehlich, J. (1988). German videos with German subtitles: A new approach to listening comprehension development. Die Unterrichtspraxis/Teaching German, 21(2), 199–203.

    Article  Google Scholar 

  • Gardner, H. (2006). Multiple intelligences: New horizons. New York: Basic Books.

    Google Scholar 

  • Garza, T. J. (1991). Evaluating the use of captioned video materials in intermediate high and advanced foreign language learning. Foreign Language Annals, 24(3), 239–258.

    Article  Google Scholar 

  • Gorjian, B. (2014). The effect of movie subtitling on incidental vocabulary learning among EL2 learners. International Journal of Asian Social Science, 4(9), 1013–1026.

    Google Scholar 

  • Grgurović, M., & Hegelheimer, V. (2007). Help options and multimedia listening: Students’ use of subtitles and the transcript. Language Learning & Technology, 11(1), 45–66.

    Google Scholar 

  • Grimmer, C. (1992). Supertext English language subtitles: A boon for English language learners. EA Journal, 10(1), 66–75.

    Google Scholar 

  • Gruba, P. (1997). The role of video media in listening assessment. System, 25, 335–345.

    Article  Google Scholar 

  • Guillory, H. G. (1998). The effects of key word captions to authentic French video in foreign language instruction. CALICO Journal, 15(1–3), 89–108.

    Google Scholar 

  • Hegelheimer, V., & O’Bryan, A. (2008). Mobile technologies and language education: A look at language learning podcasts. In M. Thomas (Ed.), Handbook of research on Web 2.0 and second language learning (pp. 331–349). Hershey, NY: Information Science Reference.

    Google Scholar 

  • Herron, C. (1994). An investigation of the effectiveness of using an advance organizer to introduce video in the foreign language classroom. Modern Language Journal, 78(2), 190–198.

    Article  Google Scholar 

  • Herron, C., Dubreil, S., Corrie, C., & Cole, S. P. (2002). A classroom investigation: Can video improve intermediate-level French language students’ ability to learn about a foreign culture? The Modern Language Journal, 86(1), 36–53.

    Article  Google Scholar 

  • Herron, C., Morris, M., Secules, T., & Curtis, L. (1995). A comparison study of the effects of video-based versus text-based instruction in the FL classroom. French Review, 68(5), 775–795.

    Google Scholar 

  • Huang, H., & Eskey, D. (2000). The effects of closed-captioned television on the listening comprehension of intermediate English as a second language students. Educational Technology Systems, 28, 75–96.

    Article  Google Scholar 

  • Kabooha, R., & Elyas, T. (2018). The effects of YouTube in multimedia instruction for vocabulary learning: Perceptions of EFL students and teachers. English Language Teaching, 11(2), 72–81.

    Article  Google Scholar 

  • Kelsen, B. (2009). Teaching EFL to the iGeneration: A survey of using YouTube as supplementary material with college EFL students in Taiwan. CALL-EJ Online, 10(2), 10–12.

    Google Scholar 

  • Kirk, D. (1992). Comparison of student responses to sources of motivation. The Language Teacher, 16(2), 23–25.

    Google Scholar 

  • Köksal, D. (2004). To kill the blackboard? Technology in language teaching. The Turkish Online Journal of Educational Technology-TOJET, 3(3), 62–72.

    Google Scholar 

  • Koolstra, C., & Beentjes, W. (1999). Children’s vocabulary acquisition in a foreign/second language through watching subtitled television at home. Educational Technology, Research, and Development, 47, 51–60.

    Article  Google Scholar 

  • Lenhart, A., & Madden, M. (2005). Teens content creators and consumers. Washington, DC: Pew Internet & American Life Report. Retrieved from www.pewinternet.org/2005/11/02/teen-content-creators-and-consumers/

    Google Scholar 

  • Macaluso, E., Noppeney, U., Talsma, D., Vercillo, T., Hartcher-O’Brien, J., & Adam, R. (2016). The curious incident of attention in multisensory integration: Bottom-up vs. Top-down. Multisensory Research. A Journal of Scientific Research on All Aspects of Multisensory Processing, 29(6–7), 557–583.

    Google Scholar 

  • Medina, M. (2002). A study of Hispanic EFL students learning English within a CALL classroom: Student introspection on learning, technology and community. Unpublished Dissertation, India University of Pennsylvania.

    Google Scholar 

  • Markham, P. (2001). The influence of culture-specific background knowledge and captions on second language comprehension. Journal of Educational Technology Systems, 29(4), 331–343.

    Article  Google Scholar 

  • Markham, P., & Peter, L. (2003). The influence of English language and Spanish language captions on foreign language listening/reading comprehension. Journal of Educational Technology Systems, 31(3), 331–341.

    Article  Google Scholar 

  • Markham, P., Peter, L., & McCarthy, T. (2001). The effects of native language vs. target language captions on foreign language students’ DVD video comprehension. Foreign Language Annals, 34(5), 439–445.

    Article  Google Scholar 

  • Massaro, D. W. (2004). From multisensory integration to talking heads and language learning. In G. Calvert, C. Spence, & B. E. Stein (Eds.), The handbook of multisensory processes (pp. 153–176). Cambridge, MA: The MIT Press.

    Chapter  Google Scholar 

  • Matielo, R., D’Ely, R., & Baretta, L. (2015). The effects of interlingual and intralingual subtitles on second language learning/acquisition: A state-of-the-art review. Trabalhos em Linguística Aplicada, 54(1), 161–182.

    Article  Google Scholar 

  • Mayer, R. E. (2005a). Introduction to multimedia learning. In R. E. Mayer (Ed.), The Cambridge handbook of multimedia learning (pp. 1–16). Cambridge, England: Cambridge University Press.

    Chapter  Google Scholar 

  • Mayer, R. E. (2005b). Principles for reducing extraneous processing in multimedia learning: Coherence, signaling, redundancy, spatial contiguity, and temporal contiguity principles. In R. E. Mayer (Ed.), The Cambridge handbook of multimedia learning (pp. 183–200). Cambridge, England: Cambridge University Press.

    Chapter  Google Scholar 

  • Mitterer, H., & McQueen, J. (2009). Foreign subtitles help but native-language subtitles harm foreign speech perception. PLoS ONE, 4(11), e7785.

    Article  Google Scholar 

  • Mukhamadiarova, A. F., Merkish, N. E., & Kulkova, M. A. (2018). The advantages of using multimedia cultural and linguistic environment in the process of teaching foreign languages. Revista Publicando, 5(16), 332–339.

    Google Scholar 

  • Neuman, S. B., & Koskinen, P. (1992). Captioned television as comprehensible input: Effects of incidental word learning from context for language minority students. Reading Research, 27, 94–106.

    Article  Google Scholar 

  • Ogasawara, S. (1994). Effectiveness of using English captioned videos on listening comprehension proficiency. Bulletin of Faculty of Liberal Arts, Nagasaki University, Humanities, 35(1), 103–114.

    Google Scholar 

  • Paivio, A. (1986). Mental representations. New York: Oxford University Press.

    Google Scholar 

  • Park, M. (2004). The effects of partial captions on Korean EL2 learners’ listening comprehension. Unpublished doctoral dissertation, University of Texas at Austin.

    Google Scholar 

  • Shrosbree, M. (2008). Digital video in the language classroom. The JALT CALL Journal, 4(1), 75–84.

    Article  Google Scholar 

  • Solomon, G., & Schrum, L. (2007). Web 2.0: New tools, new schools. Eugene, OR: International Society for Technology in Education.

    Google Scholar 

  • Swaffar, J., & Vlatten, A. (1997). A sequential model for video viewing in the foreign language curriculum. The Modern Language Journal, 81(2), 175–188.

    Article  Google Scholar 

  • Taylor, G. (2005). Perceived processing strategies of students watching captioned video. Foreign Language Annals, 38(3), 422–427.

    Article  Google Scholar 

  • Terantino, J. (2011). YouTube for foreign languages: You have to see this video. Journal of Language & Technology, 15(1), 10–16.

    Google Scholar 

  • Vanderplank, R. (1988). The value of teletext subtitles in language learning. ELT Journal, 42, 272–281.

    Article  Google Scholar 

  • Vanderplank, R. (1990). Paying attention to the words: Practical and theoretical problems in watching television programmes with uni-lingual (CEEFAX) sub-titles. System, 18, 221–234.

    Article  Google Scholar 

  • Vanderplank, R. (1993). A very verbal medium: Language learning through closed captions. TESOL Journal, 3(1), 10–14.

    Google Scholar 

  • Wagner, E. (2007). Are they watching? Test-taker viewing behavior during an L2 language video listening test. Language Learning & Technology, 11(1), 67–86.

    Google Scholar 

  • Wang, H. (2007). The effects of captions on Chinese EFL students’ incidental vocabulary acquisition. CELEA Journal, 30(4), 9–16.

    Google Scholar 

  • Wang, S., & Vásquez, C. (2012). Web 2.0 and second language learning: What does the research tell us? CALICO Journal, 29(3), 412–430.

    Article  Google Scholar 

  • Weyers, J. (1999). The effect of authentic video on communicative competence. Modern Language Journal, 83(3), 339–353.

    Article  Google Scholar 

  • Wilkinson, R. (1984). Video-based learning activities. TESL Canada Journal, 1(2), 83–86.

    Article  Google Scholar 

  • Wood, D. (1999). Aspects of video movie English teaching. Journal of Chikushi Jogakuin University, 11, 93–104.

    Google Scholar 

  • Yang, J. C., & Chang, P. (2013). Captions and reduced forms instruction: The impact on EFL students’ listening comprehension. ReCALL, 26(1), 44–61.

    Article  Google Scholar 

  • Yoshino, S., Kano, N., & Akahori, K. (2000). The effects of English and Japanese captions on the listening comprehension of Japanese EFL students. Language Laboratory, 37, 111–130.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Peter Yang .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 The Author(s)

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Yang, P. (2020). The Cognitive and Psychological Effects of YouTube Video Captions and Subtitles on Higher-Level German Language Learners. In: Freiermuth, M.R., Zarrinabadi, N. (eds) Technology and the Psychology of Second Language Learners and Users. New Language Learning and Teaching Environments. Palgrave Macmillan, Cham. https://doi.org/10.1007/978-3-030-34212-8_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-34212-8_4

  • Published:

  • Publisher Name: Palgrave Macmillan, Cham

  • Print ISBN: 978-3-030-34211-1

  • Online ISBN: 978-3-030-34212-8

  • eBook Packages: Social SciencesSocial Sciences (R0)

Publish with us

Policies and ethics