Abstract
Picture-in-Picture (PIP) is an effective lecture video design that includes a screen capture video in the center and the instructor’s talking head in one corner. Few research studies have directly investigated the usage of PIP lecture design by non-native English-speaking (NNES) instructors. The current study investigated the effects of PIP lecture design by NNES instructors and measured participants’ cognitive load and learning outcomes. Participants in the study (n = 56) watched four lecture videos about airplane flight, completed cognitive load measure questionnaires, and completed the subsequent recall tasks. The videos included either an NNES instructor or a native English-speaking (NES) instructor. Our findings indicated that PIP lecture videos produced by an NNES instructor caused a higher cognitive load, especially in learners with lower accented-language experience. Lecture videos produced by the NNES instructor also led to lower recall performance, but the PIP design did not cause a significant change in participants’ recall performance. Findings from the current study have implications for online lecture designs, especially for NNES instructors.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Data Availability
The datasets generated during and/or analyzed during the current study are available in the OSF repository (https://osf.io/a62rm/files/osfstorage/6446bd1440b2c143e4e8ff2e).
References
Ahn, J., & Moore, D. (2011). The relationship between students’ accent perception and accented voice instructions and its effect on students’ achievement in an interactive multimedia environment. Journal of Educational Multimedia and Hypermedia, 20(4), 319–335. https://www.learntechlib.org/primary/p/37520/.
Alberts, H. C. (2008). The challenges and opportunities of foreign-born instructors in the classroom. Journal of Geography in Higher Education, 32(2), 189–203. https://doi.org/10.1080/03098260701731306.
Babel, M., & Russell, J. (2015). Expectations and speech intelligibility. The Journal of the Acoustical Society of America, 137(5), 2823–2833. https://doi.org/10.1121/1.4919317.
Baddeley, A. D., & Hitch, G. J. (1974). Working memory. In G. A. Bower (Ed.), Recent advances in learning and motivation (Vol. 8, pp. 47–90). Academic.
Baddeley, A. D., & Logie, R. H. (1999). Working memory: The multiple-component model. In A. Miyake & P. Shah (Eds.), Models of working memory: Mechanisms of active maintenance and executive control (pp. 28–61). Cambridge University Press. https://doi.org/10.1017/CBO9781139174909.005.
Birdsong, D., & Molis, M. (2001). On the evidence for maturational constraints in second-language acquisition. Journal of Memory and Language, 44(2), 235–249. https://doi.org/10.1006/jmla.2000.2750.
Blasiman, R. N., Dunlosky, J., & Rawson, K. A. (2017). The what, how much, and when of study strategies: Comparing intended versus actual study behaviour. Memory (Hove, England), 25(6), 784–792. https://doi.org/10.1080/09658211.2016.1221974. https://doi-org.libproxy.eku.
Chen, H. T. M., & Lorch, R. F. Jr (2018). Effects of audio headings on learning. Journal of Experimental Psychology: Applied, 24(2), 207–221. https://doi.org/10.1037/xap0000143.
Chen, H-T., & Thomas, M. (2020). Effects of Lecture Video styles on Engagement and Learning. Educational Technology Research & Development, 68(5), 2147–2164. https://doi.org/10.1007/s11423-020-09757-6.
Chen, C. M., & Wu, C. H. (2015). Effects of different video lecture types on sustained attention, emotion, cognitive load, and learning performance. Computers & Education, 80, 108–121. https://doi.org/10.1016/j.compedu.2014.08.015.
Civikly, J., & Muchisky, D. (1991). A collaborative approach to ITA training: The ITAs, faculty, TAs, undergraduate interns, and undergraduate students. In J. D. Nyquist (Ed.), Preparing the professoriate of tomorrow to teach: Selected readings in TA training (pp. 356–360). Kendall/Hunt Pub. Co.
Clark, J. M., & Paivio, A. (1991). Dual coding theory and education. Educational Psychology Review, 3(3), 149–210. https://doi.org/10.1007/BF01320076.
Dunlosky, J., Badali, S., Rivers, M. L., & Rawson, K. A. (2020). The role of effort in understanding educational achievement: Objective effort as an explanatory construct versus effort as a student perception. Educational Psychology Review, 32(4), 1163–1175. https://doi.org/10.1007/s10648-020-09577-3.
Faul, F., Erdfelder, E., Buchner, A., & Lang, A. G. (2009). Statistical power analyses using G*Power 3.1: Tests for correlation and regression analyses. Behavior Research Methods, 41(4), 1149–1160. https://doi.org/10.3758/BRM.41.4.1149.
Feldon, D. F., Callan, G., Juth, S., & Jeong, S. (2019). Cognitive load as motivational cost. Educational Psychology Review, 31(2), 319–337. https://doi.org/10.1007/s10648-019-09464-6.
Furuya, Y., Nooraddini, M. I., Wang, W., & Waslin, M. (2019, January). A portrait of foreign-born teachers in the United States. Fairfax, VA: George Mason University Institute for Immigration Research. Retrieved from https://d101vc9winf8ln.cloudfront.net/documents/29869/original/Teacher_Paper_FINAL_WebVersion_012219.pdf?1548268969.
Grey, S., Cosgrove, A. L., & van Hell, J. G. (2020). Faces with foreign accents: An event-related potential study of accented sentence comprehension. Neuropsychologia, 147, 107575. https://doi.org/10.1016/j.neuropsychologia.2020.107575.
Gudykunst, W. B. (1993). Toward a theory of effective interpersonal and intergroup communication: An anxiety/uncertainty management perspective. In R. L. Wiseman, & J. Koester (Eds.), Intercultural communication competence (pp. 33–71). Sage.
Guo, P. J., Kim, J., & Rubin, R. (2014). How video production affects student engagement: An empirical study of MOOC videos. Proceedings of the First ACM Conference on Learning @ Scale Conference, 41–50. https://doi.org/10.1145/2556325.2566239.
Hammer, M. R., Wiseman, R. L., Rasmussen, J. L., & Bruschke, J. C. (1998). A test of anxiety/uncertainty management theory: The intercultural adaptation context. Communication Quarterly, 46(3), 309–326. https://doi.org/10.1080/01463379809370104.
Hart, G. S. (2006). Nasa-Task load index (NASA-TLX); 20 years later. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 50(9), 904–908. https://doi.org/10.1177/154193120605000909.
Hui, L., Bruin, A. B. H., Donkers, J., & Merriënboer, J. J. G. (2022). Why students do (or do not) choose retrieval practice: Their perceptions of mental effort during task performance matter. Applied Cognitive Psychology, 36(2), 433–444. https://doi.org/10.1002/acp.3933.
Ilioudi, C., Giannakos, M. N., & Chorianopoulos, K. (2013). Investigating differences among the commonly used video lecture styles. In Proceedings of the Workshop on Analytics on Video-based Learning, WAVe (Vol. 13).
Johnson, J. S., & Newport, E. L. (1989). Critical period effects in second language learning: The influence of maturational state on the acquisition of English as a second language. Cognitive Psychology, 21(1), 60–99. https://doi.org/10.1016/0010-0285(89)90003-0.
Kim, J., Guo, P. J., Seaton, D. T., Mitros, P., Gajos, K. Z., & Miller, R. C. (2014). Understanding in-video dropouts and interaction peaks in online lecture videos. Proceedings of the First ACM Conference on Learning @ Scale Conference, 31–40. https://doi.org/10.1145/2556325.2566237.
Kokoç, M., IIgaz, H., & Altun, A. (2020). Effects of sustained attention and video lecture types on learning performances. Educational Technology Research and Development, 68(6), 3015–3039. https://doi.org/10.1007/s11423-020-09829-7.
Kutlu, E., Tiv, M., Wulff, S., & Titone, D. (2022a). The impact of race on speech perception and accentedness judgements in racially diverse and non-diverse groups. Applied Linguistics, 43(5), 867–890. https://doi.org/10.1093/applin/amab072.
Kutlu, E., Tiv, M., Wulff, S., & Titone, D. (2022b). Does race impact speech perception? An account of accented speech in two different multilingual locales. Cognitive Research: Principles and Implications, 7(1), 7. https://doi.org/10.1186/s41235-022-00354-0.
Mayer, R. E. (2005). Cognitive theory of Multimedia Learning. In R. E. Mayer (Ed.), The Cambridge handbook of multimedia learning (pp. 31–48). Cambridge University Press. https://doi.org/10.1017/CBO9780511816819.004.
Mayer, R. E. (2009). Multimedia learning (2nd ed.). Cambridge University Press.
Mayer, R. E. (2017). Using multimedia for e-learning. Journal of Computer Assisted Learning, 33(5), 403–423. https://doi.org/10.1111/jcal.12197.
Mayer, R. E., Sobko, K., & Mautone, P. D. (2003). Social cues in multimedia learning: Role of speaker’s voice. Journal of Educational Psychology, 95(2), 419–425. https://doi.org/10.1037/0022-0663.95.2.419.
McGowan, K. B. (2015a). Sounding Chinese and listening Chinese: Awareness and knowledge in the laboratory. In A. M. Babel (Ed.), Awareness and control in sociolinguistic research (pp. 25–51). Cambridge University Press.
McGowan, K. B. (2015b). Social expectation improves speech perception in noise. Language and Speech, 58(4), 502–521. https://doi.org/10.1177/0023830914565191.
Miller, G. A. (1994). The magical number seven, plus or minus two: Some limits on our capacity for processing information. Psychological Review, 101(2), 343. https://doi.org/10.1037/0033-295X.101.2.343.
Montgomery, G., & Zhang, Y. B. (2018). Exploring the effects of accent stereotyping and social attraction. Journal of Language and Social Psychology, 37(3), 330–349. https://doi.org/10.1177/0261927X17728361.
Moreno, R., & Mayer, R. E. (1999). Cognitive principles of multimedia learning: The role of modality and contiguity. Journal of Educational Psychology, 91(2), 358–368. https://doi.org/10.1037/0022-0663.91.2.358.
Morris, T. W., & Chen, H-T-M. (2020). The influence of voice on pedagogical agent’s persona and recall performance. Proceedings of the 2020 International Annual Meeting of the Human Factors and Ergonomics Society, Chicago, IL: The Human Factors and Ergonomics Society. https://doi.org/10.1177/1071181320641111.
Morris, T. W., & Chen, H-T. (2021). Voice’s effect on student effort ratings and recall performance while under cognitive stress. Proceedings of the 2021 International Annual Meeting of the Human Factors and Ergonomics Society, Baltimore, MD: The Human Factors and Ergonomics Society. https://doi.org/10.1177/1071181321651070.
Munro, M. J., & Derwing, T. M. (1995). Processing time, accent, and comprehensibility in the perception of native and foreign-accented speech. Language and Speech, 38(3), 289–306.
Ortega, L. (2009). Understanding second language acquisition. Hodder Education.
Paivio, A., & Clark, J. M. (2006). Dual coding theory and education. Pathways to literacy achievement for high poverty children, 1–20.
Plass, J. L., & Kalyuga, S. (2019). Four ways of considering emotion in cognitive load theory. Educational Psychology Review, 31(2), 339–359. https://doi.org/10.1007/s10648-019-09473-5.
Plass, J. L., & Kaplan, U. (2016). Emotional design in digital media for learning. In Emotions, Technology, Design, and Learning (pp. 131–161). Elsevier. https://doi.org/10.1016/B978-0-12-801856-9.00007-4.
Rubin, D. L. (1992). Nonlanguage factors affecting undergraduates’ judgments of nonnative English-speaking teaching assistants. Research in Higher Education, 33(4), 511–531. https://doi.org/10.1007/BF00973770.
Rubin, D. L. (1998). Help! My teacher (or physician or boss) can’t talk English. In J. Martin, T. Nakayama, & L. Flores (Eds.), Readings in cultural contexts (pp. 149–159). Mayfield Press. [Reprinted in J. Martin, T. Nakayama, & L. Flores (Eds.), Readings in intercultural communication (pp. 127–137). McGraw Hill.].
Rubin, D. L., & Smith, K. A. (1990). Effects of accent, ethnicity, and lecture topic on undergraduates’ perceptions of nonnative English-speaking teaching assistants. International Journal of Intercultural Relations, 14(3), 337–353. https://doi.org/10.1016/0147-1767(90)90019-S.
Sadik, A. (2016). Students’ preferences for types of video lectures: Lecture capture vs. screencasting recordings. Journal of Educational Multimedia and Hypermedia, 25(2), 189–208.
Shuck, G. (2004). Conversational performance and the poetic construction of an ideology. Language in Society, 33(02). https://doi.org/10.1017/S0047404504332021.
Social Sciences Feminist Network Research Interest Group. (2017). The burden of invisible work in academia: Social inequalities and time use in five university departments. Humboldt Journal of Social Relations, 39, 228–245. http://www.jstor.org/stable/90007882.
Stephan, W., & Stephan, C. (1985). Intergroup anxiety. Journal of Social Issues, 41(3), 157–166. https://doi.org/10.1111/j.1540-4560.1985.tb01134.x.
Stephan, W. G., Stephan, C. W., & Gudykunst, W. B. (1999). Anxiety in intergroup relations: A comparison of anxiety/uncertainty management theory and integrated threat theory. International Journal of Intercultural Relations, 23(4), 613–628. https://doi.org/10.1016/S0147-1767(99)00012-7.
Subtirelu, N. C. (2015). She does have an accent but… race and language ideology in students’ evaluations of mathematics instructors on RateMyProfessors.com. Language in Society, 44(1), 35–62. https://doi.org/10.1017/S0047404514000736.
Sweller, J., Ayres, P., & Kalyuga, S. (2011). Measuring cognitive load. In J. Sweller, P. Ayres, & S. Kalyuga (Eds.), Cognitive load theory (pp. 71–85). Springer. https://doi.org/10.1007/978-1-4419-8126-4_6.
Sweller, J., van Merriënboer, J. J. G., & Paas, F. (2019). Cognitive architecture and instructional design: 20 years later. Educational Psychology Review, 31(2), 261–292. https://doi.org/10.1007/s10648-019-09465-5.
Turner, R. N., Hewstone, M., & Voci, A. (2007). Reducing explicit and implicit out-group prejudice via direct and extended contact: The mediating role of self-disclosure and intergroup anxiety. Journal of Personality and Social Psychology, 93(3), 369–388. https://doi.org/10.1037/0022-3514.93.3.369.
Turner, R. N., Hewstone, M., Voci, A., & Vonofakou, C. (2008). A test of the extended intergroup contact hypothesis: The mediating role of intergroup anxiety, perceived ingroup and out-group norms, and inclusion of the out-group in the self. Journal of Personality and Social Psychology, 95(4), 843–860. https://doi.org/10.1037/a0011434.
Turner, R. N., West, K., & Christie, Z. (2013). Out-group trust, intergroup anxiety, and out-group attitude as mediators of the effect of imagined intergroup contact on intergroup behavioral tendencies. Journal of Applied Social Psychology, 43(Suppl 2), E196–E205. https://doi.org/10.1111/jasp.12019.
Villarreal, D. (2012). Closing the communication gap between undergraduates and international faculty. CATESOL Journal, 24(1), 8–28. Retrieved from http://www.catesoljournal.org/wp-content/uploads/2014/06/cj24_villarreal.pdf.
Wang, J., & Antonenko, P. D. (2017). Instructor presence in instructional video: Effects on visual attention, recall, and perceived learning. Computers in Human Behavior, 71, 79–89. https://doi.org/10.1016/j.chb.2017.01.049.
Wittrock, M. C. (1989). Generative processes of comprehension. Educational Psychologist, 24(4), 345–376. https://doi.org/10.1207/s15326985ep2404_2.
Yi, H. G., Phelps, J. E. B., Smiljanic, R., & Chandrasekaran, B. (2013). Reduced efficiency of audiovisual integration for nonnative speech. The Journal of the Acoustical Society of America, 134(5), EL387–EL393. https://doi.org/10.1121/1.4822320.
Yi, H. G., Smiljanic, R., & Chandrasekaran, B. (2014). The neural processing of foreign-accented speech and its relationship to listener bias. Frontiers in Human Neuroscience, 8. https://doi.org/10.3389/fnhum.2014.00768.
Acknowledgements
Not applicable.
Funding
No funding was received for conducting this study.
Author information
Authors and Affiliations
Contributions
All authors listed on the title page have made a substantial contribution to this manuscript submission. The first author generated the idea and the design of the study. The first author also analyzed the data and wrote the first draft of the manuscript. The second and third authors assisted in the implementation of the study and reviewed and edited subsequent drafts of the manuscript.
Corresponding author
Ethics declarations
Competing interest
The authors have no relevant financial or non-financial interests to disclose.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Chen, HT.M., McClure, K.L. & Morris, T.W. Online Lecture Videos by Non-Native English-Speaking Instructors. Tech Know Learn (2024). https://doi.org/10.1007/s10758-024-09738-1
Accepted:
Published:
DOI: https://doi.org/10.1007/s10758-024-09738-1