Studying the expertise reversal of the multimedia signaling effect at a process level: evidence from eye tracking
- 100 Downloads
The purpose of this study was to shed light on the cognitive processes underlying the expertise reversal effect related to multimedia signaling. Multimedia signals highlight correspondences between text and pictures, which is supposed to support text-picture integration and thus learning from multimedia. Previous research suggests that learners’ prior knowledge moderates the multimedia signaling effect in that they only aid learners with low prior knowledge (LPK). We conducted an eye tracking study with students in secondary education who learned with a digital textbook in one of the two versions: (a) a basic version with mostly text signals only (e.g., bold face), or (b) an extended version with additional multimedia signals that aimed at supporting text-picture integration (e.g., color coding of corresponding text and picture elements). In addition to learning outcomes, we assessed students’ cognitive load and gaze behavior as process measures. Results revealed that only LPK learners were supported in learning whereas HPK learners were not affected by multimedia signals (partial expertise reversal). A moderated mediation analysis revealed that multimedia signals affected gaze behavior of LPK students in that they looked earlier at pictures. For high prior knowledge students multimedia signals lead to a higher subjective germane cognitive load. Thus, multimedia signals affected processing of materials. However, the process measures did not explain the expertise reversal of the signaling effect regarding learning outcome.
KeywordsExpertise reversal effect Multimedia learning Signaling Prior knowledge Eye tracking
This work was supported by the German Research Foundation (DFG) under contract SCH683/6.
Compliance with ethical standards
Conflict of interest
The authors declare that they have no conflict of interest.
- Baumert, J., Lehmann, R., Lehrke, M., Clausen, M., Hosenfeld, I., Neubrand, J., … Günther, W. (1998). Testaufgaben Naturwissenschaften TIMSS 7./8. Klasse (Population 2). Max-Planck-Institut für Bildungsforschung.Google Scholar
- Grüß-Niehaus, T. (2010). Comprehension of the dissolution concept in chemistry education. Hannover: Gottfried Wilhelm Leibniz Universität. (in German).Google Scholar
- Hollstein, A. (2001). Computer-supported learning on the basis of constructivist learning theories through the example of the introduction of the particle model. Essen: University of Duisburg-Essen. (in German).Google Scholar
- Judd, C. M., Yzerbyt, V. Y., & Muller, D. (2014). Mediation and moderation. In H. T. Reis & C. M. Judd (Eds.), Handbook of research methods in personality and social psychology (2nd ed., pp. 653–676). New York: Cambridge University Press. https://doi.org/10.1017/cbo9780511996481.030.CrossRefGoogle Scholar
- Kalyuga, S., & Plass, J. L. (2018). Cognitive load as a local characteristic of cognitive processes: Implications for measurement approaches. In R. Z. Zheng (Ed.), Cognitive load measurement and application: A theoretical framework for meaningful research and practice (pp. 59–74). New York: Routledge.Google Scholar
- Meyer, B. J. F. (1975). The organization of prose and its effects on memory. Amsterdam: North-Holland Publishing.Google Scholar
- Petermann, K., Friedrich, J., & Oetken, M. (2009). Test zur Diagnose von Schülervorstellungen zum Teilchenkonzept. Praxis der Naturwissenschaften—Chemie in der Schule, 58, 41–43.Google Scholar
- Rop, G., Schüler, A., Verkoeijen, P. P. J. L., Scheiter, K., & van Gog, T. (2018). Effects of task experience and layout on learning from text and pictures with or without unnecessary picture descriptions. Journal of Computer Assisted Learning,34, 458–470. https://doi.org/10.1111/jcal.12287.CrossRefGoogle Scholar
- Schanze, S. (2002). Knowledge acquisition by means of the online learning environment ChemNet. Kiel: Christian-Albrechts-Universität zu Kiel, Germany. (in German).Google Scholar
- Scheiter, K., & Eitel, A. (2015). Signals foster multimedia learning by supporting integration of highlighted text and diagram elements. Learning and Instruction,36, 11–26. https://doi.org/10.1016/j.learninstruc.2014.11.002.CrossRefGoogle Scholar
- Scheiter, K., & Eitel, A. (2016). The use of eye tracking as a research and instructional tool in multimedia learning. In C. Was, F. Sansosti, & B. Morris (Eds.), Eye-tracking technology applications in educational research (pp. 143–164). Hershey, PA: IGI Global.Google Scholar
- Schmeck, A., Opfermann, M., van Gog, T., Paas, F., & Leutner, D. (2015). Measuring cognitive load with subjective rating scales during problem solving: Differences between immediate and delayed ratings. Instructional Science,43, 93–114. https://doi.org/10.1007/s11251-014-9328-3.CrossRefGoogle Scholar
- Schmidt-Weigand, F., Kohnert, A., & Glowalla, U. (2010). A closer look at split visual attention in system-and self-paced instruction in multimedia learning. Learning and Instruction,20, 100–110. https://doi.org/10.1016/j.learninstruc.2009.02.011.CrossRefGoogle Scholar
- Schneider, W., Schlagmüller, M., & Ennemoser, M. (2007). Reading speed and comprehension test for grades 6–12. Göttingen: Hogrefe. (in German).Google Scholar
- Sweller, J., Ayres, P., & Kalyuga, S. (2011). Expertise reversal effect. In Cognitive Load (Ed.), Theory: Explorations in the learning sciences, instructional systems and performance technologies (pp. 155–170). New York: Springer.Google Scholar
- Van Gog, T. (2014). The signaling (or cueing) principle in multimedia learning. In R. E. Mayer (Ed.), The Cambridge handbook of multimedia learning (2nd ed., pp. 263–278). New York: Cambridge University Press.Google Scholar
- Wilde, M., Bätz, K., Kovaleva, A., & Urhahne, D. (2009). Testing a short scale of intrinsic motivation. Zeitschrift für Didaktik der Naturwissenschaften,15, 31–45. (in German).Google Scholar
- ZPG-Chemie (2011, Febuary). Das Teilchenmodell in Klasse 8 [The Particle Model of Matter in grade 8]. Retrieved February 28, 2016, from Landesakademie für Fortbildung und Personalentwicklung an Schulen website, http://lehrerfortbildung-bw.de/faecher/chemie/gym/fb2/modul2/.