Skip to main content
SpringerLink
Log in

Emotion and multimedia learning: an investigation of the effects of valence and arousal on different modalities in an instructional animation

  • Published:
Instructional Science Aims and scope Submit manuscript

Abstract

Previous emotion studies in education have focused mainly on the superiority of positive emotion for learning performance (e.g., enjoyment) over negative emotion (e.g., fear). However, few studies have considered different arousal levels in terms of learners’ emotion. For example, the effects of calm positive or negative emotion have not been discussed, when compared to arousing positive or negative emotion. Based on the limited Capacity model of motivated mediated message processing (LC4MP), this study investigated how learners’ emotional valence and arousal, induced by video clips, influenced their learning performance and mental effort in an animated instruction with different modalities (written-text versus spoken-text). A total of 206 participants were randomly assigned to eight groups: (a) calm positive, (b) calm negative (c) arousing positive, and (d) arousing negative emotions under different modality conditions (written and spoken). The results showed that both arousing groups outperformed calm groups on a recall test only in the written-text group regardless of valence, while emotional valence and arousal did not significantly influence learning performance in the spoken-text group. The results provide partial support for the LC4MP model and imply that the arousing emotional state has the potential to enhance multimedia learning.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  • Baddeley, A. (1992). Working memory. Science, 255(5044), 556–559.

    Article  Google Scholar 

  • Bartsch, A., & Oliver, M. B. (2011). Making sense of entertainment: On the interplay of emotion and cognition in entertainment experience. Journal of Media Psychology: Theories, Methods, and Applications, 23(1), 12–17.

    Article  Google Scholar 

  • Bolls, P. D., Lang, A., & Potter, R. F. (2001). The effects of message valence and listener arousal on attention, memory, and facial muscular responses to radio advertisements. Communication Research, 28(5), 627–651.

    Article  Google Scholar 

  • Bradley, M. M., & Lang, P. J. (1994). Measuring emotion: The self-assessment manikin and the semantic differential. Journal of Behavioral Therapy and Experimental Psychiatry, 25(1), 49–59.

    Article  Google Scholar 

  • Cacioppo, J. T., & Gardner, W. L. (1999). Emotion. Annual Review of Psychology, 50, 191–214.

    Article  Google Scholar 

  • Chen, C., & Sun, Y. (2012). Assessing the effects of different multimedia materials on emotions and learning performance for visual and verbal style learners. Computers and Education, 59(4), 1273–1285.

    Article  Google Scholar 

  • Cheon, J., Crooks, S. M., & Chung, S. (2014). Does segmenting principle counteract modality principle in instructional animation? British Journal of Educational Technology, 45(1), 56–64.

    Article  Google Scholar 

  • Cook, N. D. (2002). Tone of voice and mind: The connections between intonation, emotion, cognition and consciousness. Amsterdam: John Benjamins.

    Book  Google Scholar 

  • Fassbender, E., Richards, D., Bilgin, A., Thompson, W. F., & Heiden, W. (2012). VirSchool: The effect of background music and immersive display systems on memory for facts learned in an educational virtual environment. Computers and Education, 58(1), 490–500.

    Article  Google Scholar 

  • Feldman, B. L., & Russell, J. A. (1998). Independence and bipolarity in the structure of current affect. Journal of Personality and Social Psychology, 74(4), 967–984.

    Article  Google Scholar 

  • Gibbons, J. A., Lukowski, A. F., & Walker, W. R. (2005). Exposure increases the believability of unbelievable news headlines via elaborate cognitive processing. Media Psychology, 7(3), 273–300.

    Article  Google Scholar 

  • Goetz, T., Frenzel, A. C., Pekrun, R. H., Hall, N. C., & Ludtke, O. (2007). Between- and within-domain relations of students’ academic emotions. Journal of Educational Psychology, 99(4), 715–733.

    Article  Google Scholar 

  • Gomez, P., Zimmermann, P. G., Guttormsen Schär, S., & Danuser, B. (2009). Valence lasts longer than arousal: Persistence of induced moods as assessed by psychophysiological measures. Journal of Psychology, 23(1), 7–17.

    Google Scholar 

  • Hampson, P. J., & Morris, P. E. (1996). Understanding cognition. Cambridge: Blackwell.

    Google Scholar 

  • Isen, A. M., Daubman, K. A., & Nowicki, G. P. (1987). Positive affect facilitates creative problem solving. Journal of Personality and Social Psychology, 52(6), 1122–1131.

    Article  Google Scholar 

  • Isen, A. M., & Reeve, J. (2005). The influence of positive affect on intrinsic and extrinsic motivation: Facilitating enjoyment of play, responsible work behavior, and self-control. Motivation and Emotion, 29(4), 297–325.

    Article  Google Scholar 

  • Ivory, J. D., & Kalyanaraman, S. (2007). The effects of technological advancement and violent content in video games on players’ feelings of presence, involvement, physiological arousal, and aggression. Journal of Communication, 57(3), 532–555.

    Article  Google Scholar 

  • Joëls, M., Pu, Z., Wiegert, O., Oitzl, M. S., & Krugers, J. H. (2006). Learning under stress: How does it work? Trends in Cognitive Sciences, 10(4), 152–158.

    Article  Google Scholar 

  • Kay, R. H. (2008). Exploring the relationship between emotions and the acquisition of computer knowledge. Computers and Education, 50(4), 1269–1283.

    Article  Google Scholar 

  • Lang, A. (2000). The limited capacity model of mediated message processing. Journal of Communication, 50(1), 46–70.

    Article  Google Scholar 

  • Lang, A. (2006). Using the limited capacity model of motivated mediated message processing (LC4MP) to design effective cancer communication messages. Journal of Communication, 56(S1), S57–S80.

    Article  Google Scholar 

  • Lang, P. J., Bradley, M. M., & Cuthbert, B. N. (1997). Motivated attention: Affect, activation, and action. In P. J. Lang, R. F. Simons, & M. T. Balaban (Eds.), Attention and orienting: Sensory and motivational processes (pp. 97–135). Hillsdale: Lawrence Erlbaum Associates.

    Google Scholar 

  • Lang, A., Potter, R. F., & Bolls, P. D. (1999). Something for nothing: Is visual encoding automatic? Media Psychology, 1(2), 145–163.

    Article  Google Scholar 

  • Laukka, P., Juslin, P., & Bresin, R. (2005). A dimensional approach to vocal expression of emotion. Cognition and Emotion, 19(5), 633–653.

    Article  Google Scholar 

  • Lee, S., & Lang, A. (2009). Discrete emotion and motivation: Relative activation in the appetitive and aversive motivational systems as a function of anger, sadness, fear, and joy during televised information campaigns. Media Psychology, 12(2), 148–170.

    Article  Google Scholar 

  • Linnenbrink, E. A. (2007). The role of affect in student learning: A multi-dimensional approach to considering the interaction of affect, motivation, and engagement. In P. A. Schutz & R. Pekrun (Eds.), Emotion in education (pp. 107–124). San Diego: Academic Press.

    Chapter  Google Scholar 

  • Lusk, D. L., Evans, A. D., Jeffrey, T. R., Palmer, K. R., Wikstrom, C. S., & Doolittle, P. E. (2009). Multimedia learning and individual differences Mediating the effects of working memory capacity with segmentation. British Journal of Educational Technology, 40(4), 636–651.

    Article  Google Scholar 

  • Mayer, R. E. (2009). Multimedia learning (2nd ed.). New York: Cambridge University Press.

    Book  Google Scholar 

  • Mayer, R. E., & Moreno, R. (1998). A split-attention effect in multimedia learning: Evidence for dual-processing systems in working memory. Journal of Educational Psychology, 90(2), 312–320.

    Article  Google Scholar 

  • Mayer, R. E., & Moreno, R. (2002). Aids to computer-based multimedia learning. Learning and Instruction, 12(1), 107–119.

    Article  Google Scholar 

  • Mayer, R. E., & Moreno, R. (2003). Nine ways to reduce cognitive load in multimedia learning. Educational Psychologist, 38(1), 43–52.

    Article  Google Scholar 

  • Mousavi, S. Y., Low, R., & Sweller, J. (1995). Reducing cognitive load by mixing auditory and visual presentation modes. Journal of Educational Psychology, 87(2), 319–334.

    Article  Google Scholar 

  • Paas, F. G. W. C. (1992). Training strategies for attaining transfer of problem-solving skill in statistics: A cognitive-load approach. Journal of Educational Psychology, 84(4), 429–434.

    Article  Google Scholar 

  • Paas, F., Tuovinen, J. E., Tabbers, H., & Van Gerven, P. W. M. (2003). Cognitive load measurement as a means to advance cognitive load theory. Educational Psychologist, 38(1), 63–71.

    Article  Google Scholar 

  • Park, S., & Lim, J. (2007). Promoting positive emotion in multimedia learning using visual illustrations. Journal of Educational Multimedia and Hypermedia, 16(2), 141–162.

    Google Scholar 

  • Pekrun, R. (2006). The control-value theory of achievement emotions: Assumptions, corollaries, and implications for educational research and practice. Educational Psychology Review, 18(4), 315–341.

    Article  Google Scholar 

  • Pekrun, R., Elliot, A. J., & Maier, M. A. (2009). Achievement goals and achievement emotions: Testing of a model of their joint relations to academic performance. Journal of Educational Psychology, 101(1), 115–135.

    Article  Google Scholar 

  • Pekrun, R., Frenzel, A. C., Goetz, T., & Perry, R. P. (2007). The control-value theory of achievement emotions: An integrative approach to emotions in education. In P. A. Schutz & R. Pekrun (Eds.), Emotion in education (pp. 13–36). San Diego: Elsevier.

    Chapter  Google Scholar 

  • Pekrun, R., Goetz, T., Frenzel, A. C., Barchfeld, P., & Perry, R. P. (2011). Measuring emotions in students’ learning and performance: The achievement emotions questionnaire (AEQ). Contemporary Educational Psychology, 36(1), 36–48.

    Article  Google Scholar 

  • Pekrun, R., Goetz, T., Tiltz, W., & Perry, R. P. (2002). Academic emotions in students’ self-regulated learning and achievement: A program of qualitative and quantitative research. Educational Psychologist, 37(2), 91–106.

    Article  Google Scholar 

  • Pekrun, R., & Stephens, E. J. (2010). Achievement emotions: A control-value approach. Social and Personality Psychology Compass, 4(4), 238–255.

    Article  Google Scholar 

  • Piwek, L., Petrini, K., & Pollick, F. (2012). Auditory signal dominates visual in the perception of emotional social interactions. Seeing and Perceiving, 25(s1), 112.

    Article  Google Scholar 

  • Potter, R. F. (2009). Double the units: How increasing the number of advertisements while keeping the overall duration of commercial breaks constant affects radio listeners. Journal of Broadcasting and Electronic Media, 53(4), 584–598.

    Article  Google Scholar 

  • Rickwood, L. V., & Price, G. (1988). Hedonic arousal, time intervals, and excitation transfer. Current Psychology: Research and Reviews, 7(3), 241–256.

    Article  Google Scholar 

  • Robinson, K. (2013). The interrelationship of emotion and cognition when students undertake collaborative group work online: An interdisciplinary approach. Computers and Education, 62(1), 298–307.

    Article  Google Scholar 

  • Russell, J. A. (2003). Core affect and the psychological construction of emotion. Psychological Review, 110(1), 145–172.

    Article  Google Scholar 

  • Sanchez-Franco, M. J. (2010). WebCT—The quasimoderating effect of perceived affective quality on an extending technology acceptance model. Computers and Education, 54(1), 37–46.

    Article  Google Scholar 

  • Schneider, E. F., Lang, A., Shin, M., & Bradley, S. D. (2004). Death with a store: How story impacts emotional, motivational, and physiological responses to first-person shooter video games. Human Communication Research, 30(3), 361–375.

    Google Scholar 

  • Shen, L., Wang, M., & Shen, R. (2009). Affective e-learning: Using “emotional” data to improve learning in pervasive learning environment. Educational Technology and Society, 12(2), 176–189.

    Google Scholar 

  • Trautwein, U., Niggli, A., Schnyder, I., & Ludtke, O. (2009). Between-teacher differences in homework assignments and the development of students’ homework effort, homework emotions, and achievement. Journal of Educational Psychology, 101(1), 176–189.

    Article  Google Scholar 

  • Um, E. R., Plass, J. L., Hayward, E. O., & Homer, B. D. (2012). Emotional design in multimedia learning. Journal of Educational Psychology, 104(2), 485–498.

    Article  Google Scholar 

  • Wolfson, S., & Case, G. (2000). The effects of sound and color on responses to a computer game. Interacting with Computers, 13(2), 183–192.

    Article  Google Scholar 

  • Yegiyan, N. S., & Lang, A. (2010). Processing central and peripheral detail: How content arousal and emotional tone influence encoding. Media Psychology, 13(1), 77–99.

    Article  Google Scholar 

Download references

Acknowledgments

This publication was supported by Daegu University Research Grants in 2013.

Author information

Authors and Affiliations

  1. Instructional Technology Program, Department of Educational Psychology and Leadership, College of Education, Texas Tech University, Lubbock, TX, 79409, USA

    Sungwon Chung & Jongpil Cheon

  2. Department of Tourism Management, College of Economics and Business Administration, Daegu University, 201, Daegudae-ro, Gyeongsan-Si, Gyeongsangbuk-do, 712-714, Republic of Korea

    Kwang-Woo Lee

Authors
  1. Sungwon Chung
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jongpil Cheon
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Kwang-Woo Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Kwang-Woo Lee.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chung, S., Cheon, J. & Lee, KW. Emotion and multimedia learning: an investigation of the effects of valence and arousal on different modalities in an instructional animation. Instr Sci 43, 545–559 (2015). https://doi.org/10.1007/s11251-015-9352-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11251-015-9352-y

Keywords

Search

Navigation