Emotional Responses During Music Listening

Chapter
First Online:

Abstract

The aim of this chapter is to summarize and present the current knowledge about music and emotion from a multi-disciplinary perspective. Existing emotional models and their adequacy in describing emotional responses to music are described and discussed in different applications. The underlying emotion induction mechanisms beside cognitive appraisal are presented, and their implications on the field are analyzed. Musical characteristics such as tempo, mode, loudness, and so on are inherent properties of the musical structure and have been shown to influence the emotional states during music listening. The role of each individual parameter on emotional responses as well as their interactions is reviewed and analyzed. Different ways of measuring emotional responses to music are described, and their adequacy in accounting for emotional responses to music is discussed. The main physiological responses to music listening are briefly discussed, and their application to emotion recognition and to emotion intelligence in human–machine interaction is described. Music processing in the brain involves different brain areas and several studies attempted to investigate brain activity in relation to emotion during music listening through EEG signals. The issues and challenges of assessing human emotion through EEG are presented and discussed. Finally, an overview of problems that remain to be addressed in future research is given.

Keywords

Emotional Response Emotion Recognition Emotion Intelligence Basic Emotion Discrete Emotion 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
This is a preview of subscription content, log in to check access.

References

  1. Aftanas LI, Golocheikine SA (2001) Human anterior and frontal midline theta and lower alpha activity reflect emotional positive state and internalized attention: high-resolution EEG investigation of meditation. Neuroscience 310(1):57–60Google Scholar
  2. Altenmueller E, Schuermann K, Lim VK, Parlitz D (2002) Hits to the left, flops to the right: different emotion during music listening reflected in cortical lateralization patterns. Neuropsychologia 40(13):2242–2256Google Scholar
  3. Balconi M, Lucchiari S (2008) Consciousness and arousal effects on emotional face processing as revealed by brain oscillations. A gamma band analysis. Int J Psychophysiol 67(1):41–46Google Scholar
  4. Balkwill LL, Thompson WF (1999) A cross-cultural investigation of the perception of the emotion in music: psychophysical and cultural cues. Music Percept 17(1):43–64Google Scholar
  5. Baumgartner T, Esslen M, Jaencke L (2006) From emotion perception to emotion experience: emotions evoked by pictures and classical music. Int J Psychophysiol 60(1):34–43Google Scholar
  6. Berlyne DE (1971) Aesthetics and psychobiology. Appleton Century Crofts, New YorkGoogle Scholar
  7. Bernardi L, Porta C, Sleight P (2006) Cardiovascular, cerebrovascular and respiratory changes induced by different types of music in musicians and non-musicians: the importance of silence. Heart 92(4):445–452Google Scholar
  8. Bigand E, Vieillard S, Madurell F, Marozeau J, Dacquet A (2005) Multidimensional scaling of emotional responses to music: the effect of musical expertise and of the duration of the excerpts. Cogn Emot 19(8):1113–1139Google Scholar
  9. Blackwill LL, Thompson WF, Matsounaga R (2004) Recognition of emotion in Japanese Western and Hindustani music by Japanese listeners. Jpn Psychol Res 46(4):337–349Google Scholar
  10. Blood AJ, Zatorre RJ, Bermudez P, Evans AC (1999) Emotional responses to pleasant and unpleasant music correlate with activity in paralimbic brain regions. Nat Neurosci 2(4):382–387Google Scholar
  11. Blood AJ, Zatorre RJ (2001) Intensely pleasurable responses to music correlate with activity in brain regions implicated in reward and emotion. Proc Natl Acad Sci 98(20):11818–11832Google Scholar
  12. Boiten FA, Frijda NH, Wientjes CJE (1994) Emotions and respiratory pattern: review and critical analysis. Int J Psychophysiol 17(2):103–128Google Scholar
  13. Boucsein W (1992) Electrodermal activity. Plenum Press, New YorkGoogle Scholar
  14. Cacioppo JT, Berntson GG, Larsen JT, Poehlmann KM, Ito TA (2000) The psychophysiology of emotion. In: Lewis M, Havilnd-Jones JM (eds) Handbook of emotions. Guilford Press, New YorkGoogle Scholar
  15. Cagnon L, Peretz I (2003) Mode and tempo relative contribution to “happy-sad” judgments in equitone melodies. Cogn Emot 17(1):25–40Google Scholar
  16. Clayton M, Sager R, Will U (2005) In time with the music: the concept of entrainment and its significance for ethnomusicology. Eur Meetings Ethnomusicology 11:3–142Google Scholar
  17. Collier GL (2007) Beyond valence and activity in the emotional connotations of music. Psychol Music 35(1):110–131Google Scholar
  18. Dalla Bella S, Peretz I, Rouseau L, Grosselin N (2001) A development study of the effective value of tempo and mode in music. Cognition 80(3):B1–B10Google Scholar
  19. Davidson RJ (1988) EEG measures of cerebral asymmetry: conceptual and methodological issues. Int J Neurosci 39(1–2):71–78Google Scholar
  20. Davidson RJ, Fox NA (1989) Frontal brain asymmetry predicts infant’s response to maternal separation. J Abnorm Psychol 98(2):127–131Google Scholar
  21. Davidson RJ, Eckman P, Saron CD, Senulis J, Friegenn WW (1990) Approach-withdrawal and cerebral asymmetry: emotional expression and brain physiology. J Pers Soc Psychol 158(2):330–341Google Scholar
  22. Davies S (2001) Philosophical perspectives on music’s expressiveness. In: Juslin PA, Sloboda JA (eds) Music and emotion: theory and research. Oxford University Press, Oxford, pp 23–44Google Scholar
  23. Davis-Rollans C, Cunningham S (1987) Physiologic responses of coronary care patients to selected music. Heart Lung 16(4):370–378Google Scholar
  24. Davis C (1992) The effects of music and basic relaxation instruction on pain and anxiety of women undergoing in-office gynecological procedures. J Music Ther 29(4):202–216Google Scholar
  25. Eerola T, Vuoskoski J (2011) A comparison of the discrete and dimensional models of emotion in music. Psychol Music 39(1):18–49Google Scholar
  26. Ekman P (1992a) An argument for basic emotions. Cogn Emot 6(3–4):169–200Google Scholar
  27. Ekman P (1999) Basic emotions. In: Dalgleish T, Power MJ (eds) Handbook of cognition and emotion. Willey, New York, pp 301–320Google Scholar
  28. Ekman P (1992b) Are they basic emotions. Physiol Rev 99(3):550–553Google Scholar
  29. Flores-Gutierez EO, Diaz JL, Barrios FA, Favila-Humara R, Guevara MA, del Rio-Portilla Y, Corsi-cabrera M (2007) Metabolic and electric brain patterns during pleasant and unpleasant emotions induced by music masterpieces. Int J Psychophysiol 65(1):69–84Google Scholar
  30. Gabrielsson A, Juslin PN (1996) Emotional expression in music performance: between the performance intention and the listener’s experience. Psychol Music 24(1):68–91Google Scholar
  31. Gabrielsson A, Lindstroem E (2010) The role of structure in the musical expression of emotions. In: Juslin PN, Sloboda JA (eds) Handbook of music and emotion: theory, research, applications. Oxford University Press, New York, pp 367–400Google Scholar
  32. Gomez P, Danuser B (2007) Relationships between musical structure and psychophysiological measures of emotion. Emotion 7(2):377–387Google Scholar
  33. Green AC, Baerentsen KB, Stoedkilde-Joergensen H, Wallentin M, Roepstorff A, Vuust P (2008) Music in minor activates limbic structures: a relationship with dissonance? Neuroreport 19(7):711–714Google Scholar
  34. Heilman KM (1997) The neurobiology of emotional experience. J Neuropsychiatry Clin Neurosci 9:439–448Google Scholar
  35. Hevner K (1937) The affective value of pitch and tempo in music. Am J Psychol 49(4):621–630Google Scholar
  36. Hevner K (1935) The affective character of the major and minor modes in music. Am J Psychol 47(1):103–118Google Scholar
  37. Hodges DA (2010) Psychophysiological responses to music. In: Juslin PN, Sloboda JA (eds) Handbook of music and emotion: theory, research, applications. Oxford University Press, New York, pp 279–311Google Scholar
  38. Hunter PG, Schellenberg EG, Schimmack U (2008) Mixed affective responses to music with conflicting cues. Cogn Emot 22(2):327–352Google Scholar
  39. Husain G, Thompson WF, Schellenberg EG (2000) Effects of musical tempo and mode on mood, arousal and spatial abilities. Music Percept 20(2):151–171Google Scholar
  40. Ilie G, Thompson WF (2006) A comparison of acoustic cues in music and speech for three dimensions of affect. Music Percept 23(4):319–330MathSciNetGoogle Scholar
  41. Ishino K, Hagiwara M (2003) A feeling estimation system using a simple electroencephalograph. Proc IEEE Int Conf Syst Man Cybern 5:4204–4209Google Scholar
  42. Iwanaga M, Ikeda M, Iwaki T (1996) The effects of repetitive exposure to music on subjective and physiological responses. J Music Ther 33(3):219–230Google Scholar
  43. Izard CE, Libero D, Putnam P, Haynes O (2003) Stability of emotion experiences and their relations to personality traits. J Pers Soc Psychol 64(5):847–860Google Scholar
  44. Juslin PN, Liljestroem S, Västfjäll D, Lundqvist LO (2010) How does music evoke emotions? Exploring the underlying mechanisms. In: Juslin PN, Sloboda JA (eds) Handbook of music and emotion: theory, research, applications. Oxford University Press, Oxford, pp 605–642Google Scholar
  45. Juslin PN (1997) Perceived emotional expression in synthesized performances of a short melody: capturing the listener’s judgment policy. Musicae Scientiae 1(2):225–256Google Scholar
  46. Juslin PN, Sloboda JA (eds) (2010) Handbook of music and emotion: theory, research, applications. Oxford University Press, OxfordGoogle Scholar
  47. Juslin PN, Liljestroem S, Västfäll D, Baradas G, Silva A (2008) An experience sampling study of emotional reactions to music: listener, music and situation. Emotion 8(5):668–683Google Scholar
  48. Juslin PN, Västfjäll D (2008) Emotional responses to music: the need to consider underlying mechanisms. Behav Brain Sci 31(5):559–575Google Scholar
  49. Kellaris JJ, Rice RC (1993) The influence of tempo, loudness and gender of listener on responses to music. Psychol Mark 10(1):15–19Google Scholar
  50. Khalfa F, Schon D, Anton J, Liegois-Chauvel C (2005) Brain regions involved in the recognition of happiness and sadness in music. Neuroreport 16(18):1981–1984Google Scholar
  51. Khalfa S, Roy M, Rainwille P, Dalla Bella S, Peretz I (2008) Role of tempo entrainment in psychophysiological differentiation of happy and sad music. Int J Psychophysiol 68(1):17–26Google Scholar
  52. Kim J, Andre E (2008) Emotion recognition based on physiological changes in music listening. IEEE Trans Pattern Anal Mach Intell 30(12):2067–2083Google Scholar
  53. Kivy P (1990) Music alone: Reflexions on a purely musical experience. Cornel University Press, IthacaGoogle Scholar
  54. Ko KE, Yang HC, Sim KB (2009) Emotion recognition using EEG signals with relative power values and Bayesian network. Int J Control Autom Syst 7(5):865–870Google Scholar
  55. Koelsch S, Fritz T, Cramon DY, Mueller K, Friederici A (2006) Investigating emotion with music: an fMRI study. Hum Brain Mapp 27(3):239–250Google Scholar
  56. Koelsch S (2005) Investigating emotion with music: Neuroscientific approaches. Ann N Y Acad Sci 1060:412–418Google Scholar
  57. Koelstra S, Muehl C, Soleymani M, Lee JS, Yazdani A, Ebrahimi T, Pun T, Nijholt A, Patras I (2011) DEAP: a database for emotion analysis using physiological signals. IEEE Trans Affect Comput 3(1):18–31Google Scholar
  58. Konenci VJ (2008) Does music induce emotion? A theoretical and methodological analysis. Psychol Aesthetics Creativity Arts 2(2):115–129Google Scholar
  59. Krumnhansl C (1997) An exploratory study of musical emotions and psychophysiology. Can J Exp Physiol 51(4):336–352Google Scholar
  60. Larsen JT, Norris CJ, Cacioppo JT (2003) Effects of positive and negative affect on electromyographic activity over zygomaticus major and corrugator supercilii. Psychophysiology 40(5):776–785Google Scholar
  61. Li M, Lu BL (2009) Emotion classification on gamma-band EEG. In: Proceedings of the annual international conference of the IEEE engineering in medicine and biology society EMBS 2009, pp 1223–1226Google Scholar
  62. Lim Y-P, Wang C-H, Jung T-P, Wu T-L, Jeng S-K, Duann J-R, Chen J-H (2010) EEG-Based Emotion Recognition in Music Listening. IEEE Trans Biomedical Eng 57(7):1798–1806Google Scholar
  63. Lundquist L, Carlsson F, Hilmersson P, Juslin PN (2009) Emotional responses to music: experience, expression and physiology. Psychol Music 37(1):61–90Google Scholar
  64. Meyer LB (1956) Emotion and meaning in music. Chicago University Press, ChicagoGoogle Scholar
  65. Murugappan M, Rizon M, Nagarajan R, Yaacob S, Zunaidi I, Hazry D (2008) Lifting scheme for human emotion recognition using EEG. In: International symposium on information technology, ITSim, vol 2Google Scholar
  66. Nasoc F, Alvarez K, Lisetti CN, Finkelstein (2003) Emotion recognition from physiological signals for presence technologies. Int J Cogn Technol Work-Special Issue Presence 6(1):4–14Google Scholar
  67. Nater U, Krebs M, Ehlert U (2006) Sensation seeking, music preference and physiological reactivity to music. Musicae Scientiae 9(2):239–254Google Scholar
  68. Niklicek L, Thayer J, Van Doornen L (1997) Cardiorespiratory differentiation of musically-induced emotions. J Psychophysiol 11(4):304–321Google Scholar
  69. Pankssep J (1992) A critical role for “affective neuroscience” in resolving what is basic emotions. Psychol Rev 99(3):554–560Google Scholar
  70. Pankssep J (1998) Affective neuroscience: the foundations of human and animal emotions. Oxford University Press, OxfordGoogle Scholar
  71. Peretz I, Gagnon L, Bouchard B (1998) Music and emotion: perceptual determinants, immediacy, and isolation after brain damage. Cognition 68(2):111–141Google Scholar
  72. Petrantonakis PC, Hadjileontiadis LJ (2010) Emotion recognition from EEG using higher order crossings. IEEE Trans Inf Technol Biomed 14(2):186–197Google Scholar
  73. Pickard RW, Vryzas E, Healey J (2001) Towards machine emotional intelligence: analysis of affective physiological state. IEEE Trans Pattern Anal Mach Intell 23(10):1175–1191Google Scholar
  74. Pizzagalli DA, Greischar LL, Davidson RJ (2003) Spatio-temporal dynamics of brain mechanism in aversive classical conditioning: high-density event-related potential and brain electrical tomography analyses. Neurophysiologia 41(2):184–194Google Scholar
  75. Pizzagalli DA, Nitschke JB, Oakes TR, Hendrick AM, Horras KA, Larson CL, Abercrombie HC, Scaefer SM, Keger GV, Benca RM, Pasqual-Marqi RD, Davidson RJ (2002) Brain electrical tomography in depression: the importance of symptom severity, anxiety and melancholic features. Biol Psychiatry 52(2):73–85Google Scholar
  76. Ramos D, Bueno JLO, Bigand E (2011) Manipulating Greek musical modes and tempo affects perceived musical emotion in musicians and non-musicians. Braz J Med Biol Res 44(2):165–172Google Scholar
  77. Rickard N (2004) Intense emotional responses to music: a test of the physiological arousal hypotheses. Psychol Music 32(4):371–388Google Scholar
  78. Rigg MG (1940a) Speed as a determiner of musical mood. J Exp Psychol 27(5):566–571Google Scholar
  79. Rigg MG (1940b) The effect of register and tonality upon musical mood. J Musicology 2(2):49–61Google Scholar
  80. Russel JA, Caroll JM (1999) On the bipolarity of positive and negative affect. Psychol Bull 125(1):3–30Google Scholar
  81. Russell JA (1980) A circumplex model of affect. J Pers Soc Psychol 39(6):1161–1178Google Scholar
  82. Sammler D, Grigutsch M, Fritz T, Koelsch S (2007) Music and emotion: electrophysiological correlates of the processing of pleasant and unpleasant music. Psychophysiology 44(2):293–304Google Scholar
  83. Schellenberg EG, Krysciak A, Campbell RJ (2000) Perceiving emotion in melody: interactive effects of pitch and rhythm. Music Percept 18(2):155–171Google Scholar
  84. Scherer KR, Zentner MR (2001) Emotional effects of music: production rules. In: Juslin PN, Sloboda JA (eds) Music and emotion: theory and research. Oxford University Press, Oxford, pp 361–392Google Scholar
  85. Scherer KR (2004) Which emotions can be induced by music? What are the underlying mechanisms? And how can we measure them? J New Music Res 33(3):239–251MathSciNetGoogle Scholar
  86. Scherer KR, Oshinski JS (1977) Cue utilization in emotion attribution from auditory stimuli. Motiv Emot 1(4):331–346Google Scholar
  87. Scherer KR (1999) Appraisal theories. In: Dalgleish T, Power M (eds) Handbook of cognition and emotion. Willey, Chichester, pp 637–663Google Scholar
  88. Schimmack U, Reisenzein R (2002) Experiencing activation: energetic arousal and tense arousal are not mixtures of valence and activation. Emotion 2(4):412–417Google Scholar
  89. Schimmack U, Grob A (2000) Dimensional models of core affect: a quantitative comparison by means of structural equation modeling. Eur J Pers 14(4):325–345Google Scholar
  90. Schimmack U, Reiner R (2002) Experiencing activation: energetic arousal and tense arousal are not mixtures of valence and activation. Emotion 2(4):412–417Google Scholar
  91. Schlossberg H (1954) Three dimensions of emotion. Psychol Rev 61(2):81–88Google Scholar
  92. Schmidt LA, Trainor LJ, Santesso DL (2003) Development of frontal encephalogram (EEG) and heart rate (ECG) responses to affective musical stimuli during the first 12 months of post-natal-life. Brain Cogn 52(1):27–32Google Scholar
  93. Schmidt LA, Trainor LJ (2001) Frontal brain electrical activity (EEG) distinguishes valence and intensity of musical emotion. Cogn Emot 15(4):487–500Google Scholar
  94. Schutter DJ, De Weijer AD, Meuwese JD, Morgan B, Van Honk J (2008) Interrelations between motivational stance, cortical excitability and the frontal electroencephalogram asymmetry of emotion: a transcranial magnetic stimulation study. Hum Brain Mapp 29(5):574–580Google Scholar
  95. Skowronek J, McKinney M (2007) Features for audio classification: percussiveness of sounds. In: Vergaegh W, Aarts E, Korst J (eds) Intelligent algorithms in ambient and biomedical computing. Phillips research book series, vol 7. Springer, Dordrecht, pp 103–117Google Scholar
  96. Sourina O, Liu Y (2011) A fractal-based algorithm of emotion recognition from EEG using arousal-valence model. In: Proceedings of the international conference on bio-inspired systems and signal processing. BIOSIGNALS 2011, Rome, pp 209–214Google Scholar
  97. Thayer J, Faith M (2001) A dynamic systems model of musically induced emotions. Ann N Y Acad Sci 999(1):452–456Google Scholar
  98. Thayer RE (1989) The biophysiology of mood and arousal. Oxford University Press, OxfordGoogle Scholar
  99. Trochidis K, Bigand E (2013) Investigation of the effect of mode and tempo on emotional responses to music using EEG power asymmetry. J Psychophysiol 27(3):142–147Google Scholar
  100. Trochidis K, Sears D, Trân L, McAdams S (2012) Psychophysiological measures of emotional response to romantic orchestral music and their musical and acoustic correlates. In: Aramaki M et al (eds) Proceedings of the 9th international symposium on computer music modeling and retrieval, 19–22 June, London. Lecture notes in computer science, vol 7900. Springer, Heidelberg, pp 44–57Google Scholar
  101. Tsang CD, Trainor LJ, Santesso DL, Tasker CL, Schmidt LA (2001) Frontal EEG responses as a function of affective musical features. Ann N Y Acad Sci 930(1):439–442Google Scholar
  102. Valenza G, Lanata A, Scilingo P (2012) Oscillations of heart rate and respiration synchronize during affective visual stimulation. IEEE Trans Inf Technol Biomed 16(4):683–690Google Scholar
  103. Van der Zwaag MD, Westerink JHD, Van den Broek EL (2011) Emotional and psychophysiological responses to tempo, mode and percussiveness. Musicae Scientae 15(20):250–269Google Scholar
  104. Wagner J, Kim J, Andre E (2005) From physiological signals to emotion. In: International conference on multimedia and expo, pp 940–943Google Scholar
  105. Watson D, Wiese D, Vaidya J, Tellegen A (1999) The two general activation systems of affect: structural findings, evolutionary consideration, and psychophysiological evidence. J Pers Soc Psychol 76(5):820–838Google Scholar
  106. Watson D, Tellegen A (1985) Toward a consensual structure of mood. Psychol Bull 98(2):219–235Google Scholar
  107. Watson D, Clark LA, Tellegen A (1988) Development and validation of brief measures of positive and negative affect: the PANAS scales. J Pers Soc Psychol 54(6):1063–1070Google Scholar
  108. Webster G, Weir CG (2005) Emotional responses to music: interactive effects of mode, tempo and texture. Motiv Emot 29(1):19–39Google Scholar
  109. Witvliet C, Vrana S (2007) Play it again Sam: repeated exposure to emotionally evocative music polarizes liking and smiling responses and influences other affects reports, facial EMG and heart rate. Cogn Emot 21(1):3–25Google Scholar
  110. Wundt WM (1896) Outlines of psychology (Wilhelm Engelmann), Leipzig (translated by CH Judd)Google Scholar
  111. Zattore RJ, Samson S (1991) Role of the right temporal neocortex in retention of pitch in auditory short memory. Brain 114(6):2403–2417Google Scholar
  112. Zentner MR, Grandjean D, Scherer KR (2008) Emotions evoked by the sound of music: characterization, classification, and measurement. Emotion 8(4):494–521Google Scholar

Copyright information

© Springer-Verlag London 2014

Authors and Affiliations

  1. 1.Department of Cognitive PsychologyUniversity of BurgundyDijonFrance

Personalised recommendations