Skip to main content
SpringerLink
Log in
Book cover

Guide to Brain-Computer Music Interfacing pp 105–132Cite as

Emotional Responses During Music Listening

  • Chapter
  • First Online:

Abstract

The aim of this chapter is to summarize and present the current knowledge about music and emotion from a multi-disciplinary perspective. Existing emotional models and their adequacy in describing emotional responses to music are described and discussed in different applications. The underlying emotion induction mechanisms beside cognitive appraisal are presented, and their implications on the field are analyzed. Musical characteristics such as tempo, mode, loudness, and so on are inherent properties of the musical structure and have been shown to influence the emotional states during music listening. The role of each individual parameter on emotional responses as well as their interactions is reviewed and analyzed. Different ways of measuring emotional responses to music are described, and their adequacy in accounting for emotional responses to music is discussed. The main physiological responses to music listening are briefly discussed, and their application to emotion recognition and to emotion intelligence in human–machine interaction is described. Music processing in the brain involves different brain areas and several studies attempted to investigate brain activity in relation to emotion during music listening through EEG signals. The issues and challenges of assessing human emotion through EEG are presented and discussed. Finally, an overview of problems that remain to be addressed in future research is given.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD   54.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  • Aftanas LI, Golocheikine SA (2001) Human anterior and frontal midline theta and lower alpha activity reflect emotional positive state and internalized attention: high-resolution EEG investigation of meditation. Neuroscience 310(1):57–60

    Google Scholar 

  • Altenmueller E, Schuermann K, Lim VK, Parlitz D (2002) Hits to the left, flops to the right: different emotion during music listening reflected in cortical lateralization patterns. Neuropsychologia 40(13):2242–2256

    Google Scholar 

  • Balconi M, Lucchiari S (2008) Consciousness and arousal effects on emotional face processing as revealed by brain oscillations. A gamma band analysis. Int J Psychophysiol 67(1):41–46

    Google Scholar 

  • Balkwill LL, Thompson WF (1999) A cross-cultural investigation of the perception of the emotion in music: psychophysical and cultural cues. Music Percept 17(1):43–64

    Google Scholar 

  • Baumgartner T, Esslen M, Jaencke L (2006) From emotion perception to emotion experience: emotions evoked by pictures and classical music. Int J Psychophysiol 60(1):34–43

    Google Scholar 

  • Berlyne DE (1971) Aesthetics and psychobiology. Appleton Century Crofts, New York

    Google Scholar 

  • Bernardi L, Porta C, Sleight P (2006) Cardiovascular, cerebrovascular and respiratory changes induced by different types of music in musicians and non-musicians: the importance of silence. Heart 92(4):445–452

    Google Scholar 

  • Bigand E, Vieillard S, Madurell F, Marozeau J, Dacquet A (2005) Multidimensional scaling of emotional responses to music: the effect of musical expertise and of the duration of the excerpts. Cogn Emot 19(8):1113–1139

    Google Scholar 

  • Blackwill LL, Thompson WF, Matsounaga R (2004) Recognition of emotion in Japanese Western and Hindustani music by Japanese listeners. Jpn Psychol Res 46(4):337–349

    Google Scholar 

  • Blood AJ, Zatorre RJ, Bermudez P, Evans AC (1999) Emotional responses to pleasant and unpleasant music correlate with activity in paralimbic brain regions. Nat Neurosci 2(4):382–387

    Google Scholar 

  • Blood AJ, Zatorre RJ (2001) Intensely pleasurable responses to music correlate with activity in brain regions implicated in reward and emotion. Proc Natl Acad Sci 98(20):11818–11832

    Google Scholar 

  • Boiten FA, Frijda NH, Wientjes CJE (1994) Emotions and respiratory pattern: review and critical analysis. Int J Psychophysiol 17(2):103–128

    Google Scholar 

  • Boucsein W (1992) Electrodermal activity. Plenum Press, New York

    Google Scholar 

  • Cacioppo JT, Berntson GG, Larsen JT, Poehlmann KM, Ito TA (2000) The psychophysiology of emotion. In: Lewis M, Havilnd-Jones JM (eds) Handbook of emotions. Guilford Press, New York

    Google Scholar 

  • Cagnon L, Peretz I (2003) Mode and tempo relative contribution to “happy-sad” judgments in equitone melodies. Cogn Emot 17(1):25–40

    Google Scholar 

  • Clayton M, Sager R, Will U (2005) In time with the music: the concept of entrainment and its significance for ethnomusicology. Eur Meetings Ethnomusicology 11:3–142

    Google Scholar 

  • Collier GL (2007) Beyond valence and activity in the emotional connotations of music. Psychol Music 35(1):110–131

    Google Scholar 

  • Dalla Bella S, Peretz I, Rouseau L, Grosselin N (2001) A development study of the effective value of tempo and mode in music. Cognition 80(3):B1–B10

    Google Scholar 

  • Davidson RJ (1988) EEG measures of cerebral asymmetry: conceptual and methodological issues. Int J Neurosci 39(1–2):71–78

    Google Scholar 

  • Davidson RJ, Fox NA (1989) Frontal brain asymmetry predicts infant’s response to maternal separation. J Abnorm Psychol 98(2):127–131

    Google Scholar 

  • Davidson RJ, Eckman P, Saron CD, Senulis J, Friegenn WW (1990) Approach-withdrawal and cerebral asymmetry: emotional expression and brain physiology. J Pers Soc Psychol 158(2):330–341

    Google Scholar 

  • Davies S (2001) Philosophical perspectives on music’s expressiveness. In: Juslin PA, Sloboda JA (eds) Music and emotion: theory and research. Oxford University Press, Oxford, pp 23–44

    Google Scholar 

  • Davis-Rollans C, Cunningham S (1987) Physiologic responses of coronary care patients to selected music. Heart Lung 16(4):370–378

    Google Scholar 

  • Davis C (1992) The effects of music and basic relaxation instruction on pain and anxiety of women undergoing in-office gynecological procedures. J Music Ther 29(4):202–216

    Google Scholar 

  • Eerola T, Vuoskoski J (2011) A comparison of the discrete and dimensional models of emotion in music. Psychol Music 39(1):18–49

    Google Scholar 

  • Ekman P (1992a) An argument for basic emotions. Cogn Emot 6(3–4):169–200

    Google Scholar 

  • Ekman P (1999) Basic emotions. In: Dalgleish T, Power MJ (eds) Handbook of cognition and emotion. Willey, New York, pp 301–320

    Google Scholar 

  • Ekman P (1992b) Are they basic emotions. Physiol Rev 99(3):550–553

    Google Scholar 

  • Flores-Gutierez EO, Diaz JL, Barrios FA, Favila-Humara R, Guevara MA, del Rio-Portilla Y, Corsi-cabrera M (2007) Metabolic and electric brain patterns during pleasant and unpleasant emotions induced by music masterpieces. Int J Psychophysiol 65(1):69–84

    Google Scholar 

  • Gabrielsson A, Juslin PN (1996) Emotional expression in music performance: between the performance intention and the listener’s experience. Psychol Music 24(1):68–91

    Google Scholar 

  • Gabrielsson A, Lindstroem E (2010) The role of structure in the musical expression of emotions. In: Juslin PN, Sloboda JA (eds) Handbook of music and emotion: theory, research, applications. Oxford University Press, New York, pp 367–400

    Google Scholar 

  • Gomez P, Danuser B (2007) Relationships between musical structure and psychophysiological measures of emotion. Emotion 7(2):377–387

    Google Scholar 

  • Green AC, Baerentsen KB, Stoedkilde-Joergensen H, Wallentin M, Roepstorff A, Vuust P (2008) Music in minor activates limbic structures: a relationship with dissonance? Neuroreport 19(7):711–714

    Google Scholar 

  • Heilman KM (1997) The neurobiology of emotional experience. J Neuropsychiatry Clin Neurosci 9:439–448

    Google Scholar 

  • Hevner K (1937) The affective value of pitch and tempo in music. Am J Psychol 49(4):621–630

    Google Scholar 

  • Hevner K (1935) The affective character of the major and minor modes in music. Am J Psychol 47(1):103–118

    Google Scholar 

  • Hodges DA (2010) Psychophysiological responses to music. In: Juslin PN, Sloboda JA (eds) Handbook of music and emotion: theory, research, applications. Oxford University Press, New York, pp 279–311

    Google Scholar 

  • Hunter PG, Schellenberg EG, Schimmack U (2008) Mixed affective responses to music with conflicting cues. Cogn Emot 22(2):327–352

    Google Scholar 

  • Husain G, Thompson WF, Schellenberg EG (2000) Effects of musical tempo and mode on mood, arousal and spatial abilities. Music Percept 20(2):151–171

    Google Scholar 

  • Ilie G, Thompson WF (2006) A comparison of acoustic cues in music and speech for three dimensions of affect. Music Percept 23(4):319–330

    MathSciNet  Google Scholar 

  • Ishino K, Hagiwara M (2003) A feeling estimation system using a simple electroencephalograph. Proc IEEE Int Conf Syst Man Cybern 5:4204–4209

    Google Scholar 

  • Iwanaga M, Ikeda M, Iwaki T (1996) The effects of repetitive exposure to music on subjective and physiological responses. J Music Ther 33(3):219–230

    Google Scholar 

  • Izard CE, Libero D, Putnam P, Haynes O (2003) Stability of emotion experiences and their relations to personality traits. J Pers Soc Psychol 64(5):847–860

    Google Scholar 

  • Juslin PN, Liljestroem S, Västfjäll D, Lundqvist LO (2010) How does music evoke emotions? Exploring the underlying mechanisms. In: Juslin PN, Sloboda JA (eds) Handbook of music and emotion: theory, research, applications. Oxford University Press, Oxford, pp 605–642

    Google Scholar 

  • Juslin PN (1997) Perceived emotional expression in synthesized performances of a short melody: capturing the listener’s judgment policy. Musicae Scientiae 1(2):225–256

    Google Scholar 

  • Juslin PN, Sloboda JA (eds) (2010) Handbook of music and emotion: theory, research, applications. Oxford University Press, Oxford

    Google Scholar 

  • Juslin PN, Liljestroem S, Västfäll D, Baradas G, Silva A (2008) An experience sampling study of emotional reactions to music: listener, music and situation. Emotion 8(5):668–683

    Google Scholar 

  • Juslin PN, Västfjäll D (2008) Emotional responses to music: the need to consider underlying mechanisms. Behav Brain Sci 31(5):559–575

    Google Scholar 

  • Kellaris JJ, Rice RC (1993) The influence of tempo, loudness and gender of listener on responses to music. Psychol Mark 10(1):15–19

    Google Scholar 

  • Khalfa F, Schon D, Anton J, Liegois-Chauvel C (2005) Brain regions involved in the recognition of happiness and sadness in music. Neuroreport 16(18):1981–1984

    Google Scholar 

  • Khalfa S, Roy M, Rainwille P, Dalla Bella S, Peretz I (2008) Role of tempo entrainment in psychophysiological differentiation of happy and sad music. Int J Psychophysiol 68(1):17–26

    Google Scholar 

  • Kim J, Andre E (2008) Emotion recognition based on physiological changes in music listening. IEEE Trans Pattern Anal Mach Intell 30(12):2067–2083

    Google Scholar 

  • Kivy P (1990) Music alone: Reflexions on a purely musical experience. Cornel University Press, Ithaca

    Google Scholar 

  • Ko KE, Yang HC, Sim KB (2009) Emotion recognition using EEG signals with relative power values and Bayesian network. Int J Control Autom Syst 7(5):865–870

    Google Scholar 

  • Koelsch S, Fritz T, Cramon DY, Mueller K, Friederici A (2006) Investigating emotion with music: an fMRI study. Hum Brain Mapp 27(3):239–250

    Google Scholar 

  • Koelsch S (2005) Investigating emotion with music: Neuroscientific approaches. Ann N Y Acad Sci 1060:412–418

    Google Scholar 

  • Koelstra S, Muehl C, Soleymani M, Lee JS, Yazdani A, Ebrahimi T, Pun T, Nijholt A, Patras I (2011) DEAP: a database for emotion analysis using physiological signals. IEEE Trans Affect Comput 3(1):18–31

    Google Scholar 

  • Konenci VJ (2008) Does music induce emotion? A theoretical and methodological analysis. Psychol Aesthetics Creativity Arts 2(2):115–129

    Google Scholar 

  • Krumnhansl C (1997) An exploratory study of musical emotions and psychophysiology. Can J Exp Physiol 51(4):336–352

    Google Scholar 

  • Larsen JT, Norris CJ, Cacioppo JT (2003) Effects of positive and negative affect on electromyographic activity over zygomaticus major and corrugator supercilii. Psychophysiology 40(5):776–785

    Google Scholar 

  • Li M, Lu BL (2009) Emotion classification on gamma-band EEG. In: Proceedings of the annual international conference of the IEEE engineering in medicine and biology society EMBS 2009, pp 1223–1226

    Google Scholar 

  • Lim Y-P, Wang C-H, Jung T-P, Wu T-L, Jeng S-K, Duann J-R, Chen J-H (2010) EEG-Based Emotion Recognition in Music Listening. IEEE Trans Biomedical Eng 57(7):1798–1806

    Google Scholar 

  • Lundquist L, Carlsson F, Hilmersson P, Juslin PN (2009) Emotional responses to music: experience, expression and physiology. Psychol Music 37(1):61–90

    Google Scholar 

  • Meyer LB (1956) Emotion and meaning in music. Chicago University Press, Chicago

    Google Scholar 

  • Murugappan M, Rizon M, Nagarajan R, Yaacob S, Zunaidi I, Hazry D (2008) Lifting scheme for human emotion recognition using EEG. In: International symposium on information technology, ITSim, vol 2

    Google Scholar 

  • Nasoc F, Alvarez K, Lisetti CN, Finkelstein (2003) Emotion recognition from physiological signals for presence technologies. Int J Cogn Technol Work-Special Issue Presence 6(1):4–14

    Google Scholar 

  • Nater U, Krebs M, Ehlert U (2006) Sensation seeking, music preference and physiological reactivity to music. Musicae Scientiae 9(2):239–254

    Google Scholar 

  • Niklicek L, Thayer J, Van Doornen L (1997) Cardiorespiratory differentiation of musically-induced emotions. J Psychophysiol 11(4):304–321

    Google Scholar 

  • Pankssep J (1992) A critical role for “affective neuroscience” in resolving what is basic emotions. Psychol Rev 99(3):554–560

    Google Scholar 

  • Pankssep J (1998) Affective neuroscience: the foundations of human and animal emotions. Oxford University Press, Oxford

    Google Scholar 

  • Peretz I, Gagnon L, Bouchard B (1998) Music and emotion: perceptual determinants, immediacy, and isolation after brain damage. Cognition 68(2):111–141

    Google Scholar 

  • Petrantonakis PC, Hadjileontiadis LJ (2010) Emotion recognition from EEG using higher order crossings. IEEE Trans Inf Technol Biomed 14(2):186–197

    Google Scholar 

  • Pickard RW, Vryzas E, Healey J (2001) Towards machine emotional intelligence: analysis of affective physiological state. IEEE Trans Pattern Anal Mach Intell 23(10):1175–1191

    Google Scholar 

  • Pizzagalli DA, Greischar LL, Davidson RJ (2003) Spatio-temporal dynamics of brain mechanism in aversive classical conditioning: high-density event-related potential and brain electrical tomography analyses. Neurophysiologia 41(2):184–194

    Google Scholar 

  • Pizzagalli DA, Nitschke JB, Oakes TR, Hendrick AM, Horras KA, Larson CL, Abercrombie HC, Scaefer SM, Keger GV, Benca RM, Pasqual-Marqi RD, Davidson RJ (2002) Brain electrical tomography in depression: the importance of symptom severity, anxiety and melancholic features. Biol Psychiatry 52(2):73–85

    Google Scholar 

  • Ramos D, Bueno JLO, Bigand E (2011) Manipulating Greek musical modes and tempo affects perceived musical emotion in musicians and non-musicians. Braz J Med Biol Res 44(2):165–172

    Google Scholar 

  • Rickard N (2004) Intense emotional responses to music: a test of the physiological arousal hypotheses. Psychol Music 32(4):371–388

    Google Scholar 

  • Rigg MG (1940a) Speed as a determiner of musical mood. J Exp Psychol 27(5):566–571

    Google Scholar 

  • Rigg MG (1940b) The effect of register and tonality upon musical mood. J Musicology 2(2):49–61

    Google Scholar 

  • Russel JA, Caroll JM (1999) On the bipolarity of positive and negative affect. Psychol Bull 125(1):3–30

    Google Scholar 

  • Russell JA (1980) A circumplex model of affect. J Pers Soc Psychol 39(6):1161–1178

    Google Scholar 

  • Sammler D, Grigutsch M, Fritz T, Koelsch S (2007) Music and emotion: electrophysiological correlates of the processing of pleasant and unpleasant music. Psychophysiology 44(2):293–304

    Google Scholar 

  • Schellenberg EG, Krysciak A, Campbell RJ (2000) Perceiving emotion in melody: interactive effects of pitch and rhythm. Music Percept 18(2):155–171

    Google Scholar 

  • Scherer KR, Zentner MR (2001) Emotional effects of music: production rules. In: Juslin PN, Sloboda JA (eds) Music and emotion: theory and research. Oxford University Press, Oxford, pp 361–392

    Google Scholar 

  • Scherer KR (2004) Which emotions can be induced by music? What are the underlying mechanisms? And how can we measure them? J New Music Res 33(3):239–251

    MathSciNet  Google Scholar 

  • Scherer KR, Oshinski JS (1977) Cue utilization in emotion attribution from auditory stimuli. Motiv Emot 1(4):331–346

    Google Scholar 

  • Scherer KR (1999) Appraisal theories. In: Dalgleish T, Power M (eds) Handbook of cognition and emotion. Willey, Chichester, pp 637–663

    Google Scholar 

  • Schimmack U, Reisenzein R (2002) Experiencing activation: energetic arousal and tense arousal are not mixtures of valence and activation. Emotion 2(4):412–417

    Google Scholar 

  • Schimmack U, Grob A (2000) Dimensional models of core affect: a quantitative comparison by means of structural equation modeling. Eur J Pers 14(4):325–345

    Google Scholar 

  • Schimmack U, Reiner R (2002) Experiencing activation: energetic arousal and tense arousal are not mixtures of valence and activation. Emotion 2(4):412–417

    Google Scholar 

  • Schlossberg H (1954) Three dimensions of emotion. Psychol Rev 61(2):81–88

    Google Scholar 

  • Schmidt LA, Trainor LJ, Santesso DL (2003) Development of frontal encephalogram (EEG) and heart rate (ECG) responses to affective musical stimuli during the first 12 months of post-natal-life. Brain Cogn 52(1):27–32

    Google Scholar 

  • Schmidt LA, Trainor LJ (2001) Frontal brain electrical activity (EEG) distinguishes valence and intensity of musical emotion. Cogn Emot 15(4):487–500

    Google Scholar 

  • Schutter DJ, De Weijer AD, Meuwese JD, Morgan B, Van Honk J (2008) Interrelations between motivational stance, cortical excitability and the frontal electroencephalogram asymmetry of emotion: a transcranial magnetic stimulation study. Hum Brain Mapp 29(5):574–580

    Google Scholar 

  • Skowronek J, McKinney M (2007) Features for audio classification: percussiveness of sounds. In: Vergaegh W, Aarts E, Korst J (eds) Intelligent algorithms in ambient and biomedical computing. Phillips research book series, vol 7. Springer, Dordrecht, pp 103–117

    Google Scholar 

  • Sourina O, Liu Y (2011) A fractal-based algorithm of emotion recognition from EEG using arousal-valence model. In: Proceedings of the international conference on bio-inspired systems and signal processing. BIOSIGNALS 2011, Rome, pp 209–214

    Google Scholar 

  • Thayer J, Faith M (2001) A dynamic systems model of musically induced emotions. Ann N Y Acad Sci 999(1):452–456

    Google Scholar 

  • Thayer RE (1989) The biophysiology of mood and arousal. Oxford University Press, Oxford

    Google Scholar 

  • Trochidis K, Bigand E (2013) Investigation of the effect of mode and tempo on emotional responses to music using EEG power asymmetry. J Psychophysiol 27(3):142–147

    Google Scholar 

  • Trochidis K, Sears D, Trân L, McAdams S (2012) Psychophysiological measures of emotional response to romantic orchestral music and their musical and acoustic correlates. In: Aramaki M et al (eds) Proceedings of the 9th international symposium on computer music modeling and retrieval, 19–22 June, London. Lecture notes in computer science, vol 7900. Springer, Heidelberg, pp 44–57

    Google Scholar 

  • Tsang CD, Trainor LJ, Santesso DL, Tasker CL, Schmidt LA (2001) Frontal EEG responses as a function of affective musical features. Ann N Y Acad Sci 930(1):439–442

    Google Scholar 

  • Valenza G, Lanata A, Scilingo P (2012) Oscillations of heart rate and respiration synchronize during affective visual stimulation. IEEE Trans Inf Technol Biomed 16(4):683–690

    Google Scholar 

  • Van der Zwaag MD, Westerink JHD, Van den Broek EL (2011) Emotional and psychophysiological responses to tempo, mode and percussiveness. Musicae Scientae 15(20):250–269

    Google Scholar 

  • Wagner J, Kim J, Andre E (2005) From physiological signals to emotion. In: International conference on multimedia and expo, pp 940–943

    Google Scholar 

  • Watson D, Wiese D, Vaidya J, Tellegen A (1999) The two general activation systems of affect: structural findings, evolutionary consideration, and psychophysiological evidence. J Pers Soc Psychol 76(5):820–838

    Google Scholar 

  • Watson D, Tellegen A (1985) Toward a consensual structure of mood. Psychol Bull 98(2):219–235

    Google Scholar 

  • Watson D, Clark LA, Tellegen A (1988) Development and validation of brief measures of positive and negative affect: the PANAS scales. J Pers Soc Psychol 54(6):1063–1070

    Google Scholar 

  • Webster G, Weir CG (2005) Emotional responses to music: interactive effects of mode, tempo and texture. Motiv Emot 29(1):19–39

    Google Scholar 

  • Witvliet C, Vrana S (2007) Play it again Sam: repeated exposure to emotionally evocative music polarizes liking and smiling responses and influences other affects reports, facial EMG and heart rate. Cogn Emot 21(1):3–25

    Google Scholar 

  • Wundt WM (1896) Outlines of psychology (Wilhelm Engelmann), Leipzig (translated by CH Judd)

    Google Scholar 

  • Zattore RJ, Samson S (1991) Role of the right temporal neocortex in retention of pitch in auditory short memory. Brain 114(6):2403–2417

    Google Scholar 

  • Zentner MR, Grandjean D, Scherer KR (2008) Emotions evoked by the sound of music: characterization, classification, and measurement. Emotion 8(4):494–521

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Cognitive Psychology, University of Burgundy, Dijon, France

    Konstantinos Trochidis & Emmanuel Bigand

Authors
  1. Konstantinos Trochidis
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Emmanuel Bigand
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Konstantinos Trochidis .

Editor information

Editors and Affiliations

  1. Interdisciplinary Centre for Computer Music Research (ICCMR), Plymouth University, Plymouth, United Kingdom

    Eduardo Reck Miranda

  2. Immersion, Bordeaux, France

    Julien Castet

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer-Verlag London

About this chapter

Cite this chapter

Trochidis, K., Bigand, E. (2014). Emotional Responses During Music Listening. In: Miranda, E., Castet, J. (eds) Guide to Brain-Computer Music Interfacing. Springer, London. https://doi.org/10.1007/978-1-4471-6584-2_6

Download citation

  • DOI: https://doi.org/10.1007/978-1-4471-6584-2_6

  • Published:

  • Publisher Name: Springer, London

  • Print ISBN: 978-1-4471-6583-5

  • Online ISBN: 978-1-4471-6584-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation