Skip to main content

An Overview of Emotion as a Parameter in Music, Definitions, and Historical Approaches

  • Chapter
  • First Online:
Emotion in Video Game Soundtracking

Abstract

This chapter presents a theoretical overview of emotion in the context of music, particularly emotional analysis, different types of model, and the distinction between perceived and induced emotions. All are necessary to understand in order to examine emotion in the video game soundtracking context. You may be a videogame designer, sound designer, composer, or player; professional or enthusiastic amateur. Regardless, you will be familiar with the powerful role which soundtracking can play in shaping your experience. Music is a well-documented way to communicate feelings and emotional states, regardless of whether one has written, performed, or simply listened to it. When combined with other modalities, i.e., listening and seeing, or in the case of many games, listening, seeing, and responding with gameplay actions, the experience can become even more intense. High quality soundtracking has the potential to enhance player experience in video games (Grimshaw et al. 2008). Combining emotionally congruent sound-tracking with game narrative has the potential to create significantly stronger affective responses than either stimulus alone—the power of multimodal stimuli on affective response has been shown both anecdotally and scientifically (Camurri et al. 2005). Video game soundtracking has an inexorable link with the available technology at the time of development. This meant that there were—at least—some limitations in terms of what might be achievable in the soundtracking efforts for earlier generations of game, whether that be restrictions based on the type of synthesizer available to the composer, or the storage medium in terms of digital sound effects and speech. Game audio requires at least two additional challenges over other sound-for-picture work; firstly, the need to be dynamic (responding to gameplay states) and secondly to be emotionally congruent whilst adapting to non-linear narrative changes (Collins 2008). Early solutions such as looping can be come repetitive, and ultimately break player immersion, but branching strategies (where different cues are multiplexed at narrative breakpoints) can drastically increase the compositional complexity required in the music implementation when creating a soundtrack (Lipscomb and Zehnder 2004).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 99.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 129.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 129.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Arizmendi, T.G.: Linking mechanisms: emotional contagion, empathy, and imagery. Psychoanal. Psychol. 28, 405 (2011)

    Article  Google Scholar 

  • Bach, D.R., Grandjean, D., Sander, D., Herdener, M., Strik, W.K., Seifritz, E.: The effect of appraisal level on processing of emotional prosody in meaningless speech. NeuroImage. 42, 919–927 (2008)

    Article  Google Scholar 

  • Barkat, M., Ohala, J., Pellegrino, F.: Prosody as a distinctive feature for the discrimination of arabic dialects. In: EUROSPEECH ’99, pp. 395–398. (1999)

    Google Scholar 

  • Berg, J., Wingstedt, J.: Relations between selected musical parameters and expressed emotions: extending the potential of computer entertainment. In: Proceedings of the 2005 ACM SIGCHI International Conference on Advances in Computer Entertainment Technology, pp. 164–171. ACM, Valencia, Spain (2005)

    Google Scholar 

  • Beveridge, S., Knox, D.: Emotion classification of western contemporary music: identifying a representative feature set. In: Proceedings of the 11th International Conference on Music Perception and Cognition, Seattle, Washington, 23–27 August 2010

    Google Scholar 

  • Bråten, S.: On Being Moved: From Mirror Neurons to Empathy, vol. 68. John Benjamins, Philadelphia (2007)

    Google Scholar 

  • Camurri, A., Volpe, G., De Poli, G., Leman, M.: Communicating expressiveness and affect in multimodal interactive systems. IEEE Multimedia. 12(1), 43–53 (2005)

    Article  Google Scholar 

  • Collins, K.: Game Sound: An Introduction to the History, Theory, and Practice of Video Game Music and Sound Design. MIT Press, Cambridge, MA (2008)

    Google Scholar 

  • Cross, I.: Music and meaning, ambiguity and evolution. In: Musical Communication, pp. 27–43. Oxford University Press, New York (2005)

    Chapter  Google Scholar 

  • Daly, I., Williams, D., Hallowell, J., Hwang, F., Kirke, A., Malik, A., Weaver, J., Miranda, E., Nasuto, S.J.: Music-induced emotions can be predicted from a combination of brain activity and acoustic features. Brain Cogn. 101, 1–11 (2015). https://doi.org/10.1016/j.bandc.2015.08.003

    Article  Google Scholar 

  • Dickinson, K.: Off Key: When Film and Music Won’t Work Together. Oxford University Press, New York (2008)

    Book  Google Scholar 

  • Eerola, T., Vuoskoski, J.K.: A comparison of the discrete and dimensional models of emotion in music. Psychol. Music. 39, 18–49 (2010). https://doi.org/10.1177/0305735610362821

    Article  Google Scholar 

  • Gabrielsson, A., Juslin, P.N.: Emotional expression in music. In: Davidson, R.J., Scherer, K.R., Goldsmith, H.H. (eds.) Handbook of Affective Sciences Series in Affective Science, pp. 503–534. Oxford University Press, New York (2003)

    Google Scholar 

  • Gabrielsson, A., Lindström, E.: The influence of musical structure on emotional expression. In: Juslin, P.N., Sloboda, J.A. (eds.) Music and Emotion: Theory and Research Series in Affective Science, pp. 223–248. Oxford University Press, New York (2001)

    Google Scholar 

  • Grewe, O., Nagel, F., Kopiez, R., Altenmüller, E.: How does music arouse “chills”? Ann. N. Y. Acad. Sci. 1060, 446–449 (2005)

    Article  Google Scholar 

  • Grewe, O., Nagel, F., Kopiez, R., Altenmüller, E.: Emotions over time: synchronicity and development of subjective, physiological, and facial affective reactions to music. Emotion. 7, 774–788 (2007). https://doi.org/10.1037/1528-3542.7.4.774

    Article  Google Scholar 

  • Grimshaw, M., Lindley, C.A., Nacke, L.: Sound and immersion in the first-person shooter: mixed measurement of the player’s sonic experience. In: Proceedings of Audio Mostly Conference, 1–7. Lulea University of Technology, Piteå (2008)

    Google Scholar 

  • Herold, C.: Famous Blue Raincoat:-an approach to an integrated analysis of a song (n.d.)

    Google Scholar 

  • Huron, D.: Humdrum and Kern: Selective Feature Encoding, Beyond MIDI: The Handbook Of Musical Codes. MIT Press, Cambridge, MA (1997)

    Google Scholar 

  • Huron, D.B.: Sweet Anticipation: Music and the Psychology of Expectation. MIT Press, Cambridge, MA (2006)

    Google Scholar 

  • Juslin, P.N.: Emotional communication in music performance: a functionalist perspective and some data. Music. Percept. 14, 383–418 (1997)

    Article  Google Scholar 

  • Juslin, P.N., Sloboda, J.A.: Handbook of Music and emotion: Theory, Research, Applications. Oxford University Press, Oxford (2010)

    Google Scholar 

  • Juslin, P.N., Västfjäll, D.: Emotional responses to music: the need to consider underlying mechanisms. Behav. Brain Sci. 31, 559 (2008). https://doi.org/10.1017/S0140525X08005293

    Article  Google Scholar 

  • Lipscomb, S.D., Zehnder, S.M.: Immersion in the virtual environment: the effect of a musical score on the video gaming experience. J. Physiol. Anthropol. Appl. Hum. Sci. 23(6), 337–343 (2004)

    Article  Google Scholar 

  • Livingstone, S.R., Muhlberger, R., Brown, A.R., Thompson, W.F.: Changing musical emotion: a computational rule system for modifying score and performance. Comput. Music. J. 34(1), 41–64 (2010)

    Article  Google Scholar 

  • Marin, M.M., Bhattacharya, J.: Music Induced Emotions: Some Current Issues and Cross-Modal Comparisons. Nova Science, New York (2010)

    Google Scholar 

  • Plans, D., Morelli, D.: Experience-driven procedural music generation for games. IEEE Trans. Comput. Intell. AI Games. 4(3), 192–198 (2012). https://doi.org/10.1109/TCIAIG.2012.2212899

    Article  Google Scholar 

  • Russell, J.A.: A circumplex model of affect. J. Pers. Soc. Psychol. 39, 1161 (1980)

    Article  Google Scholar 

  • Russell, J.A.: Core affect and the psychological construction of emotion. Psychol. Rev. 110, 145 (2003)

    Article  Google Scholar 

  • Schachter, S., Singer, J.: Cognitive, social, and physiological determinants of emotional state. Psychol. Rev. 69, 379–399 (1962). https://doi.org/10.1037/h0046234

    Article  Google Scholar 

  • Scherer, K.R.: Acoustic concomitants of emotional dimensions: Judging affect from synthesized tone sequences. In: Proceedings of the Eastern Psychological Association Meeting. Education Resources Information Center, Boson (1972)

    Google Scholar 

  • Scherer, K.R.: Which emotions can be induced by music? What are the underlying mechanisms? And how can we measure them? J. New Music Res. 33, 239–251 (2004)

    Article  Google Scholar 

  • Strank, W.: The legacy of IMuse: interactive video game music in the 1990s. In: Moormann, P. (ed.) Music and Game, pp. 81–91. Springer VS, Wiesbaden (2013)

    Chapter  Google Scholar 

  • Vuoskoski, J.K., Eerola, T.: Can sad music really make you sad? Indirect measures of affective states induced by music and autobiographical memories. Psychol. Aesthet. Creat. Arts. 6, 204 (2012)

    Article  Google Scholar 

  • Warren, C.: LucasArts and the design of successful adventure games: the true secret of Monkey Island. http://www-sul.stanford.edu/depts/hasrg/histsci/STS145papers/Warren.pdf (2003)

  • Wedin, L.: Dimension analysis of emotional expression in music. Swed. J. Musicol. 51, 119–140 (1969)

    Google Scholar 

  • Wedin, L.: A multidimensional study of perceptual-emotional qualities in music. Scand. J. Psychol. 13, 241–257 (1972). https://doi.org/10.1111/j.1467-9450.1972.tb00072.x

    Article  Google Scholar 

  • Zentner, M., Grandjean, D., Scherer, K.R.: Emotions evoked by the sound of music: characterization, classification, and measurement. Emotion. 8, 494–521 (2008). https://doi.org/10.1037/1528-3542.8.4.494

    Article  Google Scholar 

  • Zentner, M.R., Meylan, S., Scherer, K.R.: Exploring musical emotions across five genres of music. In: Sixth International Conference of the Society for Music Perception and Cognition (ICMPC), 5–10 Aug 2000

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Duncan Williams .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Williams, D. (2018). An Overview of Emotion as a Parameter in Music, Definitions, and Historical Approaches. In: Williams, D., Lee, N. (eds) Emotion in Video Game Soundtracking. International Series on Computer Entertainment and Media Technology. Springer, Cham. https://doi.org/10.1007/978-3-319-72272-6_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-72272-6_2

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-72271-9

  • Online ISBN: 978-3-319-72272-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics