Abstract
The ability of music to influence the emotional interpretation of visual contexts has been supported in several psychological studies. However, we still lack a significant body of empirical studies examining the ways in which specific structural characteristics of music may alter the affective processing of visual information. The present study suggests a way to use algorithmically generated music to assess the effect of sensory dissonance on the emotional judgment of a visual scene. This was examined by presenting participants with the same abstract animated film paired with consonant, dissonant and no music. The level of sensory dissonance was controlled in this experiment by employing different interval sets for the two contrasting background music conditions. Immediately after viewing the clip, participants were asked to complete a series of bipolar adjective ratings representing the three connotative dimensions (valence, activity and potency). Results revealed that relative to the control group of no music, consonant background music significantly biased the affective impact by guiding participants toward positive valence ratings. This finding is discussed in terms of interval content theory within the general perspective of post-tonal music theory and David Temperley’s probabilistic framework (model of tonalness).
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Ayres, T., Aeschbach, S., Walker, E.L.: Psychoacoustic and experiential determinants of tonal consonance. J Aud. Res. 20, 31–42 (1980)
Barham, J.: Incorporating monsters: music as context, character and construction in Kubrick’s the shining. In: Hayward, Philip (ed.) Terror Tracks: Music, Sound and Horror Cinema. Equinox, London (2009)
Bartlett, F.C.: Remembering. Cambridge University Press, London (1932)
Baumgartner, T., Esslen, M., Jäncke, L.: From emotion perception to emotion experience: emotions evoked by pictures and classical music. Int. J. Psychophysiol. 60, 34–43 (2006)
Baumgartner, T., Lutz, K., Schmidt, C.F., Jäncke, L.: The emotional power of music: how music enhances the feeling of affective pictures. Brain Res. 1075, 151–164 (2006)
Bharucha, J.J.: Anchoring effects in music: The resolution of dissonance. Cogn. Psychol. 16, 485–518 (1984)
Blood, A.J., Zatorre, R.J., Bermudez, P., Evans, A.C.: Emotional responses to pleasant and unpleasant music correlate with activity in paralimbic brain regions. Nat. Neurosci. 2, 382–387 (1999)
Bigand, E., Parncutt, R., Lerdahl, F.: Perception of musical tension in short chord sequences: The influence of harmonic function, sensory dissonance, horizontal motion, and musical training. Percept. Psychophys. 58, 124–141 (1996)
Bolivar, V.J., Cohen, A.J., Fentress, J.: Semantic and formal congruency in music and motion pictures: Effects on the interpretation of visual action. Psychomusicology 13, 28–59 (1994)
Boltz, M.G., Schulkind, M., Kantra, S.: Effects of background music on the remembering of filmed events. Mem. Cognit. 19, 593–606 (1991)
Boltz, M.G.: Musical soundtracks as a schematic influence on the cognitive processing of filmed events. Music Percept. 18, 427–454 (2001)
Bravo, F.: The influence of music on the emotional interpretation of visual contexts. In: Aramaki, M., Barthet, M., Kronland-Martinet, R., Ystad, S. (eds.) CMMR 2012. LNCS, vol. 7900, pp. 366–377. Springer, Heidelberg (2013)
Brewer, W.F.: Literacy, theory, and rhetoric: implications for psychology. In: Spiro, R.J., Bruce, B.C., Brewer, W.F. (eds.) Theoretical Issues in Reading Comprehension: Perspectives from Cognitive Psychology, Linguistics, Artificial Intelligence, and Education, pp. 221–239. Erlbaum, Hillsdale (1980)
Cohen, A.J.: Music as a source of emotion in film. In: Juslin, P., Sloboda, J. (eds.) Music and Emotion, pp. 249–272. Oxford University Press, Oxford (2001)
Cohen, A.J.: How music influences the interpretation of film and video: approaches from experimental psychology. In: Kendall, R.A., Savage, R.W. (eds.) Selected Reports in Ethnomusicology: Perspectives in Systematic Musicology, vol. 12, pp. 15–36. University of California, Los Angeles (2005)
DeWitt, L.A., Crowder, R.G.: Tonal fusion of consonant musical intervals. Percept. Psychophys. 41, 73–84 (1987)
Eldar, E., Ganor, O., Admon, R., Bleich, A., Hendler, T.: Feeling the real world: limbic response to music depends on related content. Cereb. Cortex 17, 2828–2840 (2007)
Erlich, P.: On harmonic entropy. Mills College Tuning Digest (1997)
Forte, A.: The Structure of Atonal Music. University Press, Yale (1973)
Hastie, R.: Schematic principles in human memory. In: Higgins, E.T., Herman, C.P., Zanna, M.P. (eds.) Social Cognition: The Ontario Symposium, vol. 1, pp. 39–88. Erlbaum, Hillsdale (1981)
Heider, F., Simmel, M.: An experimental study of apparent behaviour. Am. J. Psychol. 57, 243–259 (1944)
Helmholtz, H.L.F.: On the Sensation of Tone as a Physiological Basis for the Theory of Music. Dover, New York (1954). (Original German work published 1863)
Hindemith, P.: Unterweisung im Tonsatz, 3 vols. (Mainz: Schott, 1937–70) (The Craft of Musical Composition, vol. 1: Theoretical Part, translaed by Mendel, A). Associated Music Publishers, London, New York (1942)
Lerdahl, F., Krumhansl, C.L.: Modeling tonal tension. Music Percept. 24, 329–366 (2007)
Lipscomb, S.D., Kendall, R.A.: Perceptual judgment of the relationship between music and visual components in film. Psychomusicology 13, 60–98 (1994)
Marshall, S.K., Cohen, A.J.: Effects of musical soundtracks on attitudes toward animated geometric figures. Music Percept. 6, 95–112 (1988)
Meyer, L.B.: Emotion and Meaning in Music. University of Chicago Press, Chicago (1956)
Neisser, U.: Cognition and Reality. W. H. Freeman, San Francisco (1976)
Osgood, C.E., Succi, G.J., Tannenbaum, P.H.: The Measurement of Meaning. University of Illinois Press, Urbana (1957)
Parncutt, R.: Harmony: A Psychoacoustical Approach. Springer, Berlin (1989). ISBN 0-387-51279-9
Plomp, R., Levelt, W.J.M.: Tonal consonance and the critical bandwidth. J. Acoust. Soc. Am. 38, 548–560 (1965)
Schellenberg, E.G., Trehub, S.E.: Frequency ratios and the discrimination of pure tone sequences. Percept. Psychophys. 56, 472–478 (1994)
Schellenberg, E.G., Trainor, L.J.: Sensory consonance and the perceptual similarity of complex-tone harmonic intervals: tests of adult and infant listeners. J. Acoust. Soc. Am. 100, 3321–3328 (1996)
Sirius, G., Clarke, E.F.: The perception of audiovisual relationships: a preliminary study. Psychomusicology 13, 119–132 (1994)
Taylor, S.E., Crocker, J.: Schematic bases of social information processing. In: Higgins, E.T., Herman, C.P., Zanna, M.P. (eds.) Social Cognition: The Ontario Symposium, vol. 1, 27, pp. 89–134. Erlbaum, Hillsdale (1981)
Temperley, D.: Music and probability. MIT Press, Cambridge (2007)
Thom, R., Crocker, J.: Designing a movie for sound. In: Sider, L., Freeman, D., Sider, J. (eds.) Soundscapes: The School of Sound Lectures 1998–2001, vol. 1, 27, pp. 121–137. Wallflower Press, Great Britain (1998)
Vos, J., Vianen, B.G.: Thresholds for discrimination between pure and tempered intervals: the relevance of nearly coinciding harmonics. J. Acoust. Soc. Am. 77, 76–187 (1984)
Acknowledgments
Thanks to Prof. Ian Cross, Prof. Sarah Hawkins, Dr. Emmanuel A. Stamatakis, and to all the researchers at the Centre for Music and Science (Cambridge University). Thanks to Andrew Goldman for his very constructive comments on this paper. Thanks to Dr. Christopher Hopkins, Prof. Anson Call and Prof. Steve Herrnstadt (ISU). Thank you to the anonymous reviewers for their suggestions that improved the article considerably. This work was conducted at Cambridge University and is supported by a Queens’ College Walker Studentship.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Bravo, F. (2014). Changing the Interval Content of Algorithmically Generated Music Changes the Emotional Interpretation of Visual Images. In: Aramaki, M., Derrien, O., Kronland-Martinet, R., Ystad, S. (eds) Sound, Music, and Motion. CMMR 2013. Lecture Notes in Computer Science(), vol 8905. Springer, Cham. https://doi.org/10.1007/978-3-319-12976-1_29
Download citation
DOI: https://doi.org/10.1007/978-3-319-12976-1_29
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-12975-4
Online ISBN: 978-3-319-12976-1
eBook Packages: Computer ScienceComputer Science (R0)