Abstract
This research aims to understand how soundtrack elements can stimulate an emotional response in viewers whilst watching film and how sound professionals utilise sound for this purpose. The article reviews research on affective audio in film and informs ten semi-structured interviews with film sound professionals. These interviews cover a variety of topics, all with a focus on sound design. The interview transcripts were thematically analysed, and six themes were drawn from them and are discussed in detail and explored through case-study examples. A workflow for sound design is synthesised using each theme as a step in the post-production process, intended as a way of visualising how this research can aid the film-sound profession and inform future research in the field. It is concluded that sound is currently used to bring about affective responses in specific instances, when other emotional devices are not already in use. The use of sound as a narrative aid is found to be more prevalent, and indeed currently seen as more important within the industry than for specific affective use. Further research is suggested to enhance understanding of affective audio and to develop a framework for its widespread effective implementation in film.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
L. Blake, George Lucas: Technology and the art of filmmaking [Magazine] (2004, November 1). Retrieved 16 January 2019, from Mixonline website: https://www.mixonline.com/recording/george-lucas-365460
N. Hillman, S. Pauletto, The Craftsman: The use of sound design to elicit emotions. Soundtrack 7(1), 5–23 (2014). https://doi.org/10.1286/st.7.1.5_1
N. Hillman, S. Pauletto, Audio imagineering: Utilising the four sound areas framework for emotive sound design within contemporary audio post-production. New Soundtrack 6(1), 77–107 (2016). https://doi.org/10.3366/sound.2016.0084
K. Kalinak (ed.), Sound: Dialogue, Music and Effects, 1st edn. (I.B. Tauris & Co. Ltd, New Brunswick, 2015)
A.J. Cohen, Music as a source of emotion in film, in Series in Affective Science. Music and emotion: Theory and research, (Oxford University Press, New York, 2001), pp. 249–272
P. Ivanka, M. Slobodan, The effect of music background on the emotional appraisal of film sequences | Directory of Open Access Journals. Psihologija 44(1), 71–91 (2011). https://doi.org/10.2298/PSI1101071P
B. Langkjær, Making fictions sound real – On film sound, perceptual realism and genre. MedieKultur J. Media Commun. Res. 26(48), 5–17 (2010). https://doi.org/10.7146/mediekultur.v26i48.2115
P.N. Juslin, P. Laukka, Expression, perception, and induction of musical emotions: A review and a questionnaire study of everyday listening. J. New Music Res. 33(3), 217–238 (2004). https://doi.org/10.1080/0929821042000317813
S. Ildirar, D.T. Levin, S. Schwan, T.J. Smith, Audio facilitates the perception of cinematic continuity by first-time viewers. Perception 47(3), 276–295 (2018). https://doi.org/10.1177/0301006617745782
D. Candusso, J. Thompson, How sound design shapes the audience’s response in Baz Luhrmann’s ‘Australia’. Int. J. Image 5(1), 25–31 (2014). https://doi.org/10.18848/2154-8560/CGP/v05i01/44117
J.R. Drake, The importance of sound design and its affect on perception. MA Thesis, State University of New York (2013). Retrieved from https://dspace.sunyconnect.suny.edu/handle/1951/58385
M. Chion, Audio-Vision: Sound on Screen, ed. by C. Gorbman, 2nd edn. (Columbia University Press, 1994).
D.T. Blumstein, R. Davitian, P.D. Kaye, Do film soundtracks contain nonlinear analogues to influence emotion? Biol. Lett. 6(6), 751–754 (2010). https://doi.org/10.1098/rsbl.2010.0333
L.F. Donaldson, Feeling and filmmaking: The design and affect of film sound. New Soundtrack 7(1), 31–46 (2017). https://doi.org/10.3366/sound.2017.0095
V. LoBrutto, Sound-on-film: Interviews with Creators of Film Sound (Greenwood Publishing Group, Westport, 1994)
R. Kumar, Research Methodology: A Step-by-Step Guide for Beginners, 4th edn. (SAGE, Thousand Oaks, 2014)
A. Dix, R. Beale, G.D. Abowd, Human-Computer Interaction (Pearson Education UK, London, 2003)
J. Francombe, J.S. Woodcock, R. Hughes, R. Mason, A. Franck, C. Pike, et al., Qualitative evaluation of media device orchestration for immersive spatial audio reproduction. J. Audio Eng. Soc. 66, 414–429 (2018). https://doi.org/10.17743/jaes.2018.0027
QSR International, Qualitative Data Analysis Software | NVivo [Information/Product] (2020, December 8). https://www.qsrinternational.com/nvivo-qualitative-data-analysis-software/home
V. Braun, V. Clarke, Using thematic analysis in psychology. Qual. Res. Psychol. 3(2), 77–101 (2006). https://doi.org/10.1191/1478088706qp063oa
Miller, G. (2015). Mad Max: Fury Road [Action, Adventure, Sci-Fi]. Retrieved from http://www.imdb.com/title/tt1392190/
S. Spielberg, Raiders of the Lost Ark [Action, Adventure]. Paramount Pictures, Lucasfilm (1981, June 12)
R. Scott, Blade Runner [Action, Sci-Fi, Thriller]. The Ladd Company, Shaw Brothers, Warner Bros (1982, June 25)
D. Villeneuve, Blade Runner 2049 [Action, Drama, Mystery, Sci-Fi, Thriller]. Alcon Entertainment, Columbia Pictures, Sony (2017, October 4)
Q. Tarantino, Once Upon a Time... In Hollywood [Comedy, Drama]. Columbia Pictures, Bona Film Group, Heyday Films (2019, July 24)
T. Muirhead, 111 – Once upon a time in Hollywood, vol. 111 (2019, September 10). Retrieved 26 October 2020, from https://soundcloud.com/tonebenders-podcast/111-once-upon-a-time-in-hollywood
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Ridley, H., Cunningham, S., Picking, R. (2022). Developing an Affective Audio Toolbox for Audio Post-production. In: Latifi, S. (eds) ITNG 2022 19th International Conference on Information Technology-New Generations. Advances in Intelligent Systems and Computing, vol 1421. Springer, Cham. https://doi.org/10.1007/978-3-030-97652-1_44
Download citation
DOI: https://doi.org/10.1007/978-3-030-97652-1_44
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-97651-4
Online ISBN: 978-3-030-97652-1
eBook Packages: EngineeringEngineering (R0)