Abstract
In Human-Computer Interaction (HCI) use of the auditory channel normally involves communicating information to users in the form of short, auditory messages. Given the recent trend of HCI research towards incorporating experiential objectives, we propose that the auditory channel could also be exploited for affective intent. In particular, music could be integrated within interactive technologies as a vehicle to influence users’ behaviour and their experiences. This chapter describes some of the research conducted from other fields that already embrace the affective characteristic of music within their context. The limited amount of research exploiting music affectively in an HCI environment is discussed; including a review of our previous work involving Ambient Music Email (AME), an affective musical extension for email clients. By reflecting on how other subjects investigate the affective nature of music, this chapter aims to show that the HCI field is falling behind and inspire further work in this area. In fact, there are a wide variety of potential motivations for working with affective musical interaction, with a vast realm of potential research avenues, some of which are proposed here.
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Alty, J. L., Rigas, D., & Vickers, P. (1997). Using music as a communication medium. In CHI ‘97 extended abstracts on human factors in computing systems: Looking to the future (pp. 30–31) Atlanta, Georgia: ACM, 1120234. doi:10.1145/1120212.1120234
Areni, C. S., & Kim, D. (1993). The influence of background music on shopping behavior: Classical versus Top-Forty music in a wine store. Advances in Consumer Research, 20(1), 336–340.
Bishop, D. T., Karageorghis, C. I., & Georgios, L. (2007). A grounded theory of young tennis players’ use of music to manipulate emotional state. Journal of Sport & Exercise Psychology, 29, 584–607.
Blattner, M. M., Sumikawa, D. A., & Greenberg, R. M. (1989). Earcons and icons: Their structure and common design principles. Human Computer Interaction, 4(1), 11–44. doi:10.1207/s15327051hci0401_1.
Bramwell-Dicks, A. (2010). Towards AME: Exploring the use of ambient music within an email interface. Dissertation, University of York, York.
Bramwell-Dicks, A., Petrie, H., Edwards, A. D. N., & Power, C. (2011). Affecting user behaviour and experience with music: A research agenda. BCS HCI workshop “When words fail: What can music interaction tell us about HCI?” 8 May 2011. Northumbria University, Newcastle Upon Tyne. http://mcl.open.ac.uk/Workshop. Accessed 8 Mar 2012.
Brewster, S. A. (1998). Sonically-enhanced drag and drop. Paper presented at the international conference on auditory display, Glasgow, 1–4 Nov.
Brewster, S. A. (2002). Overcoming the lack of screen space on mobile computers. Personal and Ubiquitous Computing, 6(3), 188–205. doi:10.1007/s007790200019.
Brewster, S. A. (2003). Non-speech auditory output. In J. A. Jacko & A. Sears (Eds.), The human computer interaction handbook: Fundamentals, evolving technologies and emerging applications (pp. 220–240). London: Lawrence Erlbaum Associates Inc.
Brown, M. H., & Hershberger, J. (1992). Color and sound in algorithm animation. Computer, 25(12), 52–63. doi:10.1109/2.179117.
Bullerjahn, C., & Güldenring, M. (1994). An empirical investigation of effects of film music using qualitative content analysis. Psychomusicology, 13, 99–118.
Caldwell, C., & Hibbert, S. A. (2002). The influence of music tempo and musical preference on restaurant patrons’ behavior. Psychology and Marketing, 19(11), 895–917. doi:10.1002/mar.10043.
Cassidy, G. G., & MacDonald, R. A. R. (2010). The effects of music on time perception and performance of a driving game. Scandinavian Journal of Psychology, 51(6), 455–464. doi:10.1111/j.1467-9450.2010.00830.x.
Dixon, L., Trigg, R., & Griffiths, M. (2007). An empirical investigation of music and gambling behaviour. International Gambling Studies, 7(3), 315–326. doi:10.1080/14459790701601471.
Edwards, A. D. N. (1989). Soundtrack: An auditory interface for blind users. Human Computer Interaction, 4(1), 45–66. doi:10.1207/s15327051hci0401_2.
Edworthy, J., & Waring, H. (2006). The effects of music tempo and loudness level on treadmill exercise. Ergonomics, 49(15), 1597–1610. doi:10.1080/00140130600899104.
Gaver, W. W. (1986). Auditory icons: Using sound in computer interfaces. Human Computer Interaction, 2(2), 167–177. doi:10.1207/s15327051hci0202_3.
Gfeller, K., Asmus, E., & Eckert, M. (1991). An investigation of emotional response to music and text. Psychology of Music, 19(2), 128–141. doi:10.1177/0305735691192004.
Gosselin, N., Samson, S., Adolphs, R., Noulhiane, M., Roy, M., Hasboun, D., Baulac, M., & Peretz, I. (2006). Emotional responses to unpleasant music correlates with damage to the parahippocampal cortex. Brain, 129(10), 2585–2592. doi:10.1093/brain/awl240.
Griffiths, M., & Parke, J. (2005). The psychology of music in gambling environments: An observational research note. Journal of Gambling Issues, 13. doi:10.4309/jgi.2005.13.8.
Hébert, S., Béland, R., Dionne-Fournelle, O., Crête, M., & Lupien, S. J. (2005). Physiological stress response to video-game playing: The contribution of built-in music. Life Sciences, 76(20), 2371–2380. doi:10.1016/j.lfs.2004.11.011.
Hodges, D. A. (2010). Psychophysiological measures. In P. N. Juslin & J. A. Sloboda (Eds.), Handbook of music and emotion: Theory, research, applications (pp. 279–311). Oxford: Oxford University Press.
Jensen, M. B. (1931). The influence of jazz and dirge music upon speed and accuracy of typing. Journal of Educational Psychology, 22(6), 458–462. doi:10.1037/h0074752.
Jones, M., Jones, S., Bradley, G., Warren, N., Bainbridge, D., & Holmes, G. (2008). ONTRACK: Dynamically adapting music playback to support navigation. Personal and Ubiquitous Computing, 12(7), 513–525. doi:10.1007/s00779-007-0155-2.
Juslin, P. N., & Sloboda, J. A. (2010). Handbook of music and emotion: Theory, research, applications. Oxford: Oxford University Press.
Juslin, P. N., & Västfjäll, D. (2008). Emotional responses to music: The need to consider underlying mechanisms. The Behavioral and Brain Sciences, 31(5), 559–575. doi:10.1017/S0140525X08005293.
Kennedy, M., & Kennedy, J. (2007). “discord”. The concise oxford dictionary of music. Oxford: Oxford University Press.
Kotler, P. (1973). Atmospherics as a marketing tool. Journal of Retailing, 49(4), 48.
Krumhansl, C. L. (1997). An exploratory study of musical emotions and psychophysiology. Canadian Journal of Experimental Psychology, 51(4), 336–353. doi:10.1037/1196-1961.51.4.336.
Larson, R., & Csikszentmihalyi, M. (1983). The experience sampling method. New Directions for Methodology of Social & Behavioral Science, 15, 41–56.
Livingstone, S. R., Mühlberger, R., Brown, A. R., & Loch, A. (2007). Controlling musical emotionality: An affective computational architecture for influencing musical emotions. Digital Creativity, 18(1), 43–53. doi:10.1080/14626260701253606.
Lundqvist, L.-O., Carlsson, F., Hilmersson, P., & Juslin, P. N. (2009). Emotional responses to music: Experience, expression, and physiology. Psychology of Music, 37(1), 61–90. doi:10.1177/0305735607086048.
Lychner, J. A. (1998). An empirical study concerning terminology relating to aesthetic response to music. Journal of Research in Music Education, 46(2), 303–319. doi:10.2307/3345630.
Mansur, D. L., Blattner, M. M., & Joy, K. I. (1985). Sound graphs: A numerical data analysis method for the blind. Journal of Medical Systems, 9(3), 163–174. doi:10.1007/bf00996201.
Milliman, R. E. (1982). Using background music to affect the behavior of supermarket shoppers. The Journal of Marketing, 46(3), 86–91. doi:10.2307/1251706.
Milliman, R. E. (1986). The influence of background music on the behavior of restaurant patrons. Journal of Consumer Research, 13(2), 286–289. doi:10.1086/209068.
North, A. C., Hargreaves, D. J., & McKendrick, J. (1999). The influence of in-store music on wine selections. Journal of Applied Psychology, 84(2), 271–276. doi:10.1037/0021-9010.84.2.271.
Quinn, M., & Meeker L. D. (2001). Research set to music: The climate symphony and other sonifications of ice core, radar, DNA, seismic and solar wind data. Paper presented at the international conference on auditory display, Espoo, Finland, 29 July–1 August.
Richards, D., Fassbender, E., Bilgin, A., & Thompson, W. F. (2008). An investigation of the role of background music in IVWs for learning. Research in Learning Technology, 16(3), 231–244. doi:10.1080/09687760802526715.
Sanders, T., & Cairns, P. (2010). Time perception, immersion and music in videogames. Paper presented at BCS HCI, University of Abertay, Dundee, 6–10 Sept.
Sanderson, P. (2006). The multimodal world of medical monitoring displays. Applied Ergonomics, 37(4), 501–512. doi:10.1016/j.apergo.2006.04.022.
Shiels, M. (2010). Google’s priority inbox aims to conquer e-mail overload BBC. http://www.bbc.co.uk/news/technology-11133576. Accessed 8 Mar 2011.
Simpson, S. D., & Karageorghis, C. I. (2006). The effects of synchronous music on 400-m sprint performance. Journal of Sports Sciences, 24(10), 1095–1102. doi:10.1080/02640410500432789.
Sloboda, J. A. (2010). Music in everyday life: The role of emotions. In P. N. Juslin & J. A. Sloboda (Eds.), Handbook of human emotion: Theory, research, applications (pp. 493–514). Oxford: Oxford University Press.
Sloboda, J. A., & Juslin, P. N. (2010). At the interface between the inner and outer world: Psychological perspectives. In P. N. Juslin & J. A. Sloboda (Eds.), Handbook of music and Emotion: Theory, research, applications (pp. 73–97). Oxford: Oxford University Press.
Sloboda, J. A., & O’Neill, S. A. (2001). Emotions in everyday listening to music. In P. N. Juslin & J. A. Sloboda (Eds.), Music and emotion: Theory and research (pp. 415–429). Oxford: Oxford University Press.
Spenwyn, J., Barrett, D., & Griffiths, M. (2010). The role of light and music in gambling behaviour: An empirical pilot study. International Journal of Mental Health and Addiction, 8(1), 107–118. doi:10.1007/s11469-009-9226-0.
Thompson, W. F., Schellenberg, E. G., & Letnic, A. K. (2011). Fast and loud background music disrupts reading comprehension. Psychology of Music. doi:10.1177/0305735611400173.
Vickers, P., & Alty, J. L. (2002). When bugs sing. Interacting with Computers, 14(6), 793–819. doi:10.1016/S0953-5438(02)00026-7.
Waterhouse, J., Hudson, P., & Edwards, B. (2010). Effects of music tempo upon submaximal cycling performance. Scandinavian Journal of Medicine & Science in Sports, 20(4), 662–669. doi:10.1111/j.1600-0838.2009.00948.x.
Acknowledgments
Anna Bramwell-Dicks is supported by a UK Engineering and Physical Sciences Research Council Doctoral Training Account studentship.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag London
About this chapter
Cite this chapter
Bramwell-Dicks, A., Petrie, H., Edwards, A.D.N., Power, C. (2013). Affective Musical Interaction: Influencing Users’ Behaviour and Experiences with Music. In: Holland, S., Wilkie, K., Mulholland, P., Seago, A. (eds) Music and Human-Computer Interaction. Springer Series on Cultural Computing. Springer, London. https://doi.org/10.1007/978-1-4471-2990-5_4
Download citation
DOI: https://doi.org/10.1007/978-1-4471-2990-5_4
Published:
Publisher Name: Springer, London
Print ISBN: 978-1-4471-2989-9
Online ISBN: 978-1-4471-2990-5
eBook Packages: Computer ScienceComputer Science (R0)