Skip to main content

Affective Musical Interaction: Influencing Users’ Behaviour and Experiences with Music

  • Chapter
  • First Online:

Part of the book series: Springer Series on Cultural Computing ((SSCC))

Abstract

In Human-Computer Interaction (HCI) use of the auditory channel normally involves communicating information to users in the form of short, auditory messages. Given the recent trend of HCI research towards incorporating experiential objectives, we propose that the auditory channel could also be exploited for affective intent. In particular, music could be integrated within interactive technologies as a vehicle to influence users’ behaviour and their experiences. This chapter describes some of the research conducted from other fields that already embrace the affective characteristic of music within their context. The limited amount of research exploiting music affectively in an HCI environment is discussed; including a review of our previous work involving Ambient Music Email (AME), an affective musical extension for email clients. By reflecting on how other subjects investigate the affective nature of music, this chapter aims to show that the HCI field is falling behind and inspire further work in this area. In fact, there are a wide variety of potential motivations for working with affective musical interaction, with a vast realm of potential research avenues, some of which are proposed here.

Keywords

These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  • Alty, J. L., Rigas, D., & Vickers, P. (1997). Using music as a communication medium. In CHI ‘97 extended abstracts on human factors in computing systems: Looking to the future (pp. 30–31) Atlanta, Georgia: ACM, 1120234. doi:10.1145/1120212.1120234

  • Areni, C. S., & Kim, D. (1993). The influence of background music on shopping behavior: Classical versus Top-Forty music in a wine store. Advances in Consumer Research, 20(1), 336–340.

    Google Scholar 

  • Bishop, D. T., Karageorghis, C. I., & Georgios, L. (2007). A grounded theory of young tennis players’ use of music to manipulate emotional state. Journal of Sport & Exercise Psychology, 29, 584–607.

    Google Scholar 

  • Blattner, M. M., Sumikawa, D. A., & Greenberg, R. M. (1989). Earcons and icons: Their structure and common design principles. Human Computer Interaction, 4(1), 11–44. doi:10.1207/s15327051hci0401_1.

    Article  Google Scholar 

  • Bramwell-Dicks, A. (2010). Towards AME: Exploring the use of ambient music within an email interface. Dissertation, University of York, York.

    Google Scholar 

  • Bramwell-Dicks, A., Petrie, H., Edwards, A. D. N., & Power, C. (2011). Affecting user behaviour and experience with music: A research agenda. BCS HCI workshop “When words fail: What can music interaction tell us about HCI?” 8 May 2011. Northumbria University, Newcastle Upon Tyne. http://mcl.open.ac.uk/Workshop. Accessed 8 Mar 2012.

  • Brewster, S. A. (1998). Sonically-enhanced drag and drop. Paper presented at the international conference on auditory display, Glasgow, 1–4 Nov.

    Google Scholar 

  • Brewster, S. A. (2002). Overcoming the lack of screen space on mobile computers. Personal and Ubiquitous Computing, 6(3), 188–205. doi:10.1007/s007790200019.

    Article  Google Scholar 

  • Brewster, S. A. (2003). Non-speech auditory output. In J. A. Jacko & A. Sears (Eds.), The human computer interaction handbook: Fundamentals, evolving technologies and emerging applications (pp. 220–240). London: Lawrence Erlbaum Associates Inc.

    Google Scholar 

  • Brown, M. H., & Hershberger, J. (1992). Color and sound in algorithm animation. Computer, 25(12), 52–63. doi:10.1109/2.179117.

    Article  Google Scholar 

  • Bullerjahn, C., & Güldenring, M. (1994). An empirical investigation of effects of film music using qualitative content analysis. Psychomusicology, 13, 99–118.

    Article  Google Scholar 

  • Caldwell, C., & Hibbert, S. A. (2002). The influence of music tempo and musical preference on restaurant patrons’ behavior. Psychology and Marketing, 19(11), 895–917. doi:10.1002/mar.10043.

    Article  Google Scholar 

  • Cassidy, G. G., & MacDonald, R. A. R. (2010). The effects of music on time perception and performance of a driving game. Scandinavian Journal of Psychology, 51(6), 455–464. doi:10.1111/j.1467-9450.2010.00830.x.

    Article  Google Scholar 

  • Dixon, L., Trigg, R., & Griffiths, M. (2007). An empirical investigation of music and gambling behaviour. International Gambling Studies, 7(3), 315–326. doi:10.1080/14459790701601471.

    Article  Google Scholar 

  • Edwards, A. D. N. (1989). Soundtrack: An auditory interface for blind users. Human Computer Interaction, 4(1), 45–66. doi:10.1207/s15327051hci0401_2.

    Article  Google Scholar 

  • Edworthy, J., & Waring, H. (2006). The effects of music tempo and loudness level on treadmill exercise. Ergonomics, 49(15), 1597–1610. doi:10.1080/00140130600899104.

    Article  Google Scholar 

  • Gaver, W. W. (1986). Auditory icons: Using sound in computer interfaces. Human Computer Interaction, 2(2), 167–177. doi:10.1207/s15327051hci0202_3.

    Article  Google Scholar 

  • Gfeller, K., Asmus, E., & Eckert, M. (1991). An investigation of emotional response to music and text. Psychology of Music, 19(2), 128–141. doi:10.1177/0305735691192004.

    Article  Google Scholar 

  • Gosselin, N., Samson, S., Adolphs, R., Noulhiane, M., Roy, M., Hasboun, D., Baulac, M., & Peretz, I. (2006). Emotional responses to unpleasant music correlates with damage to the parahippocampal cortex. Brain, 129(10), 2585–2592. doi:10.1093/brain/awl240.

    Article  Google Scholar 

  • Griffiths, M., & Parke, J. (2005). The psychology of music in gambling environments: An observational research note. Journal of Gambling Issues, 13. doi:10.4309/jgi.2005.13.8.

  • Hébert, S., Béland, R., Dionne-Fournelle, O., Crête, M., & Lupien, S. J. (2005). Physiological stress response to video-game playing: The contribution of built-in music. Life Sciences, 76(20), 2371–2380. doi:10.1016/j.lfs.2004.11.011.

    Article  Google Scholar 

  • Hodges, D. A. (2010). Psychophysiological measures. In P. N. Juslin & J. A. Sloboda (Eds.), Handbook of music and emotion: Theory, research, applications (pp. 279–311). Oxford: Oxford University Press.

    Google Scholar 

  • Jensen, M. B. (1931). The influence of jazz and dirge music upon speed and accuracy of typing. Journal of Educational Psychology, 22(6), 458–462. doi:10.1037/h0074752.

    Article  Google Scholar 

  • Jones, M., Jones, S., Bradley, G., Warren, N., Bainbridge, D., & Holmes, G. (2008). ONTRACK: Dynamically adapting music playback to support navigation. Personal and Ubiquitous Computing, 12(7), 513–525. doi:10.1007/s00779-007-0155-2.

    Article  Google Scholar 

  • Juslin, P. N., & Sloboda, J. A. (2010). Handbook of music and emotion: Theory, research, applications. Oxford: Oxford University Press.

    Google Scholar 

  • Juslin, P. N., & Västfjäll, D. (2008). Emotional responses to music: The need to consider underlying mechanisms. The Behavioral and Brain Sciences, 31(5), 559–575. doi:10.1017/S0140525X08005293.

    Google Scholar 

  • Kennedy, M., & Kennedy, J. (2007). “discord”. The concise oxford dictionary of music. Oxford: Oxford University Press.

    Google Scholar 

  • Kotler, P. (1973). Atmospherics as a marketing tool. Journal of Retailing, 49(4), 48.

    Google Scholar 

  • Krumhansl, C. L. (1997). An exploratory study of musical emotions and psychophysiology. Canadian Journal of Experimental Psychology, 51(4), 336–353. doi:10.1037/1196-1961.51.4.336.

    Article  Google Scholar 

  • Larson, R., & Csikszentmihalyi, M. (1983). The experience sampling method. New Directions for Methodology of Social & Behavioral Science, 15, 41–56.

    Google Scholar 

  • Livingstone, S. R., Mühlberger, R., Brown, A. R., & Loch, A. (2007). Controlling musical emotionality: An affective computational architecture for influencing musical emotions. Digital Creativity, 18(1), 43–53. doi:10.1080/14626260701253606.

    Article  Google Scholar 

  • Lundqvist, L.-O., Carlsson, F., Hilmersson, P., & Juslin, P. N. (2009). Emotional responses to music: Experience, expression, and physiology. Psychology of Music, 37(1), 61–90. doi:10.1177/0305735607086048.

    Article  Google Scholar 

  • Lychner, J. A. (1998). An empirical study concerning terminology relating to aesthetic response to music. Journal of Research in Music Education, 46(2), 303–319. doi:10.2307/3345630.

    Article  Google Scholar 

  • Mansur, D. L., Blattner, M. M., & Joy, K. I. (1985). Sound graphs: A numerical data analysis method for the blind. Journal of Medical Systems, 9(3), 163–174. doi:10.1007/bf00996201.

    Article  Google Scholar 

  • Milliman, R. E. (1982). Using background music to affect the behavior of supermarket shoppers. The Journal of Marketing, 46(3), 86–91. doi:10.2307/1251706.

    Article  Google Scholar 

  • Milliman, R. E. (1986). The influence of background music on the behavior of restaurant patrons. Journal of Consumer Research, 13(2), 286–289. doi:10.1086/209068.

    Article  Google Scholar 

  • North, A. C., Hargreaves, D. J., & McKendrick, J. (1999). The influence of in-store music on wine selections. Journal of Applied Psychology, 84(2), 271–276. doi:10.1037/0021-9010.84.2.271.

    Article  Google Scholar 

  • Quinn, M., & Meeker L. D. (2001). Research set to music: The climate symphony and other sonifications of ice core, radar, DNA, seismic and solar wind data. Paper presented at the international conference on auditory display, Espoo, Finland, 29 July–1 August.

    Google Scholar 

  • Richards, D., Fassbender, E., Bilgin, A., & Thompson, W. F. (2008). An investigation of the role of background music in IVWs for learning. Research in Learning Technology, 16(3), 231–244. doi:10.1080/09687760802526715.

    Article  Google Scholar 

  • Sanders, T., & Cairns, P. (2010). Time perception, immersion and music in videogames. Paper presented at BCS HCI, University of Abertay, Dundee, 6–10 Sept.

    Google Scholar 

  • Sanderson, P. (2006). The multimodal world of medical monitoring displays. Applied Ergonomics, 37(4), 501–512. doi:10.1016/j.apergo.2006.04.022.

    Article  Google Scholar 

  • Shiels, M. (2010). Google’s priority inbox aims to conquer e-mail overload BBC. http://www.bbc.co.uk/news/technology-11133576. Accessed 8 Mar 2011.

  • Simpson, S. D., & Karageorghis, C. I. (2006). The effects of synchronous music on 400-m sprint performance. Journal of Sports Sciences, 24(10), 1095–1102. doi:10.1080/02640410500432789.

    Article  Google Scholar 

  • Sloboda, J. A. (2010). Music in everyday life: The role of emotions. In P. N. Juslin & J. A. Sloboda (Eds.), Handbook of human emotion: Theory, research, applications (pp. 493–514). Oxford: Oxford University Press.

    Google Scholar 

  • Sloboda, J. A., & Juslin, P. N. (2010). At the interface between the inner and outer world: Psychological perspectives. In P. N. Juslin & J. A. Sloboda (Eds.), Handbook of music and Emotion: Theory, research, applications (pp. 73–97). Oxford: Oxford University Press.

    Google Scholar 

  • Sloboda, J. A., & O’Neill, S. A. (2001). Emotions in everyday listening to music. In P. N. Juslin & J. A. Sloboda (Eds.), Music and emotion: Theory and research (pp. 415–429). Oxford: Oxford University Press.

    Google Scholar 

  • Spenwyn, J., Barrett, D., & Griffiths, M. (2010). The role of light and music in gambling behaviour: An empirical pilot study. International Journal of Mental Health and Addiction, 8(1), 107–118. doi:10.1007/s11469-009-9226-0.

    Article  Google Scholar 

  • Thompson, W. F., Schellenberg, E. G., & Letnic, A. K. (2011). Fast and loud background music disrupts reading comprehension. Psychology of Music. doi:10.1177/0305735611400173.

  • Vickers, P., & Alty, J. L. (2002). When bugs sing. Interacting with Computers, 14(6), 793–819. doi:10.1016/S0953-5438(02)00026-7.

    Article  Google Scholar 

  • Waterhouse, J., Hudson, P., & Edwards, B. (2010). Effects of music tempo upon submaximal cycling performance. Scandinavian Journal of Medicine & Science in Sports, 20(4), 662–669. doi:10.1111/j.1600-0838.2009.00948.x.

    Google Scholar 

Download references

Acknowledgments

Anna Bramwell-Dicks is supported by a UK Engineering and Physical Sciences Research Council Doctoral Training Account studentship.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Anna Bramwell-Dicks .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag London

About this chapter

Cite this chapter

Bramwell-Dicks, A., Petrie, H., Edwards, A.D.N., Power, C. (2013). Affective Musical Interaction: Influencing Users’ Behaviour and Experiences with Music. In: Holland, S., Wilkie, K., Mulholland, P., Seago, A. (eds) Music and Human-Computer Interaction. Springer Series on Cultural Computing. Springer, London. https://doi.org/10.1007/978-1-4471-2990-5_4

Download citation

  • DOI: https://doi.org/10.1007/978-1-4471-2990-5_4

  • Published:

  • Publisher Name: Springer, London

  • Print ISBN: 978-1-4471-2989-9

  • Online ISBN: 978-1-4471-2990-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics