Skip to main content

Making Data Sing: Embodied Approaches to Sonification

Part of the Lecture Notes in Computer Science book series (LNISA,volume 8905)

Abstract

We report on our experiences of two recent sonification pieces we have been involved in; composing for Peter Sinclair’s RoadMusic project, and creating a multi-speaker installation with sound artist Kaffe Matthews which sonifies the movement of sharks around the Galapagos islands.

We describe these pieces in terms of translation of data into different modalities, and extending the affective capacity of the listener, allowing the data to be experienced viscerally and in an embodied manner, as opposed to intellectually or symbolically. We will discuss how this intersects with theoretical discourses drawn from cognitive science and philosophy.

Keywords

  • Sonification
  • Embodiment
  • Affect
  • Enaction

This is a preview of subscription content, access via your institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-3-319-12976-1_9
  • Chapter length: 10 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
USD   84.99
Price excludes VAT (USA)
  • ISBN: 978-3-319-12976-1
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   109.99
Price excludes VAT (USA)
Fig. 1.
Fig. 2.

References

  1. Barrass, S., Vickers, P.: Sonification design and aesthetics. In: Hermann, T., Hunt, A., Neuhoff, J. (eds.) The Sonification Handbook. Logos Publishing House, Berlin (2011)

    Google Scholar 

  2. Ben-Tal, O., Berger, J.: Creative aspects of sonification. Leonardo Music J. 37(3), 229–233 (2004)

    CrossRef  Google Scholar 

  3. Campo, A., Frauenberger, C., Holdrich, R.: Designing a generalized sonification environment. In: Proceedings of the International Conference on Auditory Display, Sydney (2004)

    Google Scholar 

  4. Clark, A., Chalmers, D.: The extended mind. Analysis 58(1), 7–19 (1998)

    CrossRef  Google Scholar 

  5. Collins, N.: The analysis of generative music programs. Organised Sound 13(3), 237–248 (2008)

    CrossRef  Google Scholar 

  6. Deleuze, G., Guattari, F.: A Thousand Plateaus: Capitalism and Schizophrenia. Continuum, London (2003)

    Google Scholar 

  7. Deleuze, G.: Francis Bacon: The Logic of Sensation. University of Minnesota Press, Minneapolis (2004)

    Google Scholar 

  8. Gregg, M., Seigworth, G. (eds.): The Affect Theory Reader. Duke University Press, Durham (2010)

    Google Scholar 

  9. Hermann, T., Hunt, A., Neuhoff, J. (eds.): The Sonification Handbook. Logos Publishing House, Berlin (2011)

    Google Scholar 

  10. de Lange, C. Bird-man and ultrasound sharks tell of Galapagos damage. In: New Scientist. http://www.newscientist.com/blogs/culturelab/2012/05/galapagos-ultrasound.html

  11. Parkinson, A., Tanaka, A.: Composing for cars. In: Proceedings of the Sound Music Computing Conference, Stockholm (2013)

    Google Scholar 

  12. Polansky, L: Manifestation and Sonification (unpublished, 2002). http://eamusic.dartmouth.edu/larry/sonifi. Accessed 2 Oct 2013

  13. Polli, A.: Atmospherics/Weather Works: A Multi-Channel Storm Sonification Project. In: Proceedings of the International Conference on Auditory Display, Sydney (2004)

    Google Scholar 

  14. Salter, C., Baalman, M., Moody-Grigsby, D.: Between mapping, sonification and composition: responsive audio environments in live performance. In: Computer Music Modeling and Retrieval, Copenhagen (2007)

    Google Scholar 

  15. Sinclair, P., Tanaka, A., Hubnet, Y.: RoadMusic: music for your ride from your ride. In: Adjunct Proceedings Automotive UI, Salzburg (2011)

    Google Scholar 

  16. Sterne, J., Akiyama, M.: The recording that never wanted to be heard and other stories of sonification. In: The Oxford Handbook of Sound Studies. Oxford University Press, Oxford (2011)

    Google Scholar 

  17. Tanaka, A.: The sound of photographic image. Ai Soc. 27(2), 315–318 (2012)

    CrossRef  Google Scholar 

  18. Varela, F., Thompson, E., Rosch, E.: The Embodied Mind: Cognitive Science and Human Experience. MIT Press, Cambridge (1993)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Adam Parkinson .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this paper

Cite this paper

Parkinson, A., Tanaka, A. (2014). Making Data Sing: Embodied Approaches to Sonification. In: Aramaki, M., Derrien, O., Kronland-Martinet, R., Ystad, S. (eds) Sound, Music, and Motion. CMMR 2013. Lecture Notes in Computer Science(), vol 8905. Springer, Cham. https://doi.org/10.1007/978-3-319-12976-1_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-12976-1_9

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-12975-4

  • Online ISBN: 978-3-319-12976-1

  • eBook Packages: Computer ScienceComputer Science (R0)