Advertisement

AI & SOCIETY

, Volume 27, Issue 2, pp 213–222 | Cite as

Aesthetic strategies in sonification

  • Florian GrondEmail author
  • Thomas Hermann
Original Article

Abstract

Sound can be listened to in various ways and with different intentions. Multiple factors influence how and what we perceive when listening to sound. Sonification, the acoustic representation of data, is in essence just sound. It functions as sonification only if we make sure to listen attentively in order to access the abstract information it contains. This is difficult to accomplish since sound always calls the listener’s attention to concrete—whether natural or musical—points of references. Important aspects determining how we listen to sonification are discussed in this paper: elicited sounds, repeated sounds, conceptual sounds, technologically mediated sounds, melodic sounds, familiar sounds, multimodal sounds and vocal sounds. We discuss how these aspects help the listener engage with the sound, but also how they can become points of reference in and of themselves. The various sonic qualities employed in sonification can potentially open but also risk closing doors to the accessibility and perceptibility of the sonified data.

Keywords

Sonification Aesthetics Historic context 

Notes

Acknowledgements

Some historic aspects mentioned in this article have been published by the first author together with Theresa Schubert-Minski in the book see this sound Grond and Schubert-Minski (2009). The authors want to acknowledge further fruitful discussions with the participants of the Science by Ear symposium February 2010 in Graz. Finally, these thoughts were evaluated and compiled after integrating the important feedback from the sonification symposium March 2010 in Aix-en-Provence.

References

  1. Baier G, Hermann T (2008) Temporal perspective from auditory perception. In: Vrobel S, Rössler OE, Marks-Tarlow T (eds) Simultaneity: temporal structures and observer perspectives, Chap. 21. World Scientific, Singapore, pp 348–363Google Scholar
  2. Beller H (2011) Between the poles of mickey mousing and counterpoint. In: Daniels D, Naumann S (eds) Audiovisuology 2 essays. pp 102–119 Walther König, KölnGoogle Scholar
  3. Bonner F, Devleschoward A (1995) AAEM minimonograph #45: the early development of electromyography. Muscle Nerve 18:825–833CrossRefGoogle Scholar
  4. Bovermann T (2009) Tangible auditory interfaces: combining auditory displays and tangible interfaces. PhD thesis, Faculty of Technology, Bielefeld UniversityGoogle Scholar
  5. Cassidy RJ, Berger J, Lee K, Maggioni M, Coifman RR (2004) Auditory display of hyperspectral colon tissue images using vocal synthesis models. In: Barrass S, Vickers P (eds) Proceedings of the 10th international conference on auditory display (ICAD2004), Sydney, Australia, http://www.icad.org/Proceedings/2004/CassidyBerger2004.pdf
  6. Chion M (2008) Le phrase audio visuelle/die audiovisuelle phrasierung. In: Meyer PM (eds) Acoustic turn. Wilhelm Fink Verlag, MünchenGoogle Scholar
  7. d’Arsonval JA (1878) Telephone employe comme galvanoscope. Comptes rendus hebdomadaires des seances de l’Academie des sciences 86, Paris, pp 832–833Google Scholar
  8. de Campo A (2007) Toward a data sonification design space map. In: Scavone GP (ed) Proceedings of the 13th international conference on auditory display, Schulich School of Music, McGill University, Schulich School of Music, McGill University, Montreal, Canada, pp 342–347, http://www.icad.org/Proceedings/2007/deCampo2007.pdf
  9. Dolar M (2006) A voice and nothing more. MIT Press, Cambridge, MAGoogle Scholar
  10. Dombois F (2002) Auditory seismology on free oscillations, focal mechanisms, explosions and synthetic seismograms. In: Nakatsu R, Kawahara H (eds) proceedings of the 8th international conference on auditory display, advanced telecommunications research institute (ATR), Kyoto, Japan, ICAD, Kyoto, Japan, http://www.icad.org/Proceedings/2002/Dombois2002.pdf
  11. Dombois F (2008) Sonification, ein plädoyer, dem naturwissenschaftlichen verfahren eine kulturhistorische einschätzung zukommen zu lassen. In: Meyer PM (eds) Acoustic turn. Wilhelm Fink Verlag, MünchenGoogle Scholar
  12. Drake S (1980) Galileo. Oxford University Press, New YorkGoogle Scholar
  13. Flückiger B (2001) Sound design die virtuelle Klangwelt des films. Schüren, MarburgGoogle Scholar
  14. Garcia-Ruiz M, Gutierrez-Pulido J (2006) An overview of auditory display to assist comprehension of molecular information. Interact Comput 18(4):853–868CrossRefGoogle Scholar
  15. Gena P, Strom C (1995) Musical synthesis of DNA sequences. In: XI Colloquio di Informatica Musicale, Univeristà di Bologna, pp 203–204Google Scholar
  16. Grond F, Schubert-Minski T (2009) Sonification, scientific method and artistic practice. In: Daniels D, Naumann S (eds) Audiovisuology compendium, Verlag der Buchhandlung Walter König, Köln, vol 1, pp 285–295, http://beta.see-this-sound.at/kompendium/abstract/70
  17. Guttman S, Gilroy LA, Blake R (2005) Hearing what the eyes see. Psychol Sci 16(3):228–235CrossRefGoogle Scholar
  18. Hermann T (2002) Sonification for exploratory data analysis. PhD thesis, Bielefeld University, Bielefeld, GermanyGoogle Scholar
  19. Hermann T, Hunt A (2005) An introduction to interactive sonification (guest editors’ introduction). IEEE MultiMed 12(2):20–24CrossRefGoogle Scholar
  20. Hermann T, Ritter H (2004) Sound and meaning in auditory data display. Proceedings of the IEEE (special issue on engineering and music–supervisory control and auditory communication) 92(4):730–741Google Scholar
  21. Hermann T, Baier G, Stephani U, Ritter H (2006) Vocal sonification of pathologic EEG features. In: Stockman T (ed) Proceedings of the 12th international conference on auditory display. International Community for Auditory Display (ICAD), Department of Computer Science, Queen Mary, University of London UK, London, UK, pp 158–163Google Scholar
  22. Hofstadter DR (1980) Gödel, escher, bach, an eternal golden braid. Vintage Books, New YorkGoogle Scholar
  23. Kepler J (1967) Weltharmonik. Max Caspar, MunichzbMATHGoogle Scholar
  24. Kramer G (1994) An introduction to auditory display. In: Kramer G (eds) In auditory display. pp 1–79 Addison-Wesley, Boston, MAGoogle Scholar
  25. Licht A (2007) Sound art, beyond music, between categories. Rizzoli International Publications, Inc., New York, NYGoogle Scholar
  26. McGurk H, MacDonald J (1976) Hearing lips and seeing voices. Nat Biotechnol 264:746–748CrossRefGoogle Scholar
  27. Rilke RM (1919) Ur-Geräusch, soglio, am Tage Mariae Himmelfahrt 1919Google Scholar
  28. Vickers P (2005) Ars informatica-ars electronica: improving sonification aesthetics. In: HCI2005: workshop on understanding & designing for aesthetic experienceGoogle Scholar
  29. Vickers P, Hogg B (2006) Sonification abstraite/sonification concrète: an ‘æsthetic perspective space’ for classifying auditory displays in the ars musica domain. In: Proceedings of the 12th international conference on auditory display, London, UK, 20–23 June 2006Google Scholar
  30. Walker BN, Nance A, Lindsay J (2006) Spearcons: speech-based earcons improve navigation performance in auditory menus. In: Proceedings of the international conference on auditory display (ICAD 2006), London, pp 63–68Google Scholar
  31. Walton J (1952) The electromyogram in myopathy: analysis with the audio-frequency spectrometer. J Neurol Neurosurg Psychiatry 15:219–226CrossRefGoogle Scholar
  32. Wedenskii N (1883) Die telephonischen Wirkungen des erregten Nerven. Centralblatt für die medicinischen Wissenschaften 26:465–468Google Scholar
  33. Williamson J, Smith RM, Hughes S (2007) Shoogle: excitatory multimodal interaction on mobile devices. In: CHI 2007 Proceedings. Shake, Rattle & Roll: New Forms of Input & Output, San Jose, CA, USAGoogle Scholar
  34. Worrall D (2009) Sonification and information-concepts, instruments and techniques. PhD thesis, University of CanberraGoogle Scholar

Copyright information

© Springer-Verlag London Limited 2011

Authors and Affiliations

  1. 1.CITEC Cognitive Interaction Technology Centre of ExcellenceBielefeld UniversityBielefedGermany

Personalised recommendations