Sonification and HCI

  • Visda GoudarziEmail author
Part of the Human–Computer Interaction Series book series (HCIS)


This chapter investigates the second and third wave HCI design processes for an auditory display design and proposes a multifaceted framework. The purpose of using such a framework in a participatory context is to provide the possibility to create shared design knowledge in sonification and building new sonification designs on top of the prior work. From the early stages of the project involving the domain scientists in the process seemed to be an obvious choice. The process works in the sense that we gathered a diverse set of data analysis problems, solutions, and methods that work for data scientists within a sonification framework.


  1. Alais D, Burr D (2004) The ventriloquist effect results from near optimal bimodal integration. Curr Biol 14(3):257–262CrossRefGoogle Scholar
  2. Alexander RL, O’Modhrain S, Roberts DA et al (2014) The bird’s ear view of space physics: audification as a tool for the spectral analysis of time series data. J Geophys Res Space Phys 119(7):5259–5271CrossRefGoogle Scholar
  3. Anderson RJ (1994) Representations and requirements: the value of ethnography in system design. Human Comput Interact 9(3):151–182CrossRefGoogle Scholar
  4. Barrass S (1996) Tada! Demonstrations of auditory information design. Unpublished PhD thesisGoogle Scholar
  5. Barrass S (2003) Sonification design patterns. In: Proceedings of International conference on auditory display, BostonGoogle Scholar
  6. Ben-Tal O, Berger J, Cook B et al (2002) The sonification application research toolbox. In: Proceedings of International conference on auditory display, KyotoGoogle Scholar
  7. Bieusheuvel S (1947) Psychological tests and their application to non-European peoples. In: Yearbook of education. Evans, London, pp 185–207Google Scholar
  8. Bregman AS (1994) Auditory scene analysis: the perceptual organization of sound. MIT Press, CambridgeGoogle Scholar
  9. Brewster S (1994) Providing a structured method for integrating non-speech audio into human-computer interfaces. Unpublished PhD thesisGoogle Scholar
  10. Candey RM, Schertenleib AM, Merced WL (2006) Xsonify sonification tool for space physics. In: Proceedings of International conference on auditory display, LondonGoogle Scholar
  11. Carroll JM, Chin G, Rosson MB, et al (2000) The development of cooperation: five years of participatory design in the virtual school. In: Proceedings on designing interactive systems: processes, practices, methods, and techniques. Association for Computing Machinery, New York, pp 239–251Google Scholar
  12. Dahl L, Herrera J, Wilkerson C (2011) Tweetdreams: making music with the audience and the world using real-time twitter data. In: Jensenius AR, Tveit A, Godøy RI et al (eds) Proceedings of the international conference on new interfaces for musical expression (NIME) Oslo, pp 272–275Google Scholar
  13. de Campo A (2007). A data sonification design space map. In: Proceedings of the 2nd International workshop on interactive sonification, YorkGoogle Scholar
  14. de Campo A, Daye C, Frauenberger C et al (2006) Sonification as an interdisciplinary working process. In: Proceedings of International conference on auditory display, LondonGoogle Scholar
  15. Dombois F (2001) Using audification in planetary seismology. In: Hiipakka J, Zacharov N, Takala T (eds) Proceedings of the 7th International conference on auditory display, Espoo, pp 227–230Google Scholar
  16. Droumeva M, Wakkary R (2006). The role of participatory workshops in investigating narrative and sound ecologies in the design of an ambient intelligence audio display. In: Stockman T, Nickerson LV, Frauenberger C et al (eds) Proceedings of the international conference on auditory display, London, pp 36–43Google Scholar
  17. Fischer G (1993) Beyond human computer interaction: designing useful and usable computational environments. In: People and computers VIII: proceedings of the HCI’93 conference (Loughborough, England), Cambridge University Press, Cambridge, UK, pp 17–31Google Scholar
  18. Fischer G (1994) Putting the owners of problems in charge with domain-oriented design environments. In: Gilmore D, Winder R, Detienne F (eds) User-centered requirements for software engineering environments. Springer, Heidelberg, pp 297–306CrossRefGoogle Scholar
  19. Fischer G, Giaccardi E (2006) Meta-design: a framework for the future of end-user development. In: Lieberman H, Paternò F, Wulf V (eds) End user development. Springer, Dordrecht, pp 427–457CrossRefGoogle Scholar
  20. Flowers JH (2005) Thirteen years of reflection on auditory graphing: promises, pitfalls, and potential new directions. In: Brazil E (ed) Proceedings of International conference on auditory display, LimerickGoogle Scholar
  21. Flowers JH, Turnage KD, Buhman DC (2005) Desktop data sonification: comments on flowers et al ICAD 1996. ACM Trans Appl Percept 2(4):473–476CrossRefGoogle Scholar
  22. Frauenberger C, Stockman T (2009) Auditory display design—an investigation of a design pattern approach. Int J Hum Comput Stud 67(11):907–922CrossRefGoogle Scholar
  23. Gaver W (1993) How in the world do we hear? Explorations in ecological acoustics. Ecol Psychol 5:283–313Google Scholar
  24. Gaver W (1994) Using and creating auditory icons. In: Kramer G (ed) Auditory display: sonification, audification and auditory interfaces. Addison-Wesley Publishing, Reading, pp 417–446Google Scholar
  25. Gaver W, Smith RB, O’Shea T (1991) Effective sounds in complex systems: the ARKola simulation. In: Robertson S, Olson G, Olson JS (eds) Proceedings of the SIGCHI conference on human factors in computing systems, New Orleans, pp 85–90Google Scholar
  26. Giaccardi E, Fischer G (2008) Creativity and evolution: a metadesign perspective. Digital Creativity 19(1):19–32CrossRefGoogle Scholar
  27. Gregory J (2003) Scandinavian approaches to participatory design. Int J Eng Educ 19(1):62–74MathSciNetGoogle Scholar
  28. Grinstein G, Smith S (1990) The perceptualization of scientific data. In: Proceedings of the SPIE/SPSE conference on electronic imaging, pp 190–199Google Scholar
  29. Harrison S, Tatar D, Sengers P (2007) The three paradigms of HCI. In: Alt. Chi. Session at the SIGCHI Conference on human factors in computing systems, San Jose, California, USA, pp 1–18Google Scholar
  30. Henneman RH, Long ER (1954) A comparison of the visual and auditory senses as channels for data presentation. In: Technical report 54(363). Wright Air Development Center, DaytonGoogle Scholar
  31. Hermann T (2002) Sonification for exploratory data analysis. PhD thesis, Universität BielefeldGoogle Scholar
  32. Hermann T (2008) Taxonomy and definitions for sonification and auditory display. In: Susini OW (ed) Proceedings of the 14th International conference on auditory display, ParisGoogle Scholar
  33. Hermann T, Baier G, Stephani U, et al (2006) Vocal Sonification of pathologic EEG features. In: Stockman T, Nickerson LV, Frauenberger C et al (eds) Proceedings of the 12th International conference on auditory display, LondonGoogle Scholar
  34. Hermann T, Nehls AV, Eitel F et al (2012) Tweetscapes: Real-time sonification of twitter data streams for radio broadcasting. In: Nees MA, Walker BN, Freeman J (eds) Proceedings of ICAD, AtlantaGoogle Scholar
  35. Holmquist LE (2008) Bootlegging: multidisciplinary brainstorming with cut-ups. In: Simonsen J, Roberston T (eds) Proceedings of the tenth anniversary conference on participatory design. Indiana University, pp 158–161Google Scholar
  36. Janata P, Childs E (2004) MarketBuzz: a Sonification of real-time financial data. In: Barrass S, Vickers P (eds) Proceedings of the tenth international conference on auditory display, SydneyGoogle Scholar
  37. Kim R, Peters MA, Shams L (2012) 0+ 1> 1 how adding non-informative sound improves performance on a visual task. Psychol Sci 23(1):6–12CrossRefGoogle Scholar
  38. Kramer G, Walker B, Bonebright T et al (1999) Sonification report: status of the field and research agenda, report prepared for the National Science Foundation by members of the International Community for Auditory Display, available via Accessed 1 Jan 2018
  39. Kramer G, Walker B, Bonebright T et al (2000) Sonification report: Status of the field and research agenda, available via Accessed 01 Jan 2018
  40. Lennox PP, Myatt T, Vaughan JM (1999) From surround to true 3-d. In: 16th International Audio Engineering Society conference on spatial sound reproduction, Rovaniemi, FinlandGoogle Scholar
  41. Mackay WE (2002) Video to support interaction design, DVD. ACM, New York. ISBN: 1-58113-516-5Google Scholar
  42. Mynatt ED (1997) Auditory icons. In: Hearst MA (ed) Dissonance on audio interfaces. IEEE Intelligent Systems, vol 12, pp 10–16Google Scholar
  43. Norman DA, Draper SW (1986) User centered system design. L. Erlbaum Associates, HillsdaleGoogle Scholar
  44. Numa K, Toriumi K, Tanaka K et al (2008) Knowledge-based intelligent information and engineering systems. Springer, Berlin, pp 823–830CrossRefGoogle Scholar
  45. Oulasvirta A, Kurvinen E, Kankainen T (2003) Understanding contexts by being there: case studies in bodystorming. Pers Ubiquit Comput 7(2):125–134CrossRefGoogle Scholar
  46. Perrott DR, Saberi K, Brown K et al (1990) Auditory psychomotor coordination and visual search performance. Percept Psychophys 48(3):214–226CrossRefGoogle Scholar
  47. Rogers Y, Preece J, Sharp H (2002) Interaction design: beyond human-computer interaction. Wiley, New YorkGoogle Scholar
  48. Sanderson P, Anderson J, Watson M (2000) Extending ecological interface design to auditory displays. In: Proceedings of the 10th Australasian conference on computer-human interaction, SydneyGoogle Scholar
  49. Schoon A, Dombois F (2009) Sonification in music. In: International conference on auditory display, CopenhagenGoogle Scholar
  50. Schuler D, Namioka A (1993) Participatory design: principles and practices. L. Erlbaum Associates, HillsdaleGoogle Scholar
  51. Soto-Faraco S, Spence C, Kingstone A (2004) Cross-modal dynamic capture: congruency effects in the perception of motion across sensory modalities. J Exp Psychol Hum Percept Perform 30:330–345CrossRefGoogle Scholar
  52. Spinuzzi C (2005) The methodology of participatory design. Tech Commun 52(2):163–174Google Scholar
  53. Svanaes, D, Seland G (2004) Putting the users center stage: role playing and low-fi prototyping enable end users to design mobile systems. In Proceedings of the SIGCHI conference on Human factors in computing systems, ViennaGoogle Scholar
  54. Taxén G (2004) Introducing participatory design in museums. In: Proceedings of the eighth conference on participatory design: artful integration: interweaving media, materials and practices, TorontoGoogle Scholar
  55. Walker BN, Cothran JT (2003) Sonification sandbox: a graphical toolkit for auditory graphs. In: Proceedings of International conference on auditory display, BostonGoogle Scholar
  56. Ware C (2000) Information visualization: perception for design. Morgan Kaufman, San FranciscoGoogle Scholar
  57. Welch RB, Warren DH (1980) Immediate perceptual response to intersensory discrepancy. Psychol Bull 88(3):638CrossRefGoogle Scholar
  58. Worrall D (2009) The use of sonic articulation in identifying correlation in capital market trading data. In: Proceedings of the 15th International conference on auditory display, CopenhagenGoogle Scholar
  59. Worrall D (2015) Realtime sonification and visualisation of network metadata. In Proceedings of the 21st International conference on auditory display, GrazGoogle Scholar
  60. Worrall D, Bylstra M, Barrass S et al (2007) The design of an extendable software framework for sonification research and auditory display. In: Proceedings of International conference on auditory display, MontrealGoogle Scholar
  61. Yamauchi Y, Swanson EB (2010) Local assimilation of an enterprise system: situated learning by means of familiarity pockets. Inf Organ 20(3–4):187–206CrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG, part of Springer Nature 2018

Authors and Affiliations

  1. 1.Audio Arts and Acoustics, Columbia College ChicagoChicagoUSA

Personalised recommendations