Sonification of Spatial Information: Audio-Tactile Exploration Strategies by Normal and Blind Subjects

  • Marta Olivetti Belardinelli
  • Stefano Federici
  • Franco Delogu
  • Massimiliano Palmiero
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5615)


On the basis of a meta-analysis of existing literature about sonification technologies, new experimental results on audio-tactile exploration strategies of georeferenced sonificated data by sighted and blind subjects are presented, discussing: technology suitability, subjects’ performances, accessibility and usability in the user/technology interaction.


sonification blindness mental mapping audio-tactile exploration strategies 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Alty, J.L., Rigas, D.: Communicating graphical information to blind users using music: the role of context. In: ACM CHI, pp. 574–581. ACM Press/Addison-Wesley Publishing Co, New York (1998)Google Scholar
  2. 2.
    Amedi, A., Stern, W.M., Camprodon, J.A., Bermpohl, F., Merabet, L., Rotman, S., Hemond, C., Meijer, P., Pascual-Leone, A.: Shape conveyed by visualto-auditory sensory substitution activates the lateral occipital complex. Nat. Neurosci. 10(6), 687–689 (2007)CrossRefGoogle Scholar
  3. 3.
    Avraamides, M., Loomis, J., Klatzky, R.L., Golledge, R.G.: Functional equivalence of spatial representations derived from vision and language: Evidence from allocentric judgments. J. Exp. Psychol. Learn. 30, 801–814 (2004)CrossRefGoogle Scholar
  4. 4.
    Berman, L., Danicic, S., Gallagher, K., Gold, N.: The Sound of Software: Using Sonification to Aid Comprehension. In: 14th IEEE International Conference on Program Comprehension, ICPC, IEEEXPLORE (2006)Google Scholar
  5. 5.
    Candey, R.M., Schertenleib, A.M., Diaz Merced, W.L.: Sonify sonification tool for space physics. In: ICAD, pp. 289–290 (2006)Google Scholar
  6. 6.
    Davies, T.C., Patla, A.E.: Obstacle Avoidance Strategies Using a Sonic Pathfinder. In: Canadian Society of Biomechanics, Halifax, Nova Scotia (2004)Google Scholar
  7. 7.
    Delogu, F., Federici, S., Olivetti Belardinelli, M.: La rappresentazione di mappe sonificate in soggetti ciechi: modalità e strategie di esplorazione audio-tattile. In 14th AIP (2008)Google Scholar
  8. 8.
    Delogu, F., Olivetti Belardinelli, M., Palmiero, M., Pasqualotto, E., Zhao, H., Plaisant, C., Federici, S.: Interactive sonification for blind people exploration of geo-referenced data: comparison between a keyboard-exploration and a haptic-exploration interfaces. In: Cogn. Process. 7 (suppl. 1), pp. 178–179 (2006)Google Scholar
  9. 9.
    Evreinova, T., Vesterinen, L., Evreinov, G., Raisamo, R.: Exploration of directional-predictive sounds for nonvisual interaction with graphs. Knowl. Inf. Syst. 13(2), 221–241 (2007)CrossRefGoogle Scholar
  10. 10.
    Garcia-Ruiz, M.A., Arthur, E., Aquino-Santos, R., Vargas Martin, M., Mendoza-Quezada, R.: Using Sonification to Teach Network Intrusion Detection: A Preliminary Usability Study. In: World Conference on Educational Multimedia, Hypermedia and Telecommunications, pp. 849–857. AACE, Cheasepeake (2007)Google Scholar
  11. 11.
    Golledge, R.G., Loomis, J.M., Klatzky, R.L., Flury, A., Yang, X.L.: Designing a personal guidance system to aid navigation without sight: progress on the GIS component. Int. J. Geo. Inf. Sci. 5(4), 373–395 (1991)CrossRefGoogle Scholar
  12. 12.
    Guizatdinova, I., Guo, Z.: Sonification of Facial Expressions. University of Tampere, New Interaction Techniques Finland (2003)Google Scholar
  13. 13.
    Heuten, W., Wichmann, D., Boll, S.: Interactive 3D Sonification for the Exploration of City Maps. In: NordiCHI, pp. 155–164 (2006)Google Scholar
  14. 14.
    Heyes, T.: Sonic Pathfinder. Electr. & Wireless World 90, 26–29 (1984)Google Scholar
  15. 15.
    Kawai, Y., Kobayashi, M., Minagawa, H., Miyakawa, M., Tomita, F.: A Support System for Visually Impaired Persons Using Three-Dimensional Virtual Sound. In: ICCHP 2000, pp. 327–334 (2000)Google Scholar
  16. 16.
    Kay, L.: Auditory perception of objects by blind persons, using a bioacoustic high resolution sonar. J. Acoustical Soc. Am. 107, 3266–3275 (2000)CrossRefGoogle Scholar
  17. 17.
    Kay, L.: Bioacoustic spatial perception by humans: a controlled laboratory measurement of spatial resolution without distal cues. J. Acoustical Soc. Am. 109, 803–808 (2001)CrossRefGoogle Scholar
  18. 18.
    Klatzky, R.L., Golledge, R.G., Loomis, J.M., Cicinelli, J.G., Pellegrino, J.W.: Performance of blind and sighted persons on spatial tasks. J. Visual. Impair. Blin. 89, 70–82 (1995)Google Scholar
  19. 19.
    Kramer, G., Walker, B.N., Bonebright, T., Cook, P., Flowers, J., Miner, N., et al.: The Sonification Report: Status of the Field and Research Agenda. In: Report prepared for the National Science Foundation by members of the International Community for Auditory Display. International Community for Auditory Display (ICAD), Santa Fe, NM (2006)Google Scholar
  20. 20.
    Lakatos, S.: Recognition of complex auditory-spatial patterns. Perception 22(3), 363–374 (1993)CrossRefGoogle Scholar
  21. 21.
    Maffiolo, V., Chateau, N., Mersiol, M.: The impact of the sonification of a vocal server on its usability and its user-frendliness. In: ICAD, pp. 130–134. Published by Advanced Telecommunications Research Institute (ATR), Kyoto (2002)Google Scholar
  22. 22.
    Mansur, D.L., Blattner, M., Joy, K.: Sound-Graphs: A numerical data analysis method for the blind. J. of Med. Sys. 9, 163–174 (1985)CrossRefGoogle Scholar
  23. 23.
    Meijer, P.B.: An experimental system for auditory image representations. IEEE Trans. Biomed. Eng. 39, 112–121 (1992)CrossRefGoogle Scholar
  24. 24.
    Merabet, L., Pogge, D., Stern, W., Bhatt, E., Hemond, C., Maguire, S., Meijer, P., Pascual-Leone, A.: Activation of visual cortex using crossmodal retinotopic Mapping. In: 14th HBM, the Annual Meeting of the Organization for Human Brain Mapping, Melburne, Australia (2008)Google Scholar
  25. 25.
    Milios, E., et al.: Sonification of range information for 3-D space perception. IEEE Trans. Neural Sys. Rehab. and Eng. 11(4), 416–421 (2003)CrossRefGoogle Scholar
  26. 26.
    Millar, S.: Understanding and representing space: theory and evidence from studies with blind and sighted children. Oxford University Press, Oxford (1994)CrossRefGoogle Scholar
  27. 27.
    Olivetti Belardinelli, M., Delogu, F., Palmiero, M., Federici, S., Pasqualotto, E., Zaho, H., Plaisant, C.: Interactive sonification of geographical maps: a behavioural study with blind subjects. In: 15th ESCOP (2007)Google Scholar
  28. 28.
    Parente, P., Bishop, G.: BATS: the blind audio tactile mapping system. In: ACM Annual Southeast Regional Conference (2003)Google Scholar
  29. 29.
    Pauletto, S., Hunt, A.: A Toolkit for Interactive Sonification. In: ICAD (2004)Google Scholar
  30. 30.
    Pfeiffer, D.G., Maffiolo, V., Chateau, N., Mersiol, M.: Listen and Learn: an Investigation of Sonification as an Instructional Variable to Improve Understanding of Complex Environments. Comput. Hum. Behav. 28(2), 475–485 (2008)CrossRefGoogle Scholar
  31. 31.
    Poguntke, M., Ellis, K.: Auditory attention control for human-computer interaction. In: Human System Interactions IEEEXPLORE, pp. 231–236 (2008)Google Scholar
  32. 32.
    Postma, A., Zuidhoek, S., Noordzij, M.L., Kappers, A.M.L.: Keep an eye on your hands: on the role of visual mechanisms in processing of haptic space. Cogn. Process. 9(1), 6–68 (2008)CrossRefGoogle Scholar
  33. 33.
    Ramloll, R., Yu, W., Riedel, B., Brewster, S.A.: Using non-speech sounds to improve access to 2D tabular numerical information for visually impaired users. In: Annual conference of British Computer Society (BCS) IHM-HCI, pp. 515–530. Springer, Heidelberg (2001)Google Scholar
  34. 34.
    Ungar, S.: Cognitive mapping without visual experience. In: Kitchin, R., Freundschuh, S. (eds.) Cogntive Mapping: Past, Present and Future, pp. 221–248. Routledge, London (2000)Google Scholar
  35. 35.
    Wickens, C.D.: Processing resources in attention. In: Parasuraman, R., Davies, R. (eds.) Varieties of attention, pp. 63–101. Academic Press, New York (1984)Google Scholar
  36. 36.
    Zhao, H., Plaisant, C., Shneiderman, B., Duraiswami, R.: Sonification of geo-referenced data for auditory information seeking: design principle and pilot study. In: ICAD (2004)Google Scholar
  37. 37.
    Zhao, H., Smith, B.K., Norman, K., Plaisant, C., Shneiderman, B.: Interactive Sonification of Choropleth Maps: Design and Evaluation. IEEE Multimedia 12(2), 26–35 (2005)CrossRefGoogle Scholar
  38. 38.
    Zhao, H., Shneiderman, B., Plaisant, C.: Listening to Choropleth Maps: Interactive Sonification of Geo-referenced Data for Users with Vision Impairment. In: Lazar, J. (ed.) Universal Usability, pp. 141–174. John Wiley & Sons Ltd., Hoboken (2008)Google Scholar
  39. 39.
    Zuidhoek, S.: Representation of space based on haptic input. Febodruck, Utrecht (2005)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Marta Olivetti Belardinelli
    • 1
    • 2
  • Stefano Federici
    • 2
    • 3
  • Franco Delogu
    • 1
  • Massimiliano Palmiero
    • 2
  1. 1.Department of PsychologySapienza’ University of RomeRomeItaly
  2. 2.ECONA, Interuniversity Centre for Research on Cognitive Processing in Natural and Artificial SystemsItaly
  3. 3.Department of Human and Educational SciencesUniversity of PerugiaPerugiaItaly

Personalised recommendations