Visual Attention in Auditory Display

  • Thorsten Mahler
  • Pierre Bayerl
  • Heiko Neumann
  • Michael Weber
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4021)


The interdisciplinary field of image sonification aims at the transformation of images to auditory signals. It brings together researchers from different fields of computer science like sound synthesizing, data mining and human computer interaction. Its goal is the use of sound and all its attributes to display the data sets itself and thus making the highly developed human aural system usable for data analysis. Unlike previous approaches we aim to sonify images of any kind. We propose that models of visual attention and visual grouping can be utilized to dynamically select relevant visual information to be sonified. For the auditory synthesis we employ an approach, which takes advantage of the sparseness of the selected input data. The presented approach proposes a combination of data sonification approaches, such as auditory scene generation, and models of human visual perception. It extends previous pixel-based transformation algorithms by incorporating mid-level vision coding and high-level control. The mapping utilizes elaborated sound parameters that allow non-trivial orientation and positioning in 3D space.


Visual Attention Auditory Signal Visual Grouping Sonify Image Human Visual Perception 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. [Fischer et al., 2004]
    Fischer, Bayerl, Neumann, Christobal, Redondo: Are iterations and curvature useful for tensor voting? In: Pajdla, T., Matas, J(G.) (eds.) ECCV 2004. LNCS, vol. 3023, pp. 158–169. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  2. [Gonzalez and Woods, 2001]
    Gonzalez, R.C., Woods, R.E.: Digital Image Processing. Addison-Wesley Longman Publishing Co. Inc., Boston (2001)Google Scholar
  3. [Hermann et al., 2000a]
    Hermann, T., Meinicke, P., Ritter, H.: Principal curve sonification. In: Cook, P.R. (ed.) Proc. of the Int. Conf. on Auditory Display, pp. 81–86. Int. Community for Auditory Display (2000a)Google Scholar
  4. [Hermann et al., 2000b]
    Hermann, T., Nattkemper, T., Schubert, W., Ritter, H.: Sonification of multi-channel image data. In: Falavar, V. (ed.) Proc. of the Mathematical and Engineering Techniques in Medical and Biological Sciences (METMBS 2000), pp. 745–750. CSREA Press (2000b)Google Scholar
  5. [Itti et al., 1998]
    Itti, L., Koch, C., Niebur, E.: A model of saliency-based visual attention for rapid scene analysis. IEEE Trans. Pattern Anal. Machine Intell. 20(11), 1254–1259 (1998)CrossRefGoogle Scholar
  6. [Krüger and Wörgötter, 2005]
    Krüger, N., Wörgötter, F.: Symbolic pointillism: Computer art motivated by human brain structures. Leonardo 38(4), 337–340 (2005)CrossRefGoogle Scholar
  7. [Marr, 1982]
    Marr, D.: Vision. W.H. Freeman and Company, New York (1982)Google Scholar
  8. [Martins et al., 2001]
    Martins, A.C.G., Rangayyan, R.M., Ruschioni, R.A.: Audification and sonification of texture in images. Journal of Electronic Imaging 10(3), 690–705 (2001)CrossRefGoogle Scholar
  9. [Meijer, 1992]
    Meijer, P.B.: An experimental system for auditory image representation. IEEE Transactions on Biomedical Engineering 39(2), 112–121 (1992)CrossRefGoogle Scholar
  10. [Rath and Rocchesso, 2005]
    Rath, M., Rocchesso, D.: Continuous sonic feedback from a rolling ball. IEEE Multimedia 12(2), 60–69 (2005)CrossRefGoogle Scholar
  11. [Simoncelli and Heeger, 1998]
    Simoncelli, E.P., Heeger, D.J.: A model of neuronal responses in visual area MT. Vision Research 38(5), 743–761 (1998)CrossRefGoogle Scholar
  12. [Trucco and Verri, 1998]
    Trucco, E., Verri, A.: Introductory Techniques for 3-D Computer Vision. Prentice Hall PTR, Upper Saddle River (1998)Google Scholar
  13. [Weidenbacher et al., 2005]
    Weidenbacher, U., Bayerl, P., Fleming, R., Neumann, H.: Extracting and depicting the 3d shape of specular surfaces. In: Siggraph Symposium on Applied Perception and Graphics in Visualization, pp. 83–86. ACM, New York (2005)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Thorsten Mahler
    • 1
  • Pierre Bayerl
    • 2
  • Heiko Neumann
    • 2
  • Michael Weber
    • 1
  1. 1.Department of Media Informatics 
  2. 2.Department of Neuro InformaticsUniversity of UlmUlmGermany

Personalised recommendations