Vision Substitution Experiments with See ColOr

  • Guido Bologna
  • Juan Diego Gomez
  • Thierry Pun
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7930)


See ColOr is a mobility aid for visually impaired people that uses the auditory channel to represent portions of captured images in real time. A distinctive feature of the See ColOr interface is the simultaneous coding of colour and depth. Four main modules were developed, in order to replicate a number of mechanisms present in the human visual systems. In this work, we first present the main experiments carried out in the first years of the project; among them : the avoidance of obstacles, the recognition and localization of objects, the detection of edges and the identification of coloured targets. Finally, we introduce new undergoing experiments in Colombia with blind persons, whose purpose is (1) to determine and to touch a target; (2) to navigate and to find a person; and (3) to find particular objects. Preliminary results illustrate encouraging results.


3D-vision vision substitution colour-depth sonification human-computer interaction 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Bologna, G., Deville, B., Vinckenbosch, M., Pun, T.: A perceptual interface for vision Ssubstitution in a color matching experiment. In: Proc. Int. Joint Conf. Neural Networks, Part of IEEE World Congress on Computational Intelligence, Hong Kong, June 1-6, pp. 1621–1628 (2008)Google Scholar
  2. 2.
    Bologna, G., Deville, B., Pun, T.: Blind navigation along a sinuous path by means of the See ColOr interface. In: Mira, J., Ferrández, J.M., Álvarez, J.R., de la Paz, F., Toledo, F.J. (eds.) IWINAC 2009, Part II. LNCS, vol. 5602, pp. 235–243. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  3. 3.
    Bologna, G., Deville, B., Gomez, J.D., Pun, T.: Toward local and global perception modules for vision substitution. Neurocomputing 74(8), 1182–1190 (2011)CrossRefGoogle Scholar
  4. 4.
    Gomez, J.D., Bologna, G., Deville, B., Pun, T.: Multisource sonification for visual substitution in an auditory memory game: one or two fingers? In: Proc. of the 17th International Conference on Auditory Display, Budapest, Hungary, June 20-23, pp. 1529–1534 (2011)Google Scholar
  5. 5.
    Gomez, J.D., Mohammed, S., Bologna, G., Pun, T.: 3D Scene accesibility for the blind via auditory-multitouch interfaces. In: Proc. of the AEGIS Workshop and International Conference (Accessibility Reaching Everywhere), Brussells, Belgium, November 28-30 (2011)Google Scholar
  6. 6.
    Gomez, J.D., Bologna, G., Pun, T.: Spatial awareness and intelligibility for the blind: audio-touch interfaces. In: Proc. of CHI 2012 (International Conference on Human-Computer Interaction), Austin, Texas, US, May 5-10, pp. 1529–1534 (2012)Google Scholar
  7. 7.
    Gomez, J.D., Bologna, G., Pun, T.: Non-visual-cueing-based sensing and understanding. In: Proc. of the 14th International ACM SIGACCESS Conference on Computers Accessibility (ASSETS 2012), Boulder Colorado, U.S, October 22-24, pp. 213–214 (2012)Google Scholar
  8. 8.
    Kalal, Z., Matas, J., Mikolajczyk, K.: P-N Learning: Bootstrapping Binary Classifiers by Structural Constraints. In: Proc. of CVPR 2010, International Conference on Computer Vision and Pattern Recognition, San Francisco, CA, US, June 13-18, pp. 49–56 (2010)Google Scholar
  9. 9.
    Kay, L.: A sonar aid to enhance spatial perception of the blind: engineering design and evaluation. The Radio and Electronic Engineer 44, 605–627 (1974)CrossRefGoogle Scholar
  10. 10.
    Levy-Tzekdek, S., Hanassy, S., Abboud, S., Maidenbaum, S., Amedi, A.: Fast, accurate reaching movements with a visual-to-auditory sensory substitution device. Restroative Neurology and Neuroscience 31, 1–11 (2012)Google Scholar
  11. 11.
    Meijer, P.B.L.: An experimental system for auditory image representations. IEEE Trans. Bio. Eng. 39(2), 112–121 (1992)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Guido Bologna
    • 1
  • Juan Diego Gomez
    • 1
  • Thierry Pun
    • 1
  1. 1.Computer Vision and Multimedia LabUniversity of GenevaSwitzerland

Personalised recommendations