Eye Tracking in Coloured Image Scenes Represented by Ambisonic Fields of Musical Instrument Sounds
We present our recent project on visual substitution by Ambisonic 3D-sound fields. Ideally, our system should be used by blind or visually impaired subjects having already seen. The original idea behind our targeted prototype is the use of an eye tracker and musical instrument sounds encoding coloured pixels. The role of the eye tracker is to activate the process of attention inherent in the vision and to restore by simulation the mechanisms of central and peripheral vision. Moreover, we advocate the view that cerebral areas devoted to the integration of information will play a role by rebuilding a global image of the environment. Finally, the role of colour itself is to help subjects distinguishing coloured objects or perceiving textures, such as sky, walls, grass and trees, etc ...
KeywordsPlane Wave Sound Source Musical Instrument Blind Person Spatial Hearing
Unable to display preview. Download preview PDF.
- 1.Algazi, V.R., Duda, R.O., Thompson, D.P., Avendano: The CIPIC HRTF Database. In: IEEE Proc. WASPAA 2001, New Paltz, NY (2001)Google Scholar
- 3.Bamford, J.S.: An Analysis of Ambisonic Sound Systems of First and Second Order. Master Thesis, Waterloo, Ontario, Canada (1995)Google Scholar
- 4.Begault, R.: 3-D Sound for Virtual Reality and Multimedia. Boston A.P. Professional (1994) ISBN: 0120847353Google Scholar
- 5.Brown, C.P., Duda, R.O.: A Structural Model for Binaural Sound Synthesis. IEEE Trans. Speech and Audio Processing 6(5) (1998)Google Scholar
- 9.Daniel, J.: Acoustic Field Representation, Application to the Transmission and the Reproduction of Complex Sound Environments in a Multimedia Context. PhD thesis, University of Paris 6 (in French, English abstract available) (2000)Google Scholar
- 10.Gerzon, M.A.: Design of Ambisonic Decoders for Multispeaker Surround Sound. Journal of the Audio Engineering Society (Abstracts) 25, 1064 (1977)Google Scholar
- 11.Gonzalez-Mora, J.L., Rodriguez-Hernandez, A., Rodriguez-Ramos, L.F., Dfaz-Saco, L., Sosa, N.: Development of a New Space Perception System for Blind People, Based on the Creation of a Virtual Acoustic Space. In: Mira, J. (ed.) IWANN 1999. LNCS, vol. 1606, pp. 321–330. Springer, Heidelberg (1999)CrossRefGoogle Scholar
- 15.Wong, F.H.T., Nagarajan, R., Yaacob, S., Chekima, A., Belkhamza, N.E.: A Stereo Auditory Display for Visually Impaired. In: Proc. TENCON, pp. 377–383 (2000)Google Scholar