Design Guidelines for Audio–Haptic Immersive Applications for People with Visual Disabilities

  • Fernando Alonso
  • José L. Fuertes
  • Loïc Martínez
  • Héctor Szabo
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4061)


We describe the goals, issues and constraints found creating audio-haptic applications oriented to people with visual disabilities. Using audio-haptic games as a measuring tool, we have found unexpected features in the user’s audio perception. Our goal is to define a model of perception and usability guidelines for developers creating immersive accessible applications. This paper presents initial findings, related to user precision over 3D audio and haptic effects. The game and environment use a multichannel speaker array taking advantage of Microsoft DirectX multichannel audio support (5.1) as the audio processing abstraction layer. The environment allows simple haptic assistance through force feedback joystick devices, also supported by Microsoft DirectX as the force feedback and user input abstraction layer.


Sound Source Haptic Device Interaural Time Difference Visual Disability Blind User 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Ortega, P.: Juegos Educativos Para Ciegos: El Ahorcado. Final-year project, Facultad de Informática, Universidad Politécnica de Madrid (2004)Google Scholar
  2. 2.
    Sánchez, J., Lumbreras, M.: Ambientes Virtuales Interactivos para Niños Ciegos, Department of Computer Science, University of Chile (2002)Google Scholar
  3. 3.
    Sánchez, J., Sáenz, M.: 3D Sound Interactive Environments for Problem Solving, Department of Computer Science, University of Chile, ASSETS 2005 (2005)Google Scholar
  4. 4.
    Kurniawan, S.H., Sporka, A., Nemec, V., Slavik, P.: Design and User Evaluation of a Spatial Audio System for Blind Users, Department of Computation, UMIST, Department of Computer Science, Czech Technical University in Prague, 2004 ICDVRAT (2004)Google Scholar
  5. 5.
  6. 6.
  7. 7.
    Klatzky, R.L.: Procedures for haptic object exploration vs. manipulation. In: Goodale, M. (ed.) Vision and action: The control of grasping, pp. 110–127. Ablex, New Jersey (1990)Google Scholar
  8. 8.
    Babuglia, M., Cuiñas, G., Fernández, N., Lazar, M., Pereira, P.: Audiojuegos, SHADE: Simple Haptic Acoustic Development Engine., Systems Engineering Degree, Facultad de Ingeniería, Universidad ORT, Uruguay (2005)Google Scholar
  9. 9.
    Algazi, V., Duda, R., Duralswami, R., Gumerov, N., Tang, Z.: Approximating the head-related transfer function using simple geometric models of the head and torso. J. Acoust. Soc. Am. 112, 2053–2064 (2002)CrossRefGoogle Scholar
  10. 10.
    Alonso, F., Fuertes, J., Martínez-Normand, L., Szabo, H.: Análisis de Percepción en Entornos Acústicos Envolventes con Asistencia Háptica para Ciegos. In: AST 2005, Rosario, Argentina (2005)Google Scholar
  11. 11.
    Algazi, R., Duda, R., Thompson, D., Avendano, C.: The CIPIC HRTF database. In: WASSAP 2001, New York (2001)Google Scholar
  12. 12.
    Blauert, J.: Spatial Hearing: The Psychophysics of Human Sound Localization. The MIT Press Revised Edn., pp. 137-150, pp. 237-246 (1996) Google Scholar
  13. 13.
  14. 14.
    Magnusson, D., Rassmus-Gröhn, K., Sjöström, C., Danielsson, H.: Haptic 3D Object Recognition – a Study with Blind Users. In: Vision 2002, Göteborg, Sweden (2002)Google Scholar
  15. 15.
    Sato, M.: Development of String-based Force Display: Development of String-based Force Display, SPIDAR Precision and Intelligence Laboratory, Tokyo Institute of Technology (2002)Google Scholar
  16. 16.
    Bussell, L.: Touch Tiles: Elementary Geometry Software with a Haptic and Auditory Interface for Visually Impaired Children. In: EuroHaptics 2003 (2003)Google Scholar
  17. 17.
    Dolby Laboratories Inc.: Room Layout and Speaker Setup (2005),

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Fernando Alonso
    • 1
  • José L. Fuertes
    • 1
  • Loïc Martínez
    • 1
  • Héctor Szabo
    • 2
  1. 1.Facultad de InformáticaUniversidad Politécnica de MadridBoadilla del Monte, MadridSpain
  2. 2.Facultad de IngenieríaUniversidad ORT UruguayMontevideoUruguay

Personalised recommendations