Journal on Multimodal User Interfaces

, Volume 5, Issue 3, pp 131–141

Eyes-free environmental awareness for navigation

  • Dalia El-Shimy
  • Florian Grond
  • Adriana Olmos
  • Jeremy R. Cooperstock
Original Paper

DOI: 10.1007/s12193-011-0065-5

Cite this article as:
El-Shimy, D., Grond, F., Olmos, A. et al. J Multimodal User Interfaces (2012) 5: 131. doi:10.1007/s12193-011-0065-5

Abstract

We consider the challenge of delivering location-based information through rich audio representations of the environment, and the associated opportunities that such an approach offers to support navigation tasks. This challenge is addressed by In-Situ Audio Services, or ISAS, a system intended primarily for use by the blind and visually impaired communities. It employs spatialized audio rendering to convey the relevant content, which may include information about the immediate surroundings, such as restaurants, cultural sites, public transportation locations, and other points of interest. Information is aggregated mostly from online data resources, converted using text-to-speech technology, and “displayed”, either as speech or more abstract audio icons, through a location-aware mobile device or smartphone. This is suitable not only for the specific constraints of the target population, but is equally useful for general mobile users whose visual attention is otherwise occupied with navigation. We designed and conducted an experiment to evaluate two techniques for delivering spatialized audio content to users via interactive auditory maps: the shockwave mode and the radar mode. While neither mode proved to be significantly better than the other, subjects proved competent at navigating the maps using these rendering strategies, and reacted positively to the system, demonstrating that spatial audio can be an effective technique for conveying location-based information. The results of this experiment and its implications to our project are described here.

Keywords

Sound spatialization Auditory maps Mobile applications Blind and visually impaired community Location-based information 

Copyright information

© OpenInterface Association 2011

Authors and Affiliations

  • Dalia El-Shimy
    • 1
  • Florian Grond
    • 2
  • Adriana Olmos
    • 1
  • Jeremy R. Cooperstock
    • 1
  1. 1.Centre for Intelligent MachinesMcGill UniversityMontréalCanada
  2. 2.Ambient Intelligence GroupUniversität BielefeldBielefeldGermany

Personalised recommendations