NAVI – A Proof-of-Concept of a Mobile Navigational Aid for Visually Impaired Based on the Microsoft Kinect

  • Michael Zöllner
  • Stephan Huber
  • Hans-Christian Jetter
  • Harald Reiterer
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6949)


We present a proof-of-concept of a mobile navigational aid that uses the Microsoft Kinect and optical marker tracking to help visually impaired people find their way inside buildings. The system is the result of a student project and is entirely based on low-cost hard- and software. It provides continuous vibrotactile feedback on the person’s waist, to give an impression of the environment and to warn about obstacles. Furthermore, optical markers can be used to tag points of interest within the building to enable synthesized voice instructions for point-to-point navigation.


Vibrotactile User Interface Navigation User Interface 


  1. 1.
    e-adept: Electronic assistance for disabled and elderly pedestrians and travelers (2011), retrieved June 2 from
  2. 2.
    Bradley, N.A., Dunlop, M.D.: An experimental investigation into wayfinding directions for visually impaired people. Personal Ubiquitous Computing 9, 395–403 (2005)CrossRefGoogle Scholar
  3. 3.
    Cardin, S., Thalmann, D., Vexo, F.: A wearable system for mobility improvement of visually impaired people. Vis. Comput. 23, 109–118 (2007)CrossRefGoogle Scholar
  4. 4.
    Cassinelli, A., Reynolds, C., Ishikawa, M.: Augmenting spatial awareness with haptic radar. In: Cruz, I., Decker, S., Allemang, D., Preist, C., Schwabe, D., Mika, P., Uschold, M., Aroyo, L.M. (eds.) ISWC 2006. LNCS, vol. 4273, pp. 61–64. Springer, Heidelberg (2006)Google Scholar
  5. 5.
    Erp, J., Veen, H., Jansen, C., Dobbins, T.: Waypoint navigation with a vibrotactile waist belt. ACM Transactions on Applied Perception 2(2), 106–117 (2005)CrossRefGoogle Scholar
  6. 6.
    Franklin, N.: Language as a means of constructing and conveying cognitive maps. In: Portugali, J. (ed.) The Construction of Cognitive Maps. GeoJournal Library, vol. 32, pp. 275–295. Springer, Netherlands (1996)CrossRefGoogle Scholar
  7. 7.
    Lee, J., Choi, E., Lim, S., Shin, B.: Wearable computer system reflecting spatial context. In: Proc. IWSCA 2008, pp. 153–159. IEEE Computer Society, Washington, DC (2008)Google Scholar
  8. 8.
    Long, R.G., Hill, E.W.: Establishing and maintaining orientation for mobility. In: Wiener, W.R., Blasch, B.B., Welsh, R.L. (eds.) Foundations of Orientation and Mobility, 2nd edn., ch. 2, pp. 39–59. AFB Press (1997)Google Scholar
  9. 9.
    Loomis, J.M., Golledge, R.G., Klatzky, R.L.: Gps-based navigation systems for the visually impaired. In: Barfield, W., Caudell, T. (eds.) Fundamentals of Wearable Computers and Augumented Reality, L. Erlbaum Associates Inc., Hillsdale (2000)Google Scholar
  10. 10.
    Petrie, H.: User requirements for a gps-based travel aid for blind people. In: Proc. of the Conference on Orientation and Navigation Systems for Blind Persons, RNIB (1995)Google Scholar
  11. 11.
    Ram, S., Sharf, J.: The people sensor: A mobility aid for the visually impaired. In: Proc. ISWC 1998, p. 166. IEEE Computer Society, Washington, DC (1998)Google Scholar
  12. 12.
    Ross, D.A., Blasch, B.B.: Wearable interfaces for orientation and wayfinding. In: Proc. ASSETS 2000, pp. 193–200. ACM, New York (2000)Google Scholar

Copyright information

© IFIP International Federation for Information Processing 2011

Authors and Affiliations

  • Michael Zöllner
    • 1
  • Stephan Huber
    • 1
  • Hans-Christian Jetter
    • 1
  • Harald Reiterer
    • 1
  1. 1.University of KonstanzGermany

Personalised recommendations