A Visual SLAM System on Mobile Robot Supporting Localization Services to Visually Impaired People

  • Quoc-Hung NguyenEmail author
  • Hai Vu
  • Thanh-Hai Tran
  • David Van Hamme
  • Peter Veelaert
  • Wilfried Philips
  • Quang-Hoan Nguyen
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8927)


This paper describes a Visual SLAM system developed on a mobile robot in order to support localization services to visually impaired people. The proposed system aims to provide services in small or mid-scale environments such as inside a building or campus of school where conventional positioning data such as GPS, WIFI signals are often not available. Toward this end, we adapt and improve existing vision-based techniques in order to handle issues in the indoor environments. We firstly design an image acquisition system to collect visual data. On one hand, a robust visual odometry method is adjusted to precisely create the routes in the environment. On the other hand, we utilize the Fast-Appearance Based Mapping algorithm that is may be the most successful for matching places in large scenarios. In order to better estimate robot’s location, we utilize a Kalman Filter that combines the matching results of current observation and the estimation of robot states based on its kinematic model. The experimental results confirmed that the proposed system is feasible to navigate the visually impaired people in the indoor environments.


Visual odometry Place recognition FAB-MAP algorithms Kalman filter 


  1. 1.
    Bailey, T., Durrant-Whyte, H.: Simultaneous Localisation and Mapping (SLAM): Part II State of the Art. IEEE Robotics & Automation Magazine 13(2), 99–110 (2006)CrossRefGoogle Scholar
  2. 2.
    Bigham, J.P., Jayant, C., Miller, A., White, B., Yeh, T.: VizWiz::LocateIt - enabling blind people to locate objects in their environment. In: CVPR Workshops 2010, pp. 65–72 (2010)Google Scholar
  3. 3.
    Borenstein, J., Ulrich, I.: The guidecane-a computerized travel aid for the active guidance of blind pedestrians. In: Proceeding of ICRA 1997, pp. 1283–1288 (1997)Google Scholar
  4. 4.
    Cummins, M., Newman, P.: FAB-MAP: Probabilistic localization and mapping in the space of appearance. The International Journal of Robotics Research 27, 647–665 (2008)CrossRefGoogle Scholar
  5. 5.
    Dakopoulos, D., Bourbakis, N.G.: Wearable Obstacle Avoidance Electronic Travel Aids for Blind: A Survey. IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews 40, 25–35 (2010)CrossRefGoogle Scholar
  6. 6.
    Fernández Alcantarilla, P.: Vision based localization: from humanoid robots to visually impaired people. In: Electronics, University of Alcala, Ph.D. Thesis (2011)Google Scholar
  7. 7.
    Fraundorfer, F., Scaramuzza, D.: Visual Odometry: Part II: Matching, Robustness, Optimization, and Applications. IEEE Transaction on Robotics & Automation Magazine 19, 78–90 (2012)CrossRefGoogle Scholar
  8. 8.
    Hamme, D.V., Veelaert, P., Philips, W.: Robust visual odometry using uncertainty models. In: The Proceedings of 13th International Conference on Advanced Concepts for Intelligent Vision Systems, Belgium (2011)Google Scholar
  9. 9.
    Helal, A., Moore, S.E., Ramachandran, B.: Drishti: an integrated navigation system for visually impaired and disabled. In: Proceedings of the Fifth International Symposium on Wearable Computers 2001, pp.149–156 (2001)Google Scholar
  10. 10.
    Kulyukin, V., Gharpure, C., Nicholson, J., Pavithran, S.: RFID in robot-assisted indoor navigation for the visually impaired. In: The Proceeding of 2004 IEEE/RSJ IROS 2004, pp. 1979–1984 (2004)Google Scholar
  11. 11.
    Liu, J.J., Phillips, C., Daniilidis, K.: Video-based localization without 3D mapping for the visually impaired. In: The proceeding of CVPR Workshops 2010, pp. 23–30 (2010)Google Scholar
  12. 12.
    Loomis, J.M., Golledge, R.D., Klatzky, R.L.: GPS-based navigation systems for the visually impaired. In: Fundamental of Wearable Computers and Augmented Reality (2001)Google Scholar
  13. 13.
    Murali, V.N., Coughlan, J.M.: Smartphone-based crosswalk detection and localization for visually impaired pedestrians. In: Proceeding of IEEE International Conference on Multimedia and Expo Workshops (ICMEW), pp. 1–7 (2013)Google Scholar
  14. 14.
    Newman, P., Kin H.: SLAM-Loop Closing with Visually Salient Features. In: The Proceedings of the 2005 IEEE International Conference on Robotics and Automation, pp. 635–642 (2005)Google Scholar
  15. 15.
    Nister, D., Stewenius, H.: Scalable recognition with a vocabulary tree. In: The Proceeding of Computer Vision and Pattern Recognition 2006, pp. 2161–2168 (2006)Google Scholar
  16. 16.
    Oliva, A., Torralba, A.: Modeling the shape of the scene: A holistic representation of the spatial envelope. International Journal of Computer Vision 42, 145–175 (2001)CrossRefzbMATHGoogle Scholar
  17. 17.
    Pradeep, V., Medioni, G., Weiland, J.: Robot vision for the visually impaired. In: The Proceeding of IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp.15–22 (2010)Google Scholar
  18. 18.
    Schindler, G., Brown, M., Szeliski, R.: City-scale location recognition. In: The Proceeding of the Computer Vision and Pattern Recognition, pp. 1–7 (2007)Google Scholar
  19. 19.
    Shoval, S., Borenstein, J., Koren, Y.: Auditory guidance with the Navbelt-a computerized travel aid for the blind. Trans. Sys. Man Cyber Part C 28, 459–467 (1998)CrossRefGoogle Scholar
  20. 20.
    Sivic, J., Zisserman, A.: Video Google: A text retrieval approach to object matching in videos. In: Proceedings of the 9th IEEE CVPR 2003, pp. 1470–1477 (2003)Google Scholar
  21. 21.
    Sunderhauf, N., Protzel, P.: Brief-gist-closing the loop by simple means. In: 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) pp. 1234–1241 (2011)Google Scholar
  22. 22.
    Winlock, T., Christiansen, E., Belongie, S.: Toward real-time grocery detection for the visually impaired. In: The Proceeding of CVPRW 2010, pp. 49–56 (2010)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Quoc-Hung Nguyen
    • 1
    Email author
  • Hai Vu
    • 1
  • Thanh-Hai Tran
    • 1
  • David Van Hamme
    • 2
  • Peter Veelaert
    • 2
  • Wilfried Philips
    • 2
  • Quang-Hoan Nguyen
    • 3
  1. 1.International Research Institute MICAHanoi University of Science and TechnologyHanoiVietnam
  2. 2.Ghent University/iMinds (IPI)GentBelgium
  3. 3.Hung Yen University of Technology and EducationHung YenVietnam

Personalised recommendations