Abstract
This paper describes a Visual SLAM system developed on a mobile robot in order to support localization services to visually impaired people. The proposed system aims to provide services in small or mid-scale environments such as inside a building or campus of school where conventional positioning data such as GPS, WIFI signals are often not available. Toward this end, we adapt and improve existing vision-based techniques in order to handle issues in the indoor environments. We firstly design an image acquisition system to collect visual data. On one hand, a robust visual odometry method is adjusted to precisely create the routes in the environment. On the other hand, we utilize the Fast-Appearance Based Mapping algorithm that is may be the most successful for matching places in large scenarios. In order to better estimate robot’s location, we utilize a Kalman Filter that combines the matching results of current observation and the estimation of robot states based on its kinematic model. The experimental results confirmed that the proposed system is feasible to navigate the visually impaired people in the indoor environments.
Keywords
- Visual odometry
- Place recognition
- FAB-MAP algorithms
- Kalman filter
Chapter PDF
References
Bailey, T., Durrant-Whyte, H.: Simultaneous Localisation and Mapping (SLAM): Part II State of the Art. IEEE Robotics & Automation Magazine 13(2), 99–110 (2006)
Bigham, J.P., Jayant, C., Miller, A., White, B., Yeh, T.: VizWiz::LocateIt - enabling blind people to locate objects in their environment. In: CVPR Workshops 2010, pp. 65–72 (2010)
Borenstein, J., Ulrich, I.: The guidecane-a computerized travel aid for the active guidance of blind pedestrians. In: Proceeding of ICRA 1997, pp. 1283–1288 (1997)
Cummins, M., Newman, P.: FAB-MAP: Probabilistic localization and mapping in the space of appearance. The International Journal of Robotics Research 27, 647–665 (2008)
Dakopoulos, D., Bourbakis, N.G.: Wearable Obstacle Avoidance Electronic Travel Aids for Blind: A Survey. IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews 40, 25–35 (2010)
Fernández Alcantarilla, P.: Vision based localization: from humanoid robots to visually impaired people. In: Electronics, University of Alcala, Ph.D. Thesis (2011)
Fraundorfer, F., Scaramuzza, D.: Visual Odometry: Part II: Matching, Robustness, Optimization, and Applications. IEEE Transaction on Robotics & Automation Magazine 19, 78–90 (2012)
Hamme, D.V., Veelaert, P., Philips, W.: Robust visual odometry using uncertainty models. In: The Proceedings of 13th International Conference on Advanced Concepts for Intelligent Vision Systems, Belgium (2011)
Helal, A., Moore, S.E., Ramachandran, B.: Drishti: an integrated navigation system for visually impaired and disabled. In: Proceedings of the Fifth International Symposium on Wearable Computers 2001, pp.149–156 (2001)
Kulyukin, V., Gharpure, C., Nicholson, J., Pavithran, S.: RFID in robot-assisted indoor navigation for the visually impaired. In: The Proceeding of 2004 IEEE/RSJ IROS 2004, pp. 1979–1984 (2004)
Liu, J.J., Phillips, C., Daniilidis, K.: Video-based localization without 3D mapping for the visually impaired. In: The proceeding of CVPR Workshops 2010, pp. 23–30 (2010)
Loomis, J.M., Golledge, R.D., Klatzky, R.L.: GPS-based navigation systems for the visually impaired. In: Fundamental of Wearable Computers and Augmented Reality (2001)
Murali, V.N., Coughlan, J.M.: Smartphone-based crosswalk detection and localization for visually impaired pedestrians. In: Proceeding of IEEE International Conference on Multimedia and Expo Workshops (ICMEW), pp. 1–7 (2013)
Newman, P., Kin H.: SLAM-Loop Closing with Visually Salient Features. In: The Proceedings of the 2005 IEEE International Conference on Robotics and Automation, pp. 635–642 (2005)
Nister, D., Stewenius, H.: Scalable recognition with a vocabulary tree. In: The Proceeding of Computer Vision and Pattern Recognition 2006, pp. 2161–2168 (2006)
Oliva, A., Torralba, A.: Modeling the shape of the scene: A holistic representation of the spatial envelope. International Journal of Computer Vision 42, 145–175 (2001)
Pradeep, V., Medioni, G., Weiland, J.: Robot vision for the visually impaired. In: The Proceeding of IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp.15–22 (2010)
Schindler, G., Brown, M., Szeliski, R.: City-scale location recognition. In: The Proceeding of the Computer Vision and Pattern Recognition, pp. 1–7 (2007)
Shoval, S., Borenstein, J., Koren, Y.: Auditory guidance with the Navbelt-a computerized travel aid for the blind. Trans. Sys. Man Cyber Part C 28, 459–467 (1998)
Sivic, J., Zisserman, A.: Video Google: A text retrieval approach to object matching in videos. In: Proceedings of the 9th IEEE CVPR 2003, pp. 1470–1477 (2003)
Sunderhauf, N., Protzel, P.: Brief-gist-closing the loop by simple means. In: 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) pp. 1234–1241 (2011)
Winlock, T., Christiansen, E., Belongie, S.: Toward real-time grocery detection for the visually impaired. In: The Proceeding of CVPRW 2010, pp. 49–56 (2010)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Nguyen, QH. et al. (2015). A Visual SLAM System on Mobile Robot Supporting Localization Services to Visually Impaired People. In: Agapito, L., Bronstein, M., Rother, C. (eds) Computer Vision - ECCV 2014 Workshops. ECCV 2014. Lecture Notes in Computer Science(), vol 8927. Springer, Cham. https://doi.org/10.1007/978-3-319-16199-0_50
Download citation
DOI: https://doi.org/10.1007/978-3-319-16199-0_50
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-16198-3
Online ISBN: 978-3-319-16199-0
eBook Packages: Computer ScienceComputer Science (R0)