Navigating blind people with walking impairments using a smart walker
Navigation in complex and unknown environments is a major challenge for elderly blind people. Unfortunately, conventional navigation aids such as white canes and guide dogs provide only limited assistance to blind people with walking impairments as they can hardly be combined with a walker, required for walking assistance. Additionally, such navigation aids are constrained to the local vicinity only. We believe that technologies developed in the field of robotics have the potential to assist blind people with walking disabilities in complex navigation tasks as they can provide information about obstacles and reason on both global and local aspects of the environment. The contribution of this article is a smart walker that navigates blind users safely by leveraging recent developments in robotics. Our walker can support the user in two ways, namely by providing information about the vicinity to avoid obstacles and by guiding the user to reach the designated target location. It includes vibro-tactile user interfaces and a controller that takes into account human motion behavior obtained from a user study. In extensive qualitative and quantitative experiments that also involved blind and age-matched participants we demonstrate that our smart walker safely navigates users with limited vision.
KeywordsElderly care Autonomous assistive robots Mobility aids for locomotion or navigation Interaction control of assistive robots Smart walker
We thank Professor Maik Winter, Barbara Weber-Fiori and Johannes Kamperschroer who were involved in the experiments with elderly people. We also thank R. Broer from RTB GmbH & Co. KG, Germany, for helpful comments and the exhibition space at SightCity. Sven Heinrich helped us with valuable information on human tactile sensitivity. Additionally, we thank Henrich Kolkhorst and three anonymous reviewers for their helpful comments. We are grateful to all our participants for their consent to publish all results. This work has been partially supported by the German Federal Ministry of Education and Research (BMBF), Contract Number 13EZ1129B-iVIEW and by a grant from the Ministry of Science, Research and the Arts of Baden-Württemberg (Az: 32-7545.24-9/1/1) for the Project ZAFH-AAL.
- Azenkot, S., Ladner, R. E., & Wobbrock, J. O. (2011). Smartphone haptic feedback for nonvisual wayfinding. In The proceedings of the 13th international ACM SIGACCESS conference on Computers and accessibility.Google Scholar
- Bosman, S., Groenendaal, B., Findlater, J.-W., Visser, T., de Graaf, M., & Markopoulos, P. (2003). GentleGuide: An exploration of haptic output for indoors pedestrian guidance. In Human–computer interaction with mobile devices and services. New York: Springer.Google Scholar
- Censi, A. (2008). An ICP variant using a point-to-line metric. In Proceedings of the IEEE international conference on robotics and automation (ICRA).Google Scholar
- Cosgun, A., Sisbot, E. A., & Christensen, H. (2014). Guidance for human navigation using a vibro-tactile belt interface and robot-like motion planning. In International Conference on Robotics & Automation.Google Scholar
- Elitac, B. V. Science suit and tactile belt. http://www.elitac.nl/.
- Engel, J., Sturm, J., & Cremers, D. (2012). Camera-based navigation of a low-cost quadrocopter. In Proceedings of the IEEE/RSJ international conference on intelligent robots and systems (IROS).Google Scholar
- feelSpace. feelSpace. http://feelspace.cogsci.uni-osnabrueck.de/.
- Feng, C., Azenkot, S., & Cakmak, M. (2015). Designing a robot guide for blind people in indoor environments. In Proceedings of the tenth annual ACM/IEEE international conference on human–robot interaction extended abstracts.Google Scholar
- Glover, J., Holstius, D., Manojlovich, M., Montgomery, K., Powers, A., Wu, J., et al. (2003). A robotically-augmented walker for older adults. Technical report. Carnegie Mellon University, Computer Science Department.Google Scholar
- Graf, B. (2001). Reactive navigation of an intelligent robotic walking aid. In Proceedings of 10th IEEE international workshop on robot and human interactive communication, 2001.Google Scholar
- Hogg, R. W., Rankin, A. L., Roumeliotis, S. I., McHenry, M. C., Helmick, D. M., Bergh, C. F., et al. (2002). Algorithms and sensors for small robot path following. In Proceedings of the IEEE international conference on robotics and automation (ICRA).Google Scholar
- Kay, L. (1974). A sonar aid to enhance spatial perception of the blind: Engineering design and evaluation. Radio and Electronic Engineer, 44, ISSN 0033-7722.Google Scholar
- MacNamara, S., & Lacey, G. (2000). A smart walker for the frail visually impaired. In International Conference on Robotics & Automation (Vol. 2, pp. 1354–1359). IEEE.Google Scholar
- Moeller, K., Toth, F., Wang, L., Moeller, J., Arras, K., Bach, M., et al. (2009). Enhanced perception for visually impaired people. In Bioinformatics and Biomedical Engineering, 2009. 3rd International Conference on ICBBE 2009.Google Scholar
- Morris, A., Donamukkala, R., Kapuria, A., Steinfeld, A., Matthews, J., Dunbar-Jacob, J., et al. (2003). A robotic walker that provides guidance. In International Conference on Robotics & Automation.Google Scholar
- Morton, R. D., & Olson, E. (2011). Positive and negative obstacle detection using the HLD classifier. In Proceedings of the IEEE/RSJ international conference on intelligent robots and systems (IROS).Google Scholar
- Pascolini, D., & Mariotti, S. P. (2011). Global estimates of visual impairment: 2010. British Journal of Ophthalmology.Google Scholar
- Quigley, M., Conley, K., Gerkey, B., Faust, J., Foote, T., Leibs, J., et al. (2009). ROS: an open-source Robot Operating System. In Proceedings of the IEEE international conference on robotics and automation (ICRA).Google Scholar
- Ran, L., Helal, S., & Moore, S. (2004). Drishti: an integrated indoor/outdoor blind navigation system and service. In Annual conference on pervasive computing and communications.Google Scholar
- Reyes Adame, M., Kamperschroer, J., Winter, M. H.-J. & Moeller, K. (2015). A smart walking aid for visually impaired elderly people: Comparison of two vibrotactile feedback systems. In 49th DGBMT Annual Conference. Luebeck, Germany.Google Scholar
- Rodriguez-Losada, D., Matia, F., Jimenez, A., Galan, R., & Lacey, G. (2005). Implementing map based navigation in guido, the robotic smartwalker. In Proceedings of the IEEE international conference on robotics and automation (ICRA).Google Scholar
- Sensodrive GmbH. Vibrotac. http://www.sensodrive.de/DE/Produkte/Vibrotac.php.
- Sight City. http://www.sightcity.net/en/.
- Tsukada, K., & Yasumura, M. (2004). Activebelt: Belt-type wearable tactile display for directional navigation. In K. Lyytinen & Y. Yoo (Eds.), Ubiquitous computing. New York: Springer.Google Scholar
- Wachaja, A., Agarwal, P., Zink, M., Reyes Adame, M., Möller, K., & Burgard. W. (2015). Navigating blind people with a smart walker. In International Conference on Intelligent Robots and Systems (IROS). Hamburg, Germany.Google Scholar
- Williams, M. A., Galbraith, C., Kane, S. K., & Hurst, A. (2014). “Just let the cane hit it”: How the blind and sighted see navigation differently. In Proceedings of the 16th international ACM SIGACCESS conference on Computers & accessibility.Google Scholar