Computer Vision-Based Terrain Sensors for Blind Wheelchair Users

  • James Coughlan
  • Roberto Manduchi
  • Huiying Shen
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4061)


We demonstrate computer vision techniques designed to aid blind or severely visually impaired wheelchair users. These techniques will be used to sense important features in nearby terrain from images collected by cameras mounted rigidly to the wheelchair. They will assist in the detection of hazards such as obstacles and drop-offs ahead of or alongside the chair, as well as detecting veer, finding curb cuts, finding a clear path, and maintaining a straight course. The resulting information is intended ultimately to be integrated with inputs from other sensors and communicated to the traveler using synthesized speech and/or audible tones and tactile cues, supplementing rather than replacing the user’s existing cane, guide dog and wayfinding skills.


Ground Plane Obstacle Detection Wheelchair User Laser Striper IEEE Intelligent Vehicle Symposium 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Bellutta, P., Manduchi, R., Matthies, L., Owens, K., Rankin, A.: Terrain Perception for DEMO III. In: Intelligent Vehicle Symposium (2000)Google Scholar
  2. 2.
    Gill, J.: Personal electronic mobility devices. Information for Professionals Working with Visually Disabled People (2000),
  3. 3.
    Greenbaum, M.G., Fernandes, S., Wainapel, S.F.: Use of a motorized wheelchair in conjunction with a guide dog for the legally blind and physically disabled. Arch. Phys. Med. Rehabil. 79(2), 216–217 (1998)CrossRefGoogle Scholar
  4. 4.
    Labayrade, R., Aubert, D., Tarel, J.P.: Real Time Obstacle Detection in Stereo Vision on Non Flat Road Geometry Through ’V-disparity’ Representation. In: Proc. IEEE Intelligent Vehicle Symposium, Versailles, France, June 18-20 (2002)Google Scholar
  5. 5.
    Levine, S.P., Bell, D.A., Jaros, L.A., Simpson, R.C., Koren, Y., Borenstein, J.: The NavChair Assistive Wheelchair Navigation System. IEEE Trans Rehabilitation Engineering 7(4), 443–451 (1999)CrossRefGoogle Scholar
  6. 6.
    Lu, X., Manduchi, R.: Detection and Localization of Curbs and Stairways Using Stereo Vision. In: IEEE Intl. Conf. on Robotics and Automation, Barcelona (April 2005)Google Scholar
  7. 7.
    Mandelbaum, R., McDowell, L., Bogoni, L., Reich, B., Hansen, M.: Real-Time Stereo Processing, Obstacle Detection, and Terrain Estimation from Vehicle-Mounted Stereo Cameras. In: Proc. IEEE Workshop on Applications of Computer Vision (WACV 1998), Princeton, New Jersey (October 1998)Google Scholar
  8. 8.
    Nisbet, P., Craig, J., Odor, P., Aitken, S.: “Smart” wheelchairs for mobility training. Technology & Disability 5, 49–62 (1995)CrossRefGoogle Scholar
  9. 9.
    Se, S., Brady, M.: Road Feature Detection and Estimation. Machine Vision and Applications 14, 157–165 (2003)Google Scholar
  10. 10.
    Thorpe, C., et al.: Driving in Traffic: Short-Range Sensing for Urban Collision Avoidance. In: Proc. SPIE: UGV Tech. IV, vol. 4715 (April 2002)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • James Coughlan
    • 1
  • Roberto Manduchi
    • 2
  • Huiying Shen
    • 1
  1. 1.Smith-Kettlewell Eye Research InstituteSan FranciscoUSA
  2. 2.Dept. of Computer EngineeringUniv. of California at Santa CruzUSA

Personalised recommendations