Wearable Multimodal Interface for Helping Visually Handicapped Persons

  • Byeong-Seok Shin
  • Honam Ahn
  • Gye Young Kim
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4282)


Handicapped Persons who partially or entirely lose their sensory for external stimuli struggle to lead on daily life due to lack of the ability of sensors. We propose a system to provide alternative sensory for visually handicapped persons with wearable multimodal interface. It acquires visual information with a variety of sensors, converts them to high-level information, and represents the information with alternative sensory such as sound or vibration. The system is mainly composed of two sub-systems. The first is obstacle detection and avoidance module with multiple ultrasound sensors and a tracker. It helps handicapped person to access to target place easily and safely. The second is stereo vision system to provide ability to track some target objects, to recognize persons around a user, and to understand color and gray-level of a specific object. Since our system is designed for wearable computers, visually handicapped persons carry and operate it very easily.


Mobile Robot Sensor Array Scale Invariant Feature Transformation Stereo Vision Handicapped Person 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Borenstein, J., Ulrich, I.: The GuideCane: A Computerized Travel Aid for the Active Guidance of Blind Pedestrians. In: Proceedings of the IEEE International Conference on Robotics and Automation, pp. 1283–1288 (1997)Google Scholar
  2. 2.
    Mori, H., Kotani, S.: Robotic Travel Aid for the Blind: HARUNOBU-6. In: Proceedings of the 2nd European Conference Disability, Virtual Reality & Assoc. Tech., pp. 193–202 (1998)Google Scholar
  3. 3.
    Borenstein, J.: The NavBelt - A Computerized Multi-Sensor Travel Aid for Active Guidance of the Blind. In: Proceedings of the CSUN’s Fifth Annual Conference on Technology and Persons with Disabilities, pp. 107–116 (1990)Google Scholar
  4. 4.
    Jiang, K., Seveviratine, L.D., Earles, S.W.E.: A Shortest Path Based Path Planning Algorithm for Nonholonomic Mobile Robots. Journal of Intelligent and Robotic Systems, 347–366 (1999)Google Scholar
  5. 5.
    Divelbiss, A.W., Wen, J.T.: A Path Space Approach to Nonholonomic Motion Planning in the Presence of Obstacles. IEEE Transactions on Robotics and Automation 13(3), 443–451 (1997)CrossRefGoogle Scholar
  6. 6.
    Hu, H., Gu, D., Brady, M.: Navigation and Guidance of An Intelligent Mobile Robot. In: Second Euromicro Workshop on Advanced Mobile Robots (EUROBOT 1997), pp. 104–111 (1997)Google Scholar
  7. 7.
    Lin, Z., Wang, J., Ma, K.: Using Eigencolor Normalization for Illumination-Invariant Color Object Recognition. Pattern Recognition 35, 2629–2642 (2002)CrossRefMATHGoogle Scholar
  8. 8.
    Kass, M.M., Witkin, A., Terzopoulos, D.: Sankes: Active Contour Models. Internation Journal of Computer Vision 2, 321–331 (1988)CrossRefMATHGoogle Scholar
  9. 9.
    Majoor, T.: Face Detection using Color-based Region of Interest Selection, Technical report, University of Amsterdam, Amsterdam, NL (2000)Google Scholar
  10. 10.
    Lienhart, R., Maydt, J.: An Extended Set of Haar-like Features for Rapid Object Detection. In: IEEE ICIP, vol. 1, pp. 900–903 (2002)Google Scholar
  11. 11.
    Nefian, A.V., Hayes, M.H.: An embedded HMM-based approach for face detection and recognition. In: Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing, vol. 6 (1999)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Byeong-Seok Shin
    • 1
  • Honam Ahn
    • 1
  • Gye Young Kim
    • 2
  1. 1.Department of Computer Science and Information EngineeringInha UniversityInchonKorea
  2. 2.School of ComputingSoongsil UniversitySeoulKorea

Personalised recommendations