Wearable Multimodal Interface for Helping Visually Handicapped Persons
Handicapped Persons who partially or entirely lose their sensory for external stimuli struggle to lead on daily life due to lack of the ability of sensors. We propose a system to provide alternative sensory for visually handicapped persons with wearable multimodal interface. It acquires visual information with a variety of sensors, converts them to high-level information, and represents the information with alternative sensory such as sound or vibration. The system is mainly composed of two sub-systems. The first is obstacle detection and avoidance module with multiple ultrasound sensors and a tracker. It helps handicapped person to access to target place easily and safely. The second is stereo vision system to provide ability to track some target objects, to recognize persons around a user, and to understand color and gray-level of a specific object. Since our system is designed for wearable computers, visually handicapped persons carry and operate it very easily.
KeywordsMobile Robot Sensor Array Scale Invariant Feature Transformation Stereo Vision Handicapped Person
Unable to display preview. Download preview PDF.
- 1.Borenstein, J., Ulrich, I.: The GuideCane: A Computerized Travel Aid for the Active Guidance of Blind Pedestrians. In: Proceedings of the IEEE International Conference on Robotics and Automation, pp. 1283–1288 (1997)Google Scholar
- 2.Mori, H., Kotani, S.: Robotic Travel Aid for the Blind: HARUNOBU-6. In: Proceedings of the 2nd European Conference Disability, Virtual Reality & Assoc. Tech., pp. 193–202 (1998)Google Scholar
- 3.Borenstein, J.: The NavBelt - A Computerized Multi-Sensor Travel Aid for Active Guidance of the Blind. In: Proceedings of the CSUN’s Fifth Annual Conference on Technology and Persons with Disabilities, pp. 107–116 (1990)Google Scholar
- 4.Jiang, K., Seveviratine, L.D., Earles, S.W.E.: A Shortest Path Based Path Planning Algorithm for Nonholonomic Mobile Robots. Journal of Intelligent and Robotic Systems, 347–366 (1999)Google Scholar
- 6.Hu, H., Gu, D., Brady, M.: Navigation and Guidance of An Intelligent Mobile Robot. In: Second Euromicro Workshop on Advanced Mobile Robots (EUROBOT 1997), pp. 104–111 (1997)Google Scholar
- 9.Majoor, T.: Face Detection using Color-based Region of Interest Selection, Technical report, University of Amsterdam, Amsterdam, NL (2000)Google Scholar
- 10.Lienhart, R., Maydt, J.: An Extended Set of Haar-like Features for Rapid Object Detection. In: IEEE ICIP, vol. 1, pp. 900–903 (2002)Google Scholar
- 11.Nefian, A.V., Hayes, M.H.: An embedded HMM-based approach for face detection and recognition. In: Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing, vol. 6 (1999)Google Scholar