Improving Computer Vision-Based Indoor Wayfinding for Blind Persons with Context Information
There are more than 161 million visually impaired people in the world today, of which 37 million are blind. Camera-based computer vision systems have the potential to assist blind persons to independently access unfamiliar buildings. Signs with text play a very important role in identification of bathrooms, exits, office doors, and elevators. In this paper, we present an effective and robust method of text extraction and recognition to improve computer vision-based indoor wayfinding. First, we extract regions containing text information from indoor signage with multiple colors and complex background and then identify text characters in the extracted regions by using the features of size, aspect ratio and nested edge boundaries. Based on the consistence of distances between two neighboring characters in a text string, the identified text characters have been normalized before they are recognized by using off-the-shelf optical character recognition (OCR) software products and output as speech for blind users.
KeywordsIndoor navigation and wayfinding indoor computer vision text extraction optical character recognition (OCR)
Unable to display preview. Download preview PDF.
- 1.Resnikoff, S., Pascolini, D., Etya’ale, D., Kocur, I., Pararajasegaram, R., Pokharel, G.P., et al.: Global data on visual impairment in the year 2002. Bulletin of the World Health Organization 82, 844–851 (2004)Google Scholar
- 2.Fu, H., Liu, X., Jia, Y.: Gaussian Mixture Modeling of Neighbor Characters for Multilingual Text Extraction in Images. In: IEEE International Conference on Image Processing, ICIP (2006)Google Scholar
- 3.Kasar, T., Kumar, J., Ramakrishnan, A.G.: Font and Background Color Independent Text Binarization. In: 2nd International Workshop on Camera-Based Document Analysis and Recognition (2007)Google Scholar
- 4.Liang, J., Doermann, D., Li, H.: Camera-based analysis of text and documents: a survey. IJDAR 7(2-3) (July 2005)Google Scholar
- 5.Lyu, M., Song, J., Cai, M.: A Comprehensive method for multilingual video text detection, localization, and extraction. IEEE transactions on circuits and systems for video technology 15 (2005)Google Scholar
- 6.Niblack, W.: An introduction to digital image processing, pp. 115–116. Prentice Hall, Englewood Cliffs (1986)Google Scholar
- 8.Phan, T., Shivakumara, P., Lim Tan, C.: A Laplacian Method for Video Text Detection. In: The 10th International Conference on Document Analysis and Recognition, pp. 66–70 (2009)Google Scholar
- 11.Tran, H., lux, A., Nguyen, H., Boucher, A.: A novel approach for text detection in images using structural features. In: The 3rd International Conference on Advances in Pattern Recognition, pp. 627–635 (2005)Google Scholar
- 12.Wolf, C., Jolion, J., Chassaing, F.: Text localization, enhancement and binarization in multimedia documents. In: Proc. ICPR, vol. 4, pp. 1037–1040 (2002)Google Scholar
- 13.Wong, E., Chen, M.: A new robust algorithm for video text extraction PR36(6) (June 2003)Google Scholar
- 14.Zhang, J., Kasturi, R.: Extraction of Text Objects in Video Documents: Recent Progress. In: The 8th IAPR International Workshop on Document Analysis Systems (2008)Google Scholar
- 15.Zhong, Y., Karu, K., Jain, A.K.: Locating text in complex color images. In: Proc. ICDAR (1995)Google Scholar