Improving Computer Vision-Based Indoor Wayfinding for Blind Persons with Context Information

  • YingLi Tian
  • Chucai Yi
  • Aries Arditi
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6180)


There are more than 161 million visually impaired people in the world today, of which 37 million are blind. Camera-based computer vision systems have the potential to assist blind persons to independently access unfamiliar buildings. Signs with text play a very important role in identification of bathrooms, exits, office doors, and elevators. In this paper, we present an effective and robust method of text extraction and recognition to improve computer vision-based indoor wayfinding. First, we extract regions containing text information from indoor signage with multiple colors and complex background and then identify text characters in the extracted regions by using the features of size, aspect ratio and nested edge boundaries. Based on the consistence of distances between two neighboring characters in a text string, the identified text characters have been normalized before they are recognized by using off-the-shelf optical character recognition (OCR) software products and output as speech for blind users.


Indoor navigation and wayfinding indoor computer vision text extraction optical character recognition (OCR) 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Resnikoff, S., Pascolini, D., Etya’ale, D., Kocur, I., Pararajasegaram, R., Pokharel, G.P., et al.: Global data on visual impairment in the year 2002. Bulletin of the World Health Organization 82, 844–851 (2004)Google Scholar
  2. 2.
    Fu, H., Liu, X., Jia, Y.: Gaussian Mixture Modeling of Neighbor Characters for Multilingual Text Extraction in Images. In: IEEE International Conference on Image Processing, ICIP (2006)Google Scholar
  3. 3.
    Kasar, T., Kumar, J., Ramakrishnan, A.G.: Font and Background Color Independent Text Binarization. In: 2nd International Workshop on Camera-Based Document Analysis and Recognition (2007)Google Scholar
  4. 4.
    Liang, J., Doermann, D., Li, H.: Camera-based analysis of text and documents: a survey. IJDAR 7(2-3) (July 2005)Google Scholar
  5. 5.
    Lyu, M., Song, J., Cai, M.: A Comprehensive method for multilingual video text detection, localization, and extraction. IEEE transactions on circuits and systems for video technology 15 (2005)Google Scholar
  6. 6.
    Niblack, W.: An introduction to digital image processing, pp. 115–116. Prentice Hall, Englewood Cliffs (1986)Google Scholar
  7. 7.
    Nikolaou, N., Papamarkos, N.: Color Reduction for Complex Document Images. International Journal of Imaging Systems and Technology 19, 14–26 (2009)CrossRefGoogle Scholar
  8. 8.
    Phan, T., Shivakumara, P., Lim Tan, C.: A Laplacian Method for Video Text Detection. In: The 10th International Conference on Document Analysis and Recognition, pp. 66–70 (2009)Google Scholar
  9. 9.
    Sauvola, J., Pietikainen, M.: Adaptive document image binarization. Pattern Recognition 33, 225–236 (2000)CrossRefGoogle Scholar
  10. 10.
    Trier, O., Taxt, T.: Evaluation of binarization methods for document images. IEEE Trans. Pattern Analysis and Machine Intelligence 17(3), 312–315 (1995)CrossRefGoogle Scholar
  11. 11.
    Tran, H., lux, A., Nguyen, H., Boucher, A.: A novel approach for text detection in images using structural features. In: The 3rd International Conference on Advances in Pattern Recognition, pp. 627–635 (2005)Google Scholar
  12. 12.
    Wolf, C., Jolion, J., Chassaing, F.: Text localization, enhancement and binarization in multimedia documents. In: Proc. ICPR, vol. 4, pp. 1037–1040 (2002)Google Scholar
  13. 13.
    Wong, E., Chen, M.: A new robust algorithm for video text extraction PR36(6) (June 2003)Google Scholar
  14. 14.
    Zhang, J., Kasturi, R.: Extraction of Text Objects in Video Documents: Recent Progress. In: The 8th IAPR International Workshop on Document Analysis Systems (2008)Google Scholar
  15. 15.
    Zhong, Y., Karu, K., Jain, A.K.: Locating text in complex color images. In: Proc. ICDAR (1995)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • YingLi Tian
    • 1
  • Chucai Yi
    • 1
  • Aries Arditi
    • 2
  1. 1.Electrical Engineering Department, The City College and Graduate CenterCity University of New YorkNew York
  2. 2.Arlene R Gordon Research InstituteLighthouse InternationalNew York

Personalised recommendations