Scene Text Detection and Tracking for Wearable Text-to-Speech Translation Camera

  • Hideaki Goto
  • Kunqi Liu
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9759)


Camera-based character recognition applications equipped with voice synthesizer are useful for the blind to read text messages in the environments. Such applications in the current market and/or similar prototypes under research require users’ active reading actions, which hamper other activities. We presented a different approach at ICCHP2014; the user can be passive, while the device actively finds useful text in the scene. Text tracking feature was introduced to avoid duplicate reading of the same text. This report presents an improved system with two key components, scene text detection and tracking, that can handle text in various languages including Japanese/Chinese and resolve some scene analysis problems such as merging of text lines. We have employed the MSER (Maximally Stable Extremal Regions) algorithm to obtain better text images, and developed a new text validation filter. Some technical challenges for future device design are presented as well.


Reading assistant Text-to-speech Scene text recognition Wearable camera Text tracking 


  1. 1.
  2. 2.
    Goto, H., Hoda, T.: Real-time text tracking for text-to-speech translation camera for the blind. In: Miesenberger, K., Fels, D., Archambault, D., Peňáz, P., Zagler, W. (eds.) ICCHP 2014, Part I. LNCS, vol. 8547, pp. 658–661. Springer, Heidelberg (2014)CrossRefGoogle Scholar
  3. 3.
    Matas, J., Chum, O., Urban, M., Pajdla, T.: Robust wide-baseline stereo from maximally stable extremal regions. Image Vis. Comput. 22(10), 761–767 (2002)CrossRefGoogle Scholar
  4. 4.
    Bay, H., Ess, A., Tuytelaars, T., van Gool, L.: SURF: speeded up robust features. Comput. Vis. Image Underst. 110(3), 346–359 (2008)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  1. 1.Cyberscience CenterTohoku UniversitySendaiJapan
  2. 2.Graduate School of Information SciencesTohoku UniversitySendaiJapan

Personalised recommendations