A Real-Time Scene Text to Speech System

  • Lukáš Neumann
  • Jiří Matas
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7585)


An end-to-end real-time scene text localization and recognition method is demonstrated. The method localizes textual content in images, a video or a webcam stream, performs character recognition (OCR) and “reads” it out loud using a text-to-speech engine. The method has been recently published, achieves state-of-the-art results on public datasets and is able to recognize different fonts and scripts including non-latin ones.

The real-time performance is achieved by posing the character detection problem as an efficient sequential selection from the set of Extremal Regions (ERs) which has a linear computation complexity in the number of pixels in the image. Robustness to blur, noise and illumination and color variations is also demonstrated. Finally, we show effects of various control parameters.


  1. 1.
    Jung-Jin, L., Lee, P.H., Lee, S.W., Yuille, A., Koch, C.: Adaboost for text detection in natural scene. In: ICDAR 2011, pp. 429–434 (2011)Google Scholar
  2. 2.
    Chen, X., Yuille, A.L.: Detecting and reading text in natural scenes. In: CVPR, vol. 2, pp. 366–373 (2004)Google Scholar
  3. 3.
    Lienhart, R., Wernicke, A.: Localizing and segmenting text in images and videos. Circuits and Systems for Video Technology 12, 256–268 (2002)CrossRefGoogle Scholar
  4. 4.
    Pan, Y.F., Hou, X., Liu, C.L.: Text localization in natural scene images based on conditional random field. In: ICDAR 2009, pp. 6–10. IEEE Computer Society (2009)Google Scholar
  5. 5.
    Epshtein, B., Ofek, E., Wexler, Y.: Detecting text in natural scenes with stroke width transform. In: CVPR 2010, pp. 2963–2970 (2010)Google Scholar
  6. 6.
    Zhang, J., Kasturi, R.: Character Energy and Link Energy-Based Text Extraction in Scene Images. In: Kimmel, R., Klette, R., Sugimoto, A. (eds.) ACCV 2010, Part II. LNCS, vol. 6493, pp. 308–320. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  7. 7.
    Neumann, L., Matas, J.: Real-time scene text localization and recognition. In: CVPR 2012 (to appear, 2012)Google Scholar
  8. 8.
    Neumann, L., Matas, J.: Text localization in real-world images using efficiently pruned exhaustive search. In: ICDAR 2011, pp. 687–691 (2011)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Lukáš Neumann
    • 1
  • Jiří Matas
    • 1
  1. 1.Centre for Machine Perception, Department of CyberneticsCzech Technical UniversityPragueCzech Republic

Personalised recommendations