Multi-oriented Text Detection from Video Using Sub-pixel Mapping

  • Anshul MittalEmail author
  • Partha Pratim Roy
  • Balasubramanian Raman
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 460)


We have proposes a robust multi oriented text detection approach in video images in this paper. Text detection and text segmentation in video data and images is a difficult task due to low contrast and noise from background. Our methodology focuses not only on spatial information of pixel but also optical flow of image data for detecting moving and static text. This paper provides an iterative algorithm with super resolution to reduce information into its fundamental unit, like alphabets and digits in our case. Proposed method performs image enhancement and sub pixel mapping Jiang Hao and Gao (Applied Mechanics and Materials. 262, 2013) [1] to localize text region and Stroke width Transformation Algorithm (SWT) Epshtein et al. (CVPR, 2010) [2] is used for further noise removal. Since SWT may include some non-text region, so SVM using HOM Khare et al. (A new Histogram Oriented Moments descriptor for multi-oriented moving text detection in video, 42(21):7627–7640, 2015) [3] as a descriptor is also used in Final text Selection, Components that satisfy is called a text region. Due to low resolution of images there is a text cluster to remove this text cluster, it is super resolved using sub pixel mapping and hence again passed through process for further segmentation giving an overall accuracy to around 80 %. Our proposed approach is tested in ICDAR2013 dataset in term of recall, precision and F-measure.


Multi-oriented text Low resolution videos Sub pixel mapping Script independent text segmentation 


  1. 1.
    Liu, Jiang Hao, and Shao Hong Gao. “Research on Chromaticity Characterization Methods of the Ink Trapping.” Applied Mechanics and Materials. Vol. 262. 2013.Google Scholar
  2. 2.
    B. Epshtein, E. Ofek, and Y. Wexler. “ Detecting text in natural scenes with stroke width transform.” In CVPR, 2010.Google Scholar
  3. 3.
    Vijeta Khare, Palaiahnakote Shivakumara, Paramesran Raveendran “A new Histogram Oriented Moments descriptor for multi-oriented moving text detection in video” Volume 42, Issue 21, 30 November 2015, Pages 7627–7640.Google Scholar
  4. 4.
    C. Liu, C. Wang, and R. Dai, “Text detection in images based on unsupervised classification of edge-based features,” in Proc. IEEE Int. Conf. Doc. Anal. Recognit., 2005, pp. 610–614.Google Scholar
  5. 5.
    J. J. Weinman, E. Learned-Miller, and A. Hanson, “Scene text recognition using similarity and a lexicon with sparse belief propagation,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 10, pp. 1733–1746, Oct. 2009.Google Scholar
  6. 6.
    Chen H, Tsai S, Schroth G, Chen D, Grzeszczuk R, Girod B.”Robust text detection in natural images with edge enhanced maximally stable extremal regions.” Proceedings of International Conference on Image Processing. 2011:2609–2612.Google Scholar
  7. 7.
    J. Fabrizio, M. Cord, and B. Marcotegui, “Text extraction from street level images,” in CMRT, 2009, pp. 199–204.Google Scholar
  8. 8.
    B. Epshtein, E. Ofek, and Y. Wexler. “Detecting text in natural scenes with stroke width transform”. In CVPR, pages 2963–2970. IEEE, 2010.Google Scholar
  9. 9.
    D. Karatzas, F. Shafait, S. Uchida, M. Iwamura, L. Gomez, S. Robles, J. Mas, D. Fernandez, J. Almazan, L.P. de las Heras, “ICDAR 2013 Robust Reading Competition”, In Proc. 12Th International Conference of Document Analysis and Recognition, 2013, IEEE CPS, pp. 1115–112.Google Scholar
  10. 10.
    Gomez, L., & Karatzas, D. (2014).” MSER-based real-time text detection and tracking”. In Proceedings of ICPR (pp. 3110–3115).Google Scholar
  11. 11.
    X., Lin, K.-H., Fu, Y., Hu, Y., Liu, Y., & Huang, T.-S. (2011).” Text from corners: A novel approach to detect text and caption in videos.” IEEE Transactions on Image Processing, 790–799.Google Scholar
  12. 12.
    Weihua Huang; Shivakumara, P.; Tan, C.L., “Detecting moving text in video using temporal information,” in Pattern Recognition, 2008. ICPR 2008. 19th International Conference on, vol., no., pp. 1–4, 8-11 Dec. 2008.Google Scholar

Copyright information

© Springer Science+Business Media Singapore 2017

Authors and Affiliations

  • Anshul Mittal
    • 1
    Email author
  • Partha Pratim Roy
    • 2
  • Balasubramanian Raman
    • 2
  1. 1.Department of Civil EngineeringIndian Institute of Technology RoorkeeRoorkeeIndia
  2. 2.Department of Computer Science and EngineeringIndian Institute of Technology RoorkeeRoorkeeIndia

Personalised recommendations