Introduction to Video Text Detection

  • Tong Lu
  • Shivakumara Palaiahnakote
  • Chew Lim Tan
  • Wenyin Liu
Chapter
Part of the Advances in Computer Vision and Pattern Recognition book series (ACVPR)

Abstract

Text plays a dominant role in video viewing and understanding as text carries rich and important information relevant to the video contents. Studies have shown that humans often pay first attention to text over other objects in a video as text helps in getting semantics relevant to the content of the video. With this in mind, this chapter introduces research in video text detection. It first reviews relevant literature and then discusses characteristics and difficulties of video text detection faced by the majority of the methods under review. Various issues such as low resolution of video images, the presence of both caption and scene text in video, and background complexity variations are examined. This chapter also presents a brief historical overview to show how video text detection has evolved from the field of document image analysis and how the document analysis community has explored various methods proposed in different fields, including image processing, pattern recognition, computer vision, and artificial intelligence to find solution to text detection in video. Finally, this chapter discusses potential applications of video text detection.

Keywords

Document Image Text Line Optical Character Recognition Text Detection Text Recognition 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

References

  1. 1.
    Sun Q-Y, Lu Y (2012) Text location in scene images using visual attention model. Int J Pattern Recogn Artif Intell 26(04):1–22CrossRefMathSciNetGoogle Scholar
  2. 2.
    Jung K, Kim KI, Jain AK (2004) Text information extraction in images and video: a survey. Pattern Recogn 37:977–997CrossRefGoogle Scholar
  3. 3.
    Chen D, Luttin J, Shearer K (2000) A survey of text detection and recognition in images and videos, IDIAP research report, pp 1–21Google Scholar
  4. 4.
    Zhang J, Kasturi R (2008) Extraction of text objects in video documents: recent progress. In: Proceedings of the eighth IAPR workshop on document analysis systems (DAS), pp 5–17Google Scholar
  5. 5.
    Doremann D, Liang J, Li H (2003) Progress in camera-based document image analysis. In: Proceedings of the seventh international conference on document analysis and recognition (ICDAR)Google Scholar
  6. 6.
    Chen D, Odobez JM (2005) Video text recognition using sequential Monte Carlo and error voting methods. Pattern Recogn Lett 1386–1403Google Scholar
  7. 7.
    Nagy G (2000) Twenty years of document image analysis. IEEE Trans Pattern Anal Mach Intel (PAMI) 38–62Google Scholar
  8. 8.
    Tang YY, Lee SW, Suen CY (1996) Automatic document processing: a survey. Pattern Recogn 1931–1952Google Scholar
  9. 9.
    Abele L, Wahl F, Scheri W (1981) Procedures for an automatic segmentation of text graphics and halftone regions in document, Scandinavian conference on image analysis, pp 177–182Google Scholar
  10. 10.
    Toyoda J, Noguchi Y, Nishmiura Y (1982) Study of extracting Japanese newspaper. Int Conf Pattern Recog 1113–1115Google Scholar
  11. 11.
    Wong IY, Casey RG, Wahl FM (1982) Document analysis system. IBM Res Dev 647–656Google Scholar
  12. 12.
    Jain AK, Chen Y (1994) Address block location using color and texture analysis, CVGIP. Image Underst 179–190Google Scholar
  13. 13.
    Jain AK, Bhattcharjee SK (1992) Address block location using Gabor filters. Pattern Recogn 1459–1477Google Scholar
  14. 14.
    Jain AK, Farrokhina F (1991) Unsupervised texture segmentation using Gabor filter. Pattern Recogn 1167–1186Google Scholar
  15. 15.
    Ohya J, Shio A, Akamatsu S (1994) Recognizing characters in scene images. IEEE Trans Pattern Anal Mach Intel (PAMI) 214–224Google Scholar
  16. 16.
    Zhong Y, Karu K, Jain AK (1995) Locating text in complex color images. Pattern Recogn 1523–1535Google Scholar
  17. 17.
    Kim HK (1996) Efficient automatic text location method and content-based indexing and structuring of video database. J Vis Commun Image Represent 7:336–344CrossRefGoogle Scholar
  18. 18.
    Shim JC, Dorai C, Bolle R (1998) Automatic text extraction from video for content-based annotation and retrieval. In: Proceedings of international conference on pattern recognition (ICPR), vol 1, pp 618–620Google Scholar
  19. 19.
    Lienhart R, Stuber F (1996) Automatic text recognition in digital videos. In: Proceedings of SPIE, pp 180–188Google Scholar
  20. 20.
    Lienhart V, Effelsberg W (1998) Automatic text segmentation and text recognition for video indexing, Technical Report TR-98-009, PraktscheInformatik IV, University of MannheinGoogle Scholar
  21. 21.
    Jain AK, Yu B (1998) Automatic text location in images and video frames. Pattern Recogn 31:2055–2076CrossRefGoogle Scholar
  22. 22.
    Wu V, Manmatha R, Risean EM (1999) Text finder: an automatic system to detect and recognize text in images. IEEE Trans Pattern Anal Mach Intell (PAMI) 21:1224–1229CrossRefGoogle Scholar
  23. 23.
    Wu V, Manmatha R, Risean EM (1997) Finding text in images. In: Proceedings of ACM international conference on digital libraries, pp 1–10Google Scholar
  24. 24.
    Mao W, Chung F, Lanm K, Siu W (2002) Hybird Chinese/English text detection in images and video frames. In: Proceedings of the international conference on pattern recognition (ICPR), vol 3, pp 1015–1018Google Scholar
  25. 25.
    Jeong KY, Jung K, Kim EY Kim JJ (1999) Neural network-based text location for news video indexing. In: Proceedings of the international conference on image processing (ICIP), pp 319–323Google Scholar
  26. 26.
    Jung K, Kim K, Kurata T, Kourogi M, Han J (2002) Text scanner with text detection technology on image sequence. In: Proceedings of the international conference on pattern recognition (ICPR), vol 3, pp 473–476Google Scholar
  27. 27.
    Kim KI, Jung J, Park SH, Kim HJ (2001) Support vector machine-based text detection in digital video. Pattern Recogn 34:527–529CrossRefGoogle Scholar
  28. 28.
    Li H, Doermann D (2000) A video text detection system based on automated training. In: Proceedings of the international conference on pattern recognition (ICPR), pp 223–226Google Scholar
  29. 29.
    Li H, Doerman D, Kia O (2000) Automatic text detection and tracking in digital video. IEEE Trans Pattern Anal Mach Intell (PAMI) 9:147–156Google Scholar
  30. 30.
    Chen D, Shearer K, Bourlard H (2001) Text enhancement with asymmetric filter for video OCR. In: Proceedings of the international conference on image analysis and processing, pp 192–197Google Scholar
  31. 31.
    Shivakumara P, Phan TQ, Tan CL (2009) A robust wavelet transform based technique for video text detection. In: Proceedings of ICDAR, pp 1285–1289Google Scholar
  32. 32.
    Shivakumara P, Phan TQ, Tan CL (2010) New fourier-statistical features in RGB space for video text detection. IEEE Trans Circ Syst Video Technol (TCSVT) 20:1520–1532CrossRefGoogle Scholar
  33. 33.
    Shivakumara P, Phan TQ, Tan CL(2010) New wavelet and color features for text detection in video. In: Proceedings of ICPR, pp 3996–3999Google Scholar
  34. 34.
    Shivakumara P, Dutta A, Tan CL, Pal U (2010) A new wavelet-median-moment based method for multi-oriented video text detection. In: Proceedings of DAS, pp 279–288Google Scholar
  35. 35.
    Shivakumara P, Phan TQ, Tan CL (2011) A laplacian approach to multi-oriented text detection in video. IEEE Trans Pattern Anal Mach Intell (TPAMI) 33:412–419CrossRefGoogle Scholar
  36. 36.
    Shivakumara P, Huang W, Tan CL (2008) An efficient edge based technique for text detection in video frames. In: Proceedings of the international workshop on document analysis systems (DAS2008), pp 307–314Google Scholar
  37. 37.
    Shivakumara P, Huang W, Tan CL (2008) Efficient video text detection using edge features. In: Proceedings of the international conference on pattern recognition (ICPR08)Google Scholar
  38. 38.
    Shivakumara P, Phan TQ, Tan CL (2009) Video text detection based on filters and edge analysis. In: Proceedings of ICME, 2009, pp 514–517Google Scholar
  39. 39.
    Shivakumara P, Phan TQ, Tan CL (2009) A gradient difference based technique for video text detection. In: Proceedings of ICDAR, 2009, pp 156–160Google Scholar
  40. 40.
    Phan TQ, Shivakumara P, Tan CL (2009) A Laplacian method for video text detection. In: Proceedings of ICDAR, pp 66–70Google Scholar
  41. 41.
    Shivakumara P, Huang W, Trung PQ, Tan CL (2010) Accurate video text detection through classification of low and high contrast images. Pattern Recogn 43:2165–2185CrossRefGoogle Scholar
  42. 42.
    Shivakumara P, Sreedhar RP, Phan TQ, Shijian L, Tan CL (2012) Multi-oriented video scene text detection through Bayesian classification and boundary growing. IEEE Trans Circ Syst Video Technol (TCSVT) 22:1227–1235CrossRefGoogle Scholar
  43. 43.
    Sharma N, Shivakumara P, Pal U, Blumenstein M, Tan CL (2012) A new method for arbitrarily-oriented text detection in video. In: Proceedings of DAS, pp 74–78Google Scholar

Copyright information

© Springer-Verlag London 2014

Authors and Affiliations

  • Tong Lu
    • 1
  • Shivakumara Palaiahnakote
    • 2
  • Chew Lim Tan
    • 3
  • Wenyin Liu
    • 4
  1. 1.Department of Computer Science and TechnologyNanjing UniversityNanjingChina
  2. 2.Faculty of CSITUniversity of MalayaKuala LumpurMalaysia
  3. 3.National University of SingaporeSingaporeSingapore
  4. 4.Multimedia Software Engineering Research CenterCity University of Hong KongKowloon TongHong Kong SAR

Personalised recommendations