Abstract
This chapter presents state-of-the-art work in the area of performance evaluation of video text detection and recognition algorithms and systems. It first introduces the three components which a performance evaluation protocol may comprise of, namely, a benchmarking database, a matching method, and a set of performance metrics. Each of these three components is then explored separately with the presentation of the corresponding component of those well-adopted performance evaluation protocols for video text detection. Finally, two well-known benchmarking datasets for video text recognition are presented.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Wenyin L, Dori D (1997) A protocol for performance evaluation of line detection algorithms. Machine Vis Applicat 9(5/6):240–250
Wolf C, Jolion J-M (2006) Object count/area graphs for the evaluation of object detection and segmentation algorithms. Int J Doc Anal Recognit 8(4):280–296
Li HP, Doermann D (2000) Automatic text detection and tracking in digital video. IEEE Trans Image Process 9(1):147–156
Lienhart R, Wernicked A (2002) Localizing and segmenting text in images and videos. IEEE Trans Circ Syst Video Technol 12(4):236–268
Wu V, Manmatha R, Riseman EM (1999) Textfinder: an automatic system to detect and recognize text in images. IEEE Trans Pattern Anal Mach Intell 21(11):1224–1229
Hua X, Wenyin L, Zhang H (2004) An automatic performance evaluation protocol for video text detection algorithms. IEEE Trans Circ Syst Video Technol 14(4):498–507
Lucas S, Panaretos A, Sosa L, Tang A, Wong S, Young R (2003) ICDAR 2003 robust reading competitions. In: Proceedings of the 7th international conference on document analysis and recognition, Edinburgh, UK, pp 682–687
Shahab A, Shafait F, Dengel A (2011) ICDAR 2011 Robust reading competition – challenge 2: reading text in scene images. In: Proceedings of the 11th international conference of document analysis and recognition, pp 1491–1496
Karatzas D, Shafait F, Uchida S, Iwamura M, Gomez L, Robles S, Mas J, Fernandez D, Almazan J, de las Heras LP (2013) ICDAR 2013 robust reading competition. In: Proceedings of the 12th international conference of document analysis and recognition, pp 1115–1124
Yao C, Bai X, Liu W, Ma Y, Tu Z (2012) Detecting texts of arbitrary orientations in natural images. In: Proceedings of the CVPR, pp 1083–1090
Kasturi R, Goldgof D, Soundararajan P, Manohar V, Garofolo J, Bowers R, Boonstra M, Korzhova V, Zhang J (2009) Framework for performance evaluation of face, text, and vehicle detection and tracking in video: data, metrics, and protocol. IEEE Trans Pattern Anal Mach Intell 31(2):319–336
Landais R, Vinet L, Jolion J-M (2005) Evaluation of commercial OCR: a new goal directed methodology for video documents. In: Proceedings of the 3rd international conference on advances in pattern recognition, vol I, pp 674–683
Knuth DE (1993) The Stanford GraphBase: a platform for combinatorial computing. ACM Press, New York
Wenyin L, Dori D (1998) A proposed scheme for performance evaluation of graphics/text separation algorithms. In: Tombre K, Chhabra A (eds) Graphics recognition – algorithms and systems, Lecture notes in computer science, vol 1389. Springer, Berlin, pp 359–371
Nagy R, Dicker A, Meyer-Wegener K (2011) NEOCR A configurable dataset for natural image text recognition. In: Proceedings of the CBDAR 2011, pp 53–58
Author information
Authors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer-Verlag London
About this chapter
Cite this chapter
Lu, T., Palaiahnakote, S., Tan, C.L., Liu, W. (2014). Performance Evaluation. In: Video Text Detection. Advances in Computer Vision and Pattern Recognition. Springer, London. https://doi.org/10.1007/978-1-4471-6515-6_10
Download citation
DOI: https://doi.org/10.1007/978-1-4471-6515-6_10
Published:
Publisher Name: Springer, London
Print ISBN: 978-1-4471-6514-9
Online ISBN: 978-1-4471-6515-6
eBook Packages: Computer ScienceComputer Science (R0)