Ground Truth for Layout Analysis Performance Evaluation
Over the past two decades a significant number of layout analysis (page segmentation and region classification) approaches have been proposed in the literature. Each approach has been devised for and/or evaluated using (usually small) application-specific datasets. While the need for objective performance evaluation of layout analysis algorithms is evident, there does not exist a suitable dataset with ground truth that reflects the realities of everyday documents (widely varying layouts, complex entities, colour, noise etc.). The most significant impediment is the creation of accurate and flexible (in representation) ground truth, a task that is costly and must be carefully designed. This paper discusses the issues related to the design, representation and creation of ground truth in the context of a realistic dataset developed by the authors. The effectiveness of the ground truth discussed in this paper has been successfully shown in its use for two international page segmentation competitions (ICDAR2003 and ICDAR2005).
KeywordsGround Truth Document Image Text Region Document Type Definition Connected Component Analysis
- 1.Philips, I.T., Chen, S., Ha, J., Haralick, R.M.: English Document Database Design and Implementation Methodology. In: Proceeding of the 2nd Annual Symposium on Document Analysis and Retrieval, UNLV, USA, pp. 65–104 (1993)Google Scholar
- 2.Antonacopoulos, A., Brough, B.: Methodology for Flexible and Efficient Analysis of the Performance of Page Segmentation Algorithms. In: Proceedings of the 5th International Conference on Document Analysis and Recognition (ICDAR 1999), Bangalore, India, pp. 451–454. IEEE-CS Press, Los Alamitos (1999)Google Scholar
- 4.Antonacopoulos, A., Ritchings, R.T.: Representation and Classification of Complex-Shaped Printed Regions Using White Tiles. In: Proceedings of the 3rd International Conference on Document Analysis and Recognition (ICDAR 1995), Montreal, Canada, pp. 1132–1135. IEEE-CS Press, Los Alamitos (1995)CrossRefGoogle Scholar