A Ground-Truthing Tool for Layout Analysis Performance Evaluation

  • A. Antonacopoulos
  • H. Meng
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2423)


There is a significant need for performance evaluation of Layout Analysis methods. The greatest stumbling block is the lack of sufficient ground truth. In particular, there is currently no ground-truth for the evaluation of the performance of page segmentation methods dealing with complexshaped regions and documents with non-uniformly oriented regions. This paper describes a new, flexible, ground-truthing tool. It is fast and easy to use as it performs page segmentation to obtain a first description of regions. The ground-truthing system allows for the editing (merging, splitting and shape alteration) of each of the region outlines obtained from page segmentation. The resulting ground-truth regions are described in terms of isothetic polygons to ensure flexibility and wide applicability. The system also provides for the labelling of each of the ground truth regions according to the type of their content and their logical function. The former can be used to evaluate page classification, while the latter can be used in assessing logical layout structure extraction.


Ground Truth Document Image Split Line Layout Analysis Interval Structure 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. [1]
    G. Nagy, “Document Image Analysis: Automated Performance Evaluation”, Document Image Analysis Systems, A.L. Spitz and A. Dengel eds., World Scientific, 1995.Google Scholar
  2. [2]
    C.H. Lee and T. Kanungo, “The architecture of TRUEVIZ: A groundTRUth / metadata Editing and VisualiZing toolkit”, Symposium on Document Image Understanding Technology, April 23–25, 2001, Columbia, MarylandGoogle Scholar
  3. [3]
    I.T. Philips, S. Chen and R.M. Haralick, “CD-ROM Document Database Standard”, Proceedings of 2nd International Conference on Document Analysis and Recognition (ICDAR’93), Tsukuba, Japan, 1993, pp. 478–483.Google Scholar
  4. [4]
    J. Kanai, S.V. Rice, T.A. Nartker and G. Nagy, “Automated Evaluation of OCR Zoning”, IEEE Transactions on Pattern Recognition and Machine Intelligence, Vol. 17, No. 1, January, 1995, pp. 86–90.CrossRefGoogle Scholar
  5. [5]
    B.A. Yanikoglu and L. Vincent, “Pink Panther: A Complete Environment for Ground-Truthing and Benchmarking Document Page Segmentation”, Pattern Recognition, Vol. 31, No. 9, 1998, pp. 1191–1204.CrossRefGoogle Scholar
  6. [6]
    A. Antonacopoulos and A Brough, “Methodology for Flexible and Efficient Analysis of the Performance of Page Segmentation Algorithms”, Proceedings of 5th International Conference on Document Analysis and Recognition (ICDAR’99), Bangalore, India, 1999, IEEE-CS Press, pp. 451–454.Google Scholar
  7. [7]
    A. Antonacopoulos, “Page Segmentation Using the Description of the Background”, Computer Vision and Image Understanding, Special issue on Document Analysis and Retrieval, Vol. 70, No. 3, June 1998, pp. 350–369.Google Scholar
  8. [8]
    A. Antonacopoulos and R.T. Ritchings, “Representation and Classification of Complex-Shaped Printed Regions Using White Tiles”, Proceedings of 3rd International Conference on Document Analysis and Recognition (ICDAR’95), Montreal, Canada, 1995, Vol. 2, pp. 1132–1135.Google Scholar
  9. [9]
    B. Gatos, S.L. Mantzaris and A. Antonacopoulos, “First International Newspaper Contest”, Proceedings of the 6th International Conference on Document Analysis and Recognition (ICDAR2001), Seattle, USA, September 2001, pp. 1190–1194.Google Scholar
  10. [10]
    A. Antonacopoulos, “Local Skew Angle Estimation from Background Space in Text Regions”, Proceedings of the 4th International Conference on Document Analysis and Recognition (ICDAR’97), Ulm, Germany, August 18–20, 1997, IEEE-CS Press, pp. 684–688.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2002

Authors and Affiliations

  • A. Antonacopoulos
    • 1
  • H. Meng
    • 1
  1. 1.PRImA Group, Department of Computer ScienceUniversity of LiverpoolLiverpoolUK

Personalised recommendations