Advertisement

A proposed scheme for performance evaluation of graphics/text separation algorithms

  • Liu Wenyin
  • Dov Dori
Performance Evaluation
Part of the Lecture Notes in Computer Science book series (LNCS, volume 1389)

Abstract

We propose an objective, comprehensive, and complexity independent metric for performance evaluation of graphics/text separation (text segmentation) algorithms. The metric includes a positive set and a negative set of indices, at both the character and the character string (text) levels, _and it evaluates the detection accuracy of the location, width, height, orientation, skew, string length, and the fragmentation of both characters and strings. Assigning a Segmentation Difficulty (SD) value to the ground truth characters, the performance indices are normalized with respect to the character SD and are therefore independent of the ground truth complexity. The evaluation provides an overall, objective, and comprehensive metric of the text segmentation capability of various algorithms aimed at performing this task.

Keywords

Performance Evaluation Text Segmentation Document Analysis Recognition 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. [1]
    Haralick, “Performance Characterization in Image Analysis—Thinning, a Case in Point”, Pattern Recognition Letters 13:5–12, 1992.Google Scholar
  2. [2]
    Lee, L. Lam, and C.Y. Suen, “Performance Evaluation of Skeletonization Algorithms for Document Image Processing”, In: Proc. of the first International Conference on Document Analysis and Recognition, Saint-Malo, France, pp 260–271, 1991.Google Scholar
  3. [3]
    Lam, and C.Y. Suen, “Evaluation of Thinning Algorithms from an OCR Viewpoint. In: Proc. of the second International Conference on Document Analysis and Recognition, Tsukuba, Japan, pp 287–290, 1993.Google Scholar
  4. [4]
    Jaisimha, R.M. Haralick, and D. Dori, “A Methodology for the Characterization of the Performance of Thinning Algorithms”, In: Proc. of the second International Conference on Document Analysis and Recognition, Tsukuba, Japan, pp 282–286, 1993.Google Scholar
  5. [5]
    Cordella and A. Marcelli, “An alternative Approach to the Performance Evaluation of Thinning Algorithms for Document Processing Applications”, In: Kasturi R, Tombre K (eds) Graphics Recognition — Methods and Applications (Lecture Notes in Computer Science, vol. 1072), Springer, Berlin, pp 13–22, 1996.Google Scholar
  6. [6]
    O. Hori, D.S. Doermann, “Quantitative Measurement of the Performance of Raster-to-Vector Conversion Algorithms”, In: Kasturi R, Tombre K (eds) Graphics Recognition — Methods and Applications (Lecture Notes in Computer Science, vol. 1072), Springer, Berlin, pp 57–68, 1996.Google Scholar
  7. [7]
    B. Kong, I.T. Phillips, R.M. Haralick, A. Prasad, R. Kasturi, “A Benchmark: Performance Evaluation of Dashed-Line Detection Algorithms”, In: Kasturi R, Tombre K (eds) Graphics Recognition — Methods and Applications (Lecture Notes in Computer Science, vol. 1072), Springer, Berlin, pp 270–285, 1996.Google Scholar
  8. [8]
    Liu W. and D. Dori, “A Protocol for Performance Evaluation of Line Detection Algorithms”, Machine Vision Applications, Special Issue on Performance Characterisitics of Vision Algorithms, 9(5):240–250, 1997.Google Scholar
  9. [9]
    L.A. Fletcher and R. Kasturi, “A Robust Algorithm for Textbox String Separation from Mixed Text/Graphics Images”, IEEE Trans. PAMI, 10(6):900–918., 1988Google Scholar
  10. [10]
    I. Chai and D. Dori, “Extraction of Text Boxes from Engineering Drawings”, Proc. SPIE/IS&T Symposium on Electronic Imaging Science and Technology, Conference on Character Recognition and Digitizer Technologies, San Jose (CA, USA), SPIE Vol. 1661, pp 38–49, 1992.Google Scholar
  11. [11]
    Gao J., Tang L. Liu W. and Tang Z., “Segmentation and Recognition of Dimension Texts in Engineering Drawings”, ICDAR'95, Montreal, Canada, pp 528–531, 1995.Google Scholar
  12. [12]
    D. Dori and Liu W., “Vector-Based Segmentation of Text Connected to Graphics in Engineering Drawings”, Advances in Structural and Syntactical Pattern Recognition, eds. P. Perner, P. Wang, and A. Rosenfeld, Lecture Notes in Computer Science, vol. [12], pp 322–331, Springer, 1996.Google Scholar
  13. [13]
    Liu W. and D. Dori, “Automated CAD Conversion with the Machine Drawing Understanding System”, Proc. DAS96, Malvern, PA, USA, October, pp 241—259, 1996.Google Scholar
  14. [14]
    http://graphics.nynexst.com/iapr-tc l0/contest.htmlGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 1998

Authors and Affiliations

  • Liu Wenyin
    • 1
  • Dov Dori
    • 1
  1. 1.Faculty of Industrial Engineering and ManagementTechnion-Israel Institute of TechnologyHaifaIsrael

Personalised recommendations