A Note on Evaluation of Image Recognition Systems

  • Herbert Tesser
  • Theron Trout
Conference paper
First Online:
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2749)

Abstract

The ability to systematically evaluate the results of automated image processing systems has been problematic. It remains so. In this work we address two issues in testing: 1) the use of incomplete and inaccurate reference data; and 2) we introduce a new, somewhat faster method of evaluating systems that recognize linear structures. We illustrate the latter using road and lines-of-communication recognition systems. We describe past work on evaluation systems and compare their strengths and weaknesses relative to the current work.

Keywords

False Negative Rate Road Segment Versus Versus Versus Versus Versus Versus Versus Versus Versus Road Extraction 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
Download to read the full conference paper text

References

  1. [Fitzgerald]
    Fitzgerald, R. W. and Lees, B. G. (1994), ‘Assessing the classification accuracy of multisource remote sensing data’, Remote Sensing of the Environment, Vol. 47, pp. 362–368.CrossRefGoogle Scholar
  2. [Forstner]
    Forstner, W., “10 Pros and Cons Against Performance Characterization of Vision Algorihtms”, Workshop ‘Performance Characterization of Vision Algorithms’, Cambridge, 1996Google Scholar
  3. [Kiiveri]
    Kiiveri, H. T., Caccetta, P. A., and Evans, F. H. (2001), Use of conditional probability networks for environmental monitoring. Int’l J. of Remote Sensing, Vol 22, No. 7, pp 1173–1190.CrossRefGoogle Scholar
  4. [Rosenfield]
    Rosenfield, G.H. (1986) Analysis of thematic map classification error matrices. Photogram metric Engineering and Remote Sensing, 52,5, pp 681–686.Google Scholar
  5. [Wiederman]
    Wiederman, C., Heipke, C., Mayer, H. Empirical Evaluation of Automatically Extracted Road Axes, CVPR Workshop on “Empirical Evaluation Methods in Computer Vision”, IEEE Computer Society Press, Los Alamitos, California, 172–187Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2003

Authors and Affiliations

  • Herbert Tesser
    • 1
  • Theron Trout
    • 2
  1. 1.Marshall UniversityHuntingtonUSA
  2. 2.Strictly Business Computer SystemsHuntingtonUSA

Personalised recommendations