Advertisement

Large scale address recognition systems Truthing, testing, tools, and other evaluation issues

  • Srirangaraj Setlur
  • Alfred Lawson
  • Venugopal Govindaraju
  • Sargur Srihari
Original Research Paper

Abstract.

This paper describes the issues involved in the design of a system for evaluating improvements in the performance of a real-time address recognition system being used by the United States Postal Service for processing mail-piece images. Evaluation of the performance of recognition systems is normally carried out by measuring the performance of the system on a representative sample of images. Designing a comprehensive and valid testing scenario is a complex task that requires careful attention. Sampling live mail-stream to generate a deck of images representative of the general mail-stream for testing, truthing (generating reference data on a significant number of images), grading and evaluation, and designing tools to facilitate these functions are important topics that need to be addressed. This paper describes the efforts of the United States Postal Service and CEDAR towards developing an infrastructure for sampling, truthing, and testing of mail-stream images.

Key words:Truthing – Software tools – Evaluation systems – Recognition systems 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag Berlin Heidelberg 2002

Authors and Affiliations

  • Srirangaraj Setlur
    • 1
  • Alfred Lawson
    • 2
  • Venugopal Govindaraju
    • 1
  • Sargur Srihari
    • 1
  1. 1.Center of Excellence for Document Analysis and Recognition, 520 Lee Entrance Ste 202, Amherst NY 14228, USA; e-mail: {setlur,govind,srihari}@cedar.buffalo.edu US
  2. 2.United States Postal Service, 8403 Lee Highway, Merrifield VA 22082, USA; e-mail: alawson@email.usps.gov US

Personalised recommendations