Advertisement

Performance Evaluation in 1 : 1 Biometric Engines

  • Ruud M. Bolle
  • Nalini K. Ratha
  • Sharath Pankanti
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3338)

Abstract

Performance of a biometric system is characterized by its speed, accuracy, and cost. This paper presents fundamentals of 1 : 1 biometric match engine accuracy performance metrics and its evaluation. Here, we explain the basic terminology, performance metrics and related system issues. We also discuss practical methods used for evaluating 1 : 1 biometric match engine accuracy performance and provide a summary of the state-of-art of biometric identifier accuracies.

Keywords

Receiver Operating Characteristic Equal Error Rate Technology Evaluation Speaker Recognition Biometric System 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Bolle, R., Connell, J., SharathPankanti, R.N., Senior, A.: Guide to Biometrics. Springer Professional Computing, New York (2004)Google Scholar
  2. 2.
    Wayman, J.L.: A scientific approach to evaluating biometric systems using mathematical methodology. In: Proceedings of CardTech/SecureTech., Orlando, FL, May 1997, pp. 477–492 (1997)Google Scholar
  3. 3.
    Peterson, W., Birdsall, T., Fox, W.: The theory of signal delectability. Transactions of the IRE PGIT-4, 171–212 (1954)MathSciNetCrossRefGoogle Scholar
  4. 4.
    Biometrics Working Group: Best practices in testing and reporting performance of biometric devices (2000), http://www.afb.org.uk/bwg/bestprac.html
  5. 5.
    Germain, R.: Large scale systems. In: Jain, A., Bolle, R., Pankanti, S. (eds.) Biometrics: Personal Identification in Networked Society, pp. 311–326. Kluwer Academic Press, Norwell (1999)Google Scholar
  6. 6.
    Daugman, J., Williams, G.: A proposed standard for biometric decidability. In: CardTechSecureTech, Atlanta, GA, pp. 223–234 (1996)Google Scholar
  7. 7.
    NIST Speech Group: NIST Year 2003 Speaker Recognition Evaluation Plan (2003), http://www.nist.gov/speech/tests/spk/2003/doc/2003-spkrec-evalplan-v2.2.pdf
  8. 8.
    Mansfield, T., Wayman, J.: Best practices in testing and reporting performance of biometric devices, For biometrics working group. Technical Report Issue 2 Draft 9, Centre for Mathematics and Scientific Computing, National Physics Laboratory, Middlesex, UK (2002)Google Scholar
  9. 9.
    Phillips, P., Grother, P., Micheals, R., Blackburn, D., Elham, T., Bone, J.M.: FRVT 2002: Facial recognition vendor test. Technical report, DoD Counterdrug Technology Development Office, Defence Advance Research Project Agency, National Institute of Justice, Dahlgren, VA; Crane, IN; Arlington, VA (2003)Google Scholar
  10. 10.
    Blackburn, D., Bone, M., Phillips, P.: FRVT 2000: Facial recognition vendor test. Technical report, DoD Counterdrug Technology Development Office, Defence Advance Research Project Agency, National Institute of Justice, Dahlgren, VA; Crane, IN; Arlington, VA (2000)Google Scholar
  11. 11.
    Phillips, P., Moon, H., Rauss, P., Rizvi, S.: The FERET September 1996 database and evaluation procedure. In: Bigün, J., Borgefors, G., Chollet, G. (eds.) AVBPA 1997. LNCS, vol. 1206, Springer, Heidelberg (1997)CrossRefGoogle Scholar
  12. 12.
    Biometric Systems Lab, Pattern Recognition and Image Processing Laboratory, U.S. National Biometric Test Center (FVC2002: Fingerprint verification competition)Google Scholar
  13. 13.
    Maio, D., Maltoni, D., Cappelli, R., Wayman, J., Jain, A.: FVC2000: Fingerprint verification competition. IEEE Transanctions on Pattern Analysis and Machine Intelligence 24, 402–412 (2002)CrossRefGoogle Scholar
  14. 14.
    Przybocki, M., Martin, A.: The 1999 NIST Speaker Recognition Evaluation Speaker Detection and Speaker Tracking. In: EUROSPEECH 1999 6th European Conference on Speech Communication and Technology, Budapest, Hungary (1999)Google Scholar
  15. 15.
    Campbell, J. (ed.): NIST 1999 Speaker Recognition Workshop. Digital Signal Processing, vol. 10(1-3) (2000)Google Scholar
  16. 16.
    Duda, R., Hart, P.: Pattern classification and scene analysis. John Wiley & Sons, Inc., New York (1973)zbMATHGoogle Scholar
  17. 17.
    Mansfield, T., Kelly, G., Chandler, D., Kane, J.: Biometric product testing final report. Technical Report CESG Contract X92A/4009309, Centre for Mathematics and Scientific Computing, National Physics Laboratory, Middlesex, UK (2001)Google Scholar
  18. 18.
    Cochran, W.: Sampling Techniques. In: Probability and Mathematical Statistics, 3rd edn. Wiley Series, John Wiley & Sons, New York (1977)Google Scholar
  19. 19.
    O’Gorman, L.: Seven issues with human authentication technologies. In: Proc. IEEE AutoID 2002, Tarrytown, NY, USA, pp. 185–186 (2002)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2004

Authors and Affiliations

  • Ruud M. Bolle
    • 1
  • Nalini K. Ratha
    • 1
  • Sharath Pankanti
    • 1
  1. 1.IBM Thomas J Watson Research CenterYorktown Heights

Personalised recommendations