Abstract
We present the methodology and recognition performance characteristics used in the Face Recognition Vendor Test 2002. We refine the notion of a biometric imposter, and show that the traditional measures of identification and verification performance, are limiting cases of the open-universe watch list task. The watch list problem generalizes the tradeoff of detection and identification of persons of interest against a false alarm rate. In addition, we use performance scores on disjoint populations to establish a means of computing and displaying distribution-free estimates of the variation of verification vs. false alarm performance. Finally we formalize gallery normalization, which is an extension of previous evaluation methodologies; we define a pair of gallery dependent mappings that can be applied as a post recognition step to vectors of distance or similarity scores. All the methods are biometric non-specific, and applicable to large populations.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
K. Fukunaga. Statistical Pattern Recognition, chapter 3. Academic Press, second edition, 1990.
R. J. Micheals, P. Grother, and P. J. Phillips. The NIST Human ID Evaluation Framework. In Proceedings of the Fourth International Conference on Audio-and Video-based Biometric Person Authentication, June 2003.
P. J. Phillips, H. Moon, S.A. Rizvi, and P. J. Rauss. The FERET Evaluation Methodology for Face Recognition Algorithms. IEEE Trans. Pattern Analysis and Machine Intelligence, 22:1090–1104, 2000.
P. J. Phillips, P. Grother, R. J. Micheals, D.M. Blackburn, E. Tabassi, and M. Bone. Face Recognition Vendor Test 2002. Evaluation Report IR 6965, National Institute of Standards and Technology, http://www.itl.nist.gov/iad/894.03/face/face.html, March 2003.
J. L. Wayman. Error-Rate Equations for the General Biometric System. IEEE Robotics and Automation Magazine, pages 35–48, 3 1999.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Grother, P., Micheals, R.J., Phillips, P.J. (2003). Face Recognition Vendor Test 2002 Performance Metrics. In: Kittler, J., Nixon, M.S. (eds) Audio- and Video-Based Biometric Person Authentication. AVBPA 2003. Lecture Notes in Computer Science, vol 2688. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-44887-X_109
Download citation
DOI: https://doi.org/10.1007/3-540-44887-X_109
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-40302-9
Online ISBN: 978-3-540-44887-7
eBook Packages: Springer Book Archive