Machine Vision and Applications

, Volume 16, Issue 2, pp 128–138 | Cite as

The CSU Face Identification Evaluation System

Its purpose, features, and structure
  • J. Ross Beveridge
  • David Bolme
  • Bruce A. Draper
  • Marcio Teixeira
Article

Abstract.

The CSU Face Identification Evaluation System includes standardized image preprocessing software, four distinct face recognition algorithms, analysis tools to study algorithm performance, and Unix shell scripts to run standard experiments. All code is written in ANSII C. The four algorithms provided are principle components analysis (PCA), a.k.a eigenfaces, a combined principle components analysis and linear discriminant analysis algorithm (PCA + LDA), an intrapersonal/extrapersonal image difference classifier (IIDC), and an elastic bunch graph matching (EBGM) algorithm. The PCA + LDA, IIDC, and EBGM algorithms are based upon algorithms used in the FERET study contributed by the University of Maryland, MIT, and USC, respectively. One analysis tool generates cumulative match curves; the other generates a sample probability distribution for recognition rate at recognition rank 1, 2, etc., using Monte Carlo sampling to generate probe and gallery choices. The sample probability distributions at each rank allow standard error bars to be added to cumulative match curves. The tool also generates sample probability distributions for the paired difference of recognition rates for two algorithms. Whether one algorithm consistently outperforms another is easily tested using this distribution. The CSU Face Identification Evaluation System is available through our Web site and we hope it will be used by others to rigorously compare novel face identification algorithms to standard algorithms using a common implementation and known comparison techniques.

Keywords:

Face recognition Evaluation Statistical tools 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Bartlett MS, Draper B, Baek K, Beveridge R (July 2003) Recognizing faces with pca and ica. Comput Vision Image Understand 91:115-137Google Scholar
  2. 2.
    Beveridge JR (2003) Evaluation of face recognition algorithms Web site. +http: www.cs.colostate.edu+Google Scholar
  3. 3.
    Beveridge JR (2001) The geometry of LDA and PCA classifiers illustrated with 3D examples. Technical Report CS-01-101, Computer Science, Colorado State UniversityGoogle Scholar
  4. 4.
    Beveridge JR, Bolme D, Teixeira M, Draper BA (2003) The CSU Face Identification Evaluation System User’s Guide: Version 5.0. Technical report, Colorado State UniversityGoogle Scholar
  5. 5.
    Beveridge JR, She K, Draper B, Givens GH (December 2001) A nonparametric statistical comparison of principal component and linear discriminant subspaces for face recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 535-542Google Scholar
  6. 6.
    Blackburn DM, Bone M, Phillips PJ (2003) Facial Recognition Vendor Test 2000: executive overview. Technical report, Face Recognition Vendor Test (www.frvt.org)Google Scholar
  7. 7.
    Bolme DS (June 2003) Elastic bunch graph matching. Master’s thesis, Computer Science, Colorado State UniversityGoogle Scholar
  8. 8.
    Duda RO, Hart PE, Stork DG (2001) Pattern classification, 2nd edn. Wiley, New YorkGoogle Scholar
  9. 9.
    Givens G, Beveridge JR, Draper BA, Phillips PJ, Grother P (2004) How features of the human face affect recognition: a statistical comparison of three face recognition algorithms. In: Proceedings of the IEEE conference on computer vision and pattern recognition 2004 (to appear)Google Scholar
  10. 10.
    Givens GH, Beveridge JR, Draper BA, Bolme D (2003) Using a generalized linear mixed model to study the configuration space of a PCA+LDA human face recognition algorithm. Technical report, Computer Science, Colorado State UniversityGoogle Scholar
  11. 11.
    Micheals RJ, Boult T (December 2001) Efficient evaluation of classification and recognition systems. In: Proceedings of the IEEE conference on computer vision and pattern recognition 2001, I:50-57Google Scholar
  12. 12.
    Moghaddam B, Nastar C, Pentland A (1996) A Bayesian similarity measure for direct image matching. In: Proceedings of ICPR, B:350-358Google Scholar
  13. 13.
    Moon H, Phillips J (1998) Analysis of pca-based face recognition algorithms. In: Boyer K, Phillips J (eds) Empirical evaluation techniques in computer vision. IEEE Press, New YorkGoogle Scholar
  14. 14.
    Okada K, Steffens J, Maurer T, Hong H, Elagin E, Neven H, von der Malsburg C (1998) The Bochum/USC face recognition system and how it fared in the FERET Phase III test. In: Wechsler H, Phillips PJ, Bruce V, Soulié FF, Huang TS (eds) Face recognition: from theory to applications. Springer, Berlin Heidelberg New York, pp 186-205Google Scholar
  15. 15.
    Phillips PJ, Moon HJ, Rizvi SA, Rauss PJ (October 2000) The FERET evaluation methodology for face-recognition algorithms. Trans Pattern Anal Mach Intell 22(10):1090-1104CrossRefGoogle Scholar
  16. 16.
    Phillips PJ, Grother P, Micheals RJ, Blackburn DM, Tabassi E, Bone JM (2002) FRVT 2002: overview and summary. Technical report, Face Recognition Vendor Test 2002 (www.frvt.org)Google Scholar
  17. 17.
    Teixeira ML (July 2003) The Bayesian intrapersonal/extrapersonal classifier. Master’s thesis, Computer Science, Colorado State UniversityGoogle Scholar
  18. 18.
    Turk MA, Pentland AP (June 1991) Face recognition using eigenfaces. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 586 - 591Google Scholar
  19. 19.
    Yambor WS (2000) Analysis of PCA-based and Fisher discriminant-based image recognition algorithms. Master’s thesis, Colorado State UniversityGoogle Scholar
  20. 20.
    Zhao W, Chellappa R, Krishnaswamy A (1998) Discriminant analysis of principal components for face recognition. In: Wechsler, Philips, Bruce, Fogelman-Soulie, Huang (eds) Face recognition: from theory to applications, Springer, Berlin Heidelberg New York, pp 73-85Google Scholar
  21. 21.
    Zhao W, Chellappa R, Phillips PJ (1999) Subspace linear discriminant analysis for face recognition. University of Maryland, Computer Science DepartmentGoogle Scholar

Copyright information

© Springer-Verlag Berlin/Heidelberg 2005

Authors and Affiliations

  • J. Ross Beveridge
    • 1
  • David Bolme
    • 1
  • Bruce A. Draper
    • 1
  • Marcio Teixeira
    • 1
  1. 1.Computer Science DepartmentColorado State UniversityUSA

Personalised recommendations