Abstract
The quadratic discriminant (QD) classifier has proved to be simple and effective in many pattern recognition problems. However, it requires the computation of the inverse of the sample group covariance matrix. In many biometric problems, such as face recognition, the number of training patterns is considerably smaller than the number of features, and therefore the covariance matrix is singular. Several studies have shown that the use of mixture covariance matrices defined as a combination between the sample group covariance matrices and, for instance, the pooled covariance matrix, not only overcomes the singularity and instability of the sample group covariance matrices but also improves the QD classifier performance. However, little attention has been paid to understanding what has happened with the final shape of these mixture covariance matrices. In this work, we visually analyse in the commonly used eigenfaces space the eigenvectors and eigenvalues of these covariance matrices, given by the three following approaches: maximum likelihood, maximum classification accuracy, and maximum entropy. Experiments using the two well-known ORL and FERET face databases have shown that the maximum entropy approach is the one that achieves a more intuitive visual performance and best classification accuracies, especially in face experiments where moderate changes in facial expressions, pose, and scale, occur.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
C. Liu and H. Wechsler, “Probabilistic Reasoning Models for Face Recognition”. In Proc. of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR’98, Santa Barbara, California, USA, June 1998.
C. E. Thomaz, D. F. Gillies and R. Q. Feitosa, “Using Mixture Covariance Matrices to Improve Face and Facial Expression Recognitions”, in Proc. of 3rd International Conference of Audio-and Video-Based Biometric Person Authentication AVBPA’01, Springer-Verlag LNCS 2091, pp. 71–77, Halmstad, Sweden, June 2001.
C. E. Thomaz, D. F. Gillies and R. Q. Feitosa. A New Quadratic Classifier applied to Biometric Recognition. In proceedings of the Post-ECCV Workshop on Biometric Authentication, Springer-Verlag LNCS 2359, pp. 186–196, Copenhagen, Denmark, June 2002.
E. T. Jaynes, “On the rationale of maximum-entropy methods”, Proceedings of the IEEE, vol. 70, pp. 939–952, 1982.
J.H. Friedman, “Reguralized Discriminant Analysis”, Journal of the American Statistical Association, vol. 84, no. 405, pp. 165–175, March 1989.
J.P. Hoffbeck and D.A. Landgrebe, “Covariance Matrix Estimation and Classification with Limited Training Data”IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 18, no. 7, July 1996.
J.R. Magnus and H. Neudecker, Matrix Differential Calculus with Applications in Statistics and Econometrics, revised edition. Chichester: John Wiley & Sons Ltd., 1999.
K. Fukunaga, Introduction to Statistical Pattern Recognition, second edition. Boston: Academic Press, 1990.
M. Kirby and L. Sirovich, “Application of the Karhunen-Loeve procedure for the characterization of human faces”, IEEE Trans. Pattern Analysis and Machine Intelligence, Vol. 12, No. 1, Jan. 1990.
M. Turk and A. Pentland, “Eigenfaces for Recognition”, “Journal of Cognitive Neuroscience”, Vol. 3, pp. 72–85, 1991.
P. J. Phillips, H. Wechsler, J. Huang and P. Rauss, “The FERET database and evaluation procedure for face recognition algorithms”, Image and Vision Computing Journal, vol. 16, no. 5, pp. 295–306, 1998.
R.A. Johnson R.A. and D.W. Wichern, Applied Multivariate Statistical Analysis, by Prentice-Hall, Inc., 3d. edition, 1992.
T. Greene and W.S. Rayens, “Covariance pooling and stabilization for classification”, Computational Statistics & Data Analysis, vol. 11, pp. 17–42, 1991.
T.W. Anderson, An Introduction to Multivariate Statistical Analysis, second edition. New York: John Wiley & Sons, 1984.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Thomaz, C.E., Gillies, D.F. (2003). Visual Analysis of the Use of Mixture Covariance Matrices in Face Recognition. In: Kittler, J., Nixon, M.S. (eds) Audio- and Video-Based Biometric Person Authentication. AVBPA 2003. Lecture Notes in Computer Science, vol 2688. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-44887-X_21
Download citation
DOI: https://doi.org/10.1007/3-540-44887-X_21
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-40302-9
Online ISBN: 978-3-540-44887-7
eBook Packages: Springer Book Archive