Gabor Feature Based Classification Using LDA/QZ Algorithm for Face Recognition

  • Weihong Deng
  • Jiani Hu
  • Jun Guo
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4221)


This paper proposes a LDA/QZ algorithm and its combination of Gabor Filter-based features for the face recognition. The LDA/QZ algorithm follows the common “PCA+LDA” framework, but it has two significant virtues compared with previous algorithms: 1) In PCA step, LDA/QZ transforms the feature space into complete PCA space, so that all discriminatory information is preserved, and 2) In LDA step, the QZ-decomposition is applied to solve the generalized eigenvalue problem, so that LDA can be performed stably even when within-class scatter matrix is singular. Moreover, the Gabor Filter-based Features and the new LDA/QZ algorithm are combined for face recognition. We also performed comparative experimental studies of several state-of-art dimension reduction algorithms and their combinations of Gabor feature for face recognition. The evaluation is based on six experiments involving various types of face images from ORL, FERET, and AR database and experimental results show the LDA/QZ algorithm is always the best or comparable to the best in term of recognition accuracy.


Face Recognition Linear Discriminant Analysis Face Image Generalize Eigenvalue Problem Discriminatory Information 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Zhao, W., Chellappa, R., Rosenfeld, A., Phillips, P.J.: Face Recognition: A Literature Survey. ACM Computing Surveys, 399–458 (2003)Google Scholar
  2. 2.
    Belhumeour, P.N., Hespanha, J.P., Kriegman, D.J.: Eigenfaces versus Fisherfaces: Recognition Using Class Specific Linear Projection. IEEE Trans. Pattern Analysis and Machine Intelligence 19, 711–720 (1997)CrossRefGoogle Scholar
  3. 3.
    Swets, D.L., Weng, J.: Using discriminant eigenfeatures for image retrieval. IEEE Trans. Pattern Anal. Machine Intell. 18, 831–836 (1996)CrossRefGoogle Scholar
  4. 4.
    Fukunaga, K.: Introduction to Statistical Pattern Recognition, 2nd edn. Academic Press, London (1990)MATHGoogle Scholar
  5. 5.
    Phillips, P.J., Wechsler, H., Rauss, P.: The FERET Database and Evaluation Procedure for Face-Recognition Algorithms. Image and Vision Computing 16, 295–306 (1998)CrossRefGoogle Scholar
  6. 6.
    Martinez, A.M., Benavente, R.: The AR Face Database (2003),
  7. 7.
    Turk, M., Pentland, A.: Eigenfaces for Recognition. J. Cognitive Neuroscience. 13, 71–86 (1991)CrossRefGoogle Scholar
  8. 8.
    Friedman, J.H.: Regularized Discriminant Analysis. J. Am. Statistical Assoc. 84, 165–175 (1989)CrossRefGoogle Scholar
  9. 9.
    Daugman, J.G.: Uncertainty Relation for Resolution in Space, Spatial Frequency, and Orientation Optimized by Two-Dimensional Cortical Filters. J. Optical Soc. Am. 2, 1160–1169 (1985)CrossRefGoogle Scholar
  10. 10.
    Daugman, J.G.: Two-Dimensional Spectral Analysis of Cortical Receptive Field Profiles. Vision Research 20, 847–856 (1980)CrossRefGoogle Scholar
  11. 11.
    Deng, W., Hu, J., Guo, J.: Gabor-Eigen-Whiten-Cosine: A Robust Scheme for Face Recognition. In: Zhao, W., Gong, S., Tang, X. (eds.) AMFG 2005. LNCS, vol. 3723, pp. 336–349. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  12. 12.
    Liu, C.: Capitalize on Dimensionality Increasing Techniques for Improving Face Recognition Grand Challenge Performance. IEEE Trans. Pattern Anal. Machine Intell. 28, 725–737 (2006)CrossRefGoogle Scholar
  13. 13.
    Yang, J., Yang, J.Y.: Why Can LDA Be Performed in PCA Transformed Space? Pattern Recognition 36, 563–566 (2003)CrossRefGoogle Scholar
  14. 14.
    Moler, C.B., Stewart, G.W.: An Algorithm for Generalized Matrix Eigenvalue Problems. SIAM J. Num. Anal. 10, 241–256 (1973)MATHCrossRefMathSciNetGoogle Scholar
  15. 15.
    Kaufman, L.: Some Thoughts on the QZ Algorithm for Solving the Generalized Eigenvalue Problem. ACM Trans. Math. Soft. 3, 65–75 (1977)MATHCrossRefMathSciNetGoogle Scholar
  16. 16.
    Zheng, W.S., Lai, J.H., Yuen, P.C.: GA-Fisher: A New LDA-Based Face Recognition Algorithm With Selection of Principal Components. IEEE Trans. Syst., Man, Cybern. B. 35, 1065–1078 (2005)CrossRefGoogle Scholar
  17. 17.
    Liu, C., Wechsler, H.: Gabor Feature Based Classification Using the Enhanced Fisher Linear Discriminant Model for Face Recognition. IEEE Trans. Image Processing. 11, 467–476 (2002)CrossRefGoogle Scholar
  18. 18.
    Yang, J., Alejandro, F.F., Yang, J., Zhang, D., Jin, Z.: KPCA Plus LDA: A Complete Kernel Fisher Discriminant Framework for Feature Extraction and Recognition. IEEE Trans. Pattern Anal. Machine Intell. 27, 230–244 (2005)CrossRefGoogle Scholar
  19. 19.
    Ye, J., Li, Q.: A Two-Stage Linear Discriminant Analysis via QR-Decomposition. IEEE Trans. Pattern Anal. Machine Intell. 27, 929–941 (2005)CrossRefGoogle Scholar
  20. 20.
    Howland, P., Park, H.: Generalizing Discriminant Analysis Using the Generalized Singular Value Decomposition. IEEE Trans. Pattern Anal. Machine Intell. 26, 995–1006 (2004)CrossRefGoogle Scholar
  21. 21.
    Jing, X.Y., Zhang, D., Tang, Y.Y.: An Improved LDA Approach. IEEE Trans. Syst., Man, Cybern. B. 34, 1942–1951 (2004)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Weihong Deng
    • 1
  • Jiani Hu
    • 1
  • Jun Guo
    • 1
  1. 1.Beijing University of Posts and TelecommunicationsBeijingChina

Personalised recommendations