Abstract
The formulation of trace quotient is shared by many computer vision problems; however, it was conventionally approximated by an essentially different formulation of quotient trace, which can be solved with the generalized eigenvalue decomposition approach. In this paper, we present a direct solution to the former formulation. First, considering that the feasible solutions are constrained on a Grassmann manifold, we present a necessary condition for the optimal solution of the trace quotient problem, which then naturally elicits an iterative procedure for pursuing the optimal solution. The proposed algorithm, referred to as Optimal Projection Pursuing (OPP), has the following characteristics: 1) OPP directly optimizes the trace quotient, and is theoretically optimal; 2) OPP does not suffer from the solution uncertainty issue existing in the quotient trace formulation that the objective function value is invariant under any nonsingular linear transformation, and OPP is invariant only under orthogonal transformations, which does not affect final distance measurement; and 3) OPP reveals the underlying equivalence between the trace quotient problem and the corresponding trace difference problem. Extensive experiments on face recognition validate the superiority of OPP over the solution of the corresponding quotient trace problem in both objective function value and classification capability.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Belhumeur, P., Hespanha, J., Kriegman, D.: Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection. IEEE Trans. Pattern Analysis and Machine Intelligence 19(7), 711–720 (1997)
Belkin, M., Niyogi, P.: Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering. In: Advances in Neural Information Processing System 15, Vancouver, British Columbia, Canada (2001)
Edelman, A., Arias, T.A., Simth, S.T.: The Geometry of Algorithms with Orthogonality Constraints. SIAM J. Matrix Anal. Appl. 20(2), 303–353
Fukunaga, K.: Statistical Pattern Recognition. Academic Press, London (1990)
Hand, D.: Kernel Discriminant Analysis. Research Studies Press, Chichester (1982)
He, X., Yan, S., Hu, Y., Niyogi, P., Zhang, H.: Face Recognition using Laplacianfaces. IEEE Transactions on Pattern Analysis and Machine Intelligence 27(3) (March 2005)
Joliffe, I.: Principal Component Analysis. Springer, New York (1986)
Li, H., Jiang, T., Zhang, K.: Efficient and Robust Feature Extraction by Maximum Margin Criterion. In: Advances in Neural Information Processing Systems 16 (2004)
Lu, J., Plataniotis, K.N., Venetsanopoulos, N.: Face Recognition Using Kernel Direct Discriminant Analysis Algorithms. IEEE Trans. On Neural Networks (August 2002)
Luettin, J., Maitre, G.: Evaluation Protocol for the Extended M2VTS Database (XM2VTS). DMI for Perceptual Artificial Intelligence (1998)
Martinez, A., Benavente, R.: The AR Face Database (2003), http://rvl1.ecn.purdue.edu/~aleix/aleix_faceDB.html
Shashua, A., Levin, A.: Linear Image Coding for Regression and Classification using the Tensor-rank Principle. In: IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), Hawaii (December 2001)
Sim, T., Baker, S., Bsat, M.: The CMU Pose, Illumination, and Expression (PIE) Database. In: Proceedings of the IEEE International Conference on Automatic Face and Gesture Recognition (May 2002)
Turk, M., Pentland, A.: Face Recognition Using Eigenfaces. In: IEEE Conference on Computer Vision and Pattern Recognition, Maui, Hawaii (1991)
Vasilescu, M., Terzopoulos, D.: Multilinear Subspace Analysis for Image Ensembles”. In: Proc. Computer Vision and Pattern Recognition Conf (CVPR 2003), June 2003, vol. 2, pp. 93–99 (2003)
Wang, X., Tang, X.: A unified framework for subspace face recognition. IEEE Trans. Pattern Analysis and Machine Intelligence 26(9), 1222–1228 (2004)
Wilks, W.: Mathematical Statistics. Wiley, New York (1963)
Yang, M.: Kernel Eigenfaces vs. Kernel Fisherfaces: Face Recognition Using Kernel Methods. In: Proc. of the 5th Int. Conf. on Automatic Face and Gesture Recognition, Washington, DC (May 2002)
Yan, S., Xu, D., Zhang, B., Zhang, H.: Graph Embedding: A General Framework for Dimensionality Reduction. In: Proc. Computer Vision and Pattern Recognition Conf. (2005)
Ye, J., Janardan, R., Park, C., Park, H.: An optimization criterion for generalized discriminant analysis on undersampled problems. IEEE Transactions on Pattern Analysis and Machine Intelligence 26, 982–994 (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Yan, S., Tang, X. (2006). Trace Quotient Problems Revisited. In: Leonardis, A., Bischof, H., Pinz, A. (eds) Computer Vision – ECCV 2006. ECCV 2006. Lecture Notes in Computer Science, vol 3952. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11744047_18
Download citation
DOI: https://doi.org/10.1007/11744047_18
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-33834-5
Online ISBN: 978-3-540-33835-2
eBook Packages: Computer ScienceComputer Science (R0)