Abstract
When locality preserving projection (LPP) method was originally proposed, it takes as the LPP solution the minimum eigenvalue solution of an eigenequation. After that, LPP has been used for image recognition problems such as face recognition. However, almost no researcher realizes that LPP usually encounters several difficulties when applied to the image recognition problem. For example, since image recognition problems are usually small sample size (SSS) problems, the corresponding eigenequation cannot be directly solved. In addition, it seems that even if one can obtain the solution of the eigenequation by using the numerical analysis approach, the obtained conventional LPP solution might produce the ‘presentation confusion’ problem for samples from different classes, which is disadvantageous for the classification to procedure a high accuracy. In this paper we first thoroughly investigate the characteristics and drawbacks of the conventional LPP solution in the small sample size (SSS) problem in which the sample number is smaller than the data dimension. In order to overcome these drawbacks, we propose a new LPP solution for the SSS problem, which has clear physical meaning and can be directly and easily worked out because it is generated from a non-singular eigenequation. Experimental results the proposed solution scheme can produce a much lower classification error rate than the conventional LPP solution.
Chapter PDF
Similar content being viewed by others
References
Belkin, M., Niyogi, P.: Laplacian eigenmaps and spectral techniques for embedding and clustering. In: Proceedings of the Conference on Advances in Neural Information Processing Systems (2001)
Yang, J., Zhang, D., Yang, J.-Y., Niu, B.: Globally maximizing, locally minimizing: Unsupervised discriminant projection with applications to face and palm biometrics. IEEE Trans. Pattern Anal. Mach. Intell. 29(4), 650–664 (2007)
He, X., Niyogi, P.: Locality preserving projections. In: Proceedings of the Conference on Advances in Nerual Information Processing Systems (2003)
He, X., Yan, S., et al.: Face recognition using laplacianfaces. IEEE Trans. PAMI 27(3), 328–340 (2005)
Min, W., Lu, K., He, X.: Locality preserving projection. Pattern Recognition J. 37(4), 781–788 (2004)
He, X., Cai, D., Min, W.: Statistical and computational analysis of locality preserving projection. In: Proceedings of the 22nd International Conference on Machine Learning, pp. 281–288 (2005)
He, X., Yan, S., Hu, Y., Zhang, H.: Learning a Locality Preserving Subspace for Visual Recognition. In: ICCV 2003, pp. 385–393 (2003)
Zheng, Z., Yang, F., Tan, W., Jia, J., Yang, J.: Gabor feature-based face recognition using supervised locality preserving projection. Signal Processing 87, 2473–2483 (2007)
He, X.: Incremental semi-supervised subspace learning for image retrieval. ACM Multimedia, 2–8 (2004)
Cheng, J., Liu, Q., Lu, H., Chen, Y.-W.: Supervised kernel locality preserving projections for face recognition. Neurocomputing 67, 443–449 (2005)
Chen, H.-T., Chang, H.-W., Liu, T.-L.: Local discriminant embedding and its variants. In: Proc. CVPR (2005)
Yan, S., Xu, D., Zhang, B., Zhang, H.-J., Yang, Q., Lin, S.: Graph embedding and extension: A general framework for dimensionality reduction. IEEE Transactions on PAMI 29(1) (2007)
Feng, G., Hu, D., Zhang, D., Zhou, Z.: An alternative formulation of kernel LPP with application to image recognition. Neurocomputing 69(13-15), 1733–1738 (2006)
Hu, D., Feng, G., Zhou, Z.: Two-dimensional locality preserving projections (2DLPP) with its application to palmprint recognition. Pattern Recognition 40(1), 339–342 (2007)
Cai, D., He, X.: Orthogonal locality preserving indexing. In: SIGIR 2005, pp. 3–10 (2005)
Cai, D., He, X., Hu, Y., Han, J., Huang, T.S.: Learning a Spatially Smooth Subspace for Face Recognition. In: CVPR 2007 (2007)
Xu, Y., Zhang, D., Jin, Z., Li, M., Yang, J.-Y.: A fast kernel-based nonlinear discriminant analysis for multi-class problems. Pattern Recognition 39(6), 1026–1033 (2006)
Xu, Y., Yang, J.-y., Yang, J.: A reformative kernel Fisher discriminant analysis. Pattern Recognition 37(6), 1299–1302 (2004)
Xu, Y., Jin, Z.: Down-sampling face images and low-resolution face recognition. In: The third international conference on innovative computing, information and control (in Press)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Xu, Y., Zhang, D. (2008). A New Solution Scheme of Unsupervised Locality Preserving Projection Method for the SSS Problem. In: da Vitoria Lobo, N., et al. Structural, Syntactic, and Statistical Pattern Recognition. SSPR /SPR 2008. Lecture Notes in Computer Science, vol 5342. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-89689-0_81
Download citation
DOI: https://doi.org/10.1007/978-3-540-89689-0_81
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-89688-3
Online ISBN: 978-3-540-89689-0
eBook Packages: Computer ScienceComputer Science (R0)