A New Solution Scheme of Unsupervised Locality Preserving Projection Method for the SSS Problem

  • Yong Xu
  • David Zhang
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5342)


When locality preserving projection (LPP) method was originally proposed, it takes as the LPP solution the minimum eigenvalue solution of an eigenequation. After that, LPP has been used for image recognition problems such as face recognition. However, almost no researcher realizes that LPP usually encounters several difficulties when applied to the image recognition problem. For example, since image recognition problems are usually small sample size (SSS) problems, the corresponding eigenequation cannot be directly solved. In addition, it seems that even if one can obtain the solution of the eigenequation by using the numerical analysis approach, the obtained conventional LPP solution might produce the ‘presentation confusion’ problem for samples from different classes, which is disadvantageous for the classification to procedure a high accuracy. In this paper we first thoroughly investigate the characteristics and drawbacks of the conventional LPP solution in the small sample size (SSS) problem in which the sample number is smaller than the data dimension. In order to overcome these drawbacks, we propose a new LPP solution for the SSS problem, which has clear physical meaning and can be directly and easily worked out because it is generated from a non-singular eigenequation. Experimental results the proposed solution scheme can produce a much lower classification error rate than the conventional LPP solution.


Locality preserving projection Feature extraction Face recognition 


  1. 1.
    Belkin, M., Niyogi, P.: Laplacian eigenmaps and spectral techniques for embedding and clustering. In: Proceedings of the Conference on Advances in Neural Information Processing Systems (2001)Google Scholar
  2. 2.
    Yang, J., Zhang, D., Yang, J.-Y., Niu, B.: Globally maximizing, locally minimizing: Unsupervised discriminant projection with applications to face and palm biometrics. IEEE Trans. Pattern Anal. Mach. Intell. 29(4), 650–664 (2007)CrossRefGoogle Scholar
  3. 3.
    He, X., Niyogi, P.: Locality preserving projections. In: Proceedings of the Conference on Advances in Nerual Information Processing Systems (2003)Google Scholar
  4. 4.
    He, X., Yan, S., et al.: Face recognition using laplacianfaces. IEEE Trans. PAMI 27(3), 328–340 (2005)CrossRefGoogle Scholar
  5. 5.
    Min, W., Lu, K., He, X.: Locality preserving projection. Pattern Recognition J. 37(4), 781–788 (2004)CrossRefzbMATHGoogle Scholar
  6. 6.
    He, X., Cai, D., Min, W.: Statistical and computational analysis of locality preserving projection. In: Proceedings of the 22nd International Conference on Machine Learning, pp. 281–288 (2005)Google Scholar
  7. 7.
    He, X., Yan, S., Hu, Y., Zhang, H.: Learning a Locality Preserving Subspace for Visual Recognition. In: ICCV 2003, pp. 385–393 (2003)Google Scholar
  8. 8.
    Zheng, Z., Yang, F., Tan, W., Jia, J., Yang, J.: Gabor feature-based face recognition using supervised locality preserving projection. Signal Processing 87, 2473–2483 (2007)CrossRefzbMATHGoogle Scholar
  9. 9.
    He, X.: Incremental semi-supervised subspace learning for image retrieval. ACM Multimedia, 2–8 (2004)Google Scholar
  10. 10.
    Cheng, J., Liu, Q., Lu, H., Chen, Y.-W.: Supervised kernel locality preserving projections for face recognition. Neurocomputing 67, 443–449 (2005)CrossRefGoogle Scholar
  11. 11.
    Chen, H.-T., Chang, H.-W., Liu, T.-L.: Local discriminant embedding and its variants. In: Proc. CVPR (2005)Google Scholar
  12. 12.
    Yan, S., Xu, D., Zhang, B., Zhang, H.-J., Yang, Q., Lin, S.: Graph embedding and extension: A general framework for dimensionality reduction. IEEE Transactions on PAMI 29(1) (2007)Google Scholar
  13. 13.
    Feng, G., Hu, D., Zhang, D., Zhou, Z.: An alternative formulation of kernel LPP with application to image recognition. Neurocomputing 69(13-15), 1733–1738 (2006)CrossRefGoogle Scholar
  14. 14.
    Hu, D., Feng, G., Zhou, Z.: Two-dimensional locality preserving projections (2DLPP) with its application to palmprint recognition. Pattern Recognition 40(1), 339–342 (2007)CrossRefzbMATHGoogle Scholar
  15. 15.
    Cai, D., He, X.: Orthogonal locality preserving indexing. In: SIGIR 2005, pp. 3–10 (2005)Google Scholar
  16. 16.
    Cai, D., He, X., Hu, Y., Han, J., Huang, T.S.: Learning a Spatially Smooth Subspace for Face Recognition. In: CVPR 2007 (2007)Google Scholar
  17. 17.
    Xu, Y., Zhang, D., Jin, Z., Li, M., Yang, J.-Y.: A fast kernel-based nonlinear discriminant analysis for multi-class problems. Pattern Recognition 39(6), 1026–1033 (2006)CrossRefzbMATHGoogle Scholar
  18. 18.
    Xu, Y., Yang, J.-y., Yang, J.: A reformative kernel Fisher discriminant analysis. Pattern Recognition 37(6), 1299–1302 (2004)CrossRefzbMATHGoogle Scholar
  19. 19.
    Xu, Y., Jin, Z.: Down-sampling face images and low-resolution face recognition. In: The third international conference on innovative computing, information and control (in Press)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Yong Xu
    • 1
  • David Zhang
    • 2
  1. 1.Harbin Institute of Technology, Shenzhen Graduate SchoolShenzhenChina
  2. 2.The Biometrics Research CentreThe Hong Kong Polytechnic University, KowloonHong KongChina

Personalised recommendations