Neighbor Line-Based Locally Linear Embedding

  • De-Chuan Zhan
  • Zhi-Hua Zhou
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3918)


Locally linear embedding (Lle) is a powerful approach for mapping high-dimensional data nonlinearly to a lower-dimensional space. However, when the training examples are not densely sampled, Lle often returns invalid results. In this paper, the Nl 3 e (Neighbor Line-based Lle) approach is proposed, which generates some virtual examples with the help of neighbor line such that the Lle learning can be executed on an enriched training set. Experiments show that Nl 3 e outperforms Lle in visualization.


Face Recognition Query Point Minority Class Dimensionality Reduction Method Linear Embedding 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Chawla, N.V., Bowyer, K.W., Hall, L.O., Kegelmeyer, W.P.: Smote: Synthetic minority over-sampling technique. Journal of Artificial Intelligence Research 16, 321–357 (2002)MATHGoogle Scholar
  2. 2.
    Cox, T., Cox, M.: Multidimensional Scaling. Chapman and Hall, London (1994)MATHGoogle Scholar
  3. 3.
    de Ridder, D., Loog, M., Reinders, M.J.T.: Local fisher embedding. In: Proceddings of the 17th International Conference on Pattern Recognition, Cambridge, UK, pp. 295–298 (2004)Google Scholar
  4. 4.
    de Silva, V., Tenenbaum, J.B.: Global versus local methods in nonlinear dimensionality reduction. In: Becker, S., Thrun, S., Overmayer, K. (eds.) Advances in Neural Information Processing Systems, Cambridge, MA, vol. 15, pp. 705–712. MIT Press, Cambridge (2002)Google Scholar
  5. 5.
    Duda, R.O., Hart, P.E., Stork, D.G.: Pattern Classification, 2nd edn. Wiley, New York (2004)MATHGoogle Scholar
  6. 6.
    Geng, X., Zhan, D.-C., Zhou, Z.-H.: Supervised nonlinear dimensionality reduction for visualization and classification. IEEE Transactions on System, Man and Cybernetics-Part B: Cybernetics 35, 1098–1107 (2005)CrossRefGoogle Scholar
  7. 7.
    Jolliffe, Z.T.: Principal Component Analysis. Springer, Heidelberg (1986)CrossRefMATHGoogle Scholar
  8. 8.
    Li, S.Z., Lu, J.: Face recognition using the nearest feature line method. IEEE Transactions on Neural networks 10, 439–443 (1999)CrossRefGoogle Scholar
  9. 9.
    Roweis, S.T., Saul, L.K.: Nonlinear dimensionality reduction by local linear embedding. Science 290, 2323–2326 (2000)CrossRefGoogle Scholar
  10. 10.
    Tenenbaum, J.B., de Silva, V., Langford, J.C.: A global geometric framework for nonlinear dimensionality reduction. Science 290, 2319–2323 (2000)CrossRefGoogle Scholar
  11. 11.
    Wu, J., Zhou, Z.-H.: Face recognition with one training image per person. Pattern Recognition Letters 23, 1711–1719 (2002)CrossRefMATHGoogle Scholar
  12. 12.
    Zhang, J., Shen, H., Zhou, Z.-H.: Unified locally linear embedding and linear discriminant analysis algorithm (ULLELDA) for face recognition. In: Li, S.Z., Lai, J.-H., Tan, T., Feng, G.-C., Wang, Y. (eds.) SINOBIOMETRICS 2004. LNCS, vol. 3338, pp. 296–304. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  13. 13.
    Zheng, W., Zhao, L., Zou, C.: Locally nearest neighbor classifiers for pattern classification. Pattern Recognition 37, 1307–1309 (2004)CrossRefMATHGoogle Scholar
  14. 14.
    Zhou, Z.-H., Jiang, Y.: Medical diagnosis with C4.5 rule preceded by artificial neural network ensemble. IEEE Transactions on Information Technology in Biomedicine 7, 37–42 (2003)CrossRefGoogle Scholar
  15. 15.
    Zhou, Z.-H., Jiang, Y.: NeC4.5: neural ensemble based C4.5. IEEE Transactions on Knowledge and Data Engineering 16, 770–773 (2004)CrossRefGoogle Scholar
  16. 16.
    Zhou, Z.-H., Jiang, Y., Chen, S.-F.: Extracing symbolic rules from trained neural network ensembles. AI Communications 16, 3–15 (2003)MATHGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • De-Chuan Zhan
    • 1
  • Zhi-Hua Zhou
    • 1
  1. 1.National Laboratory for Novel Software TechnologyNanjing UniversityNanjingChina

Personalised recommendations