Machine Learning

, 78:35

Semi-supervised local Fisher discriminant analysis for dimensionality reduction

  • Masashi Sugiyama
  • Tsuyoshi Idé
  • Shinichi Nakajima
  • Jun Sese

DOI: 10.1007/s10994-009-5125-7

Cite this article as:
Sugiyama, M., Idé, T., Nakajima, S. et al. Mach Learn (2010) 78: 35. doi:10.1007/s10994-009-5125-7


When only a small number of labeled samples are available, supervised dimensionality reduction methods tend to perform poorly because of overfitting. In such cases, unlabeled samples could be useful in improving the performance. In this paper, we propose a semi-supervised dimensionality reduction method which preserves the global structure of unlabeled samples in addition to separating labeled samples in different classes from each other. The proposed method, which we call SEmi-supervised Local Fisher discriminant analysis (SELF), has an analytic form of the globally optimal solution and it can be computed based on eigen-decomposition. We show the usefulness of SELF through experiments with benchmark and real-world document classification datasets.


Semi-supervised learningDimensionality reductionCluster assumptionLocal Fisher discriminant analysisPrincipal component analysis
Download to read the full article text

Copyright information

© Springer Science+Business Media, LLC 2009

Authors and Affiliations

  • Masashi Sugiyama
    • 1
  • Tsuyoshi Idé
    • 2
  • Shinichi Nakajima
    • 3
  • Jun Sese
    • 4
  1. 1.Department of Computer ScienceTokyo Institute of TechnologyMeguro-kuJapan
  2. 2.IBM Research, Tokyo Research LaboratoryYamato-shiJapan
  3. 3.Nikon CorporationKumagaya-shiJapan
  4. 4.Department of Information ScienceOchanomizu UniversityBunkyoJapan