Nonnegative Matrix Factorization (NMF) Based Supervised Feature Selection and Adaptation

  • Paresh Chandra Barman
  • Soo-Young Lee
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5326)


We proposed a novel algorithm of supervised feature selection and adaptation for enhancing the classification accuracy of unsupervised Nonnegative Matrix Factorization (NMF) feature extraction algorithm. At first the algorithm extracts feature vectors for a given high dimensional data then reduce the feature dimension using mutual information based relevant feature selection and finally adapt the selected NMF features using the proposed Non-negative Supervised Feature Adaptation (NSFA) learning algorithm. The supervised feature selection and adaptation improve the classification performance which is fully confirmed by simulations with text-document classification problem. Moreover, the non-negativity constraint, of this algorithm, provides biologically plausible and meaningful feature.


Nonnegative Matrix Factorization Feature Adaptation Feature extraction Feature selection Document classification 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Makrehchi, M.M., Kamel, M.S.: Text classification using small number of features. In: Perner, P., Imiya, A. (eds.) MLDM 2005. LNCS (LNAI), vol. 3587, pp. 580–589. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  2. 2.
    Yang, Y., Pedersen, J.O.: A comparative study on feature selection in text categorization. In: Proc. of 14th ICML, pp. 412–420 (1997)Google Scholar
  3. 3.
    Slonim, N., Tishby, N.: The power of word clusters for text classification. In: Proc. ECIR (2001)Google Scholar
  4. 4.
    Lee, D.D., Seung, H.S.: Learning of the parts of objects by nonnegative matrix factorization. Nature 401, 788–791 (1999)CrossRefzbMATHGoogle Scholar
  5. 5.
    Cichocki, A., Zdunek, R.: Multilayer Nonnegative Matrix Factorization. Electronics Letters 42, 947–948 (2006)CrossRefGoogle Scholar
  6. 6.
    Hoyer, P.O.: Non-negative Matrix Factorization with Sparseness Constraints. Journal of Machine Learning Research 5, 1457–1469 (2004)MathSciNetzbMATHGoogle Scholar
  7. 7.
    Shahnaz, F., Berry, M.W., Paul, P., Plemmons, R.J.: Document clustering using nonnegative matrix factorization. Information Processing and Management 42, 373–386 (2006)CrossRefzbMATHGoogle Scholar
  8. 8.
    Smaragdis, P., Brown, J.C.: Non-Negative Matrix Factorization for Polyphonic Music Transcription. In: Proc. WASPAA 2003, IEEE Press, Los Alamitos (2003)Google Scholar
  9. 9.
    Haykin, S.: Neural Networks a comprehensive foundation, 2nd edn. Prentice Hall, Englewood Cliffs (1999)zbMATHGoogle Scholar
  10. 10.
    Barman, P.C., Lee, S.Y.: Document Classification with Unsupervised Nonnegative Matrix Factorization and Supervised Perceptron Learning. In: Proc. ICIA 2007, pp. 182–186. IEEE Press, Korea (2007)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Paresh Chandra Barman
    • 1
  • Soo-Young Lee
    • 1
  1. 1.Department of Bio and Brain EngineeringBrain Science Research Center (BSRC), KAISTDaejeonKorea

Personalised recommendations