Nonnegative Matrix Factorization (NMF) Based Supervised Feature Selection and Adaptation
We proposed a novel algorithm of supervised feature selection and adaptation for enhancing the classification accuracy of unsupervised Nonnegative Matrix Factorization (NMF) feature extraction algorithm. At first the algorithm extracts feature vectors for a given high dimensional data then reduce the feature dimension using mutual information based relevant feature selection and finally adapt the selected NMF features using the proposed Non-negative Supervised Feature Adaptation (NSFA) learning algorithm. The supervised feature selection and adaptation improve the classification performance which is fully confirmed by simulations with text-document classification problem. Moreover, the non-negativity constraint, of this algorithm, provides biologically plausible and meaningful feature.
KeywordsNonnegative Matrix Factorization Feature Adaptation Feature extraction Feature selection Document classification
Unable to display preview. Download preview PDF.
- 2.Yang, Y., Pedersen, J.O.: A comparative study on feature selection in text categorization. In: Proc. of 14th ICML, pp. 412–420 (1997)Google Scholar
- 3.Slonim, N., Tishby, N.: The power of word clusters for text classification. In: Proc. ECIR (2001)Google Scholar
- 8.Smaragdis, P., Brown, J.C.: Non-Negative Matrix Factorization for Polyphonic Music Transcription. In: Proc. WASPAA 2003, IEEE Press, Los Alamitos (2003)Google Scholar
- 10.Barman, P.C., Lee, S.Y.: Document Classification with Unsupervised Nonnegative Matrix Factorization and Supervised Perceptron Learning. In: Proc. ICIA 2007, pp. 182–186. IEEE Press, Korea (2007)Google Scholar