Neurodynamics-Based Nonnegative Matrix Factorization for Classification

  • Nian ZhangEmail author
  • Keenan Leatham
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11302)


This paper contributes to study the influence of various NMF algorithms on the classification accuracy of each classifier as well as to compare the classifiers among themselves. We focus on a fast nonnegative matrix factorization (NMF) algorithm based on a discrete-time projection neural network (DTPNN). The NMF algorithm is combined with three classifiers in order to find out the influence of dimensionality reduction performed by the NMF algorithm on the accuracy rate of the classifiers. The convergent objective function values in terms of two popular objective functions, Frobenius norm and Kullback-Leibler (K-L) divergence for different NMF based algorithms on a wide range of data sets are demonstrated. The CPU running time in terms of these objective functions on different combination of NMF algorithms and data sets are also shown. Moreover, the convergent behaviors of different NMF methods are illustrated. In order to test its effectiveness on classification accuracy, a performance study of three well-known classifiers is carried out and the influence of the NMF algorithm on the accuracy is evaluated.


Nonnegative matrix factorization Discrete-time projection neural network Dimensional reduction Feature selection Classification 



This work was supported in part by the National Science Foundation (NSF) under Grants HRD #1505509, HRD #1533479, and DUE #1654474.


  1. 1.
    Gantz, J., Reinsel, D.: The digital universe in 2020: big data, bigger digital shadows, and biggest growth in the far east. IDC – EMC Corporation (2012)Google Scholar
  2. 2.
    Xiao, Y., Zhu, Z., Zhao, Y., Wei, Y., Wei, S., Li, X.: Topographic NMF for data representation. IEEE Trans. Cybern. 44(10), 1762–1771 (2014)CrossRefGoogle Scholar
  3. 3.
    Lee, D.D., Seung, H.S.: Learning the parts of objects by nonnegative matrix factorization. Nature 401(6755), 788–791 (1999)CrossRefGoogle Scholar
  4. 4.
    Liu, X., Zhong, G., Dong, J.: Natural image illuminant estimation via deep non-negative matrix factorization. IET Image Process. 12(1), 121–125 (2018)CrossRefGoogle Scholar
  5. 5.
    Li, X., Cui, G., Dong, Y.: Graph regularized non-negative low-rank matrix factorization for image clustering. IEEE Trans. Cybern. 47(11), 3840–3853 (2017)MathSciNetCrossRefGoogle Scholar
  6. 6.
    Wang, S., Deng, C., Lin, W., Huang, G.B., Zhao, B.: NMF-based image quality assessment using extreme learning machine. IEEE Trans. Cybern. 47(1), 232–243 (2017)CrossRefGoogle Scholar
  7. 7.
    He, W., Zhang, H., Zhang, L.: Sparsity-regularized robust non-negative matrix factorization for hyperspectral unmixing. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 9(9), 4267–4279 (2016)CrossRefGoogle Scholar
  8. 8.
    Babaee, M., Yu, X., Rigoll, G., Datcu, M.: Immersive interactive SAR image representation using non-negative matrix factorization. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 9(7), 2844–2853 (2016)CrossRefGoogle Scholar
  9. 9.
    Xu, R., Li, Y., Xing, M.: Fusion of multi-aspect radar images via sparse non-negative matrix factorization. Electron. Lett. 49(25), 1635–1637 (2013)CrossRefGoogle Scholar
  10. 10.
    Xu, B., Liu, Q., Huang, T.: A discrete-time projection neural network for sparse signal reconstruction with application to face recognition. IEEE Trans. Neural Netw. Learn. Syst. 99, 1–12 (2018)Google Scholar
  11. 11.
    Gong, M., Jiang, X., Li, H., Tan, K.C.: Multiobjective sparse non-negative matrix factorization. IEEE Trans. Cybern. 99, 1–14 (2018)Google Scholar
  12. 12.
    Zhang, N., Xiong, J., Zhong, J., Leatham, K.: Gaussian process regression method for classification for high-dimensional data with limited samples. In: The 8th International Conference on Information Science and Technology (ICIST 2018), Cordoba, Granada and Seville, Spain (2018)Google Scholar
  13. 13.
    Zhang, N., Leatham, K.: Feature selection based on SVM in photo-thermal infrared (IR) imaging spectroscopy classification with limited training samples. WSEAS Trans. Sig. Process. 13(33), 285–292 (2017)Google Scholar
  14. 14.
    Tang, B., He, H.: ENN: extended nearest neighbor method for pattern recognition. IEEE Comput. Intell. Mag. 10(3), 52–60 (2015)CrossRefGoogle Scholar
  15. 15.
    Zhang, N., Karimoune, W., Thompson, L., Dang, H.: A between-class overlapping coherence-based algorithm in KNN classification. In: The 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC2017), Banff, Canada (2017)Google Scholar
  16. 16.
    Xia, Y., Wang, J.: On the stability of globally projected dynamical systems. J. Optim. Theory Appl. 106(1), 129–150 (2000)MathSciNetCrossRefGoogle Scholar
  17. 17.
    Che, H., Wang, J.: A nonnegative matrix factorization algorithm based on a discrete-time projection neural network. Neural Netw. 103, 63–71 (2018)CrossRefGoogle Scholar
  18. 18.
    Lee, D.D., Seung, H.S.: Algorithms for non-negative matrix factorization. In: Advances in Neural Information Processing Systems, vol. 13, pp. 556–562. MIT Press, Cambridge (2001)Google Scholar
  19. 19.
    Berry, M.W., Browne, M., Langville, A.N., Pauca, V.P., Plemmons, R.J.: Algorithms and applications for approximate nonnegative matrix factorization. Comput. Stat. Data Anal. 52(1), 155–173 (2007)MathSciNetCrossRefGoogle Scholar
  20. 20.
    Lin, C.J.: Projected gradient methods for nonnegative matrix factorization. Neural Comput. 19(10), 2756–2779 (2007)MathSciNetCrossRefGoogle Scholar
  21. 21.
    Kim, H., Park, H.: Nonnegative matrix factorization based on alternating nonnegativity constrained least squares and active set method. SIAM J. Matrix Anal. Appl. 30(2), 713–730 (2008)MathSciNetCrossRefGoogle Scholar
  22. 22.
    Kim, H., Park, H.: Toward faster nonnegative matrix factorization. A new algorithm and comparisons. In: Proceedings of the Eighth IEEE International Conference on Data Mining, pp. 353–362 (2008)Google Scholar
  23. 23.
    Guan, N.Y., Tao, D.C., Luo, Z.G., Yuan, B.: NeNMF: an optimal gradient method for nonnegative matrix factorization. IEEE Trans. Signal Process. 60(6), 2882–2898 (2012)MathSciNetCrossRefGoogle Scholar
  24. 24.
    Lichman, M.: UCI Machine Learning Repository. School of Information and Computer Science, University of California, Irvine, CA (2013).

Copyright information

© Springer Nature Switzerland AG 2018

Authors and Affiliations

  1. 1.Department of Electrical and Computer EngineeringUniversity of the District of ColumbiaWashington, D.C.USA

Personalised recommendations