Skip to main content
SpringerLink
Log in

A late fusion scheme for multi-graph regularized NMF

  • ORIGINAL PAPER
  • Published:
Machine Vision and Applications Aims and scope Submit manuscript

Abstract

Graph regularized non-negative matrix factorization (GNMF), which is an important extension of NMF, shows good clustering performance on some datasets. However, GNMF only uses one graph to simulate the manifold structure of the data, which may be not accurate enough. Then, some scholars proposed multi-graph regularized NMF(MGNMF). MGNMF first combines multiple graphs into one graph through a linear combination method, and then obtains a low-dimensional representation of the data. However, the representation ability of MGNMF is limited and cannot fully make use of the multi-graph information since MGNMF first combines multiple graphs into one graph and then obtains only one low-dimensional representation of the data, which makes clustering performance unsatisfactory enough. Therefore, we propose an innovative method, i.e., a late fusion scheme for multi-graph regularized NMF(LFS/MGNMF). Different from the existing algorithms, LFS/MGNMF does not directly combine multiple graphs into a graph, but first obtains their own low-dimensional representation matrices, and then uses self-expressiveness property of data to obtain the self-representation matrices of all the low-dimensional representations and removes noise simultaneously. In addition, by using the tensor low-rank constraint, i.e., tensor nuclear norm constraint, LFS/MGNMF can explore higher-order information among different self-representation matrices. Finally, LFS/MGNMF fuses the self-representation matrices for clustering. Therefore, we believe the proposed method is a late fusion scheme and can make full use of the multi-graph information. As far as we know, LFS/MGNMF is the first late fusion method for multi-graph regularized methods. The Augmented Lagrange Multiplier method is exploited to solve LFS/MGNMF, and the experimental results on four datasets are very promising and fully demonstrate the superiority of LFS/MGNMF.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

Data availibility statement

The data generated or analysed during the current study are available from the corresponding author on reasonable request.

References

  1. Yang, Y., Wang, H.: Multi-view clustering: a survey. Big Data Min. Anal. 1, 83–107 (2018)

    Article  Google Scholar 

  2. Chao, G., Sun, S., Bi, J.: A survey on multiview clustering. IEEE Trans. Artif. Intell. 2, 146–168 (2021)

    Article  Google Scholar 

  3. Ji, G., Lu, G.-F.: One-step incomplete multiview clustering with low-rank tensor graph learning. Inform. Sci. 615, 209–225 (2022)

    Article  Google Scholar 

  4. Peng, S., Ser, W., Chen, B., Lin, Z.: Robust semi-supervised nonnegative matrix factorization for image clustering. Pattern Recogn. 111, 107683 (2021)

    Article  Google Scholar 

  5. Ma, J., Zhang, Y., Zhang, L.: Discriminative subspace matrix factorization for multiview data clustering. Pattern Recogn. 111, 107676 (2021)

    Article  Google Scholar 

  6. Lee, D.D., Seung, H.S.: Learning the parts of objects by non-negative matrix factorization. Nature 401, 788–791 (1999)

    Article  MATH  Google Scholar 

  7. Sandler, R., Lindenbaum, M.: Nonnegative matrix factorization with earth mover’s distance metric for image analysis. IEEE Trans. Pattern Anal. Mach. Intell. 33, 1590–1602 (2011)

    Article  Google Scholar 

  8. Guan, N., Tao, D., Luo, Z., Yuan, B.: NeNMF: an optimal gradient method for nonnegative matrix factorization. IEEE Trans. Signal Process. 60, 2882–2898 (2012)

    Article  MathSciNet  MATH  Google Scholar 

  9. Li, Z., Tang, J., He, X.: Robust structured nonnegative matrix factorization for image representation. IEEE Trans. Neural Netw. Learn. Syst. 29, 1947–1960 (2017)

    Article  MathSciNet  Google Scholar 

  10. Liu, X., Song, P., Sheng, C., Zhang, W.: Robust multi-view non-negative matrix factorization for clustering. Digit. Signal Process. 123, 103447 (2022)

    Article  Google Scholar 

  11. Cai, D., He, X., Han, J., Huang, T.S.: Graph regularized nonnegative matrix factorization for data representation. IEEE Trans. Pattern Anal. Mach. Intell. 33, 1548–1560 (2010)

    Google Scholar 

  12. Shang, F., Jiao, L., Wang, F.: Graph dual regularization non-negative matrix factorization for co-clustering. Pattern Recogn. 45, 2237–2250 (2012)

    Article  MATH  Google Scholar 

  13. Xing, Z., Ma, Y., Yang, X., Nie, F.: Graph regularized nonnegative matrix factorization with label discrimination for data clustering. Neurocomputing 440, 297–309 (2021)

    Article  Google Scholar 

  14. Peng, C., Kang, Z., Hu, Y., Cheng, J., Cheng, Q.S.: Robust Graph Regularized Nonnegative Matrix Factorization for Clustering. ACM Trans. Knowl. Discov. Data (TKDD) 11, 1–30 (2017)

    Article  Google Scholar 

  15. Huang, S., Xu, Z., Kang, Z., Ren, Y.: Regularized nonnegative matrix factorization with adaptive local structure learning. Neurocomputing 382, 196–209 (2020)

    Article  Google Scholar 

  16. Wang, J.J.-Y., Bensmail, H., Gao, X.: Multiple graph regularized nonnegative matrix factorization. Pattern Recogn. 46, 2840–2847 (2013)

    Article  MATH  Google Scholar 

  17. Shu, Z., Wu, X., Fan, H., Huang, P., Wu, D., Hu, C., Ye, F.: Parameter-less auto-weighted multiple graph regularized nonnegative matrix factorization for data representation. Knowl. Based Syst. 131, 105–112 (2017)

    Article  Google Scholar 

  18. Zhang, K., Zhao, X., Peng, S.: Multiple graph regularized semi-supervised nonnegative matrix factorization with adaptive weights for clustering. Eng. Appl. Artif. Intell. 106, 104499 (2021)

    Article  Google Scholar 

  19. Zhang, Z., Jiang, B., Luo, B.: MGARL: multiple graph adversarial regularized learning, in: 2021 IEEE international conference on multimedia and expo (ICME), IEEE, (2021), pp. 1–6

  20. Hu, J., Li, Y., Xu, G., Gao, W.: Dynamic subspace dual-graph regularized multi-label feature selection. Neurocomputing 467, 184–196 (2022)

    Article  Google Scholar 

  21. Ding, J., Fang, X., Jia, L., Jiang, Y., Li, R.: Diversity multi-view clustering with subspace and nmf-based manifold learning⋆, IEEE Access, (2023)

  22. Shu, Z., Zuo, F., Wu, W., You, C.: Dual local learning regularized NMF with sparse and orthogonal constraints. Appl. Intell. 53, 7713–7727 (2023)

    Article  Google Scholar 

  23. Yang, L., Yan, L., Wei, X., Yang, X.: Label consistency-based deep semisupervised NMF for tumor recognition. Eng. Appl. Artif. Intell. 117, 105511 (2023)

    Article  Google Scholar 

  24. Salahian, N., Tab, F.A., Seyedi, S.A., Chavoshinejad, J.: Deep autoencoder-like NMF with contrastive regularization and feature relationship preservation. Expert Syst. Appl. 214, 119051 (2023)

    Article  Google Scholar 

  25. Luong, K., Nayak, R., Balasubramaniam, T., Bashar, M.A.: Multi-layer manifold learning for deep non-negative matrix factorization-based multi-view clustering. Pattern Recogn. 131, 108815 (2022)

    Article  Google Scholar 

  26. Xie, Y., Tao, D., Zhang, W., Liu, Y., Zhang, L., Qu, Y.: On unifying multi-view self-representations for clustering by tensor multi-rank minimization. Int. J. Comput. Vision 126, 1157–1179 (2018)

    Article  MathSciNet  MATH  Google Scholar 

  27. Kilmer, M.E., Martin, C.D.: Factorization strategies for third-order tensors. Linear Algebra Appl. 435, 641–658 (2011)

    Article  MathSciNet  MATH  Google Scholar 

  28. Semerci, O., Hao, N., Kilmer, M.E., Miller, E.L.: Tensor-based formulation and nuclear norm regularization for multienergy computed tomography. IEEE Trans. Image Process. 23, 1678–1693 (2014)

    Article  MathSciNet  MATH  Google Scholar 

  29. Liu, G., Lin, Z., Yan, S., Sun, J., Yu, Y., Ma, Y.: Robust recovery of subspace structures by low-rank representation. IEEE Trans. Pattern Anal. Mach. Intell. 35, 171–184 (2013)

    Article  Google Scholar 

  30. Elhamifar, E., Vidal, R.: Sparse subspace clustering: algorithm, theory, and applications. IEEE Trans. Pattern Anal. Mach. Intell. 35, 2765–2781 (2013)

    Article  Google Scholar 

  31. Hu, W., Tao, D., Zhang, W., Xie, Y., Yang, Y.: The twist tensor nuclear norm for video completion. IEEE Trans. Neural Netw. Learn. Syst. 28, 2961–2973 (2016)

    Article  MathSciNet  Google Scholar 

  32. Belhumeur, P.N., Hespanha, J.P., Kriegman, D.J.: Eigenfaces vs. fisherfaces: recognition using class specific linear projection. IEEE Trans. Pattern Anal. Mach. Intell. 19, 711–720 (1997)

    Article  Google Scholar 

  33. Samaria, F.S., Harter, A.C.: Parameterisation of a stochastic model for human face identification, in: Proceedings of 1994 IEEE workshop on applications of computer vision, IEEE, (1994), pp. 138–142

  34. Georghiades, A.S., Belhumeur, P.N., Kriegman, D.J.: From few to many: Illumination cone models for face recognition under variable lighting and pose. IEEE Trans. Pattern Anal. Mach. Intell. 23, 643–660 (2001)

    Article  Google Scholar 

  35. Nene, S.A., Nayar, S.K., Murase, H.: Columbia object image library (coil-100), (1996)

  36. Yan, K., Fang, X., Xu, Y., Liu, B.: Protein fold recognition based on multi-view modeling. Bioinformatics 35, 2982–2990 (2019)

    Article  Google Scholar 

Download references

Acknowledgements

This research was supported by NSFC (No. 61976005).

Author information

Authors and Affiliations

  1. School of Computer and Information, Anhui Polytechnic University, Wuhu, 241000, Anhui, China

    Guangyan Ji & Gui-Fu Lu

Authors
  1. Guangyan Ji
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Gui-Fu Lu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Gui-Fu Lu.

Ethics declarations

Conflict of interest

The authors have no competing interests to declare that are relevant to the content of this article.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ji, G., Lu, GF. A late fusion scheme for multi-graph regularized NMF. Machine Vision and Applications 34, 96 (2023). https://doi.org/10.1007/s00138-023-01455-6

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s00138-023-01455-6

Keywords

Search

Navigation