Skip to main content
SpringerLink
Log in

Robust multi-view clustering in latent low-rank space with discrepancy induction

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

Due to the fantastic ability to capture consistent and complementary information between views, multi-view graph clustering has attracted extensive research attention. However, multi-view data are mostly high-dimensional, which may contain many redundant and irrelevant features. At the same time, the original data are usually contaminated by noise and outliers, which may destroy the intrinsic structural information of data and reduce the reliability of the affinity matrix learned. Moreover, most models assign different weights to each view to fully consider the relation between views. The intrinsic information of some views cannot be fully utilized due to the small view weights assigned to them. To deal with these problems, in this study, we propose a robust multi-view clustering model by combining low-dimensional and low-rank latent space learning, self-representation learning, and multi-view discrepancy induction fusion into a unified framework. Specifically, the original high-dimensional data is first reconstructed in a low-dimensional and low-rank space. A self-representation learning method is used to learn the reliable affinity matrix for each view. Furthermore, the Hilbert-Schmidt independence criterion is used as a discrepancy induction module for the complementary fusion of views. Finally, to preserve the data’s local geometric structure, a simple adaptive graph regularization term is applied to the affinity matrix for each view. The comprehensive experiments on six benchmark datasets validate that the proposed model outperforms the six state-of-the-art comparison models in robustness and clustering performance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

Data Availability

The datasets supporting the conclusions of this article are included within the corresponding references.

Notes

  1. The pictures are respectively downloaded from links: https://p0.ssl.cdn.btime.com/t01ea210a7841354c87.jpg?size=421x306, https://i0.hdslb.com/bfs/bangumi/image/43d66dbd27f8cd68d59c7d583226666651e396e3.png@279w_372h.webp, https://pic1.zhimg.com/v2-68f94466225ad77993047fb1ec0605c0_r.jpg

References

  1. Zhang X, Gao H, Li G, Zhao J, Huo J, Yin J, Liu Y, Zheng L (2018) Multi-view clustering based on graph-regularized nonnegative matrix factorization for object recognition. Information Sciences 432:463–478

    Article  MathSciNet  MATH  Google Scholar 

  2. Zhang P, Liu X, Xiong J, Zhou S, Zhao W, Zhu E, Cai Z (2022) Consensus one-step multi-view subspace clustering. IEEE Transactions on Knowledge and Data Engineering 34(10):4676–4689

    Article  Google Scholar 

  3. Zhu Y, Tan M, Wei J (2022) Robust multi-view classification with sample constraints. Neural Processing Letters 54(4):2589–2612

    Article  Google Scholar 

  4. Li S, Shao M, Fu Y (2018) Multi-view low-rank analysis with applications to outlier detection. ACM Transactions on Knowledge Discovery from Data 12(3)

  5. Sun S, Dong W, Liu Q (2021) Multi-view representation learning with deep gaussian processes. IEEE Transactions on Pattern Analysis and Machine Intelligence 43(12):4453–4468

    Article  Google Scholar 

  6. Ravi L, Subramaniyaswamy V, Vijayakumar V, Jhaveri RH, Shah J (2021) Hybrid user clustering-based travel planning system for personalized point of interest recommendation. Mathematical Modeling. Computational Intelligence Techniques and Renewable Energy, Springer Singapore, Singapore, pp 311–321

    Google Scholar 

  7. Wu JM-T, Lin JC-W, Fournier-Viger P, Djenouri Y, Chen C-H, Li Z (2019) The density-based clustering method for privacy-preserving data mining. Mathematical Biosciences and Engineering 16(3):1718–1728

    Article  MathSciNet  MATH  Google Scholar 

  8. Yan F, Wang X-d, Zeng Z-q, Hong C-q (2020) Adaptive multi-view subspace clustering for high-dimensional data. Pattern Recognition Letters 130:299–305

    Article  Google Scholar 

  9. Gao Q, Wan Z, Liang Y, Wang Q, Liu Y, Shao L (2020) Multi-view projected clustering with graph learning. Neural Networks 126:335–346

    Article  Google Scholar 

  10. Lu G-F, Zhao J (2022) Latent multi-view self-representations for clustering via the tensor nuclear norm. Applied Intelligence 52(6):6539–6551

    Article  Google Scholar 

  11. You C-Z, Shu Z-Q, Fan H-H (2021) Non-negative sparse laplacian regularized latent multi-view subspace clustering. Journal of Algorithms and Computational Technology 15

  12. Zheng Q, Zhu J, Li Z, Pang S, Wang J, Li Y (2020) Feature concatenation multi-view subspace clustering. Neurocomputing 379:89–102

    Article  Google Scholar 

  13. Wang X, Lei Z, Guo X, Zhang C, Shi H, Li SZ (2019) Multi-view subspace clustering with intactness-aware similarity. Pattern Recognition 88:50–63

    Article  Google Scholar 

  14. Tan J, Yang Z, Cheng Y, Ye J, Wang B, Dai Q (2021) Sragl-awcl: A two-step multi-view clustering via sparse representation and adaptive weighted cooperative learning. Pattern Recognition 117

  15. Yang M-S, Sinaga KP (2021) Collaborative feature-weighted multi-view fuzzy c-means clustering. Pattern Recognition 119:108064

  16. Yin H, Wang G, Hu W, Zhang Z (2022) Fine-grained multi-view clustering with robust multi-prototypes representation. Applied Intelligence

  17. Zheng Q, Zhu J, Ma Y, Li Z, Tian Z (2021) Multi-view subspace clustering networks with local and global graph information. Neurocomputing 449:15–23

    Article  Google Scholar 

  18. Shi S, Nie F, Wang R, Li X (2022) Self-weighting multi-view spectral clustering based on nuclear norm. Pattern Recognition 124:108429

    Article  Google Scholar 

  19. Nie F, Zhu W, Li X (2019) Structured graph optimization for unsupervised feature selection. IEEE Transactions on Knowledge and Data Engineering 33(3):1210–1222

    Google Scholar 

  20. Ren Z, Li X, Mukherjee M, Huang Y, Sun Q, Huang Z (2021) Robust multi-view graph clustering in latent energy-preserving embedding space. Information Sciences 569:582–595

    Article  MathSciNet  Google Scholar 

  21. Zhong G, Shu T, Huang G, Yan X (2022) Multi-view spectral clustering by simultaneous consensus graph learning and discretization. Knowledge-Based Systems 235:107632

  22. Li J, Zhou G, Qiu Y, Wang Y, Zhang Y, Xie S (2020) Deep graph regularized non-negative matrix factorization for multi-view clustering. Neurocomputing 390:108–116

    Article  Google Scholar 

  23. Chang S, Hu J, Li T, Wang H, Peng B (2021) Multi-view clustering via deep concept factorization. Knowledge-Based Systems 217:106807

  24. Hechmi S, Gallas A, Zagrouba E (2019) Multi-kernel sparse subspace clustering on the riemannian manifold of symmetric positive definite matrices. Pattern Recognition Letters 125:21–27

    Article  Google Scholar 

  25. Fu Z, Zhao Y, Chang D, Zhang X, Wang Y (2022) Auto-weighted low-rank representation for clustering. Knowledge-Based Systems 251:109063

    Article  Google Scholar 

  26. Bouhlel N, Feki G, Ben Amar C (2021) Adaptive weighted least squares regression for subspace clustering. Knowledge and Information Systems 63(11):2883–2900

    Article  Google Scholar 

  27. Hao W, Pang S, Chen Z (2021) Multi-view spectral clustering via common structure maximization of local and global representations. Neural Networks 143:595–606

    Article  MATH  Google Scholar 

  28. Zheng Q, Zhu J, Tian Z, Li Z, Pang S, Jia X (2020) Constrained bilinear factorization multi-view subspace clustering. Knowledge-Based Systems 194:105514

  29. Lu C, Feng J, Lin Z, Mei T, Yan S (2018) Subspace clustering by block diagonal representation. IEEE transactions on pattern analysis and machine intelligence 41(2):487–501

    Article  Google Scholar 

  30. Gu Z, Deng Z, Huang Y, Liu D, Zhang Z (2021) Subspace clustering via integrating sparse representation and adaptive graph learning. Neural Processing Letters 53(6):4377–4388

    Article  Google Scholar 

  31. Abhadiomhen SE, Wang Z, Shen X (2022) Coupled low rank representation and subspace clustering. Applied Intelligence 52(1):530–546

    Article  Google Scholar 

  32. Liu M, Wang Y, Sun J, Ji Z (2020) Structured block diagonal representation for subspace clustering. Applied Intelligence 50(8):2523–2536

    Article  Google Scholar 

  33. Chen Y, Wang S, Zheng F, Cen Y (2020) Graph-regularized least squares regression for multi-view subspace clustering. Knowledge-Based Systems 194:105482

    Article  Google Scholar 

  34. Chen M-S, Huang L, Wang C-D, Huang D, Lai J-H (2021) Relaxed multi-view clustering in latent embedding space. Information Fusion 68:8–21

    Article  Google Scholar 

  35. Yu X, Liu H, Wu Y, Zhang C (2021) Fine-grained similarity fusion for multi-view spectral clustering. Information Sciences 568:350–368

    Article  MathSciNet  Google Scholar 

  36. Guo J, Yin W, Sun Y, Hu Y (2019) Multi-view subspace clustering with block diagonal representation. IEEE Access 7:84829–84838

    Article  Google Scholar 

  37. Liu M, Wang Y, Palade V, Ji Z (2023) Multi-view subspace clustering network with block diagonal and diverse representation. Information Sciences 626:149–165

    Article  Google Scholar 

  38. Tan J, Yang Z, Ren J, Wang B, Cheng Y, Ling W-K (2022) A novel robust low-rank multi-view diversity optimization model with adaptive-weighting based manifold learning. Pattern Recognition 122:108298

  39. Zhang C, Fu H, Hu Q, Cao X, Xie Y, Tao D, Xu D (2018) Generalized latent multi-view subspace clustering. IEEE transactions on pattern analysis and machine intelligence 42(1):86–99

    Article  Google Scholar 

  40. Tang C, Zhu X, Liu X, Li M, Wang P, Zhang C, Wang L (2018) Learning a joint affinity graph for multiview subspace clustering. IEEE Transactions on Multimedia 21(7):1724–1736

    Article  Google Scholar 

  41. Zhang G-Y, Huang D, Wang C-D (2023) Facilitated low-rank multi-view subspace clustering. Knowledge-Based Systems 260:110141

  42. Lin Q, Xue Y, Wen J, Zhong P (2019) A sharing multi-view feature selection method via alternating direction method of multipliers. Neurocomputing 333:124–134

    Article  Google Scholar 

  43. Lv J, Kang Z, Wang B, Ji L, Xu Z (2021) Multi-view subspace clustering via partition fusion. Information Sciences 560:410–423

  44. Li Z, Hu Z, Nie F, Wang R, Li X (2022) Multi-view clustering based on generalized low rank approximation. Neurocomputing 471:251–259

    Article  Google Scholar 

  45. Chao G, Wang S, Yang S, Li C, Chu D (2022) Incomplete multi-view clustering with multiple imputation and ensemble clustering. Applied Intelligence 52(13):14811–14821

  46. Li Y, Liao H (2021) Multi-view clustering via adversarial view embedding and adaptive view fusion. Applied Intelligence 51(3):1201–1212

    Article  Google Scholar 

  47. Brbiá M, Kopriva I (2018) Multi-view low-rank sparse subspace clustering. Pattern Recognition 73:247–258

    Article  Google Scholar 

  48. Chen C, Qian H, Chen W, Zheng Z, Zhu H (2019) Auto-weighted multi-view constrained spectral clustering. Neurocomputing 366:1–11

    Article  Google Scholar 

  49. Zhao N, Bu J (2022) Robust multi-view subspace clustering based on consensus representation and orthogonal diversity. Neural Networks 150:102–111

    Article  Google Scholar 

  50. Sang X, Lu J, Lu H (2022) Consensus graph learning for auto-weighted multi-view projection clustering. Information Sciences 609:816–837

    Article  Google Scholar 

  51. Liu X, Song P, Sheng C, Zhang W (2022) Robust multi-view non-negative matrix factorization for clustering. Digital Signal Processing 123:103447

  52. Liu X, Pan G, Xie M (2021) Multi-view subspace clustering with adaptive locally consistent graph regularization. Neural Computing and Applications 33(22):15397–15412

  53. Fu L, Yang J, Chen C, Zhang C (2022) Low-rank tensor approximation with local structure for multi-view intrinsic subspace clustering. Information Sciences 606:877–891

  54. Wang S, Chen Y, Jin Y, Cen Y, Li Y, Zhang L (2021) Error-robust low-rank tensor approximation for multi-view clustering. Knowledge-Based Systems 215:106745

    Article  Google Scholar 

  55. Yao L, Lu G-F (2022) Double structure scaled simplex representation for multi-view subspace clustering. Neural Networks 151:168–177

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported by the National Natural Science Foundation of China (Nos. 61976182 and 62076171), Sichuan Key R &D project (2020YFG0035), the Natural Science Foundation of Sichuan Province (2022NS552FSC0898), and the Sichuan Science and Technology Achievements Transfer and Transformation Dem-onstration Project (2022ZHCG0005).

Author information

Author notes

  1. Hongmei Chen, Tianrui Li and Xiaoling Yang contributed equally to this work.

Authors and Affiliations

  1. School of Computing and Artificial Intelligence, Southwest Jiaotong University, 611756, Chengdu, China

    Bo Xiong, Hongmei Chen, Tianrui Li & Xiaoling Yang

  2. National Engineering Laboratory of Integrated Transportation Big Data Application Technology, Southwest Jiaotong University, 611756, Chengdu, China

    Bo Xiong, Hongmei Chen, Tianrui Li & Xiaoling Yang

Authors
  1. Bo Xiong
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hongmei Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Tianrui Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Xiaoling Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Bo Xiong: Conceptualization, Metho-dology, Software, Writing - Original Draft, Validation, Formal analysis, Investigation, Visualization, Writing - Review & Editing. Hongmei Chen: Writing - Review & Editing, Supervision, Visualization, Investigation, Formal analysis, Validation. Tianrui Li: Writing - Review & Editing, Supervision, Resources. Xiaoling Yang: Writing - Review & Editing.

Corresponding author

Correspondence to Hongmei Chen.

Ethics declarations

Competing interests

The authors have no competing interests to declare that are relevant to the content of this article.

Ethics Approval

This article does not contain any studies with human participants or animals performed by any of the authors.

Informed Consent

As this article does not contain any studies with human participants or animals, the informed consent is not applicable.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Xiong, B., Chen, H., Li, T. et al. Robust multi-view clustering in latent low-rank space with discrepancy induction. Appl Intell 53, 23655–23674 (2023). https://doi.org/10.1007/s10489-023-04699-x

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-023-04699-x

Keywords

Search

Navigation