Skip to main content
SpringerLink
Log in

Fine-grained multi-view clustering with robust multi-prototypes representation

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

Multi-view clustering is a hot research topic that improves clustering performance by leveraging complementary information from multiple views. Recently, many multi-view clustering methods have been proposed. Most of them take the entire sample space as a fusion object and treat the local structures within each view equally. This paradigm is considered coarse-grained information fusion. However, in many real-world applications, different local structures with strong or weak clustering capacities could coexist in one view. To fully exploit valuable information of local structures, it is necessary to distinguish these local structures with different clustering capacities. In this paper, we propose a novel fine-grained multi-view clustering method. First, the sample space of each view is divided into many sub-clusters by using multi-prototypes representation. Second, the robustness of the multi-prototypes representation is enhanced by reducing the overlap between sub-clusters, which can reduce the effect of noise data. Finally, each sub-cluster’s contribution weights are automatically assigned based on its clustering capacity. In addition, the robust multi-prototypes representation, the fine-grained multi-view fusion, and the clustering process are integrated into a unified framework. An effective alternating optimization algorithm is adopted to solve the objective function. Extensive experiments on two toy datasets and several real-world datasets prove that our method outperforms the traditional methods in clustering accuracy.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Notes

  1. http://archive.ics.uci.edu/ml/datasets/Multiple+Features

  2. https://github.com/jmpu/multiview_cluster/blob/master/Wiki_textimage/Wiki_textimage.mat

  3. https://archive.ics.uci.edu/ml/datasets/One-hundred+plant+species+leaves+data+set

  4. http://www.cs.columbia.edu/CAVE/research/coil-20.htm

  5. http://www.uk.research.att.com/facedatabase.html

  6. https://github.com/mbrbic/Multi-view-LRSSC/blob/master/datasets/prokaryotic.mat

References

  1. Xiao H, Chen Y, Shi X (2021) Knowledge graph embedding based on multi-view clustering framework. IEEE Trans Knowl Data Eng 33(2):585–596

    Article  Google Scholar 

  2. Wang Q, Chen M, Nie F, Li X (2020) Detecting coherent groups in crowd scenes by multiview clustering. IEEE Trans Pattern Anal Mach Intell 42(1):46–58

    Article  Google Scholar 

  3. Yu H, Tang J, Wang G, Gao X (2021) A novel multi-view clustering method for unknown mapping relationships between cross-view samples. In: Proceedings of the 27th ACM SIGKDD conference on knowledge discovery and data mining, pp 2075–2083

  4. Tian J, Zhao J, Zheng C (2021) Clustering of cancer data based on Stiefel manifold for multiple views. BMC Bioinforma 22(1):268

    Article  Google Scholar 

  5. Liu X, Li M, Tang C, Xia J, Xiong J, Liu L, Kloft M, Zhu E (2021) Efficient and effective regularized incomplete multi-view clustering. IEEE Trans Pattern Anal Mach Intell 43(8):2634–2646

    Google Scholar 

  6. Lv J, Kang Z, Wang B, Ji L, Xu Z (2021) Multi-view subspace clustering via partition fusion. Inf Sci 560:410–423

    Article  MathSciNet  Google Scholar 

  7. Zhang C, Fu H, Hu Q, Cao X, Xie Y, Tao D, Xu D (2020) Generalized latent multi-view subspace clustering. IEEE Trans Pattern Anal Mach Intell 42(1):86–99

    Article  Google Scholar 

  8. Yan H, Liu S, Yu P S (2019) From joint feature selection and self-representation learning to robust multi-view subspace clustering. In: Proceedings of the 19th IEEE international conference on data mining, ICDM, pp 1414–1419

  9. Wang H, Wang Y, Zhang Z, Fu X, Zhuo L, Xu M, Wang M (2021) Kernelized multiview subspace analysis by self-weighted learning. IEEE Trans Multimed 23:3828–3840

    Article  Google Scholar 

  10. Feng L, Liu W, Meng X, Zhang Y (2021) Re-weighted multi-view clustering via triplex regularized non-negative matrix factorization. Neurocomputing 464:352–363

    Article  Google Scholar 

  11. Hu Z, Nie F, Wang R, Li X (2020) Multi-view spectral clustering via integrating nonnegative embedding and spectral embedding. Inform Fus 55:251–259

    Article  Google Scholar 

  12. Zong L, Zhang X, Liu X (2018) Multi-view clustering on unmapped data via constrained nonnegative matrix factorization. Neural Netw 108:155–171

    Article  MATH  Google Scholar 

  13. Wang H, Yang Y, Liu B (2020) GMC: graph-based multi-view clustering. IEEE Trans Knowl Data Eng 32(6):1116–1129

    Article  Google Scholar 

  14. Huang S, Xu Z, Tsang I, Kang Z (2020) Auto-weighted multi-view co-clustering with bipartite graphs. Inf Sci 512:18–30

    Article  MathSciNet  MATH  Google Scholar 

  15. Yin H, Hu W, Zhang Z, Lou J, Miao M (2021) Incremental multi-view spectral clustering with sparse and connected graph learning. Neural Netw 144:260–270

    Article  Google Scholar 

  16. Xie J, Girshick R, Farhadi A (2016) Unsupervised deep embedding for clustering analysis. In: Proceedings of the 33nd international conference on machine learning, ICML, vol 48, pp 478–487

  17. Dizaji K G, Herandi A, Deng C, Cai W, Huang H (2017) Deep clustering via joint convolutional autoencoder embedding and relative entropy minimization. In: Proceedings of the IEEE international conference on computer vision, ICCV, pp 5747–5756

  18. Tu W, Zhou S, Liu X, Guo X, Cai Z, Zhu E, Cheng J (2021) Deep fusion clustering network. In: Proceedings of the 35th AAAI conference on artificial intelligence, AAAI, pp 9978– 9987

  19. Xie Y, Lin B, Qu Y, Li C, Zhang W, Ma L, Wen Y, Tao D (2021) Joint deep multi-view learning for image clustering. IEEE Trans Knowl Data Eng 33(11):3594–3606

    Article  Google Scholar 

  20. Wen J, Wu Z, Zhang Z, Fei L, Zhang B, Xu Y (2021) Structural deep incomplete multi-view clustering network. In: Proceedings of the 30th ACM international conference on information and knowledge management, CIKM, pp 3538–3542

  21. Wen J, Zhang Z, Zhang Z, Wu Z, Fei L, Xu Y, Zhang B (2020) Dimc-net: deep incomplete multi-view clustering network. In: Proceedings of the 28th ACM international conference on multimedia, ACM MM, pp 3753–3761

  22. Li Z, Wang Q, Tao Z, Gao Q, Yang Z (2019) Deep adversarial multi-view clustering network. In: Proceedings of the 28th international joint conference on artificial intelligence, IJCAI, pp 2952–2958

  23. Wen J, Zhang Z, Zhang Z, Fei L, Wang M (2021) Generalized incomplete multiview clustering with flexible locality structure diffusion. IEEE Trans Cybern 51(1):101–114

    Article  Google Scholar 

  24. Han J, Xu J, Nie F, Li X (2020) Multi-view k-means clustering with adaptive sparse memberships and weight allocation. IEEE Trans Knowl Data Eng, 1–1

  25. Hu Y, Song Z, Wang B, Gao J, Sun Y, Yin B (2021) Akm3c: adaptive k-multiple-means for multi-view clustering. IEEE Trans Circ Syst Vid Technol 31(11):4214–4226

    Article  Google Scholar 

  26. Yin H, Hu W, Li F, Lou J (2021) One-step multi-view spectral clustering by learning common and specific nonnegative embeddings. Int J Mach Learn Cybern 12(7):2121–2134

    Article  Google Scholar 

  27. Yu X, Liu H, Wu Y, Zhang C (2021) Fine-grained similarity fusion for multi-view spectral clustering. Inf Sci 568:350–368

    Article  MathSciNet  Google Scholar 

  28. Zhao Q, Zong L, Zhang X, Liu X, Yu H (2020) Multi-view clustering via clusterwise weights learning. Knowl-Based Syst 193:105459

    Article  Google Scholar 

  29. Gao J, Han J, Liu J, Wang C (2013) Multi-view clustering via joint nonnegative matrix factorization. In: Proceedings of the 13th SIAM international conference on data mining, ICDM, pp 252–260

  30. Xue Z, Li G, Wang S, Zhang C, Zhang W, Huang Q (2015) GOMES: a group-aware multi-view fusion approach towards real-world image clustering. In: Proceedings of the IEEE international conference on multimedia and expo, ICME, pp 1–6

  31. Nie F, Wang C-L, Li X (2019) K-multiple-means: a multiple-means clustering method with specified K clusters. In: Proceedings of the 25th ACM SIGKDD international conference on knowledge discovery & data mining, KDD, pp 959–967

  32. Li Z, Nie F, Chang X, Nie L, Zhang H, Yang Y (2018) Rank-constrained spectral clustering with flexible embedding. IEEE Trans Neural Netw Learn Syst 29(12):6073–6082

    Article  MathSciNet  Google Scholar 

  33. Fan K (1949) On a theorem of weyl concerning eigenvalues of linear transformations I. Proc Natl Acad Sci USA 35(11):652

    Article  MathSciNet  Google Scholar 

  34. Nie F, Wang X, Jordan M I, Huang H (2016) The constrained laplacian rank algorithm for graph-based clustering. In: Proceedings of the 30th AAAI conference on artificial intelligence, AAAI, pp 1969–1976

  35. Nie F, Wang X, Huang H (2014) Clustering and projected clustering with adaptive neighbors. In: Proceedings of the 20th ACM SIGKDD international conference on knowledge discovery and data mining, KDD, pp 977–986

  36. Nie F, Huang H, Cai X, Ding C H Q (2010) Efficient and robust feature selection via joint 2,1-norms minimization. In: Proceedings of the 24th annual conference on neural information processing systems, NIPS, pp 1813–1821

  37. MacQueen J, et al. (1967) Some methods for classification and analysis of multivariate observations. In: Proceedings of the 5th Berkeley symposium on mathematical statistics and probability, vol 1, pp 281–297

  38. Ng A, Jordan M, Weiss Y (2001) On spectral clustering: analysis and an algorithm. Adv Neural Inform Process Syst 14:849–856

    Google Scholar 

  39. Kumar A, Rai P, III H D (2011) Co-regularized multi-view spectral clustering. In: Proceedings of the 24th international conference on neural information processing systems, NeurIPS, pp 1413–1421

  40. Huang H-C, Chuang Y-Y, Chen C-S (2012) Affinity aggregation for spectral clustering. In: Proceedings of the IEEE conference on computer vision and pattern recognition, CVPR, pp 773–780

  41. Li Y, Nie F, Huang H, Huang J (2015) Large-scale multi-view spectral clustering via bipartite graph. In: Proceedings of the 29th AAAI conference on artificial intelligence, AAAI, pp 2750–2756

  42. Nie F, Li J, Li X (2016) Parameter-free auto-weighted multiple graph learning: a framework for multiview clustering and semi-supervised classification. In: Proceedings of the 25th international joint conference on artificial intelligence, IJCAI, pp 1881–1887

  43. Rauber P E, Falcão A X, Telea A C (2016) Visualizing time-dependent data using dynamic t-sne. In: Proceedings of 18th eurographics conference on visualization, pp 73–77

  44. Van der Maaten L, Hinton G (2008) Visualizing data using t-sne. J Mach Learn Res 9:11

    MATH  Google Scholar 

Download references

Acknowledgments

This work has been partially supported by grants from the National Natural Science Foundation of China (62072151), the Key Project supported by the Joint Funds of the National Natural Science Foundation of China (U20A20228), the Zhejiang Basic Public Welfare Research Project (LGN18F020002), the Natural Science Foundation of Zhejiang Province (LR20F020002), the Anhui Provincial Natural Science Fund for Distinguished Young Scholars (2008085J30), the Fundamental Research Funds for Central Universities of China (JZ2019HGPA0102), the Huzhou Public Welfare Applied Research Project (2021GZ05), and the Huzhou University Graduate Scientific Research Innovation Project (2022KYCX44).

Author information

Authors and Affiliations

  1. School of Information Engineering and Zhejiang Province Key Laboratory of Smart Management, Application of Modern Agricultural Resources, Huzhou University, Huzhou, 313000, China

    Hongwei Yin, Guixiang Wang & Wenjun Hu

  2. School of Computer Science and Information Engineering, Key Laboratory of Knowledge Engineering with Big Data (Ministry of Education), Hefei University of Technology, Hefei, 230009, China

    Zhao Zhang

Authors
  1. Hongwei Yin
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Guixiang Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Wenjun Hu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Zhao Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to Hongwei Yin or Wenjun Hu.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yin, H., Wang, G., Hu, W. et al. Fine-grained multi-view clustering with robust multi-prototypes representation. Appl Intell 53, 8402–8420 (2023). https://doi.org/10.1007/s10489-022-03898-2

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-022-03898-2

Keywords

Search

Navigation