Skip to main content
Log in

\(\hbox {S}^{2}\)CFC: semi-supervised collaborative fuzzy clustering method

  • Original Research
  • Published:
Journal of Ambient Intelligence and Humanized Computing Aims and scope Submit manuscript

Abstract

This study presents a new knowledge-based fuzzy clustering called semi-supervised collaborative fuzzy clustering (S\(^{2}\)CFC), which emphasizes aggregating diverse knowledge sources rather than using them in separate steps to revealing structures of data objects stored across multiple data sites while maintaining data sharing restrictions. The proposed method aggregates fuzzy logic, semi-supervised and collaborative learning simultaneously into a unified objective function for both horizontal and vertical data site distributions. This unified behavior strengthens the principles of existing data analysis and the growth of the concept of knowledge-based fuzzy clustering. Also, the proposed objective function benefits from cases such as (a) using a more appropriate and compatible criterion with fuzzy concepts in reconciliation between the structure obtained from the data site and knowledge induced from semi-supervised and collaborative learning, (b) learning collaboration intensity between data sites (c) ability to adjust the fuzziness rate of the structures (d) explicit solutions for constituent variables. The proposed method is also reinforced with a preprocessing phase to resolve inconsistencies between the reference data site structure and received structures from other data sites before engaging in the collaboration phase with a fuzzy similarity measure based on set theoric measure. The comprehensive experimental results clearly indicate the importance of aggregation instead of knowledge sequential learning. Our method outperforms in both horizontal and vertical modes its series of rival techniques in terms of accuracy, precision, recall, specificity, NMI, ARI, and convergence speed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  • Bache K, Lichman M (2013) UCI machine learning repository: Data sets. University of California, School of Information and Computer Science

  • Beg I, Ashraf S (2009) Similarity measures for fuzzy sets. Appl Comput Math 8(2):192–202

    MATH  Google Scholar 

  • Bensaid AM, Hall LO, Bezdek JC, Clarke LP (1996) Partially supervised clustering for image segmentation. Pattern Recognit 29(5):859–871

    Article  Google Scholar 

  • Bouchachia A, Pedrycz W (2006) Enhancement of fuzzy clustering by mechanisms of partial supervision. Fuzzy Sets Syst 157(13):1733–1759

    Article  MATH  Google Scholar 

  • Coletta LF, Vendramin L, Hruschka ER, Campello RJ, Pedrycz W (2011) Collaborative fuzzy clustering algorithms: some refinements and design guidelines. IEEE Trans Fuzzy Syst 20(3):444–462

    Article  Google Scholar 

  • Cornuéjols A, Wemmert C, Gançarski P, Bennani Y (2018) Collaborative clustering: why, when, what and how. Inf Fus 39:81–95

    Article  Google Scholar 

  • Dang TH, Ngo LT, Pedrycz W (2015) Interval type-2 fuzzy c-means approach to collaborative clustering. In: 2015 IEEE international conference on fuzzy systems (FUZZ-IEEE), IEEE, pp 1–7

  • Dang TH, Ngo LT, Pedrycz W (2016) Multiple kernel based collaborative fuzzy clustering algorithm. In: Asian conference on intelligent information and database systems. Springer, pp 585–594

  • Deng Z, Jiang Y, Chung FL, Ishibuchi H, Choi KS, Wang S (2015) Transfer prototype-based fuzzy clustering. IEEE Trans Fuzzy Syst 24(5):1210–1232

    Article  Google Scholar 

  • Depaire B, Falcón R, Vanhoof K, Wets G (2011) Pso driven collaborative clustering: a clustering algorithm for ubiquitous environments. Intell Data Anal 15(1):49–68

    Article  Google Scholar 

  • Falcon R, Jeon G, Bello R, Jeong J (2007) Learning collaboration links in a collaborative fuzzy clustering environment. In: Mexican international conference on artificial intelligence. Springer, pp 483–495

  • Falcón R, Depaire B, Vanhoof K, Abraham A (2008) Towards a suitable reconciliation of the findings in collaborative fuzzy clustering. In: 2008 eighth international conference on intelligent systems design and applications, IEEE, vol 3, pp 652–657

  • Filali A, Jlassi C, Arous N (2016) Som variants for topological horizontal collaboration. In: 2016 2nd international conference on advanced technologies for signal and image processing (ATSIP), IEEE, pp 459–464

  • Gao J, Tan PN, Cheng H (2006) Semi-supervised clustering with partial background information. In: Proceedings of the 2006 SIAM international conference on data mining, SIAM, pp 489–493

  • Ghassany M, Bennani Y (2015) Collaborative fuzzy clustering of variational bayesian generative topographic mapping. Int J Comput Intell Appl 14(01):1550001

    Article  Google Scholar 

  • Ghassany M, Grozavu N, Bennani Y (2012a) Collaborative clustering using prototype-based techniques. Int J Comput Intell Appl 11(03):1250017

    Article  Google Scholar 

  • Ghassany M, Grozavu N, Bennani Y (2012b) Collaborative generative topographic mapping. In: International conference on neural information processing. Springer, pp 591–598

  • Ghassany M, Grozavu N, Bennani Y (2013) Collaborative multi-view clustering. In: The 2013 international joint conference on neural networks (IJCNN), IEEE, pp 1–8

  • Grozavu N, Bennani Y (2010) Topological collaborative clustering. Aust J Intell Inf Process Syst 12(3)

  • Grozavu N, Ghassany M, Bennani Y (2011) Learning confidence exchange in collaborative clustering. In: The 2011 international joint conference on neural networks, IEEE, pp 872–879

  • Grozavu N, Cabanes G, Bennani Y (2014) Diversity analysis in collaborative clustering. In: 2014 international joint conference on neural networks (IJCNN), IEEE, pp 1754–1761

  • Hammouda K, Kamel M (2006) Collaborative document clustering. In: Proceedings of the 2006 SIAM international conference on data mining, SIAM, pp 453–463

  • Hu G, Du Z (2019) Adaptive kernel-based fuzzy c-means clustering with spatial constraints for image segmentation. Int J Pattern Recognit Artif Intell 33(01):1954003

    Article  Google Scholar 

  • Huang HC, Chuang YY, Chen CS (2011) Multiple kernel fuzzy clustering. IEEE Trans Fuzzy Syst 20(1):120–134

    Article  Google Scholar 

  • Hwang C, Rhee FCH (2007) Uncertain fuzzy clustering: Interval type-2 fuzzy approach to \(c\)-means. IEEE Trans Fuzzy Syst 15(1):107–120

    Article  Google Scholar 

  • Keyvanpour MR, Shirzad MB, Mehmandoost S (2020) Cid: a novel clustering-based database intrusion detection algorithm. J Ambient Intell Humaniz Comput 1–12

  • Kuhn HW (2005) The hungarian method for the assignment problem. Naval Res Logist 52(1):7–21

    Article  Google Scholar 

  • Lachaud A, Grozavu N, Matei B, Bennani Y (2017) Collaborative clustering between different topological partitions. In: 2017 international joint conference on neural networks (IJCNN), IEEE, pp 4111–4117

  • Li K, Cao Z, Cao L, Zhao R (2009) A novel semi-supervised fuzzy c-means clustering method. In: 2009 Chinese control and decision conference, IEEE, pp 3761–3765

  • Liu H, Huang ST (2003) Evolutionary semi-supervised fuzzy clustering. Pattern Recognit Lett 24(16):3105–3113

    Article  Google Scholar 

  • Loia V, Pedrycz W, Senatore S (2003) P-fcm: a proximity-based fuzzy clustering for user-centered web applications. Int J Approx Reason 34(2–3):121–144

    Article  MATH  Google Scholar 

  • Mai DS, Ngo LT (2015) Semi-supervised fuzzy c-means clustering for change detection from multispectral satellite image. In: 2015 IEEE international conference on fuzzy systems (FUZZ-IEEE), IEEE, pp 1–8

  • Mai SD, Ngo LT (2018) Multiple kernel approach to semi-supervised fuzzy clustering algorithm for land-cover classification. Eng Appl Artif Intell 68:205–213

    Article  Google Scholar 

  • Mitra S, Banka H, Pedrycz W (2006) Rough–fuzzy collaborative clustering. IEEE Trans Syst Man Cybern Part B (Cybern) 36(4):795–805

  • Moradi M, Keyvanpour MR (2015) An analytical review of xml association rules mining. Artif Intell Rev 43(2):277–300

    Article  Google Scholar 

  • Ngo LT, Mai DS, Pedrycz W (2015) Semi-supervising interval type-2 fuzzy c-means clustering with spatial information for multi-spectral satellite image classification and change detection. Comput Geosci 83:1–16

    Article  Google Scholar 

  • Ngo LT, Dang TH, Pedrycz W (2018) Towards interval-valued fuzzy set-based collaborative fuzzy clustering algorithms. Pattern Recognit 81:404–416

    Article  Google Scholar 

  • Pedrycz W (1985) Algorithms of fuzzy clustering with partial supervision. Pattern Recognit Lett 3(1):13–20

    Article  Google Scholar 

  • Pedrycz W (1996) Conditional fuzzy c-means. Pattern Recognit Lett 17(6):625–631

    Article  Google Scholar 

  • Pedrycz W (2002) Collaborative fuzzy clustering. Pattern Recognit Lett 23(14):1675–1686

    Article  MATH  Google Scholar 

  • Pedrycz W (2005) Knowledge-based clustering: from data to information granules. Wiley, New York

    Book  MATH  Google Scholar 

  • Pedrycz W (2006) Collaborative and knowledge-based fuzzy clustering

  • Pedrycz W, Hirota K (2008) A consensus-driven fuzzy clustering. Pattern Recognit Lett 29(9):1333–1343

    Article  Google Scholar 

  • Pedrycz W, Rai P (2008) Collaborative clustering with the use of fuzzy c-means and its quantification. Fuzzy Sets Syst 159(18):2399–2427

    Article  MATH  Google Scholar 

  • Pedrycz W, Rai P (2009) A multifaceted perspective at data analysis: a study in collaborative intelligent agents. IEEE Trans Syst Man Cybern Part B (Cybern) 39(4):834–844

    Article  Google Scholar 

  • Pedrycz W, Vukovich G (2002) Clustering in the framework of collaborative agents. In: 2002 IEEE World Congress on Computational Intelligence. 2002 IEEE International Conference on Fuzzy Systems. FUZZ-IEEE’02. Proceedings (Cat. No. 02CH37291), IEEE, vol 1, pp 134–138

  • Pedrycz W, Waletzky J (1997) Fuzzy clustering with partial supervision. IEEE Trans Syst Man Cybern Part B Cybern 27(5):787–795

    Article  Google Scholar 

  • Prasad M, Lin CT, Yang CT, Saxena A (2013) Vertical collaborative fuzzy c-means for multiple eeg data sets. In: International conference on intelligent robotics and applications, Springer, pp 246–257

  • Prasad M, Siana L, Li DL, Lin CT, Liu Y, Saxena A (2014) A preprocessed induced partition matrix based collaborative fuzzy clustering for data analysis. In: 2014 IEEE International conference on fuzzy systems (FUZZ-IEEE), IEEE, pp 1553–1558

  • Salehi F, Keyvanpour MR, Sharifi A (2020) SMKFC-ER: Semi-supervised multiple kernel fuzzy clustering based on entropy and relative entropy. Inf Sci 547:667–688

    Article  MATH  Google Scholar 

  • Savargiv M, Masoumi B, Keyvanpour MR (2020) A new ensemble learning method based on learning automata. J Ambient Intell Humaniz Comput 1–16

  • Shen Y, Pedrycz W (2017) Collaborative fuzzy clustering algorithm: some refinements. Int J Approx Reason 86:41–61

    Article  MATH  Google Scholar 

  • Son LH (2015) Dpfcm. Expert Systems with Applications. Int J 42(1):51–66

    Google Scholar 

  • Sublime J, Grozavu N, Bennani Y, Cornuéjols A (2015a) Vertical collaborative clustering using generative topographic maps. In: 2015 7th International Conference of soft computing and pattern recognition (SoCPaR), IEEE, pp 199–204

  • Sublime J, Grozavu N, Cabanes G, Bennani Y, Cornuéjols A (2015b) From horizontal to vertical collaborative clustering using generative topographic maps. Int J Hybrid Intell Syst 12(4):245–256

    Google Scholar 

  • Sun S, Jiang Y, Qian P (2014) Transfer learning based maximum entropy clustering. In: 2014 4th IEEE international conference on information science and technology, IEEE, pp 829–832

  • Timm H, Klawonn F, Kruse R (2002) An extension of partially supervised fuzzy cluster analysis. In: 2002 Annual meeting of the North American fuzzy information processing society proceedings. NAFIPS-FLINT 2002 (Cat. No. 02TH8622), IEEE, pp 63–68

  • Yasunori E, Yukihiro H, Makito Y, Sadaaki M (2009) On semi-supervised fuzzy c-means clustering. In: 2009 IEEE international conference on fuzzy systems, IEEE, pp 1119–1124

  • Yin X, Shu T, Huang Q (2012) Semi-supervised fuzzy clustering with metric learning and entropy regularization. Knowl Based Syst 35:304–311

    Article  Google Scholar 

  • Yu F, Yu S (2009) Prototypes-based horizontal collaborative fuzzy clustering. In: 2009 Second Pacific-Asia conference on web mining and web-based application, IEEE, pp 66–69

  • Yu F, Tang J, Cai R (2007a) A necessary preprocessing in horizontal collaborative fuzzy clustering. In: 2007 IEEE international conference on granular computing (GRC 2007), IEEE, pp 399

  • Yu F, Tang J, Cai R (2007b) Partially horizontal collaborative fuzzy c-means. Int J Fuzzy Syst 9(4)

  • Yu F, Tang J, Wu F, Sun Q (2007c) Auto-weighted horizontal collaboration fuzzy clustering. In: Fuzzy information and engineering, Springer, pp 592–600

  • Yu F, Yu J, Tang J (2009) The model of generalized partially horizontal collaborative fuzzy c-means. In: 2009 Chinese control and decision conference, IEEE, pp 6095–6099

  • Yu S, Yu F (2010) Incorporating prototypes into horizontal collaborative fuzzy c-means. In: 2010 Chinese control and decision conference, ieee, pp 3612–3616

  • Zarinbal M, Zarandi MF, Turksen I (2015a) Relative entropy collaborative fuzzy clustering method. Pattern Recogn 48(3):933–940

    Article  MATH  Google Scholar 

  • Zarinbal M, Zarandi MF, Turksen I, Izadi M (2015b) A type-2 fuzzy image processing expert system for diagnosing brain tumors. J Med Syst 39(10):110

    Article  Google Scholar 

  • Zeng S, Wang X, Cui H, Zheng C, Feng D (2017) A unified collaborative multikernel fuzzy clustering for multiview data. IEEE Trans Fuzzy Syst 26(3):1671–1687

    Article  Google Scholar 

  • Zhang C, Cui Y, Han Z, Zhou JT, Fu H, Hu Q (2020) Deep partial multi-view learning. IEEE transactions on pattern analysis and machine intelligence

  • Zhang H, Lu J (2009) Semi-supervised fuzzy clustering: a kernel-based approach. Knowl Based Syst 22(6):477–481

    Article  Google Scholar 

  • Zhang X, Zhang X, Liu H, Liu X (2016) Multi-task multi-view clustering. IEEE Trans Knowl Data Eng 28(12):3324–3338

    Article  Google Scholar 

  • Zhang Y, Chung FL, Wang S (2018) A multiview and multiexemplar fuzzy clustering approach: Theoretical analysis and experimental studies. IEEE Trans Fuzzy Syst 27(8):1543–1557

    Article  Google Scholar 

  • Zhou J, Chen CP, Chen L, Li HX (2013) A collaborative fuzzy clustering algorithm in distributed network environments. IEEE Trans Fuzzy Syst 22(6):1443–1456

    Article  Google Scholar 

  • Zhou S, Li D, Zhang Z, Ping R (2020) A new membership scaling fuzzy c-means clustering algorithm. IEEE Trans Fuzzy Syst

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Mohammad Reza Keyvanpour.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Salehi, F., Keyvanpour, M.R. & Sharifi, A. \(\hbox {S}^{2}\)CFC: semi-supervised collaborative fuzzy clustering method. J Ambient Intell Human Comput 14, 727–753 (2023). https://doi.org/10.1007/s12652-021-03326-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12652-021-03326-2

Keywords

Navigation