Abstract
This study presents a new knowledge-based fuzzy clustering called semi-supervised collaborative fuzzy clustering (S\(^{2}\)CFC), which emphasizes aggregating diverse knowledge sources rather than using them in separate steps to revealing structures of data objects stored across multiple data sites while maintaining data sharing restrictions. The proposed method aggregates fuzzy logic, semi-supervised and collaborative learning simultaneously into a unified objective function for both horizontal and vertical data site distributions. This unified behavior strengthens the principles of existing data analysis and the growth of the concept of knowledge-based fuzzy clustering. Also, the proposed objective function benefits from cases such as (a) using a more appropriate and compatible criterion with fuzzy concepts in reconciliation between the structure obtained from the data site and knowledge induced from semi-supervised and collaborative learning, (b) learning collaboration intensity between data sites (c) ability to adjust the fuzziness rate of the structures (d) explicit solutions for constituent variables. The proposed method is also reinforced with a preprocessing phase to resolve inconsistencies between the reference data site structure and received structures from other data sites before engaging in the collaboration phase with a fuzzy similarity measure based on set theoric measure. The comprehensive experimental results clearly indicate the importance of aggregation instead of knowledge sequential learning. Our method outperforms in both horizontal and vertical modes its series of rival techniques in terms of accuracy, precision, recall, specificity, NMI, ARI, and convergence speed.
Similar content being viewed by others
References
Bache K, Lichman M (2013) UCI machine learning repository: Data sets. University of California, School of Information and Computer Science
Beg I, Ashraf S (2009) Similarity measures for fuzzy sets. Appl Comput Math 8(2):192–202
Bensaid AM, Hall LO, Bezdek JC, Clarke LP (1996) Partially supervised clustering for image segmentation. Pattern Recognit 29(5):859–871
Bouchachia A, Pedrycz W (2006) Enhancement of fuzzy clustering by mechanisms of partial supervision. Fuzzy Sets Syst 157(13):1733–1759
Coletta LF, Vendramin L, Hruschka ER, Campello RJ, Pedrycz W (2011) Collaborative fuzzy clustering algorithms: some refinements and design guidelines. IEEE Trans Fuzzy Syst 20(3):444–462
Cornuéjols A, Wemmert C, Gançarski P, Bennani Y (2018) Collaborative clustering: why, when, what and how. Inf Fus 39:81–95
Dang TH, Ngo LT, Pedrycz W (2015) Interval type-2 fuzzy c-means approach to collaborative clustering. In: 2015 IEEE international conference on fuzzy systems (FUZZ-IEEE), IEEE, pp 1–7
Dang TH, Ngo LT, Pedrycz W (2016) Multiple kernel based collaborative fuzzy clustering algorithm. In: Asian conference on intelligent information and database systems. Springer, pp 585–594
Deng Z, Jiang Y, Chung FL, Ishibuchi H, Choi KS, Wang S (2015) Transfer prototype-based fuzzy clustering. IEEE Trans Fuzzy Syst 24(5):1210–1232
Depaire B, Falcón R, Vanhoof K, Wets G (2011) Pso driven collaborative clustering: a clustering algorithm for ubiquitous environments. Intell Data Anal 15(1):49–68
Falcon R, Jeon G, Bello R, Jeong J (2007) Learning collaboration links in a collaborative fuzzy clustering environment. In: Mexican international conference on artificial intelligence. Springer, pp 483–495
Falcón R, Depaire B, Vanhoof K, Abraham A (2008) Towards a suitable reconciliation of the findings in collaborative fuzzy clustering. In: 2008 eighth international conference on intelligent systems design and applications, IEEE, vol 3, pp 652–657
Filali A, Jlassi C, Arous N (2016) Som variants for topological horizontal collaboration. In: 2016 2nd international conference on advanced technologies for signal and image processing (ATSIP), IEEE, pp 459–464
Gao J, Tan PN, Cheng H (2006) Semi-supervised clustering with partial background information. In: Proceedings of the 2006 SIAM international conference on data mining, SIAM, pp 489–493
Ghassany M, Bennani Y (2015) Collaborative fuzzy clustering of variational bayesian generative topographic mapping. Int J Comput Intell Appl 14(01):1550001
Ghassany M, Grozavu N, Bennani Y (2012a) Collaborative clustering using prototype-based techniques. Int J Comput Intell Appl 11(03):1250017
Ghassany M, Grozavu N, Bennani Y (2012b) Collaborative generative topographic mapping. In: International conference on neural information processing. Springer, pp 591–598
Ghassany M, Grozavu N, Bennani Y (2013) Collaborative multi-view clustering. In: The 2013 international joint conference on neural networks (IJCNN), IEEE, pp 1–8
Grozavu N, Bennani Y (2010) Topological collaborative clustering. Aust J Intell Inf Process Syst 12(3)
Grozavu N, Ghassany M, Bennani Y (2011) Learning confidence exchange in collaborative clustering. In: The 2011 international joint conference on neural networks, IEEE, pp 872–879
Grozavu N, Cabanes G, Bennani Y (2014) Diversity analysis in collaborative clustering. In: 2014 international joint conference on neural networks (IJCNN), IEEE, pp 1754–1761
Hammouda K, Kamel M (2006) Collaborative document clustering. In: Proceedings of the 2006 SIAM international conference on data mining, SIAM, pp 453–463
Hu G, Du Z (2019) Adaptive kernel-based fuzzy c-means clustering with spatial constraints for image segmentation. Int J Pattern Recognit Artif Intell 33(01):1954003
Huang HC, Chuang YY, Chen CS (2011) Multiple kernel fuzzy clustering. IEEE Trans Fuzzy Syst 20(1):120–134
Hwang C, Rhee FCH (2007) Uncertain fuzzy clustering: Interval type-2 fuzzy approach to \(c\)-means. IEEE Trans Fuzzy Syst 15(1):107–120
Keyvanpour MR, Shirzad MB, Mehmandoost S (2020) Cid: a novel clustering-based database intrusion detection algorithm. J Ambient Intell Humaniz Comput 1–12
Kuhn HW (2005) The hungarian method for the assignment problem. Naval Res Logist 52(1):7–21
Lachaud A, Grozavu N, Matei B, Bennani Y (2017) Collaborative clustering between different topological partitions. In: 2017 international joint conference on neural networks (IJCNN), IEEE, pp 4111–4117
Li K, Cao Z, Cao L, Zhao R (2009) A novel semi-supervised fuzzy c-means clustering method. In: 2009 Chinese control and decision conference, IEEE, pp 3761–3765
Liu H, Huang ST (2003) Evolutionary semi-supervised fuzzy clustering. Pattern Recognit Lett 24(16):3105–3113
Loia V, Pedrycz W, Senatore S (2003) P-fcm: a proximity-based fuzzy clustering for user-centered web applications. Int J Approx Reason 34(2–3):121–144
Mai DS, Ngo LT (2015) Semi-supervised fuzzy c-means clustering for change detection from multispectral satellite image. In: 2015 IEEE international conference on fuzzy systems (FUZZ-IEEE), IEEE, pp 1–8
Mai SD, Ngo LT (2018) Multiple kernel approach to semi-supervised fuzzy clustering algorithm for land-cover classification. Eng Appl Artif Intell 68:205–213
Mitra S, Banka H, Pedrycz W (2006) Rough–fuzzy collaborative clustering. IEEE Trans Syst Man Cybern Part B (Cybern) 36(4):795–805
Moradi M, Keyvanpour MR (2015) An analytical review of xml association rules mining. Artif Intell Rev 43(2):277–300
Ngo LT, Mai DS, Pedrycz W (2015) Semi-supervising interval type-2 fuzzy c-means clustering with spatial information for multi-spectral satellite image classification and change detection. Comput Geosci 83:1–16
Ngo LT, Dang TH, Pedrycz W (2018) Towards interval-valued fuzzy set-based collaborative fuzzy clustering algorithms. Pattern Recognit 81:404–416
Pedrycz W (1985) Algorithms of fuzzy clustering with partial supervision. Pattern Recognit Lett 3(1):13–20
Pedrycz W (1996) Conditional fuzzy c-means. Pattern Recognit Lett 17(6):625–631
Pedrycz W (2002) Collaborative fuzzy clustering. Pattern Recognit Lett 23(14):1675–1686
Pedrycz W (2005) Knowledge-based clustering: from data to information granules. Wiley, New York
Pedrycz W (2006) Collaborative and knowledge-based fuzzy clustering
Pedrycz W, Hirota K (2008) A consensus-driven fuzzy clustering. Pattern Recognit Lett 29(9):1333–1343
Pedrycz W, Rai P (2008) Collaborative clustering with the use of fuzzy c-means and its quantification. Fuzzy Sets Syst 159(18):2399–2427
Pedrycz W, Rai P (2009) A multifaceted perspective at data analysis: a study in collaborative intelligent agents. IEEE Trans Syst Man Cybern Part B (Cybern) 39(4):834–844
Pedrycz W, Vukovich G (2002) Clustering in the framework of collaborative agents. In: 2002 IEEE World Congress on Computational Intelligence. 2002 IEEE International Conference on Fuzzy Systems. FUZZ-IEEE’02. Proceedings (Cat. No. 02CH37291), IEEE, vol 1, pp 134–138
Pedrycz W, Waletzky J (1997) Fuzzy clustering with partial supervision. IEEE Trans Syst Man Cybern Part B Cybern 27(5):787–795
Prasad M, Lin CT, Yang CT, Saxena A (2013) Vertical collaborative fuzzy c-means for multiple eeg data sets. In: International conference on intelligent robotics and applications, Springer, pp 246–257
Prasad M, Siana L, Li DL, Lin CT, Liu Y, Saxena A (2014) A preprocessed induced partition matrix based collaborative fuzzy clustering for data analysis. In: 2014 IEEE International conference on fuzzy systems (FUZZ-IEEE), IEEE, pp 1553–1558
Salehi F, Keyvanpour MR, Sharifi A (2020) SMKFC-ER: Semi-supervised multiple kernel fuzzy clustering based on entropy and relative entropy. Inf Sci 547:667–688
Savargiv M, Masoumi B, Keyvanpour MR (2020) A new ensemble learning method based on learning automata. J Ambient Intell Humaniz Comput 1–16
Shen Y, Pedrycz W (2017) Collaborative fuzzy clustering algorithm: some refinements. Int J Approx Reason 86:41–61
Son LH (2015) Dpfcm. Expert Systems with Applications. Int J 42(1):51–66
Sublime J, Grozavu N, Bennani Y, Cornuéjols A (2015a) Vertical collaborative clustering using generative topographic maps. In: 2015 7th International Conference of soft computing and pattern recognition (SoCPaR), IEEE, pp 199–204
Sublime J, Grozavu N, Cabanes G, Bennani Y, Cornuéjols A (2015b) From horizontal to vertical collaborative clustering using generative topographic maps. Int J Hybrid Intell Syst 12(4):245–256
Sun S, Jiang Y, Qian P (2014) Transfer learning based maximum entropy clustering. In: 2014 4th IEEE international conference on information science and technology, IEEE, pp 829–832
Timm H, Klawonn F, Kruse R (2002) An extension of partially supervised fuzzy cluster analysis. In: 2002 Annual meeting of the North American fuzzy information processing society proceedings. NAFIPS-FLINT 2002 (Cat. No. 02TH8622), IEEE, pp 63–68
Yasunori E, Yukihiro H, Makito Y, Sadaaki M (2009) On semi-supervised fuzzy c-means clustering. In: 2009 IEEE international conference on fuzzy systems, IEEE, pp 1119–1124
Yin X, Shu T, Huang Q (2012) Semi-supervised fuzzy clustering with metric learning and entropy regularization. Knowl Based Syst 35:304–311
Yu F, Yu S (2009) Prototypes-based horizontal collaborative fuzzy clustering. In: 2009 Second Pacific-Asia conference on web mining and web-based application, IEEE, pp 66–69
Yu F, Tang J, Cai R (2007a) A necessary preprocessing in horizontal collaborative fuzzy clustering. In: 2007 IEEE international conference on granular computing (GRC 2007), IEEE, pp 399
Yu F, Tang J, Cai R (2007b) Partially horizontal collaborative fuzzy c-means. Int J Fuzzy Syst 9(4)
Yu F, Tang J, Wu F, Sun Q (2007c) Auto-weighted horizontal collaboration fuzzy clustering. In: Fuzzy information and engineering, Springer, pp 592–600
Yu F, Yu J, Tang J (2009) The model of generalized partially horizontal collaborative fuzzy c-means. In: 2009 Chinese control and decision conference, IEEE, pp 6095–6099
Yu S, Yu F (2010) Incorporating prototypes into horizontal collaborative fuzzy c-means. In: 2010 Chinese control and decision conference, ieee, pp 3612–3616
Zarinbal M, Zarandi MF, Turksen I (2015a) Relative entropy collaborative fuzzy clustering method. Pattern Recogn 48(3):933–940
Zarinbal M, Zarandi MF, Turksen I, Izadi M (2015b) A type-2 fuzzy image processing expert system for diagnosing brain tumors. J Med Syst 39(10):110
Zeng S, Wang X, Cui H, Zheng C, Feng D (2017) A unified collaborative multikernel fuzzy clustering for multiview data. IEEE Trans Fuzzy Syst 26(3):1671–1687
Zhang C, Cui Y, Han Z, Zhou JT, Fu H, Hu Q (2020) Deep partial multi-view learning. IEEE transactions on pattern analysis and machine intelligence
Zhang H, Lu J (2009) Semi-supervised fuzzy clustering: a kernel-based approach. Knowl Based Syst 22(6):477–481
Zhang X, Zhang X, Liu H, Liu X (2016) Multi-task multi-view clustering. IEEE Trans Knowl Data Eng 28(12):3324–3338
Zhang Y, Chung FL, Wang S (2018) A multiview and multiexemplar fuzzy clustering approach: Theoretical analysis and experimental studies. IEEE Trans Fuzzy Syst 27(8):1543–1557
Zhou J, Chen CP, Chen L, Li HX (2013) A collaborative fuzzy clustering algorithm in distributed network environments. IEEE Trans Fuzzy Syst 22(6):1443–1456
Zhou S, Li D, Zhang Z, Ping R (2020) A new membership scaling fuzzy c-means clustering algorithm. IEEE Trans Fuzzy Syst
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Salehi, F., Keyvanpour, M.R. & Sharifi, A. \(\hbox {S}^{2}\)CFC: semi-supervised collaborative fuzzy clustering method. J Ambient Intell Human Comput 14, 727–753 (2023). https://doi.org/10.1007/s12652-021-03326-2
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12652-021-03326-2