Abstract
The detection of community structure has aroused wide attention since it can reveal the underlying properties of complex networks in biology, as well as physical and social sciences. Many community detection algorithms have been proposed to detect the communities in the un-weighted networks. However, the recently high-level of interest in complex weighted networks gives rise to a need to develop new methods and measures to take the weights of links into account. To fulfill the above needs, we propose a new generalization of the clustering coefficient that retains the information encoded in the weights of links and thus fully capture the richness of the information contained in the data. We also define a new generation of the complete graph (CG) of a weighted network based on the maximal weight attached to each node. Furthermore, we use the weighted clustering coefficient (WCC) and CG to design a novel community detection algorithm based on a proposed pyramidal clustering. It performs in three main steps. In the first step, the CG is generated, and the WCC is computed for all the nodes. The second step uses CG and WCC to divide the network into a set of pyramidal clusters (PCs), where each PC has a score. For the final steps, we propose a measure for the clusters, called connectivity, that computes the degree of connectivity between the PCs. Pairs of PCs with high connectivity are merged until the degree of connectivity between all the clusters is low. The experiment results on weighted and un-weighted real-world networks show that the proposed method outperforms other state-of-art algorithms in terms of normalized mutual information and modularity.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Adamic LA, Glance N (2005) The political blogosphere and the 2004 US election: divided they blog. In: Proceedings of the 3rd international workshop on Link discovery. pp 36–43
Albert R, Jeong H, Barabási A-L (1999) Diameter of the world-wide web. Nature 401:130–131
Atay Y, Koc I, Babaoglu I, Kodaz H (2017) Community detection from biological and social networks: A comparative analysis of metaheuristic algorithms. Appl Soft Comput 50:194–211. https://doi.org/10.1016/j.asoc.2016.11.025
Barrat A, Barthelemy M, Pastor-Satorras R, Vespignani A (2004) The architecture of complex weighted networks. Proc Natl Acad Sci 101:3747–3752. https://doi.org/10.1073/pnas.0400087101
Blondel VD, Guillaume J-L, Lambiotte R, Lefebvre E (2008) Fast unfolding of communities in large networks. J Stat Mech Theory Exp 2008:P10008. https://doi.org/10.1088/1742-5468/2008/10/P10008
Clauset A, Newman MEJ, Moore C (2004) Finding community structure in very large networks. Phys Rev E 70:066111. https://doi.org/10.1103/PhysRevE.70.066111
Cuijuan Wang W, Tang B Sun, et al (2015) Review on community detection algorithms in social networks. In: 2015 IEEE International Conference on Progress in Informatics and Computing (PIC). IEEE, Nanjing, China, pp 551–555
Danon L, Díaz-Guilera A, Duch J, Arenas A (2005) Comparing community structure identification. J Stat Mech Theory Exp 2005:P09008–P09008. https://doi.org/10.1088/1742-5468/2005/09/P09008
Duch J, Arenas A (2005) Community detection in complex networks using extremal optimization. Phys Rev E Stat Nonlin Soft Matter Phys 72:027104. https://doi.org/10.1103/PhysRevE.72.027104
Ezeh C, Tao R, Zhe L et al (2019) Multi-type node detection in network communities. Entropy 21:1237. https://doi.org/10.3390/e21121237
Fortunato S (2010) Community detection in graphs. Phys Rep 486:75–174. https://doi.org/10.1016/j.physrep.2009.11.002
Fortunato S, Hric D (2016) Community detection in networks: a user guide. Phys Rep 659:1–44. https://doi.org/10.1016/j.physrep.2016.09.002
Girvan M, Newman MEJ (2002) Community structure in social and biological networks. Proc Natl Acad Sci 99:7821–7826. https://doi.org/10.1073/pnas.122653799
Grover A, Leskovec J (2016) node2vec: scalable feature learning for networks. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, San Francisco California USA, pp 855–864
Harenberg S, Bello G, Gjeltema L et al (2014) Community detection in large-scale networks: a survey and empirical evaluation: community detection in large-scale networks. Wiley Interdiscip Rev Comput Stat 6:426–439. https://doi.org/10.1002/wics.1319
Holme P, Min Park S, Kim BJ, Edling CR (2007) Korean university life in a network perspective: Dynamics of a large affiliation network. Phys Stat Mech Its Appl 373:821–830. https://doi.org/10.1016/j.physa.2006.04.066
Huang J, Sun H, Liu Y et al (2011) Towards online multiresolution community detection in large-scale networks. PLoS One 6:e23829. https://doi.org/10.1371/journal.pone.0023829
Javed MA, Younis MS, Latif S et al (2018) Community detection in networks: A multidisciplinary review. J Netw Comput Appl 108:87–111. https://doi.org/10.1016/j.jnca.2018.02.011
Ji P, Zhang S, Zhou Z (2020a) A decomposition-based ant colony optimization algorithm for the multi-objective community detection. J Ambient Intell Humaniz Comput 11:173–188. https://doi.org/10.1007/s12652-019-01241-1
Ji P, Zhang S, Zhou Z (2020b) Overlapping community detection based on maximal clique and multi-objective ant colony optimization. In: 2020 Chinese control and decision conference (CCDC). IEEE, Hefei, China, pp 5164–5169
Karataş A, Şahin S (2018) Application areas of community detection: a review. In: 2018 International congress on big data, deep learning and fighting cyber terrorism (IBIGDELFT). IEEE, pp 65–70
Kong H, Kang Q, Li W et al (2019) A hybrid iterated carousel greedy algorithm for community detection in complex networks. Phys Stat Mech Appl 536:122124. https://doi.org/10.1016/j.physa.2019.122124
Lalwani D, Somayajulu DV, Krishna PR (2015) A community driven social recommendation system. In: 2015 IEEE International Conference on Big Data (Big Data). IEEE, pp 821–826
Le Martelot E, Hankin C (2011) Multi-scale community detection using stability as optimisation criterion in a greedy algorithm. In: KDIR. pp 216–225
Leskovec J, Lang KJ, Dasgupta A, Mahoney MW (2009) Community structure in large networks: natural cluster sizes and the absence of large well-defined clusters. Internet Math 6:29–123. https://doi.org/10.1080/15427951.2009.10129177
Li H-J, Bu Z, Wang Z et al (2018) Enhance the Performance of Network Computation by a Tunable Weighting Strategy. IEEE Trans Emerg Top Comput Intell 2:214–223. https://doi.org/10.1109/TETCI.2018.2829906
Lusseau D (2003) The emergent properties of a dolphin social network. Proc R Soc Lond B Biol Sci 270:S186–S188
Lusseau D, Newman ME (2004) Identifying the role that animals play in their social networks. Proc R Soc Lond B Biol Sci 271:S477–S481
MacQueen J (1967) Some methods for classification and analysis of multivariate observations. In: Proceedings of the fifth Berkeley symposium on mathematical statistics and probability. Oakland, CA, USA, pp 281–297
Midoun MA, Wang X (2019) New magnetic algorithm to detect community structure based on the magnets' approach. Mod Phys Lett B 33:1950166
Mosadegh MJ, Behboudi M (2011) Using social network paradigm for developing a conceptual framework in CRM. Aust J Bus Manag Res 1:63
Nascimento MCV (2014) Community detection in networks via a spectral heuristic based on the clustering coefficient. Discrete Appl Math 176:89–99. https://doi.org/10.1016/j.dam.2013.09.017
Newman MEJ (2001) The structure of scientific collaboration networks. Proc Natl Acad Sci 98:404–409. https://doi.org/10.1073/pnas.98.2.404
Newman MEJ (2004) Analysis of weighted networks. Phys Rev E 70:056131. https://doi.org/10.1103/PhysRevE.70.056131
Newman MEJ (2006) Finding community structure in networks using the eigenvectors of matrices. Phys Rev E 74:036104. https://doi.org/10.1103/PhysRevE.74.036104
Newman MEJ, Girvan M (2004) Finding and evaluating community structure in networks. Phys Rev E 69:026113. https://doi.org/10.1103/PhysRevE.69.026113
Onnela J-P, Saramäki J, Kertész J, Kaski K (2005) Intensity and coherence of motifs in weighted complex networks. Phys Rev E 71:065103. https://doi.org/10.1103/PhysRevE.71.065103
Osaba E, Del Ser J, Camacho D et al (2018) Community detection in weighted directed networks using nature-inspired heuristics. In: Yin H, Camacho D, Novais P, Tallón-Ballesteros AJ et al (eds) Intelligent data engineering and automated learning– IDEAL 2018. Springer International Publishing, Cham, pp 325–335
Osaba E, Del Ser J, Camacho D et al (2020) Community detection in networks using bio-inspired optimization: latest developments, new results and perspectives with a selection of recent meta-heuristics. Appl Soft Comput 87:106010. https://doi.org/10.1016/j.asoc.2019.106010
Plantié M, Crampes M (2013) Survey on social community detection. In: Social media retrieval. Springer, pp 65–85
Pons P, Latapy M (2006) Computing communities in large networks using random walks. J Graph Algorithms Appl 10:191–218
Raghavan UN, Albert R, Kumara S (2007) Near linear time algorithm to detect community structures in large-scale networks. Phys Rev E 76:036106. https://doi.org/10.1103/PhysRevE.76.036106
Reichardt J, Bornholdt S (2006) Statistical mechanics of community detection. Phys Rev E 74:016110. https://doi.org/10.1103/PhysRevE.74.016110
Rossi R, Ahmed N (2015) The network data repository with interactive graph analytics and visualization. In: Twenty-Ninth AAAI Conference on Artificial Intelligence
Rosvall M, Bergstrom CT (2007) Maps of information flow reveal community structure in complex networks. ArXiv Prepr Physicssoc-Ph07070609
Salathé M, Jones JH (2010) Dynamics and control of diseases in networks with community structure. PLoS Comput Biol 6:e1000736. https://doi.org/10.1371/journal.pcbi.1000736
Saramäki J, Kivelä M, Onnela J-P et al (2007) Generalizations of the clustering coefficient to weighted complex networks. Phys Rev E 75:027105. https://doi.org/10.1103/PhysRevE.75.027105
Shahabi Sani N, Manthouri M, Farivar F (2020) A multi-objective ant colony optimization algorithm for community detection in complex networks. J Ambient Intell Humaniz Comput 11:5–21. https://doi.org/10.1007/s12652-018-1159-7
Shang K, Small M, Wang Y et al (2020a) A novel metric for community detection. EPL Europhys Lett 129:68002. https://doi.org/10.1209/0295-5075/129/68002
Shang K, Yang B, Moore JM et al (2020) Growing networks with communities: a distributive link model. Chaos Interdiscip J Nonlinear Sci 30:041101. https://doi.org/10.1063/5.0007422
Waskiewicz TV (2012) Friend of a Friend Influence in Terrorist Social Networks
Watts DJ, Strogatz SH (1998) Collective dynamics of 'small-world' networks. Nature 393:440–442. https://doi.org/10.1038/30918
You X, Ma Y, Liu Z (2019) A three-stage algorithm on community detection in social networks. Knowl Based Syst. https://doi.org/10.1016/j.knosys.2019.06.030
Zachary WW (1977) An Information Flow Model for Conflict and Fission in Small Groups. J Anthropol Res 33:452–473. https://doi.org/10.1086/jar.33.4.3629752
Zhang B, Horvath S (2005) A General Framework for Weighted Gene Co-Expression Network Analysis. Stat Appl Genet Mol Biol. https://doi.org/10.2202/1544-6115.1128
Zhou H (2003) Distance, dissimilarity index, and network community structure. Phys Rev E 67:061901. https://doi.org/10.1103/PhysRevE.67.061901
Zhou X, Yang K, Xie Y et al (2019) A novel modularity-based discrete state transition algorithm for community detection in networks. Neurocomputing 334:89–99
Acknowledgement
This research is supported by the National Natural Science Foundation of China (No: 61672124), the Password Theory Project of the 13th Five-Year Plan National Cryptography Development Fund (No: MMJJ20170203), Liaoning Province Science and Technology Innovation Leading Talents Program Project (No: XLYC1802013), Key R&D Projects of Liaoning Province (No: 2019020105-JH2/103), Jinan City '20 universities' Funding Projects Introducing Innovation Team Program (No: 2019GXRC031).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Midoun, M.A., Wang, X. & Talhaoui, M.Z. A pyramidal community detection algorithm based on a generalization of the clustering coefficient. J Ambient Intell Human Comput 12, 9111–9125 (2021). https://doi.org/10.1007/s12652-020-02608-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12652-020-02608-5