Skip to main content
Log in

An improved multi-objective evolutionary algorithm for simultaneously detecting separated and overlapping communities

  • Published:
Natural Computing Aims and scope Submit manuscript

Abstract

In our previous work, a multi-objective evolutionary algorithm (MEA_CDPs) was proposed for detecting separated and overlapping communities simultaneously. However, MEA_CDPs has a couple of defects, like individuals cannot be transformed to community structure by the decoder when the quality of community structure is lower certain thresholds, many vertices with weak overlapping nature are identified as overlapping nodes, and the objective functions can not control the ratio of separated nodes to overlapping nodes. Therefore, in this paper, to overcome these defects, we improve MEA_CDPs by designing more efficient objective functions. We also extend MEA_CDPs’ capability in detecting hierarchical community structures. The improved algorithm is named as iMEA_CDPs. In the experiments, a set of computer-generated networks are first used to test the effect of parameters in iMEA_CDPs, and then four real-world networks are used to validate the performance of iMEA_CDPs. The experimental results show that iMEA_CDPs outperforms MEA_CDPs. Moreover, compared with MEA_CDPs, iMEA_CDPs can detect various kinds of overlapping and hierarchical community structures.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  • Adamic LA, Huberman BA (2000) Power-law distribution of the world wide web. Science 287:2115

    Article  Google Scholar 

  • Albert R, Barabási A-L (2002) Statistical mechanics of complex networks. Rev Mod Phys 74:47–97

    Article  MathSciNet  MATH  Google Scholar 

  • Barabási A-L, Albert R (1999) Emergence of scaling in random networks. Science 286:509–512

    Article  MathSciNet  MATH  Google Scholar 

  • Blondel VD, Guillaume J-L, Lambiotte R, Lefebvre E (2008) Fast unfolding of communities in large networks. J Stat Mech 2008:P10008

    Article  Google Scholar 

  • Buzdalov B, Shalyto A (2014) A provably asymptotically fast version of the generalized Jensen algorithm for non-dominated sorting. PPSN XIII:528–537

    Google Scholar 

  • Clauset A (2005) Finding local community structure in networks. Phys Rev E 72:026132

    Article  Google Scholar 

  • Clauset A, Newman MEJ, Moore C (2004) Finding community structure in very large networks. Phys Rev E 70:066111

    Article  Google Scholar 

  • Cui W, Xiao Y, Wang H et al (2013) Online search of overlapping communities. In: Proceedings of the 2013 ACM SIGMOD international conference on management of data (SIGMOD 13), 22–27 Jun

  • Danon L, Díaz-Guilera A, Duch J, Arenas A (2005) Comparing community structure identification. J Stat Mech 9:P09008

    Google Scholar 

  • Deb K, Pratap A, Agarwal S, Meyarivan T (2002) A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans Evol Comput 6(2):182–197

    Article  Google Scholar 

  • Fortin, FA, Grenier, S, Parizeau, M (2013) Generalizing the improved run-time complexity algorithm for non-dominated sorting. In: Proceeding of the fifteenth annual conference on genetic and evolutionary computation conference, pp 615–622

  • Fortunato S (2009) Community detection in graphs. Phys Rep 486:75–174

    Article  MathSciNet  Google Scholar 

  • Fortunato S, Barthélemy M (2007) Resolution limit in community detection. Proc Natl Acad Sci 104:36–41

    Article  Google Scholar 

  • Girvan M, Newman MEJ (2002) Community structure in social and biological networks. Proc Natl Acad Sci 99:8271–8276

    Article  MathSciNet  MATH  Google Scholar 

  • Gog A, Dumitrescu D, Hirsbrunner B (2007) Community detection in complex networks using collaborative evolutionary algorithms. In: Proceedings of the 9th European conference on artificial life, pp 886–894

  • Goldberg DE, Lingle R (1985) Alleles, loci, and the traveling salesman problem. In: Proceedings of the 1st international conference on genetic algorithms, pp 154–159

  • Jensen MT (2003) Reducing the run-time complexity of multiobjective EAs: the NSGA-II and other algorithms. IEEE Trans Evol Comput 7(5):503–515

    Article  Google Scholar 

  • Krebs V unpublished, http://www.orgnet.com/

  • Lancichinetti A, Fortunato S (2008) Community detection algorithms: a comparative analysis. Phys Rev E 80:056117

    Article  Google Scholar 

  • Lancichinetti A, Fortunato S, Radicchi F (2008) Benchmark graphs for testing community detection algorithms. Phys Rev E 78:046110

    Article  Google Scholar 

  • Lancichinetti A, Fortunato S, Kertész J (2009) Detecting the overlapping and hierarchical community structure of complex networks. New J Phys 11:033015

    Article  Google Scholar 

  • Lancichinetti A, Radicchi F, Ramasco JJ, Fortunato S (2011) Finding statistically significant communities in networks. PLoS one 6(4):e18961

    Article  Google Scholar 

  • Lázár A, Ábel D, Vicsek T (2010) Modularity measure of networks with overlapping communities. Europhys Lett 90(1):18001

    Article  Google Scholar 

  • Li Y, Liu J, Liu C (2014) A comparative analysis of evolutionary and memetic algorithms for community detection from signed social networks. Soft Comput 18(2):329–348

    Article  Google Scholar 

  • Liu X, Li D, Wang S, Tao Z (2007) Effective algorithm for detecting community structure in complex networks based on GA and clustering. In: Proceedings of the 7th international conference on computational science, pp 657–664

  • Liu J, Zhong W, Abbass HA, Green D (2010) Separated and overlapping community detection in complex networks using multiobjective evolutionary algorithms. In: Proceedings of IEEE 2010 congress on evolutionary computation (CEC)

  • Liu C, Liu J, Jiang Z (2014) A multiobjective evolutionary algorithm based on similarity for community detection from signed social networks. IEEE Trans Cybern 44(12):2274–2287

    Article  Google Scholar 

  • Lusseau D, Schneider K, Boisseau O, Haase P, Slooten E, Dawson SM (2003) The bottlenose dolphin community of doubtful sound features a large proportion of long-lasting associations. Behav Ecol Sociobiol 54:396–405

    Article  Google Scholar 

  • McDaid AF, Greene D, Hurley N (2011) Normalized mutual information to evaluate overlapping community finding algorithms, arXiv preprint arXiv:1110.2515

  • Meo PD, Ferrara E, Fiumara G, Provetti A (2013) Enhancing community detection using a network weighting strategy. Inf Sci 222:648–668

    Article  MathSciNet  MATH  Google Scholar 

  • Nepusz T, Petróczi A, Négyessy L, Bazsó F (2008) Fuzzy communities and the concept of bridgeness in complex networks. Phys Rev E 77:016107

    Article  MathSciNet  Google Scholar 

  • Newman MEJ (2004) Fast algorithm for detecting community structure in networks. Phys Rev E 69:066133

    Article  Google Scholar 

  • Newman MEJ, Girvan M (2004) Finding and evaluating community structure in networks. Phys Rev E 69:026113

    Article  Google Scholar 

  • Newman MEJ, Leicht EA (2007) Mixture models and exploratory analysis in networks. PNAS 104:9564–9569

    Article  MATH  Google Scholar 

  • Palla G, Derényi I, Farkas I, Vicsek T (2005) Uncovering the overlapping community structure of complex networks in nature and society. Nature 435:814–818

    Article  Google Scholar 

  • Pizzuti C (2012) A multiobjective genetic algorithm to find communities in complex networks. IEEE Trans Evol Comput 16(3):418–430

    Article  Google Scholar 

  • Radicchi F, Castellano C, Cecconi F, Loreto V, Parisi D (2004) Defining and identifying communities in networks. PNAS 101:2658–2663

    Article  Google Scholar 

  • Reichardt J, Bornholdt S (2004) Detecting fuzzy community structures in complex networks with a Potts model. Phys Rev Lett 93:218701

    Article  Google Scholar 

  • Rosvall M, Bergstrom CT (2007) An information-theoretic framework for resolving community structure in complex networks. PNAS 104:7327–7331

    Article  Google Scholar 

  • Rosvall M, Bergstrom CT (2008) Maps of random walks on complex networks reveal community structure. Proc Natl Acad Sci 105(4):1118–1123

    Article  Google Scholar 

  • Shen H, Cheng X, Cai K, Hu MB (2009a) Detect overlapping and hierarchica1 community structure in networks. Phys A 388:1706–1712

    Article  Google Scholar 

  • Shen H, Cheng X, Cai K, Hu MB (2009b) Detect overlapping and hierarchical community structure in networks. Phys A 388:1706–1712

    Article  Google Scholar 

  • Shi C, Yu PS, Cai Y, Yan Z, Wu B (2011) On selection of objective functions in multi-objective community detection. CIKM 2301–2304

  • Shi C, Yan Z, Cai Y, Wu B (2012) Multi-objective community detection in complex networks. Appl Soft Comput 12(2):850–859

    Article  Google Scholar 

  • Strogatz SH (2001) Exploring complex networks. Nature 410:268–276

    Article  Google Scholar 

  • Tasgin M, Herdagdelen A, Bingol H (2007) Community detection in complex networks using genetic algorithms, Arxiv preprint http://arxiv.org/abs/cond-mat/0604419

  • Watts DJ, Strogatz SH (1998) Collective dynamics of small-world networks. Nature 393(6638):440–442

    Article  Google Scholar 

  • Xie J, Kelley S, Szymanski BK (2011) Overlapping community detection in networks: the state of the art and comparative study. ACM Comput Surv 45(4):43

    Google Scholar 

  • Yahn Y, Bagrow JP, Lehmann S (2010) Link communities reveal multi-scale complexity in networks. Nature 466:761–764

    Article  Google Scholar 

  • Zachary W (1977) An information flow model for conflict and fission in small groups. J Anthropol Res 33:452–473

    Article  Google Scholar 

  • Zeng Y, Liu J (2014) Community detection from signed social networks using a multi-objective evolutionary algorithm, In: the Proceedings of the 18th Asia Pacific symposium on intelligent and evolutionary systems, Singapore, pp 259–270

  • Zhang Q, Li H (2007) MOEA/D: a multiobjective evolutionary algorithm based on decomposition. IEEE Trans Evol Comput 11(6):712–731

    Article  Google Scholar 

  • Zhang SH, Wang RS, Zhang XS (2007a) Uncovering fuzzy community structure in complex networks. Phys Rev E 76:046103

    Article  Google Scholar 

  • Zhang SH, Wang RS, Zhang XS (2007b) Identification of overlapping community structure in complex networks using fuzzy c-means clustering. Phys A 374:483–490

    Article  Google Scholar 

  • Zhou M, Liu J (2014) A memetic algorithm for enhancing the robustness of scale-free networks against malicious attacks. Phys A 410:131–143

    Article  Google Scholar 

  • Zitzler E, Thiele L, Laumanns M, Fonseca CM, da Fonseca VG (2003) Performance assessment of multiobjective optimizers: an analysis and review. IEEE Trans Evol Comput 7(2):117–132

    Article  Google Scholar 

Download references

Acknowledgments

This work is partially supported by the Outstanding Young Scholar Program of National Natural Science Foundation of China (NSFC) under Grant 61522311, the General Program of NSFC under Grant 61271301, the Overseas, Hong Kong & Macao Scholars Collaborated Research Program of NSFC under Grant 61528205, the Research Fund for the Doctoral Program of Higher Education of China under Grant 20130203110010, and the Fundamental Research Funds for the Central Universities under Grant K5051202052.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jing Liu.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Liu, C., Liu, J. & Jiang, Z. An improved multi-objective evolutionary algorithm for simultaneously detecting separated and overlapping communities. Nat Comput 15, 635–651 (2016). https://doi.org/10.1007/s11047-015-9529-y

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11047-015-9529-y

Keywords

Navigation