Testing Community Detection Algorithms: A Closer Look at Datasets

  • Ahmed Ibrahem Hafez
  • Aboul Ella Hassanien
  • Aly A. Fahmy
Part of the Intelligent Systems Reference Library book series (ISRL, volume 65)


Social networks of various kinds demonstrate a strong community effect. Actors in a network tend to form closely-knit groups; those groups are also called communities or clusters. Detecting such groups in a social network (i.e., community detection) remains a core problem in social network analysis. Among the challenges that face the researchers to come up with advanced community detection methods, there is a key challenge, which is the validation and evaluation of their methods. The limited benchmark data available, the lack of ground truth for many of the available network datasets, and the nature of the social behavior factor in the problem, turned the evaluation process to be very hard. Accordingly, understanding such challenges may help in designing good community detection methods. This chapter presents testing strategies for community detection approaches and explores a number of datasets that could be used in the testing process as well as stating some characteristics of those datasets.


Social network analysis Community detection Method evaluation Social network datasets 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Girvan, M., Newman, M.E.J.: Community structure in social and biological networks. Proceedings of the National Academy of Sciences 99(12), 7821–7826 (2002)CrossRefMATHMathSciNetGoogle Scholar
  2. 2.
    Fortunato, S.: Community detection in graphs. Physics Reports 486(3-5), 75–174 (2010)CrossRefMathSciNetGoogle Scholar
  3. 3.
    Newman, M.E.J., Girvan, M.: Finding and evaluating community structure in networks. Physics Rev. E 69(2), 026113 (2004)Google Scholar
  4. 4.
    Radicchi, F., Castellano, C., Cecconi, F., Loreto, V., Parisi, D.: Defining and identifying communities in networks. Proceedings of the National Academy of Sciences of USA 101(9), 2658–2663 (2004)CrossRefGoogle Scholar
  5. 5.
    Clauset, A., Newman, M.E.J., Moore, C.: Finding community structure in very large networks. Phys. Rev. E 70(6), 066111 (2004)Google Scholar
  6. 6.
    Luxburg, U.: A Tutorial on Spectral Clustering. Statistics and Computing 17(4), 395–416 (2007)CrossRefMathSciNetGoogle Scholar
  7. 7.
    Hafez, A.I., Ghali, N.I., Hassanien, A.E., Fahmy, A.A.: Genetic Algorithms for community detection in social networks. In: 2012 12th International Conference on Intelligent Systems Design and Applications (ISDA), pp. 460–465 (2012)Google Scholar
  8. 8.
    Pizzuti, C.: A multi-objective genetic algorithm for community detection in networks. In: 21st International Conference on Tools with Artificial Intelligence, pp. 379–386 (2009)Google Scholar
  9. 9.
    Hastings, M.B.: Community detection as an inference problem. Phys. Rev. E 74(3), 035102 (2006)Google Scholar
  10. 10.
    Newman, M.E.J., Leicht, E.A.: Mixture models and exploratory analysis in networks. Proceedings of the National Academy of Sciences 104(23), 9564–9569 (2007)CrossRefMATHGoogle Scholar
  11. 11.
    Dempster, A.P., Laird, N.M., Rubin, D.B.: Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society, Series B 39(1), 1–38 (1977)MATHMathSciNetGoogle Scholar
  12. 12.
    Tang, L., Liu, H.: Community Detection and Mining in Social Media. Morgan & Claypool Publishers (2010)Google Scholar
  13. 13.
    Leskovec, J., Lang, K., Mahoney, M.: Empirical Comparison of Algorithms for Network Community Detection. In: ACM WWW International Conference on World Wide Web (2010)Google Scholar
  14. 14.
    Shi, J., Malik, J.: Normalized Cuts and Image Segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence 22, 888–905 (1997)Google Scholar
  15. 15.
    Flake, G.W., Lawrence, S., Lee Giles, C.: Efficient Identification of Web Communities. In: Sixth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 150–160 (2000)Google Scholar
  16. 16.
    Newman, M.E.J.: Analysis of weighted networks. Phys. Rev. E 70(5), 056131 (2004)Google Scholar
  17. 17.
    Danon, L., Diaz-Guilera, A., Duch, J., Arenas, A.: Comparing community structure identification. Journal of Statistical Mechanics: Theory and Experiment 9, 09008 (2005)Google Scholar
  18. 18.
    Fan, Y., Li, M., Zhang, P., Wu, J., Di, Z.: Accuracy and precision of methods for community identification in weighted networks. Physica A: Statistical Mechanics and its Applications 377(1), 363–372 (2007)CrossRefGoogle Scholar
  19. 19.
    Lancichinetti, A., Fortunato, S.: Benchmarks for testing community detection algorithms on directed and weighted graphs with overlapping communities. Phys. Rev. E 80(1), 016118 (2009)Google Scholar
  20. 20.
    Bastian, M., Heymann, S., Jacomy, M.: Gephi: An Open Source Software for Exploring and Manipulating Networks. In: International AAAI Conference on Weblogs and Social Media (2009)Google Scholar
  21. 21.
    Jacomy, M., Heymann, S., Venturini, T., Bastian, M.: ForceAtlas2, A Continuous Graph Layout Algorithm for Handy Network Visualization. Medialab Center of Research (2012)Google Scholar
  22. 22.
  23. 23.
    Stanford Large Network Dataset Collection (2013),
  24. 24.
    Zachary, W.W.: An information flow model for conflict and fission in small groups. Journal of Anthropological Research 33(4), 452–473 (1977)Google Scholar
  25. 25.
    Lusseau, D.: The emergent properties of dolphin social network. Proceedings of the Royal Society of London. Series B: Biological Sciences 270(suppl. 2), S186–S188 (2003)Google Scholar
  26. 26.
    McAuley, J.J., Leskovec, J.: Learning to Discover Social Circles in Ego Networks. In: NIPS, pp. 548–556 (2012)Google Scholar
  27. 27.
    Leskovec, J.: Social Circles in Ego Networks (2013),
  28. 28.
    Hechter, M.: Principles of Group Solidarity, ch. 2. University of California Press (1988)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Ahmed Ibrahem Hafez
    • 1
  • Aboul Ella Hassanien
    • 2
  • Aly A. Fahmy
    • 3
  1. 1.Faculty of Computer and Information, Scientific Research Group in Egypt (SRGE)Minia UniversityMiniaEgypt
  2. 2.Faculty of Computers and Information, Scientific Research Group in Egypt (SRGE)Cairo UniversityCairoEgypt
  3. 3.Faculty of Computers and InformationCairo UniversityCairoEgypt

Personalised recommendations