Towards Community Detection on Heterogeneous Platforms

  • Stijn HeldensEmail author
  • Ana Lucia Varbanescu
  • Arnau Prat-Pérez
  • Josep-Lluis Larriba-Pey
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9523)


Over the last decade, community detection has become an increasingly important topic of research due to its many applications in different fields of research, such as biology and sociology. One example of a modern community detection algorithm is Scalable Community Detection (SCD), which has been shown to produce high-quality results, but its performance remains an issue on large graphs. In this work, we demonstrate how SCD can benefit from the heterogeneity offered by hybrid CPU-GPU platforms by presenting Het-SCD: a heterogeneous version of SCD which combines the larger memory capacity of the CPU with the larger computational power of the GPU. To enable this, we have designed an entirely new version of SCD which efficiently uses the fine-grained parallelism of GPUs. We report performance results on six real-world graphs (up to 1.8 B edges) and six platforms. We observe excellent performance for only the GPU (e.g., 70x speedup over sequential CPU version on graph of 117 M edges) and for combining the CPU and GPU (e.g., 40x speedup for same graph on low-end GPU with insufficient memory to store entire dataset). These results demonstrate that Het-SCD is an excellent solution for large-scale community detection, since it provides high performance while preserving the high quality of the original algorithm.


Community detection Heterogeneous computing GPU computing SCD algorithm WCC metric 


  1. 1.
    Baxter, S.: Modern GPU. (2013)
  2. 2.
    Blondel, V.D., Guillaume, J.L., Lambiotte, R., Lefebvre, E.: Fast unfolding of communities in large networks. J. Stat. Mech: Theory Exp. 2008(10), P10008 (2008)CrossRefGoogle Scholar
  3. 3.
    Cheong, C.Y., Huynh, H.P., Lo, D., Goh, R.S.M.: Hierarchical parallel algorithm for modularity-based community detection using GPUs. In: Wolf, F., Mohr, B., an Mey, D. (eds.) Euro-Par 2013. LNCS, vol. 8097, pp. 775–787. Springer, Heidelberg (2013) CrossRefGoogle Scholar
  4. 4.
    Fortunato, S.: Community detection in graphs. Phys. Rep. 486(3), 75–174 (2010)CrossRefMathSciNetGoogle Scholar
  5. 5.
    Fortunato, S., Barthélemy, M.: Resolution limit in community detection. Proc. Nat. Acad. Sci. 104(1), 36–41 (2007)CrossRefGoogle Scholar
  6. 6.
    Karypis, G., Kumar, V.: A fast and high quality multilevel scheme for partitioning irregular graphs. SIAM J. Sci. Comput. 20(1), 359–392 (1998)CrossRefMathSciNetGoogle Scholar
  7. 7.
    Leskovec, J., Krevl, A.: SNAP datasets: stanford large network dataset collection (2014).
  8. 8.
    Leung, I.X., Hui, P., Lio, P., Crowcroft, J.: Towards real-time community detection in large networks. Phys. Rev. E 79(6), 066107 (2009)CrossRefGoogle Scholar
  9. 9.
    Newman, M.E.: The structure and function of complex networks. SIAM Rev. 45(2), 167–256 (2003)zbMATHCrossRefMathSciNetGoogle Scholar
  10. 10.
    Newman, M.E.: Detecting community structure in networks. Eur. Phys. J. B Condens. Matter Complex Syst. 38(2), 321–330 (2004)CrossRefGoogle Scholar
  11. 11.
    NVIDIA Corporation: NVIDIA CUDA C Programming Guide (2011)Google Scholar
  12. 12.
    Palla, G., Derényi, I., Farkas, I., Vicsek, T.: Uncovering the overlapping community structure of complex networks in nature and society. Nature 435, 814–818 (2005)CrossRefGoogle Scholar
  13. 13.
    Prat-Pérez, A., Dominguez-Sal, D., Brunat, J.M., Larriba-Pey, J.L.: Shaping communities out of triangles. In: CIKM 2012. ACM (2012)Google Scholar
  14. 14.
    Prat-Pérez, A., Dominguez-Sal, D., Larriba-Pey, J.L.: High quality, scalable and parallel community detection for large real graphs. In: WWW 2014 (2014)Google Scholar
  15. 15.
    Scott, J.: Social Network Analysis. Sage, London (2012) Google Scholar
  16. 16.
    Soman, J., Narang, A.: Fast community detection algorithm with GPUs and multicore architectures. In: IPDPS 2011. IEEE (2011)Google Scholar
  17. 17.
    Staudt, C., Meyerhenke, H.: Engineering parallel algorithms for community detection in massive networks. IEEE TPDS PP(99), 1 (2015)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Stijn Heldens
    • 1
    Email author
  • Ana Lucia Varbanescu
    • 1
  • Arnau Prat-Pérez
    • 2
  • Josep-Lluis Larriba-Pey
    • 2
  1. 1.Informatics InstituteUniversity of AmsterdamAmsterdamThe Netherlands
  2. 2.DAMA-UPCUniversitat Politèchnica de CatalunyaBarcelonaSpain

Personalised recommendations