A Spectral Algorithm with Additive Clustering for the Recovery of Overlapping Communities in Networks

Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9925)

Abstract

This paper presents a novel spectral algorithm with additive clustering, designed to identify overlapping communities in networks. The algorithm is based on geometric properties of the spectrum of the expected adjacency matrix in a random graph model that we call stochastic blockmodel with overlap (SBMO). An adaptive version of the algorithm, that does not require the knowledge of the number of hidden communities, is proved to be consistent under the SBMO when the degrees in the graph are (slightly more than) logarithmic. The algorithm is shown to perform well on simulated data and on real-world graphs with known overlapping communities.

References

  1. 1.
    Airoldi, E., Blei, D., Fienberg, S., Xing, E.: Mixed membership stochastic blockmodels. J. Mach. Learn. Res. 9, 1981–2014 (2008)MATHGoogle Scholar
  2. 2.
    Anandkumar, A., Ge, R., Hsu, D., Kakade, S.: A tensor spectral approach to learning mixed membership community models. JMLR 15(1), 2239–2312 (2014)MathSciNetMATHGoogle Scholar
  3. 3.
    Arthur, D., Vassilvitskii, S.: k-means++: the advantage of careful seeding. In: Proceedings of the 18th ACM-SIAM Symposium on Discrete Algorithms (2007)Google Scholar
  4. 4.
    Ball, B., Karrer, B., Newman, M.E.: An efficient and principled way for detecting communities in networks. Phys. Rev. E 84, 036103 (2011)CrossRefGoogle Scholar
  5. 5.
    Chatterjee, S.: Matrix estimation by universal singular value thresholding. Ann. Stat. 43(1), 177–214 (2015)MathSciNetCrossRefMATHGoogle Scholar
  6. 6.
    Holland, P.W., Leinhardt, S.: Stochastic blockmodels: first steps. Soc. Netw. 5(2), 109–137 (1983)MathSciNetCrossRefGoogle Scholar
  7. 7.
    Karrer, B., Newman, M.E.: Stochastic blockmodels and community structure in networks. Phys. Rev. E 83, 016107 (2011)MathSciNetCrossRefGoogle Scholar
  8. 8.
    Latouche, P., Birmelé, E., Ambroise, C.: Overlapping stochastic block models with applications to the French political blogoshpere. Ann. Appl. Stat. 5(1), 309–336 (2011)MathSciNetCrossRefMATHGoogle Scholar
  9. 9.
    Mc Auley, J., Leskovec, J.: Learning to discover social circles in ego networks. In: NIPS, vol. 25, pp. 548–556 (2012)Google Scholar
  10. 10.
    Newman, M.E.: Spectral methods for network community detection and graph partitioning. Phys. Rev. E 88, 042822 (2013)CrossRefGoogle Scholar
  11. 11.
    Palla, G., Derényi, I., Farkas, I., Vicsek, T.: Uncovering the overlapping community structure of complex networks in nature and society. Nature 435, 814–818 (2005)CrossRefGoogle Scholar
  12. 12.
    Rohe, K., Chatterjee, S., Yu, B.: Spectral clustering and the high-dimensional stochastic blockmodel. Ann. Stat. 39(4), 1978–1915 (2011)MathSciNetCrossRefMATHGoogle Scholar
  13. 13.
    Shepard, R.N., Arabie, P.: Additive clustering: representation of similarities as combinations of discrete overlapping properties. Psychol. Rev. 86(2), 87 (1979)CrossRefGoogle Scholar
  14. 14.
    Von Luxburg, U.: A tutorial on spectral clustering. Stat. Comput. 17, 395–416 (2007)MathSciNetCrossRefGoogle Scholar
  15. 15.
    Xie, J., Kelley, S., Szymanski, B.: Overlapping community detection in networks: state of the art and comparative study. ACM Comput. Surv. 45, 43 (2013)CrossRefMATHGoogle Scholar
  16. 16.
    Yang, J., Leskovec, J.: Community-affiliation graph model for overlapping community detection. In: IEEE International Conference on Data Mining (2012)Google Scholar
  17. 17.
    Zelnik-Manor, L., Perona, P.: Self-tuning spectral clustering. In: Advances in Neural Information Processing Systems (2004)Google Scholar
  18. 18.
    Zhang, S., Wang, R.-S., Zhang, X.-S.: Identification of overlapping community structure in complex networks using fuzzy c-means clustering. Phyisca A 374, 483–490 (2007)CrossRefGoogle Scholar
  19. 19.
    Zhang, Y., Levina, E., Zhu, J.: Detecting overlapping communities in networks with spectral methods (2014). arXiv:1412.3432v1
  20. 20.
    Zhao, Y., Levina, E., Zhu, J.: Consistency of community detection in networks under degree-corrected stochastic block models. Ann. Stat. 40(4), 2266–2292 (2012)MathSciNetCrossRefMATHGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  1. 1.CNRS & CRIStALUniversité LilleVilleneuve-d’ascqFrance
  2. 2.Télécom ParisTechUniversité Paris-SaclayParisFrance
  3. 3.Inria-ENSParisFrance

Personalised recommendations