Skip to main content
SpringerLink
Log in

Overlapping Communities in Co-purchasing and Social Interaction Graphs: A Memetic Approach

  • Chapter
  • First Online:
Business and Consumer Analytics: New Ideas

Abstract

Simple undirected graphs can be employed to represent numerous complex systems including those arising in social networks, biological networks, communication networks, transportation routes and several others. An important feature of complex networks is the presence of communities, groups of elements densely connected among them but sparsely linked to the rest of the network. In many cases these communities can be overlapping, with nodes participating in more than one community. In this chapter, we present a memetic algorithm for overlapping community detection. Our approach uses the communities of links to depict the overlapping community structure in a simple undirected graph. The approach uses the line of the original graph interest. We perform modularity optimization to discover the communities of the vertices of the line graph to unveil the overlapping community structure of the network. To assess the quality of our method, we present results in synthetically generated benchmark networks and to exemplify the usefulness of our approach we present two case studies. In the first case study we use a network of characters of the novel “A Storm of Swords” book series “A Song of Ice and Fire”, written by George R. R. Martin; and a second one using a co-purchasing network of luxury items from a brand-centric point of view.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 299.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 379.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    http://www.cfinder.org/.

  2. 2.

    http://www.hbo.com/game-of-thrones.

  3. 3.

    https://www.macalester.edu/~abeverid/thrones.html.

  4. 4.

    http://awoiaf.westeros.org/index.php/POV_character.

  5. 5.

    Amazon Standard Identification Number.

  6. 6.

    http://www.wordle.net.

References

  1. Ahn, Y.Y., Bagrow, J.P., Lehmann, S.: Link communities reveal multiscale complexity in networks. Nature 466(7307), 761–764 (2010)

    Article  Google Scholar 

  2. melio, A., Pizzuti, C.: Overlapping community discovery methods: A survey. In: Social Networks: Analysis and Case Studies, pp. 105–125. Springer (2014)

    Google Scholar 

  3. Ansari, A., Essegaier, S., Kohli, R.: Internet recommendation systems. Journal of Marketing Research 37(3), 363–375 (2000)

    Article  Google Scholar 

  4. Barabási, A.L., Frangos, J.: Linked: the new science of networks science of networks. Basic Books (2014)

    Google Scholar 

  5. Chen, W., Liu, Z., Sun, X., Wang, Y.: A game-theoretic framework to identify overlapping communities in social networks. Data Mining and Knowledge Discovery 21(2), 224–240 (2010)

    Article  MathSciNet  Google Scholar 

  6. Danon, L., Diaz-Guilera, A., Duch, J., Arenas, A.: Comparing community structure identification. Journal of Statistical Mechanics: Theory and Experiment 2005(09), P09,008 (2005)

    Article  Google Scholar 

  7. Derényi, I., Palla, G., Vicsek, T.: Clique percolation in random networks. Physical review letters 94(16), 160,202 (2005)

    Article  Google Scholar 

  8. Evans, T., Lambiotte, R.: Line graphs, link partitions, and overlapping communities. Physical Review E 80(1), 016,105 (2009)

    Article  Google Scholar 

  9. Fortunato, S.: Community detection in graphs. Physics Reports 486(3), 75–174 (2010)

    Article  MathSciNet  Google Scholar 

  10. Friggeri, A., Chelius, G., Fleury, E.: Egomunities, exploring socially cohesive person-based communities. arXiv preprint arXiv:1102.2623 (2011)

    Google Scholar 

  11. Gabardo, A.C., Berretta, R., de Vries, N.J., Moscato, P.: Where does my brand end? An overlapping community approach. In: Intelligent and Evolutionary Systems: The 20th Asia Pacific Symposium, IES 2016, Canberra, Australia, November 2016, Proceedings, pp. 133–148. Springer (2017)

    Google Scholar 

  12. Gach, O., Hao, J.K.: A memetic algorithm for community detection in complex networks. In: Parallel Problem Solving from Nature-PPSN XII, pp. 327–336. Springer (2012)

    Google Scholar 

  13. Goldberg, D.E., Holland, J.H.: Genetic algorithms and machine learning. Machine Learning 3(2), 95–99 (1988)

    Article  Google Scholar 

  14. Gong, M., Cai, Q., Chen, X., Ma, L.: Complex network clustering by multiobjective discrete particle swarm optimization based on decomposition. IEEE Transactions on Evolutionary Computation 18(1), 82–97 (2014)

    Article  Google Scholar 

  15. Gong, M., Cai, Q., Li, Y., Ma, J.: An improved memetic algorithm for community detection in complex networks. In: Evolutionary Computation (CEC), 2012 IEEE Congress on, pp. 1–8. IEEE (2012)

    Google Scholar 

  16. Gong, M., Fu, B., Jiao, L., Du, H.: Memetic algorithm for community detection in networks. Physical Review E 84(5), 056,101 (2011)

    Article  Google Scholar 

  17. Gregory, S.: Finding overlapping communities in networks by label propagation. New Journal of Physics 12(10), 103,018 (2010)

    Article  Google Scholar 

  18. Havemann, F., Gläser, J., Heinz, M.: A link-based memetic algorithm for reconstructing overlapping topics from networks of papers and their cited sources. In: 15th International Conference on Scientometrics and Informetrics (2015)

    Google Scholar 

  19. He, D., Jin, D., Chen, Z., Zhang, W.: Identification of hybrid node and link communities in complex networks. Scientific Reports 5 (2015)

    Google Scholar 

  20. Holland, J.H.: Adaptation in natural and artificial systems: an introductory analysis with applications to biology, control, and artificial intelligence. MIT Press (1992)

    Google Scholar 

  21. Huang, Z., Wang, Z., Zhang, Z.: Detecting overlapping and hierarchical communities in complex network based on maximal cliques. In: Social Media Processing, pp. 184–191. Springer (2015)

    Google Scholar 

  22. Jebabli, M., Cherifi, H., Cherifi, C., Hamouda, A.: Overlapping community detection versus ground-truth in Amazon co-purchasing network. In: 2015 11th International Conference on Signal-Image Technology & Internet-Based Systems (SITIS), pp. 328–336. IEEE (2015). http://ieeexplore.ieee.org/xpl/articleDetails.jsp?arnumber=7400584&tag=1

  23. Lancichinetti, A., Fortunato, S.: Benchmarks for testing community detection algorithms on directed and weighted graphs with overlapping communities. Physical Review E 80(1), 016,118 (2009)

    Article  Google Scholar 

  24. Lancichinetti, A., Fortunato, S., Kertész, J.: Detecting the overlapping and hierarchical community structure in complex networks. New Journal of Physics 11(3), 033,015 (2009)

    Article  Google Scholar 

  25. Lancichinetti, A., Fortunato, S., Radicchi, F.: Benchmark graphs for testing community detection algorithms. Physical Review E 78(4), 046,110 (2008)

    Article  Google Scholar 

  26. Lancichinetti, A., Radicchi, F., Ramasco, J.J., Fortunato, S.: Finding statistically significant communities in networks. PLoS One 6(4), e18,961 (2011)

    Article  Google Scholar 

  27. Li, Y., Liu, J., Liu, C.: A comparative analysis of evolutionary and memetic algorithms for community detection from signed social networks. Soft Computing 18(2), 329–348 (2014)

    Article  Google Scholar 

  28. Lima, C.F., Sastry, K., Goldberg, D.E., Lobo, F.G.: Combining competent crossover and mutation operators: a probabilistic model building approach. In: Proceedings of the 7th annual conference on Genetic and evolutionary computation, pp. 735–742. ACM (2005)

    Google Scholar 

  29. Linden, G., Smith, B., York, J.: Amazon. com recommendations: Item-to-item collaborative filtering. Internet Computing, IEEE 7(1), 76–80 (2003)

    Article  Google Scholar 

  30. Lucas, B., Arefin, A.S., De Vries, N.J., Berretta, R., Carlson, J., Moscato, P.: Engagement in motion: Exploring short term dynamics in page-level social media metrics. In: Big Data and Cloud Computing (BdCloud), 2014 IEEE Fourth International Conference on, pp. 334–341. IEEE (2014)

    Google Scholar 

  31. Ma, L., Gong, M., Liu, J., Cai, Q., Jiao, L.: Multi-level learning based memetic algorithm for community detection. Applied Soft Computing 19, 121–133 (2014)

    Article  Google Scholar 

  32. Martin, G.R.: A storm of swords. Bantam (2000)

    Google Scholar 

  33. McAuley, J., Pandey, R., Leskovec, J.: Inferring networks of substitutable and complementary products. In: Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 785–794. ACM (2015)

    Google Scholar 

  34. McAuley, J., Yang, A.: Addressing complex and subjective product-related queries with customer reviews. arXiv preprint arXiv:1512.06863 (2015)

    Google Scholar 

  35. McDaid, A., Hurley, N.: Detecting highly overlapping communities with model-based overlapping seed expansion. In: Advances in Social Networks Analysis and Mining (ASONAM), 2010 International Conference on, pp. 112–119. IEEE (2010)

    Google Scholar 

  36. Miller, B.L., Goldberg, D.E.: Genetic algorithms, tournament selection, and the effects of noise. Complex Systems 9(3), 193–212 (1995)

    MathSciNet  Google Scholar 

  37. Moscato, P., Cotta, C.: A modern introduction to memetic algorithms. In: Handbook of Metaheuristics, pp. 141–183. Springer (2010)

    Google Scholar 

  38. Moscato, P., et al.: On evolution, search, optimization, genetic algorithms and martial arts: Towards memetic algorithms. Caltech concurrent computation program, C3P Report 826, 1989 (1989)

    Google Scholar 

  39. Naeni, L.M., Berretta, R., Moscato, P.: MA-Net: A reliable memetic algorithm for community detection by modularity optimization. In: Proceedings of the 18th Asia Pacific Symposium on Intelligent and Evolutionary Systems, Volume 1, pp. 311–323. Springer (2015)

    Google Scholar 

  40. Neri, F., Cotta, C., Moscato, P.: Handbook of memetic algorithms, vol. 379. Springer (2012)

    Google Scholar 

  41. Newman, M.E.: The structure and function of complex networks. SIAM review 45(2), 167–256 (2003)

    Article  MathSciNet  Google Scholar 

  42. Newman, M.E.: Modularity and community structure in networks. Proceedings of the National Academy of Sciences 103(23), 8577–8582 (2006)

    Article  Google Scholar 

  43. Palla, G., Derényi, I., Farkas, I., Vicsek, T.: Uncovering the overlapping community structure of complex networks in nature and society. Nature 435(7043), 814–818 (2005)

    Article  Google Scholar 

  44. Paul, M., Anand, R., Anand, A.: Detection of highly overlapping communities in complex networks. Journal of Medical Imaging and Health Informatics 5(5), 1099–1103 (2015)

    Article  Google Scholar 

  45. Pizzuti, C.: GA-Net: A genetic algorithm for community detection in social networks. In: Parallel Problem Solving from Nature–PPSN X, pp. 1081–1090. Springer (2008)

    Google Scholar 

  46. Pizzuti, C.: A multi-objective genetic algorithm for community detection in networks. In: Tools with Artificial Intelligence, 2009. ICTAI’09. 21st International Conference on, pp. 379–386. IEEE (2009)

    Google Scholar 

  47. Pizzuti, C.: Overlapped community detection in complex networks. In: Proceedings of the 11th Annual conference on Genetic and evolutionary computation, pp. 859–866. ACM (2009)

    Google Scholar 

  48. Raghavan, U.N., Albert, R., Kumara, S.: Near linear time algorithm to detect community structures in large-scale networks. Physical Review E 76(3), 036,106 (2007)

    Article  Google Scholar 

  49. Rust, R.T., Huang, M.H.: The service revolution and the transformation of marketing science. Marketing Science 33(2), 206–221 (2014)

    Article  Google Scholar 

  50. Shi, C., Cai, Y., Fu, D., Dong, Y., Wu, B.: A link clustering based overlapping community detection algorithm. Data & Knowledge Engineering 87, 394–404 (2013)

    Article  Google Scholar 

  51. Wu, P., Pan, L.: Detecting highly overlapping community structure based on maximal clique networks. In: Advances in Social Networks Analysis and Mining (ASONAM), 2014 IEEE/ACM International Conference on, pp. 196–199. IEEE (2014)

    Google Scholar 

  52. Wu, P., Pan, L.: Multi-objective community detection based on memetic algorithm. PLoS ONE 10(5), e0126,845 (2015)

    Article  Google Scholar 

  53. Wu, Z.H., Lin, Y.F., Gregory, S., Wan, H.Y., Tian, S.F.: Balanced multi-label propagation for overlapping community detection in social networks. Journal of Computer Science and Technology 27(3), 468–479 (2012)

    Article  MathSciNet  Google Scholar 

  54. Xie, J., Kelley, S., Szymanski, B.K.: Overlapping community detection in networks: The state-of-the-art and comparative study. ACM Computing Surveys (CSUR) 45(4), 43 (2013)

    Article  Google Scholar 

  55. Xie, J., Szymanski, B.K.: Community detection using a neighborhood strength driven label propagation algorithm. In: Network Science Workshop (NSW), 2011 IEEE, pp. 188–195. IEEE (2011)

    Google Scholar 

  56. Yamazaki, T., Shimizu, N., Kobayashi, H., Yamauchi, S.: Weighted micro-clustering: Application to community detection in large-scale co-purchasing networks with user attributes. In: Proceedings of the 25th International Conference Companion on World Wide Web, WWW ’16 Companion, pp. 131–132. International World Wide Web Conferences Steering Committee, Republic and Canton of Geneva, Switzerland (2016). http://dx.doi.org/10.1145/2872518.2889406

Download references

Acknowledgements

The authors of this chapter acknowledge Dr. Sergio Gómez for his contribution providing the centrality data of the network “Storm of Swords” and for his valuable comments. We also thank Ceci Brie, for her help interpreting some aspects of the obtained communities and their structure. Ademir Gabardo is supported by CNPQ Brasil (http://cnpq.br), grant number 204978/2014-9. P.M. acknowledges this research by The University of Newcastle, and previous founding from the Australian Research Council grants Future Fellowship FT120100060 and with R.B. they acknowledge support via Discovery Project DP140104183.

Author information

Authors and Affiliations

  1. School of Electrical Engineering and Computing, The University of Newcastle, Callaghan, NSW, Australia

    Ademir Gabardo, Regina Berretta & Pablo Moscato

Authors
  1. Ademir Gabardo
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Regina Berretta
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Pablo Moscato
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Regina Berretta .

Editor information

Editors and Affiliations

  1. School of Electrical Engineering and Computing, The University of Newcastle, Callaghan, NSW, Australia

    Pablo Moscato

  2. School of Electrical Engineering and Computing, The University of Newcastle, Callaghan, NSW, Australia

    Natalie Jane de Vries

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Gabardo, A., Berretta, R., Moscato, P. (2019). Overlapping Communities in Co-purchasing and Social Interaction Graphs: A Memetic Approach. In: Moscato, P., de Vries, N. (eds) Business and Consumer Analytics: New Ideas. Springer, Cham. https://doi.org/10.1007/978-3-030-06222-4_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-06222-4_9

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-06221-7

  • Online ISBN: 978-3-030-06222-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation