Skip to main content
SpringerLink
Log in

Multi-granular attributed network representation learning

  • Original Article
  • Published:
International Journal of Machine Learning and Cybernetics Aims and scope Submit manuscript

Abstract

In recent years, increasing attention has been paid to network representation learning, which aims to map nodes into low dimensional vectors while preserving topology and node attribute information, which are both backbone information of the network. Existing studies mainly focus on fusing structure and node attributes on single granularity for the attributed network. However, many complex networks present multi-granular characteristics. In this paper, we propose MultI-granular attributed network Representation Learning (MIRL), an algorithm that captures the relationship between different granular attributed networks. Firstly, topological structure and attributes are fused from fine to coarse under different granularities to mine the node potential relationship between different granular networks. The coarser-grained node is composed of a number of fine-grained nodes that are similar in structure and attributes. For the attributed network at the coarsest granularity which is much smaller than the original attributed network, one of the existing network representation learning methods can be used to learn the representation of the coarsest granularity. To obtain more accurate representation of the original network, we train a graph convolutional neural network (GCN) at the coarsest granulation. The parameters of GCN passing from coarse to fine are shared between two adjacent granularities, so as to trade off time consumption and embedding performance. We evaluate our algorithm on three real-world datasets and two benchmark applications. Our experimental results demonstrate that MIRL significantly increases effectiveness compared to state-of-art network representation methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. Ayan Kumar B, Koushik M, Maximilien D, Jean-Loup G, Bivas M (2020) Louvainne: hierarchical Louvain method for high quality and scalable network embedding. In: Proceedings of the 13th international conference on web search and data mining, pp 43–51

  2. Cao S, Lu W, Xu Q (2015) Grarep: learning graph representations with global structural information. In: Proceedings of the 24th ACM international on conference on information and knowledge management, pp 891–900

  3. Cen Y, Zou X, Zhang J, Yang H, Zhou J, Tang J (2019) Representation learning for attributed multiplex heterogeneous network. In: Proceedings of the 25th ACM SIGKDD international conference on knowledge discovery data mining, pp 1358–1368

  4. Chen H, Perozzi B, Hu Y, Skiena S (2018) HARP: hierarchical representation learning for networks. In: Proceedings of 32nd the AAAI conference on artificial intelligence, pp 2127–2134

  5. Deng C, Zhao Z, Wang Y, Zhang Z, Feng Z (2020) Graphzoom: a multi-level spectral approach for accurate and scalable graph embedding. In: International conference on learning representations, pp 26–30

  6. Dong Yuxiao, Chawla Nitesh V, and Swami Ananthram (2017) metapath2vec: Scalable representation learning for heterogeneous networks. In Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pages 135–144, 2017

  7. Du L, Lu Z, Wang Y, Song G, Wang Y, Chen W (2018) Galaxy network embedding: a hierarchical community structure preserving approach. In: Proceedings of the 27th international joint conference on artificial intelligence, pp 2079–2085

  8. Duan Z, Sun X, Zhao S, Chen J, Zhang Y, Tang J (2021) Hierarchical community structure preserving approach for network embedding. Inf Sci 1084–1096

  9. Fu G, Hou C, Yao X (2019) Learning topological representation for networks via hierarchical sampling. In: International joint conference on neural networks, pp 1–8

  10. Gao H, Huang H (2018) Deep attributed network embedding. In: Twenty-seventh international joint conference on artificial intelligence, pp 3364–3370

  11. Gao H, Pei J, Huang H (2019) Progan: network embedding via proximity generative adversarial network. In: Proceedings of the 25th ACM SIGKDD international conference on knowledge discovery data mining, pp 1308–1316

  12. Grover A, Leskovec J (2016) node2vec: scalable feature learning for networks. In: Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining, pp 855–864

  13. Guo J, Xu L, Liu J (2019) SPINE: structural identity preserved inductive network embedding. In: Proceedings of the 28th international joint conference on artificial intelligence, pp 2399–2405

  14. Hou Y, Chen H, Li C, Cheng J, Yang M-C (2019) A representation learning framework for property graphs. In: Proceedings of the 25th ACM SIGKDD international conference on knowledge discovery and data mining, pp 65–73

  15. Huang X, Li J, Hu X (2017) Label informed attributed network embedding. In: Proceedings of the tenth ACM international conference on web search and data mining, pp 731–739

  16. Kipf TN, Welling M (2017) Semi-supervised classification with graph convolutional networks. In: 5th international conference on learning representations, pp 24–26

  17. Li P, Wang G, Hu J, Li Y (2020) Multi-granularity complex network representation learning. In: International joint conference on rough sets. Springer, pp 236–250

  18. Li Y, Wang Y, Zhang T, Zhang J, Chang Y (2019) Learning network embedding with community structural information. In: Proceedings of the 28th international joint conference on artificial intelligence, pp 2937–2943

  19. Liang J, Gurukar S, Parthasarathy S (2021) MILE: a multi-level framework for scalable graph embedding. In: Proceedings of the 15th international AAAI conference on web and social media, pp 361–372

  20. Liang S, Ouyang Z, Meng Z (2021) A normalizing flow-based co-embedding model for attributed networks. ACM Trans Knowl Discov Data (TKDD) 16(3):1–31

    Article  Google Scholar 

  21. Liao L, He X, Zhang H, Chua T-S (2018) Attributed social network embedding. In: IEEE transactions on knowledge and data engineering, pp 2257–2270

  22. Liben-nowell D, Kleinberg J (2007) The link-prediction problem for social networks. J Am Soc Inf Sci Technol 1019–1031

  23. Liu J, He Z, Wei L, Huang Y (2018) Content to node: Self-translation network embedding. In: Proceedings of the 24th ACM SIGKDD international conference on knowledge discovery data mining, pp 1794–1802

  24. Liu J, Li N, He Z (2019) Network embedding with dual generation tasks. In: Proceedings of the 28th international joint conference on artificial intelligence, pp 5102–5108

  25. Long Q, Wang Y, Du L, Song G, Jin Y, Lin W (2019) Hierarchical community structure preserving network embedding: a subspace approach. In: Proceedings of the 28th ACM international conference on information and knowledge management, pp 409–418

  26. Ma Y, Ren Z, Jiang Z, Tang J, Yin D (2018) Multi-dimensional network embedding with hierarchical structure. In: Proceedings of the 11th ACM international conference on web search and data mining, pp 387–395

  27. Meng Z, Liang S, Bao H, Zhang X (2019) Co-embedding attributed networks. In: Proceedings of the twelfth ACM international conference on web search and data mining, pp 393–401

  28. Ou M, Cui P, Pei J, Zhang Z, Zhu W (2016) Asymmetric transitivity preserving graph embedding. In: Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining, pp 1105–1114

  29. Perozzi B, Al-Rfou R, Skiena S (2014) Deepwalk: online learning of social representations. In: Proceedings of the 20th ACM SIGKDD international conference on knowledge discovery and data mining, pp 701–710

  30. Qiu J, Dong Y, Ma H, Li J, Wang K, Tang J (2018) Network embedding as matrix factorization: Unifying deepwalk, line, pte, and node2vec. In: Proceedings of the 11th ACM international conference on web search and data mining, pp 459–467

  31. Rossi RA, Zhou R, Ahmed N (2020) Deep inductive graph representation learning. In: IEEE transactions on knowledge and data engineering, pp 438–452

  32. Sculley D (2010) Web-scale k-means clustering. In: Proceedings of the 19th international conference on world wide web, pp 1177–1178

  33. Sen P, Namata G, Bilgic M, Getoor L, Galligher B, Eliassi-Rad T (2008) Collective classification in network data. AI Mag 93–93

  34. Shi C, Hu B, Zhao WX, Philip SY (2018) Heterogeneous information network embedding for recommendation. In: IEEE transactions on knowledge and data engineering, pp 357–370

  35. Shi C, Lu Y, Hu L Liu Z, Ma H (2020) Rhine: relation structure-aware heterogeneous information network embedding. IEEE Trans Knowl Data Eng 34(1):433–447

  36. Shin S-J, Song K, Moon I-C (2020) Hierarchically clustered representation learning. In: The 34th AAAI conference on artificial intelligence, pp 5776–5783

  37. Tang J, Qu M, Mei Q (2015) PTE: predictive text embedding through large-scale heterogeneous text networks. In: Proceedings of the 21th ACM SIGKDD international conference on knowledge discovery and data mining, pp 1165–1174

  38. Tang J, Qu M, Wang M, Zhang M, Yan J, Mei Q (2015) LINE: large-scale information network embedding. In: Proceedings of the 24th international conference on world wide web, pp 1067–1077

  39. Tang J, Zhang J, Yao L, Li J, Zhang L, Su Z (2008) Arnetminer: extraction and mining of academic social networks. In: Proceedings of the 14th ACM SIGKDD international conference on knowledge discovery and data mining, pp 990–998

  40. Tu C, Liu H, Liu Z, Sun M (2017) CANE: context-aware network embedding for relation modeling. In: Proceedings of the 55th annual meeting of the association for computational linguistics, pp 1722–1731

  41. Tu C, Zeng X, Wang H, Zhang Z, Liu Z, Sun M, Zhang B, Lin L (2019) A unified framework for community detection and network representation learning. In: IEEE transactions on knowledge and data engineering, pp 1051–1065

  42. Wang W, Dongyang MA, Xin G, Han Y, Wang B (2021) A network representation learning method based on topology. Inf Sci 443–458

  43. Xie W-B, Lee Y-L, Wang C, Chen D-B, Zhou T (2020) Hierarchical clustering supported by reciprocal nearest neighbors. Inf Sci 279–292

  44. Yan G, Li Z, Luo H, Wang Y, Chang W, Yang M, Su R, Liu N (2021) Multilayer network representation learning method based on random walk of multiple information. In: IEEE access, pp 53178–53189

  45. Yang C, Liu Z, Zhao D, Sun M, Chang EY (2015) Network representation learning with rich text information. In: Proceedings of the 24th international joint conference on artificial intelligence, pp 2111–2117

  46. Yang D, Rosso P, Li B, Cudre-Mauroux P (2019) Nodesketch: highly-efficient graph embeddings via recursive sketching. In: Proceedings of the 25th ACM SIGKDD international conference on knowledge discovery data mining, pp 1162–1172

  47. Zhang J, Dong Y, Wang Y, Tang J, Ding M (2019) Prone: fast and scalable network representation learning. In: Proceedings of the 28th international joint conference on artificial intelligence, pp 4278–4284

  48. Zhang Z, Yang H, Bu J, Zhou S, Yu P, Zhang J, Ester M, Wang C (2018) ANRL: attributed network representation learning via deep neural networks. In: Proceedings of the 27th international joint conference on artificial intelligence, pp 3155–3161

  49. Zhen Z, Hongxia Y, Jiajun B, Sheng Z, Pinggang Y, Jianwei Z, Martin E, Can W (2018) Anrl: attributed network representation learning via deep neural networks. In: Proceedings of the 27th international joint conference on artificial intelligence, pp 3155–3161

  50. Zhao S, Zhang L, Xiansheng X, Zhang Y (2014) Hierarchical description of uncertain information. Inf Sci 268:133–146

    Article  MathSciNet  Google Scholar 

Download references

Acknowledgements

National Natural Science Foundation of China (Grants #61876001) and National High Technology Research and Development Program (Grant #2017YFB1401903). The authors acknowledge the High-performance Computing Platform of Anhui University for providing computing resources.

Author information

Authors and Affiliations

  1. Key Laboratory of Intelligent Computing and Signal Processing, Ministry of Education, Hefei, 230601, Anhui, People’s Republic of China

    Ziwei Du & Shu Zhao

  2. School of Computer Science and Technology, Anhui University, Hefei, 230601, Anhui, People’s Republic of China

    Jiaxian Zou, Ziwei Du & Shu Zhao

  3. Information Materials and Intelligent Sensing Laboratory of Anhui Province, Hefei, 230601, Anhui, People’s Republic of China

    Shu Zhao

Authors
  1. Jiaxian Zou
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ziwei Du
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Shu Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Shu Zhao.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zou, J., Du, Z. & Zhao, S. Multi-granular attributed network representation learning. Int. J. Mach. Learn. & Cyber. 13, 2071–2087 (2022). https://doi.org/10.1007/s13042-022-01507-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13042-022-01507-9

Keywords

Search

Navigation