Advertisement

Structural Role Enhanced Attributed Network Embedding

  • Zhao Li
  • Xin WangEmail author
  • Jianxin Li
  • Qingpeng Zhang
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11881)

Abstract

In recent years, network embedding methods based on deep learning to process network structure data have attracted widespread attention. It aims to represent nodes in the network as low-dimensional dense real-value vectors and effectively preserve network structure and other valuable information. Most network embedding methods now only preserve the network topology and do not take advantage of the rich attribute information in networks. In this paper, we propose a novel deep attributed network embedding framework (RolEANE), which can preserve network topological structure and attribute information well at the same time. The framework consists of two parts, one of which is the network structural role proximity enhanced deep autoencoder, which is used to capture highly nonlinear network topological structure and attribute information. The other part is that we proposed a neighbor optimization strategy to modify the Skip-Gram model so that it can integrate the network topological structure and attribute information to improve the final embedded performance. The experiments on four real datasets show that our method outperforms other state-of-the-art network embedding methods.

Keywords

Network embedding Attributed network Autoencoder Structural role proximity 

Notes

Acknowledgments

This work is supported by the National Natural Science Foundation of China (61572353), the Natural Science Foundation of Tianjin (17JCYBJC15400), and the Australian Research Council Linkage Project (LP180100750).

References

  1. 1.
    Perozzi, B., Al-Rfou, R., Skiena, S.: Deepwalk: online learning of social representations. In: Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 701–710. ACM (2014)Google Scholar
  2. 2.
    Grover, A., Leskovec, J.: node2vec: scalable feature learning for networks. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 855–864. ACM (2016)Google Scholar
  3. 3.
    Tang, J., Qu, M., Wang, M., Zhang, M., Yan, J., Mei, Q.: Line: large-scale information network embedding. In: Proceedings of the 24th International Conference on World Wide Web, pp. 1067–1077. International World Wide Web Conferences Steering Committee (2015)Google Scholar
  4. 4.
    Wang, D., Cui, P., Zhu, W.: Structural deep network embedding. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 1225–1234. ACM (2016)Google Scholar
  5. 5.
    Cao, S., Lu, W., Xu, Q.: GraRep: learning graph representations with global structural information. In: Proceedings of the 24th ACM International on Conference on Information and Knowledge Management, pp. 891–900. ACM (2015)Google Scholar
  6. 6.
    Ou, M., Cui, P., Pei, J., Zhang, Z., Zhu, W.: Asymmetric transitivity preserving graph embedding. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 1105–1114. ACM (2016)Google Scholar
  7. 7.
    Yang, C., Liu, Z., Zhao, D., Sun, M., Chang, E.: Network representation learning with rich text information. In: Twenty-Fourth International Joint Conference on Artificial Intelligence (2015)Google Scholar
  8. 8.
    Huang, X., Li, J., Hu, X.: Accelerated attributed network embedding. In: Proceedings of the 2017 SIAM International Conference on Data Mining, pp. 633–641. SIAM (2017)CrossRefGoogle Scholar
  9. 9.
    Zhang, D., Yin, J., Zhu, X., Zhang, C.: Homophily, structure, and content augmented network representation learning. In: 2016 IEEE 16th International Conference on Data Mining (ICDM), pp. 609–618. IEEE (2016)Google Scholar
  10. 10.
    Huang, X., Li, J., Hu, X.: Label informed attributed network embedding. In: Proceedings of the Tenth ACM International Conference on Web Search and Data Mining, pp. 731–739. ACM (2017)Google Scholar
  11. 11.
    Wang, S., Tang, J., Morstatter, F., Liu, H.: Paired restricted Boltzmann machine for linked data. In: Proceedings of the 25th ACM International on Conference on Information and Knowledge Management, pp. 1753–1762. ACM (2016)Google Scholar
  12. 12.
    Liao, L., He, X., Zhang, H., Chua, T.S.: Attributed social network embedding. IEEE Trans. Knowl. Data Eng. 30(12), 2257–2270 (2018)CrossRefGoogle Scholar
  13. 13.
    Ribeiro, L.F., Saverese, P.H., Figueiredo, D.R.: struc2vec: learning node representations from structural identity. In: Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 385–394. ACM (2017)Google Scholar
  14. 14.
    Donnat, C., Zitnik, M., Hallac, D., Leskovec, J.: Learning structural node embeddings via diffusion wavelets. In: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 1320–1329. ACM (2018)Google Scholar
  15. 15.
    Mikolov, T., Sutskever, I., Chen, K., Corrado, G.S., Dean, J.: Distributed representations of words and phrases and their compositionality. In: Advances in Neural Information Processing Systems, pp. 3111–3119 (2013)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Zhao Li
    • 1
  • Xin Wang
    • 1
    • 2
    Email author
  • Jianxin Li
    • 3
  • Qingpeng Zhang
    • 4
  1. 1.College of Intelligence and ComputingTianjin UniversityTianjinChina
  2. 2.Tianjin Key Laboratory of Cognitive Computing and ApplicationTianjinChina
  3. 3.School of Information TechnologyDeakin UniversityMelbourneAustralia
  4. 4.School of Data ScienceCity University of Hong KongHong KongChina

Personalised recommendations