Skip to main content
SpringerLink
Log in

Entity-Context and Relation-Context Combined Knowledge Graph Embeddings

  • Research Article-Computer Engineering and Computer Science
  • Published:
Arabian Journal for Science and Engineering Aims and scope Submit manuscript

Abstract

Hierarchical structures are very common in knowledge graphs, and semantic hierarchy-preserved knowledge graph embeddings have achieved promising results in the knowledge graph link prediction task. However, handling one-to-many, many-to-one, and many-to-many relations that can provide hierarchical information is challenging and brings entity indistinguishability issues. To address this limitation, this paper proposes a novel knowledge graph embedding model, namely Entity-context and Relation-context combined Knowledge Graph Embeddings (ERKE), in which each relation is defined as a rotation with variable moduli from the source entity to the target entity in the polar coordinate system. It can be seen as a combination of two spaces—modulus space and phase space. In the modulus space, modulus information is used to model semantic hierarchies, and entity-context information is adopted to make node representations more expressive. Besides, based on the design of the propagation rule of Graph Convolution Network (GCN), a new GCN model suitable for processing semantic hierarchies in knowledge graphs is proposed. In the phase space, relation-context information is used to make entities easier to distinguish. Specifically, a rotation operation in the polar coordinate system is transformed to the addition operation in the rectangular coordinate system, and relations between entities are mapped into their entity-specific hyperplanes. The proposed method is verified by the experiments on three benchmark datasets, and experimental results demonstrate that the proposed method can learn the semantic hierarchies in knowledge graphs and improve the prediction accuracy of complex one-to-many, many-to-one, and many-to-many cases simultaneously.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  1. He, H.; Balakrishnan, A.; Eric, M.; Liang, P.: Learning symmetric collaborative dialogue agents with dynamic knowledge graph embeddings. In: Proceedings of the Association for Computational Linguistics, pp. 1766–1776. ACL (2017)

  2. Wang, X.; He, X.; Cao, Y.; Liu, M.; Chua, T. S.: KGAT: knowledge graph attention network for recommendation. In: International Conference on Knowledge Discovery and Data Mining, pp. 950–958. ACM (2019)

  3. Diefenbach, D.; Singh, K.; Maret, P.: Wdaqua-core1: a question answering service for rdf knowledge bases. In: International Conference on World Wide Web, pp. 1087–1091. ACM (2018)

  4. Denis, K.; Stephan, B.; Volker, T.: Type-constrained representation learning in knowledge graphs. In: International Semantic Web Conference, pp. 640–655. Springer (2015)

  5. Robert, W.; Evgeniy G.; Kevin M.; Sun, S. H.; Rahul G.: Knowledge base completion via search-based question answering. In: International Conference on World Wide Web, pp. 516–526. ACM (2014)

  6. Xie, R.; Liu, Z.; Sun, M.: Representation learning of knowledge graphs with hierarchical types. In: International Joint Conference on Artificial Intelligence, pp. 2965–2971. Morgan Kaufmann (2016)

  7. Zhang, Z.; Zhuang, F.; Qu, M.; Lin, F.; He, Q.: Knowledge graph embedding with hierarchical relation structure. In: International Conference on Empirical Methods in Natural Language Processing, pp. 3198–3207. ACL (2018)

  8. Zhang, Z.; Cai, J.; Zhang, Y.; Wang, J.: Learning hierarchy-aware knowledge graph embeddings for link prediction. In: International AAAI Conference on Artificial Intelligence, pp. 3065–3072. AAAI (2020)

  9. Kipf, T.N.; Welling, M.: Semi-supervised classification with graph convolutional networks. http://arxiv.org/abs/1609.02907 (2016)

  10. Wang, Z.; Zhang, J.; Feng, J.; Chen, Z.: Knowledge graph embedding by translating on hyperplanes. In: International AAAI Conference on Artificial Intelligence, pp. 1112–1119. AAAI (2014)

  11. Lin, Y.; Liu, Z.; Sun, M.; Liu Y.; Zhu, X.: Learning entity and relation embeddings for knowledge graph completion. In: International AAAI Conference on Artificial Intelligence, pp. 2181–2187, AAAI (2015)

  12. Ji, G.; He, S.; Xu, L.; Liu K.; Zhao, J.: Knowledge graph embedding via dynamic mapping matrix. In: Proceedings of the Association for Computational Linguistics, pp. 687–696. ACL (2015)

  13. Bordes, A.; Usunier, N.; Garcia-Duran, A.; Weston, J.; Yakhnenko, O.: Translating embeddings for modeling multi-relational data. In: Proceedings of the Annual Conference on Neural Information Processing Systems, pp. 2787–2795. MIT (2013)

  14. Ji, G.; Liu, K.; He S.; Zhao, J.: Knowledge graph completion with adaptive sparse transfer matrix. In: International AAAI Conference on Artificial Intelligence, pp. 985–991. AAAI (2016)

  15. Ebisu, T.; Ichise, R.: TorusE: Knowledge graph embedding on a lie group. In: International AAAI Conference on Artificial Intelligence, pp. 1819–1826. AAAI (2018)

  16. Sun, Z.; Deng, Z. H.; Nie, J. Y.; Tang, J.: RotatE: Knowledge graph embedding by relational rotation in complex space. https://arxiv.org/abs/1902.10197 (2019)

  17. Zhang, S.; Tay, Y.; Yao, L.; Liu, Q.: Quaternion knowledge graph embeddings. In: Proceedings in Advances in Neural Information Processing Systems, pp. 2735–2745. MIT (2019)

  18. Tang, Y.; Huang, J.; Wang, G.; He, X.; Zhou, B.: Orthogonal relation transforms with graph context modeling for knowledge graph embedding. https://arxiv.org/abs/1911.04910 (2020)

  19. Yang, B.; Yih, W.; He, X.; Gao, J.; Deng, L.: Embedding entities and relations for learning and inference in knowledge bases. https://arxiv.org/pdf/1412.6575 (2020)

  20. Liu, H.; Wu, Y.; Yang, Y.: Analogical inference for multi-relational embeddings, In: International Conference on Machine Learning, pp. 2168–2178. ACM (2017)

  21. Kazemi, S.M.; Poole, D.: Simple embedding for link prediction in knowledge graphs. In: Proceedings in Advances in Neural Information Processing Systems, pp. 4284–4295. MIT Press (2018)

  22. Trouillon, T.; Welbl, J.; Riedel, S.; Gaussier, E.; Bouchard, G.: Complex embeddings for simple link prediction. In: International Conference on Machine Learning, pp. 2071–2080. ACM (2016)

  23. Xu, C.; Li, R.: Relation embedding with dihedral group in knowledge graph. In: Proceedings of the Association for Computational Linguistics, pp. 263–272. ACL (2019)

  24. Nickel, M.; Rosasco, L.; Poggio, T.: Holographic embeddings of knowledge graphs. In: International AAAI Conference on Artificial Intelligence, pp. 1955–1961. AAAI (2016)

  25. Socher, R.; Chen, D.; Manning, C. D.; Ng, A.: Reasoning with neural tensor networks for knowledge base completion. In: Proceedings in Advances in Neural Information Processing Systems, pp. 926–934. MIT (2013)

  26. Shi, B.; Weninger, T.: ProjE: embedding projection for knowledge graph completion. In: International AAAI Conference on Artificial Intelligence, pp. 1236–1242. AAAI (2017)

  27. Dong, X.; Gabrilovich, E.; Heitz, G.; Horn, W.; Lao, N.: Knowledge vault: a web-scale approach to probabilistic knowledge fusion. In: International Conference on Knowledge Discovery and Data Mining, pp. 601–610. ACM (2014)

  28. Dettmers, T.; Minervini, P.; Stenetorp P.; Riedel, S.: Convolutional 2D knowledge graph embeddings. In: International AAAI Conference on Artificial Intelligence, pp. 1811–1818. AAAI (2018)

  29. Nguyen, D. Q.; Nguyen, T. D.; Phung, D.: A novel embedding model for knowledge base completion based on convolutional neural network, In: Proceedings of the Association for Computational Linguistics, pp. 327–333. ACL (2018)

  30. Balazevic, I.; Allen, C.; Hospedales, T. M.: Hypernetwork knowledge graph embeddings. In: Proceedings of Artificial Neural Networks and Machine Learning, pp. 553–565. Springer (2019)

  31. Schlichtkrull, M.; Kipf, T.N.; Bloem, P.; van den Berg, R.; Titov, I.: Modeling relational data with graph convolutional networks. In: Proceedings of Extended Semantic Web Conference, pp. 593–607. Springer (2018)

  32. Cai, L.; Yan, B.; Mai, G.; Janowicz, K.; Zhu, R.: TransGCN: coupling transformation assumptions with graph convolutional networks for link prediction. In: International Conference on Knowledge Capture, pp. 131–138. ACM (2019)

  33. Nathani, D.; Chauhan, J.; Sharma, C.; Kaul, M.: Learning attention-based embeddings for relation prediction in knowledge graphs. In: Proceedings of the Association for Computational Linguistics, pp. 4710–4723. ACL (2019)

  34. Shang, C.; Tang, Y.; Huang, J.; Bi, J.; He, X.: End-to-end structure-aware convolutional networks for knowledge base completion. In: International AAAI Conference on Artificial Intelligence, pp. 3060–3067. AAAI (2019)

  35. Mahdisoltani, F.; Biega, J.; Suchanek, F.M.: Yago3: A knowledge base from multilingual wikipedias. In: Conference on Innovative Data Systems Research. CIDR (2013)

Download references

Acknowledgements

This paper is partly supported by the National Social Science Foundation of China (No. 20AZD114), the Key R&D and Promotion Projects in Henan Province of China (No. 212102210165), and the Special Funds for Fundamental Scientific Research Operation Fees of Central Universities (No. 2020JKF310).

Author information

Authors and Affiliations

  1. School of Information Technology and Cyber Security, People’s Public Security University of China, Beijing, 100038, China

    Yong Wu, Xiaoming Fan & Binjun Wang

  2. School of Chemistry and Physics, Queensland University of Technology, Brisbane, QLD, 4001, Australia

    Wei Li

Authors
  1. Yong Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Wei Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Xiaoming Fan
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Binjun Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Binjun Wang.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wu, Y., Li, W., Fan, X. et al. Entity-Context and Relation-Context Combined Knowledge Graph Embeddings. Arab J Sci Eng 47, 1471–1482 (2022). https://doi.org/10.1007/s13369-021-05977-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13369-021-05977-x

Keywords

Search

Navigation