Skip to main content

Incorporating Domain and Range of Relations for Knowledge Graph Completion

  • Conference paper
  • First Online:
Knowledge Graph and Semantic Computing: Knowledge Computing and Language Understanding (CCKS 2019)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1134))

Included in the following conference series:

  • 1272 Accesses

Abstract

Knowledge graphs store facts as triples, with each containing two entities and one relation. Information of entities and relations are important for knowledge graph related tasks like link prediction. Knowledge graph embedding methods embed entities and relations into a continuous vector space and accomplish link prediction via calculation with embeddings. However, some embedding methods only focus on information of triples and ignore individual information about relations. For example, relations inherently have domain and range which will contribute much towards learning, even though sometimes they are not explicitly given in knowledge graphs. In this paper, we propose a framework TransX\(_C\) (X can be replaced with E, H, R or D) to help preserve individual information of relations, which can be applied to multiple traditional translation-based embedding methods (i.e. TransE, TransH, TransR and TransD). In TransX\(_C\), we use two logistic regression classifiers to model domain and range of relations respectively, and then we train the embedding model and classifiers jointly in order to include information of triples as well as domain and range of relations. The performance of TransX\(_C\) are evaluated on link prediction task. Experimental results show that our method outperforms the corresponding translation-based model, indicating the effectiveness of considering domain and range of relations into link prediction.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Bollacker, K.D., Evans, C., Paritosh, P., Sturge, T., Taylor, J.: Freebase: a collaboratively created graph database for structuring human knowledge. In: SIGMOD Conference, pp. 1247–1250. ACM (2008)

    Google Scholar 

  2. Bordes, A., Usunier, N., García-Durán, A., Weston, J., Yakhnenko, O.: Translating embeddings for modeling multi-relational data. In: NIPS, pp. 2787–2795 (2013)

    Google Scholar 

  3. Cai, L., Wang, W.Y.: KBGAN: adversarial learning for knowledge graph embeddings. In: NAACL-HLT, pp. 1470–1480. Association for Computational Linguistics (2018)

    Google Scholar 

  4. Chang, K., Yih, W., Yang, B., Meek, C.: Typed tensor decomposition of knowledge bases for relation extraction. In: EMNLP, pp. 1568–1579. ACL (2014)

    Google Scholar 

  5. Dettmers, T., Minervini, P., Stenetorp, P., Riedel, S.: Convolutional 2D knowledge graph embeddings. In: AAAI, pp. 1811–1818. AAAI Press (2018)

    Google Scholar 

  6. Dong, X., et al.: Knowledge vault: a web-scale approach to probabilistic knowledge fusion. In: KDD, pp. 601–610. ACM (2014)

    Google Scholar 

  7. Fan, M., Zhou, Q., Chang, E., Zheng, T.F.: Transition-based knowledge graph embedding with relational mapping properties. In: PACLIC, pp. 328–337. The PACLIC 28 Organizing Committee and PACLIC Steering Committee/ACL/Department of Linguistics, Faculty of Arts, Chulalongkorn University (2014)

    Google Scholar 

  8. Ji, G., He, S., Xu, L., Liu, K., Zhao, J.: Knowledge graph embedding via dynamic mapping matrix. In: ACL (1), pp. 687–696. The Association for Computer Linguistics (2015)

    Google Scholar 

  9. Ji, G., Liu, K., He, S., Zhao, J.: Knowledge graph completion with adaptive sparse transfer matrix. In: AAAI, pp. 985–991. AAAI Press (2016)

    Google Scholar 

  10. Kazemi, S.M., Poole, D.: Simple embedding for link prediction in knowledge graphs. In: NeurIPS, pp. 4289–4300 (2018)

    Google Scholar 

  11. Krompaß, D., Baier, S., Tresp, V.: Type-constrained representation learning in knowledge graphs. In: Arenas, M., et al. (eds.) ISWC 2015. LNCS, vol. 9366, pp. 640–655. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-25007-6_37

    Chapter  Google Scholar 

  12. Krompass, D., Nickel, M., Tresp, V.: Large-scale factorization of type-constrained multi-relational data. In: DSAA, pp. 18–24. IEEE (2014)

    Google Scholar 

  13. Lin, Y., Liu, Z., Sun, M., Liu, Y., Zhu, X.: Learning entity and relation embeddings for knowledge graph completion. In: AAAI, pp. 2181–2187. AAAI Press (2015)

    Google Scholar 

  14. Liu, H., Wu, Y., Yang, Y.: Analogical inference for multi-relational embeddings. In: ICML. Proceedings of Machine Learning Research, vol. 70, pp. 2168–2178. PMLR (2017)

    Google Scholar 

  15. Miller, G.A.: WordNet: a lexical database for English. Commun. ACM 38(11), 39–41 (1995)

    Article  Google Scholar 

  16. Nguyen, D.Q., Nguyen, T.D., Nguyen, D.Q., Phung, D.Q.: A novel embedding model for knowledge base completion based on convolutional neural network. In: NAACL-HLT (2), pp. 327–333. Association for Computational Linguistics (2018)

    Google Scholar 

  17. Nguyen, D.Q., Vu, T., Nguyen, T.D., Nguyen, D.Q., Phung, D.Q.: A capsule network-based embedding model for knowledge graph completion and search personalization. CoRR abs/1808.04122 (2018)

    Google Scholar 

  18. Nickel, M., Rosasco, L., Poggio, T.A.: Holographic embeddings of knowledge graphs. In: AAAI, pp. 1955–1961. AAAI Press (2016)

    Google Scholar 

  19. Nickel, M., Tresp, V., Kriegel, H.: A three-way model for collective learning on multi-relational data. In: ICML, pp. 809–816. Omnipress (2011)

    Google Scholar 

  20. Rocktäschel, T., Singh, S., Riedel, S.: Injecting logical background knowledge into embeddings for relation extraction. In: HLT-NAACL, pp. 1119–1129. The Association for Computational Linguistics (2015)

    Google Scholar 

  21. Sabour, S., Frosst, N., Hinton, G.E.: Dynamic routing between capsules. In: NIPS, pp. 3859–3869 (2017)

    Google Scholar 

  22. Toutanova, K., Chen, D.: Observed versus latent features for knowledge base and text inference. In: Proceedings of the 3rd Workshop on Continuous Vector Space Models and their Compositionality, pp. 57–66 (2015)

    Google Scholar 

  23. Trouillon, T., Welbl, J., Riedel, S., Gaussier, É., Bouchard, G.: Complex embeddings for simple link prediction. In: ICML. JMLR Workshop and Conference Proceedings, vol. 48, pp. 2071–2080. JMLR.org (2016)

    Google Scholar 

  24. Wang, K., Liu, Y., Xu, X., Lin, D.: Knowledge graph embedding with entity neighbors and deep memory network. CoRR abs/1808.03752 (2018)

    Google Scholar 

  25. Wang, P., Dou, D., Wu, F., de Silva, N., Jin, L.: Logic rules powered knowledge graph embedding. CoRR abs/1903.03772 (2019)

    Google Scholar 

  26. Wang, Q., Mao, Z., Wang, B., Guo, L.: Knowledge graph embedding: a survey of approaches and applications. IEEE Trans. Knowl. Data Eng. 29(12), 2724–2743 (2017)

    Article  Google Scholar 

  27. Wang, Z., Zhang, J., Feng, J., Chen, Z.: Knowledge graph embedding by translating on hyperplanes. In: AAAI, pp. 1112–1119. AAAI Press (2014)

    Google Scholar 

  28. Xiao, H., Huang, M., Hao, Y., Zhu, X.: TransA: an adaptive approach for knowledge graph embedding. CoRR abs/1509.05490 (2015)

    Google Scholar 

  29. Yang, B., Yih, W., He, X., Gao, J., Deng, L.: Embedding entities and relations for learning and inference in knowledge bases. In: ICLR (2015)

    Google Scholar 

  30. Zhang, Y., Yao, Q., Dai, W., Chen, L.: AutoKGE: searching scoring functions for knowledge graph embedding. CoRR abs/1904.11682 (2019)

    Google Scholar 

Download references

Acknowledgements

This work is funded by NSFC 61473260/61673338, and Supported by Alibaba-Zhejiang University Joint Institute of Frontier Technologies.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Huajun Chen .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Li, J., Zhang, W., Chen, H. (2019). Incorporating Domain and Range of Relations for Knowledge Graph Completion. In: Zhu, X., Qin, B., Zhu, X., Liu, M., Qian, L. (eds) Knowledge Graph and Semantic Computing: Knowledge Computing and Language Understanding. CCKS 2019. Communications in Computer and Information Science, vol 1134. Springer, Singapore. https://doi.org/10.1007/978-981-15-1956-7_5

Download citation

  • DOI: https://doi.org/10.1007/978-981-15-1956-7_5

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-15-1955-0

  • Online ISBN: 978-981-15-1956-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics