Encyclopedia of Big Data Technologies

Living Edition
| Editors: Sherif Sakr, Albert Zomaya

Knowledge Graph Embeddings

  • Paolo Rosso
  • Dingqi Yang
  • Philippe Cudré-Mauroux
Living reference work entry
DOI: https://doi.org/10.1007/978-3-319-63962-8_284-1

Synonyms

Definitions

Knowledge graph embeddings: a vector representation of entities and relations in a knowledge graph that preserves the inherent structure of the knowledge graph as well as the reasoning ability over the graph.

Overview

With the growing popularity of multi-relational data on the Web, knowledge graphs (KGs) have become a key data source in various application domains, such as Web search, question answering, and natural language understanding. In a typical KG such as Freebase (Bollacker et al. 2008) or Google’s Knowledge Graph (Google 2014), entities are connected via relations. For example, Bern is capital of Switzerland. Formally, a popular approach to represent such relational data is to use the Resource Description Framework. It defines a fact as a triple (subject, predicate, and object), which is also known as head, relation, and tail or (h, r, t) for short. Following the above example, the head, relation, and tail...

This is a preview of subscription content, log in to check access.

References

  1. Battiti R, Masulli F (1990) BFGS optimization for faster and automated supervised learning. In: International neural network conference. Springer, pp 757–760Google Scholar
  2. Bollacker K, Evans C, Paritosh P, Sturge T, Taylor J (2008) Freebase: a collaboratively created graph database for structuring human knowledge. In: Proceedings of the 2008 ACM SIGMOD international conference on management of data. ACM, pp 1247–1250Google Scholar
  3. Bordes A, Usunier N, Garcia-Duran A, Weston J, Yakhnenko O (2013) Translating embeddings for modeling multi-relational data. In: Advances in neural information processing systems, pp 2787–2795Google Scholar
  4. Bordes A, Chopra S, Weston J (2014a) Question answering with subgraph embeddings. arXiv preprint, arXiv:14063676Google Scholar
  5. Bordes A, Glorot X, Weston J, Bengio Y (2014b) A semantic matching energy function for learning with multi-relational data. Mach Learn 94(2):233–259Google Scholar
  6. Dehaspe L, Toivonen H (1999) Discovery of frequent datalog patterns. Data Min Knowl Disc 3(1):7–36Google Scholar
  7. Drumond L, Rendle S, Schmidt-Thieme L (2012) Predicting RDF triples in incomplete knowledge bases with tensor factorization. In: Proceedings of the 27th annual ACM symposium on applied computing. ACM, pp 326–331Google Scholar
  8. Duchi J, Hazan E, Singer Y (2011) Adaptive subgradient methods for online learning and stochastic optimization. J Mach Learn Res 12:2121–2159Google Scholar
  9. Feng J, Huang M, Yang Y et al (2016) Gake: graph aware knowledge embedding. In: Proceedings of COLING 2016, the 26th international conference on computational linguistics: technical papers, pp 641–651Google Scholar
  10. Galárraga LA, Teflioudi C, Hose K, Suchanek F (2013) AMIE: association rule mining under incomplete evidence in ontological knowledge bases. In: Proceedings of the 22nd international conference on World Wide Web. ACM, pp 413–422Google Scholar
  11. Guo S, Wang Q, Wang B, Wang L, Guo L (2015) Semantically smooth knowledge graph embedding. In: ACL, vol 1, pp 84–94Google Scholar
  12. Guo S, Wang Q, Wang L, Wang B, Guo L (2016) Jointly embedding knowledge graphs and logical rules. In: EMNLP, pp 192–202Google Scholar
  13. Guo S, Wang Q, Wang B, Wang L, Guo L (2017) SSE: semantically smooth embedding for knowledge graphs. IEEE Trans Knowl Data Eng 29(4):884–897Google Scholar
  14. Ji G, He S, Xu L, Liu K, Zhao J (2015) Knowledge graph embedding via dynamic mapping matrix. In: ACL, vol 1, pp 687–696Google Scholar
  15. Jiang T, Liu T, Ge T, Sha L, Li S, Chang B, Sui Z (2016) Encoding temporal information for time-aware link prediction. In: EMNLP, pp 2350–2354Google Scholar
  16. Lao N, Cohen WW (2010) Relational retrieval using a combination of path-constrained random walks. Mach Learn 81(1):53–67Google Scholar
  17. Lin Y, Liu Z, Luan H, Sun M, Rao S, Liu S (2015a) Modeling relation paths for representation learning of knowledge bases. arXiv preprint, arXiv:150600379Google Scholar
  18. Lin Y, Liu Z, Sun M, Liu Y, Zhu X (2015b) Learning entity and relation embeddings for knowledge graph completion. In: AAAI, pp 2181–2187Google Scholar
  19. Miettinen P (2011) Boolean tensor factorizations. In: 2011 IEEE 11th international conference on Data mining (ICDM). IEEE, pp 447–456Google Scholar
  20. Mikolov T, Yih Wt, Zweig G (2013) Linguistic regularities in continuous space word representations. In: HLT-NAACL, vol 13, pp 746–751Google Scholar
  21. Muggleton S (1995) Inverse entailment and progol. N Gener Comput 13(3):245–286Google Scholar
  22. Nickel M, Tresp V (2013) Logistic tensor factorization for multi-relational data. arXiv preprint, arXiv:13062084Google Scholar
  23. Nickel M, Tresp V, Kriegel HP (2011) A three-way model for collective learning on multi-relational data. In: ICML, vol 11, pp 809–816Google Scholar
  24. Nickel M, Tresp V, Kriegel HP (2012) Factorizing yago: scalable machine learning for linked data. In: Proceedings of the 21st international conference on World Wide Web. ACM, pp 271–280Google Scholar
  25. Richardson M, Domingos P (2006) Markov logic networks. Mach Learn 62(1):107–136Google Scholar
  26. Robbins H, Monro S (1951) A stochastic approximation method. Ann Math Stat 22:400–407Google Scholar
  27. Socher R, Chen D, Manning CD, Ng A (2013) Reasoning with neural tensor networks for knowledge base completion. In: Advances in neural information processing systems, pp 926–934Google Scholar
  28. Toutanova K, Lin V, Yih Wt, Poon H, Quirk C (2016) Compositional learning of embeddings for relation paths in knowledge base and text. In: ACL, vol 1Google Scholar
  29. Trouillon T, Welbl J, Riedel S, Gaussier É, Bouchard G (2016) Complex embeddings for simple link prediction. In: International conference on machine learning, pp 2071–2080Google Scholar
  30. Wang Z, Zhang J, Feng J, Chen Z (2014a) Knowledge graph and text jointly embedding. In: EMNLP, vol 14, pp 1591–1601Google Scholar
  31. Wang Z, Zhang J, Feng J, Chen Z (2014b) Knowledge graph embedding by translating on hyperplanes. In: AAAI, pp 1112–1119Google Scholar
  32. Wang Q, Wang B, Guo L (2015) Knowledge base completion using embeddings and rules. In: IJCAI, pp 1859–1866Google Scholar
  33. West R, Gabrilovich E, Murphy K, Sun S, Gupta R, Lin D (2014) Knowledge base completion via search-based question answering. In: Proceedings of the 23rd international conference on World Wide Web. ACM, pp 515–526Google Scholar
  34. Weston J, Bordes A, Yakhnenko O, Usunier N (2013) Connecting language and knowledge bases with embedding models for relation extraction. arXiv preprint, arXiv:13077973Google Scholar
  35. Xie R, Liu Z, Sun M (2016) Representation learning of knowledge graphs with hierarchical types. In: IJCAI, pp 2965–2971Google Scholar
  36. Yang B, Yih Wt, He X, Gao J, Deng L (2014) Embedding entities and relations for learning and inference in knowledge bases. arXiv preprint, arXiv:14126575Google Scholar
  37. Yu X, Ren X, Sun Y, Gu Q, Sturt B, Khandelwal U, Norick B, Han J (2014) Personalized entity recommendation: a heterogeneous information network approach. In: Proceedings of the 7th ACM international conference on web search and data mining. ACM, pp 283–292Google Scholar
  38. Zhang F, Yuan NJ, Lian D, Xie X, Ma WY (2016) Collaborative knowledge base embedding for recommender systems. In: Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining. ACM, pp 353–362Google Scholar

Copyright information

© Springer International Publishing AG 2018

Authors and Affiliations

  • Paolo Rosso
    • 1
  • Dingqi Yang
    • 1
  • Philippe Cudré-Mauroux
    • 1
  1. 1.eXascale InfolabUniversity of FribourgFribourgSwitzerland

Section editors and affiliations

  • Philippe Cudré-Mauroux
    • 1
  • Olaf Hartig
    • 2
  1. 1.eXascale InfolabUniversity of FribourgFribourgSwitzerland
  2. 2.Linköping University