Skip to main content

Knowledge Graph Embeddings

  • Living reference work entry
  • Latest version View entry history
  • First Online:
Encyclopedia of Big Data Technologies

Synonyms

Knowledge base embeddings; RDF graph embeddings

Definitions

Knowledge graph embeddings: a vector representation of entities and relations in a knowledge graph that preserves the inherent structure of the knowledge graph as well as the reasoning ability over the graph.

Overview

With the growing popularity of multi-relational data on the Web, knowledge graphs (KGs) have become a key data source in various application domains, such as Web search, question answering, and natural language understanding. In a typical KG such as Freebase (Bollacker et al. 2008) or Google’s Knowledge Graph (Google 2014), entities are connected via relations. For example, Bern is capital of Switzerland. Formally, a popular approach to represent such relational data is to use the Resource Description Framework. It defines a fact as a triple (subject, predicate, and object), which is also known as head, relation, and tail or (h, r, t) for short. Following the above example, the head, relation, and tail...

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions

References

  • Battiti R, Masulli F (1990) BFGS optimization for faster and automated supervised learning. In: International neural network conference. Springer, pp 757–760

    Google Scholar 

  • Bollacker K, Evans C, Paritosh P, Sturge T, Taylor J (2008) Freebase: a collaboratively created graph database for structuring human knowledge. In: Proceedings of the 2008 ACM SIGMOD international conference on management of data. ACM, pp 1247–1250

    Google Scholar 

  • Bordes A, Usunier N, Garcia-Duran A, Weston J, Yakhnenko O (2013) Translating embeddings for modeling multi-relational data. In: Advances in neural information processing systems, pp 2787–2795

    Google Scholar 

  • Bordes A, Chopra S, Weston J (2014a) Question answering with subgraph embeddings. arXiv preprint, arXiv:14063676

    Google Scholar 

  • Bordes A, Glorot X, Weston J, Bengio Y (2014b) A semantic matching energy function for learning with multi-relational data. Mach Learn 94(2):233–259

    Google Scholar 

  • Dehaspe L, Toivonen H (1999) Discovery of frequent datalog patterns. Data Min Knowl Disc 3(1):7–36

    Google Scholar 

  • Drumond L, Rendle S, Schmidt-Thieme L (2012) Predicting RDF triples in incomplete knowledge bases with tensor factorization. In: Proceedings of the 27th annual ACM symposium on applied computing. ACM, pp 326–331

    Google Scholar 

  • Duchi J, Hazan E, Singer Y (2011) Adaptive subgradient methods for online learning and stochastic optimization. J Mach Learn Res 12:2121–2159

    Google Scholar 

  • Feng J, Huang M, Yang Y et al (2016) Gake: graph aware knowledge embedding. In: Proceedings of COLING 2016, the 26th international conference on computational linguistics: technical papers, pp 641–651

    Google Scholar 

  • Galárraga LA, Teflioudi C, Hose K, Suchanek F (2013) AMIE: association rule mining under incomplete evidence in ontological knowledge bases. In: Proceedings of the 22nd international conference on World Wide Web. ACM, pp 413–422

    Google Scholar 

  • Google (2014) https://www.google.com/intl/bn/inside search/features/search/knowledge.html

  • Guo S, Wang Q, Wang B, Wang L, Guo L (2015) Semantically smooth knowledge graph embedding. In: ACL, vol 1, pp 84–94

    Google Scholar 

  • Guo S, Wang Q, Wang L, Wang B, Guo L (2016) Jointly embedding knowledge graphs and logical rules. In: EMNLP, pp 192–202

    Google Scholar 

  • Guo S, Wang Q, Wang B, Wang L, Guo L (2017) SSE: semantically smooth embedding for knowledge graphs. IEEE Trans Knowl Data Eng 29(4):884–897

    Google Scholar 

  • Ji G, He S, Xu L, Liu K, Zhao J (2015) Knowledge graph embedding via dynamic mapping matrix. In: ACL, vol 1, pp 687–696

    Google Scholar 

  • Jiang T, Liu T, Ge T, Sha L, Li S, Chang B, Sui Z (2016) Encoding temporal information for time-aware link prediction. In: EMNLP, pp 2350–2354

    Google Scholar 

  • Lao N, Cohen WW (2010) Relational retrieval using a combination of path-constrained random walks. Mach Learn 81(1):53–67

    Google Scholar 

  • Lin Y, Liu Z, Luan H, Sun M, Rao S, Liu S (2015a) Modeling relation paths for representation learning of knowledge bases. arXiv preprint, arXiv:150600379

    Google Scholar 

  • Lin Y, Liu Z, Sun M, Liu Y, Zhu X (2015b) Learning entity and relation embeddings for knowledge graph completion. In: AAAI, pp 2181–2187

    Google Scholar 

  • Miettinen P (2011) Boolean tensor factorizations. In: 2011 IEEE 11th international conference on Data mining (ICDM). IEEE, pp 447–456

    Google Scholar 

  • Mikolov T, Yih Wt, Zweig G (2013) Linguistic regularities in continuous space word representations. In: HLT-NAACL, vol 13, pp 746–751

    Google Scholar 

  • Muggleton S (1995) Inverse entailment and progol. N Gener Comput 13(3):245–286

    Google Scholar 

  • Nickel M, Tresp V (2013) Logistic tensor factorization for multi-relational data. arXiv preprint, arXiv:13062084

    Google Scholar 

  • Nickel M, Tresp V, Kriegel HP (2011) A three-way model for collective learning on multi-relational data. In: ICML, vol 11, pp 809–816

    Google Scholar 

  • Nickel M, Tresp V, Kriegel HP (2012) Factorizing yago: scalable machine learning for linked data. In: Proceedings of the 21st international conference on World Wide Web. ACM, pp 271–280

    Google Scholar 

  • Richardson M, Domingos P (2006) Markov logic networks. Mach Learn 62(1):107–136

    Google Scholar 

  • Robbins H, Monro S (1951) A stochastic approximation method. Ann Math Stat 22:400–407

    Google Scholar 

  • Socher R, Chen D, Manning CD, Ng A (2013) Reasoning with neural tensor networks for knowledge base completion. In: Advances in neural information processing systems, pp 926–934

    Google Scholar 

  • Toutanova K, Lin V, Yih Wt, Poon H, Quirk C (2016) Compositional learning of embeddings for relation paths in knowledge base and text. In: ACL, vol 1

    Google Scholar 

  • Trouillon T, Welbl J, Riedel S, Gaussier É, Bouchard G (2016) Complex embeddings for simple link prediction. In: International conference on machine learning, pp 2071–2080

    Google Scholar 

  • Wang Z, Zhang J, Feng J, Chen Z (2014a) Knowledge graph and text jointly embedding. In: EMNLP, vol 14, pp 1591–1601

    Google Scholar 

  • Wang Z, Zhang J, Feng J, Chen Z (2014b) Knowledge graph embedding by translating on hyperplanes. In: AAAI, pp 1112–1119

    Google Scholar 

  • Wang Q, Wang B, Guo L (2015) Knowledge base completion using embeddings and rules. In: IJCAI, pp 1859–1866

    Google Scholar 

  • West R, Gabrilovich E, Murphy K, Sun S, Gupta R, Lin D (2014) Knowledge base completion via search-based question answering. In: Proceedings of the 23rd international conference on World Wide Web. ACM, pp 515–526

    Google Scholar 

  • Weston J, Bordes A, Yakhnenko O, Usunier N (2013) Connecting language and knowledge bases with embedding models for relation extraction. arXiv preprint, arXiv:13077973

    Google Scholar 

  • Xie R, Liu Z, Sun M (2016) Representation learning of knowledge graphs with hierarchical types. In: IJCAI, pp 2965–2971

    Google Scholar 

  • Yang B, Yih Wt, He X, Gao J, Deng L (2014) Embedding entities and relations for learning and inference in knowledge bases. arXiv preprint, arXiv:14126575

    Google Scholar 

  • Yu X, Ren X, Sun Y, Gu Q, Sturt B, Khandelwal U, Norick B, Han J (2014) Personalized entity recommendation: a heterogeneous information network approach. In: Proceedings of the 7th ACM international conference on web search and data mining. ACM, pp 283–292

    Google Scholar 

  • Zhang F, Yuan NJ, Lian D, Xie X, Ma WY (2016) Collaborative knowledge base embedding for recommender systems. In: Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining. ACM, pp 353–362

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Philippe Cudré-Mauroux .

Editor information

Editors and Affiliations

Section Editor information

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG

About this entry

Check for updates. Verify currency and authenticity via CrossMark

Cite this entry

Rosso, P., Yang, D., Cudré-Mauroux, P. (2018). Knowledge Graph Embeddings. In: Sakr, S., Zomaya, A. (eds) Encyclopedia of Big Data Technologies. Springer, Cham. https://doi.org/10.1007/978-3-319-63962-8_284-1

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-63962-8_284-1

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-63962-8

  • Online ISBN: 978-3-319-63962-8

  • eBook Packages: Springer Reference MathematicsReference Module Computer Science and Engineering

Publish with us

Policies and ethics

Chapter history

  1. Latest

    Knowledge Graph Embeddings
    Published:
    23 February 2018

    DOI: https://doi.org/10.1007/978-3-319-63962-8_284-1

  2. Original

    Knowledge Graph Embeddings
    Published:
    24 February 2012

    DOI: https://doi.org/10.1007/978-3-319-63962-8_284-2