Skip to main content
SpringerLink
Log in

Semantic- and relation-based graph neural network for knowledge graph completion

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

Knowledge graph completion (KGC) refines missing entities, relationships, or attributes from a knowledge graph, which is significant for referral systems, biological informatics, and search engines. As an effective KGC approach, a graph neural network (GNN) learns to aggregate information from neighboring nodes by iteratively passing messages between them. However, the semantic and relational information contained in knowledge graphs is rarely used in the existing GNN-based approaches for KGC (i.e., only structure information is used). Hence, a semantic- and relation-based GNN (SR-GNN) model, which combines the semantic similarity information between neighboring entities and the relational features of knowledge graphs, is proposed. First, we develop an entity semantic aggregation module that learns semantic similarity information among neighboring entities connected to the same central entity via an RNN. Second, we propose a relational aggregation module that captures the different semantics among different types of relations through a GRU. This enables the model to better comprehend semantic relationships and be applied to KGC tasks requiring relationship embedding vectors. Extensive studies conducted on the FB15k-237, WN18RR, WN18 and YAGO3-10 datasets reveal that, when compared to 17 baseline models, the SR-GNN exhibits state-of-the-art performance in terms of the MRR and H@n metrics. Significantly, the MRR metric improves by \(10.2 \%\) on the FB15K-237 dataset and by \(4.2 \%\) on the WN18RR dataset over those of the rival models.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Algorithm 1
Algorithm 2
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19

Similar content being viewed by others

Availability of data and materials

The datasets and materials used during this study are available by following the links in the text.

Code Availability

The Python code can be obtained by contacting the author (Yujie Tian).

References

  1. Yu M, Jiang T, Yu J, Zhao M, Guo J, Yang M, Yu R, Li X (2023) Sepake: a structure-enhanced and position-aware knowledge embedding framework for knowledge graph completion. Appl Intell 53(20):23113–23123

    Article  Google Scholar 

  2. Ta HT, Rahman ABS, Majumder N, Hussain A, Najjar L, Howard N, Poria S, Gelbukh A (2023) Wikides: A wikipedia-based dataset for generating short descriptions from paragraphs. Inf Fusion 90:265–282

  3. Formica A, Taglino F (2023) Semantic relatedness in dbpedia: A comparative and experimental assessment. Inf Sci 621:474–505

    Article  Google Scholar 

  4. Zeb A, Saif S, Chen J, Yu JJ, Jiang Q, Zhang D (2024) Cope: Composition-based poincaré embeddings for link prediction in knowledge graphs. Inf Sci 662:120197

    Article  Google Scholar 

  5. Wang J, Li W, Liu W, Wang C, Jin Q (2023) Enabling inductive knowledge graph completion via structure-aware attention network. Appl Intell 53(21):25003–25027

    Article  Google Scholar 

  6. Jiang D, Wang R, Yang J, Xue L (2021) Kernel multi-attention neural network for knowledge graph embedding. Know-Based Syst 107188

  7. Bordes A, Usunier N, Garcia-Duran A, Weston J, Yakhnenko O (2013) Translating embeddings for modeling multi-relational data. Proceedings of advances in neural information processing systems (NIPS), pp 2787–2795

  8. Bai L, Li N, Li G, Zhang Z, Zhu L (2024) Embedding-based entity alignment of cross-lingual temporal knowledge graphs. Neural Netw 172:106143

    Article  Google Scholar 

  9. Sun Z, Deng Z, Nie J, Tang J (2019) Rotate: Knowledge graph embedding by relational rotation in complex space. In: 7th International conference on learning representations (ICLR)

  10. Chao L, He J, Wang T, Chu W (2021) Pairre: Knowledge graph embeddings via paired relation vectors. Proceedings of the 59th annual meeting of the association for computational linguistics and the 11th international joint conference on natural language processing (ACL-IJCNLP), pp 4360–4369

  11. Nickel M, Tresp V, Kriegel H (2011) A three-way model for collective learning on multi-relational data. Proceedings of the 28th international conference on machine learning (ICML), pp 809–816

  12. Yang B, Yih SW-t, He X, Gao J, Deng L (2015) Embedding entities and relations for learning and inference in knowledge bases. In: Proceedings of the international conference on learning representations (ICLR)

  13. Trouillon T, Welbl J, Riedel S, Gaussier É, Bouchard G (2016) Complex embeddings for simple link prediction. Proceedings of the 33nd international conference on machine learning (ICML), pp 2071–2080

  14. Balazevic I, Allen C, Hospedales TM (2019) Tucker: Tensor factorization for knowledge graph completion. Proceedings of the 2019 conference on empirical methods in natural language processing and the 9th international joint conference on natural language processing (EMNLP-IJCNLP), pp 5184–5193

  15. Vashishth S, Sanyal S, Nitin V, Agrawal N, Talukdar PP (2020) Interacte: Improving convolution-based knowledge graph embeddings by increasing feature interactions. Proceedings of the AAAI conference on artificial intelligence (AAAI), pp 3009–3016

  16. Dettmers T, Minervini P, Stenetorp P, Riedel S (2018) Convolutional 2d knowledge graph embeddings. Proceedings of the thirty-second AAAI conference on artificial intelligence (AAAI), pp 1811–1818

  17. Daza D, Cochez M, Groth P (2021) Inductive entity representations from text via link prediction. Proceedings of the web conference 2021 (WWW), pp 798–808

  18. Yao L, Mao C, Luo Y (2019) Kg-bert: Bert for knowledge graph completion. arXiv preprint arXiv:1909.03193

  19. Wang B, Shen T, Long G, Zhou T, Wang Y, Chang Y (2021) Structure-augmented text representation learning for efficient knowledge graph completion. Proceedings of the web conference 2021 (WWW), pp 1737–1748

  20. Schlichtkrull MS, Kipf TN, Bloem P, Berg R, Titov I, Welling M (2018) Modeling relational data with graph convolutional networks. 15th International conference on extended semantic web conference (ESWC), pp 593–607

  21. Vashishth S, Sanyal S, Nitin V, Talukdar PP (2020) Composition-based multi-relational graph convolutional networks. In: 8th International conference on learning representations (ICLR)

  22. Li R, Cao Y, Zhu Q, Bi G, Fang F, Liu Y, Li Q (2022) How does knowledge graph embedding extrapolate to unseen data: A semantic evidence view. Proceedings of the AAAI conference on artificial intelligence (AAAI), pp 5781–5791

  23. Velickovic P, Cucurull G, Casanova A, Romero A, Liò P, Bengio Y (2018) Graph attention networks. In: 6th International conference on learning representations (ICLR)

  24. Shang C, Tang Y, Huang J, Bi J, He X, Zhou B (2019) End-to-end structure-aware convolutional networks for knowledge base completion. Proceedings of the AAAI conference on artificial intelligence (AAAI), pp 3060–3067

  25. Wang H, Yang J, Yang LT, Gao Y, Ding J, Zhou X, Liu H (2024) Mvtucker: Multi-view knowledge graphs representation learning based on tensor tucker model. Inform Fusion 106:102249

  26. Deng W, Li K, Zhao H (2023) A flight arrival time prediction method based on cluster clustering-based modular with deep neural network. IEEE Trans Intell Trans Syst pp 1–10

  27. Zhao H, Wu Y, Deng W (2023) An interpretable dynamic inference system based on fuzzy broad learning. IEEE Trans Instrum Meas 72:1–12

    Google Scholar 

  28. Zhao H, Liu H, Jin Y, Dang X, Deng W (2021) Feature extraction for data-driven remaining useful life prediction of rolling bearings. IEEE Trans Instrum Meas 70:1–10

    Google Scholar 

  29. Zhao H, Liu J, Chen H, Chen J, Li Y, Xu J, Deng W (2023) Intelligent diagnosis using continuous wavelet transform and gauss convolutional deep belief network. IEEE Trans Reliab 72(2):692–702

    Article  Google Scholar 

  30. Yang S, Zhang W, Tang R, Zhang M, Huang Z (2022) Approximate inferring with confidence predicting based on uncertain knowledge graph embedding. Infor Sci pp 679–690

  31. Wang J, Li W, Liu W, Wang C, Jin Q (2023) Enabling inductive knowledge graph completion via structure-aware attention network. Appl Intell 53(21):25003–25027

    Article  Google Scholar 

  32. Zhang D, Rong Z, Xue C, Li G (2024) Simre: Simple contrastive learning with soft logical rule for knowledge graph embedding. Inf Sci 661:120069

  33. Devlin J, Chang M, Lee K, Toutanova K (2019) BERT: pre-training of deep bidirectional transformers for language understanding. Proceedings of the 2019 conference of the north american chapter of the association for computational linguistics: human language technologies, (NAACL-HLT), pp 4171–4186

  34. Kim B, Hong T, Ko Y, Seo J (2020) Multi-task learning for knowledge graph completion with pre-trained language models. Proceedings of the 28th international conference on computational linguistics (COLING), pp 1737–1743

  35. Li Y, Hu B, Liu J, Chen Y, Xu J (2023) A neighborhood re-ranking model with relation constraint for knowledge graph completion. IEEE/ACM Transactions on Audio, Speech, and Language Processing, pp 411–425

  36. Paul GR, Preethi J (2024) A novel breast cancer detection system using SDM-WHO-RNN classifier with LS-CED segmentation. Exp Syst Appl 238(Part C), p 121781

  37. Oyewola DO, Akinwunmi SA, Omotehinwa TO (2024) Deep lstm and lstm-attention q-learning based reinforcement learning in oil and gas sector prediction. Knowl-Based Syst 284:111290

    Article  Google Scholar 

  38. Akilan T, Baalamurugan K (2024) Automated weather forecasting and field monitoring using gru-cnn model along with iot to support precision agriculture. Exp Syst Appl p 123468

  39. Cho K, Merrienboer B, Gülçehre Ç, Bahdanau D, Bougares F, Schwenk H, Bengio Y (2014) Learning phrase representations using RNN encoder-decoder for statistical machine translation. Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP), pp 1724–1734

  40. Zhang Z, Wang J, Ye J, Wu F (2022) Rethinking graph convolutional networks in knowledge graph completion. In: The web conference 2022

  41. Wang Y, Ge X, Wang B, Kuo C-J (2023) Greenkgc: A lightweight knowledge graph completion method. In: Proceedings of the 61st annual meeting of the association for computational linguistics (ACL), pp 10596–10613

  42. Ji S, Bu C, Li L, Wu X (2023) Localtgep: A lightweight edge partitioner for time-varying graph. IEEE Trans Emerg Top Comput pp 1–12

  43. Peng Y, Zhang J (2020) Lineare: Simple but powerful knowledge graph embedding for link prediction. In: 20th IEEE International conference on data mining, ICDM 2020, Sorrento, Italy, pp 422–431. Accessed 17–20 Nov 2020

  44. Tran HN, Takasu A (2022) MEIM: Multi-partition Embedding Interaction Beyond Block Term Format for Efficient and Expressive Link Prediction. In: Proceedings of the thirty-first international joint conference on artificial intelligence (IJCAI), pp 2262–2269

Download references

Acknowledgements

This work is partly supported by the National Natural Science Foundation of China under grants 62306100 and 62176085, and the Natural Science Research Project of Anhui Educational Committee under grant 2023AH052180. The authors are equally grateful to the Hefei University Arithmetic Platform for providing support.

Author information

Authors and Affiliations

  1. School of Artificial Intelligence and Big Data, Hefei University, Hefei, 230000, China

    Xinlu Li, Yujie Tian & Shengwei Ji

Authors
  1. Xinlu Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yujie Tian
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Shengwei Ji
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Xinlu Li: Conceptualization, Methodology, Su-pervision. Yujie Tian: Software, Conducting experiments, Writing - Original draft preparation. Shengwei Ji: Reviewing, Investigation and Editing.

Corresponding author

Correspondence to Shengwei Ji.

Ethics declarations

Conflicts of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Li, X., Tian, Y. & Ji, S. Semantic- and relation-based graph neural network for knowledge graph completion. Appl Intell (2024). https://doi.org/10.1007/s10489-024-05482-2

Download citation

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10489-024-05482-2

Keywords

Search

Navigation