Skip to main content
SpringerLink
Log in

A cross-linguistic entity alignment method based on graph convolutional neural network and graph attention network

  • Regular Paper
  • Published:
Computing Aims and scope Submit manuscript

Abstract

Cross-language entity alignment forms an important component of building a Knowledge Graph. The task of cross-lingual entity alignment is to match entities in a source language with their counterparts in target languages. In practice, there is an imbalance of attribute information in corresponding entities at the same level, and the problem of neighboring point weight assignment is not considered, which not only loses the association information between entities but also limits the utilization of entity attributes in the alignment process, making this task challenging. In this paper, we propose a cross-lingual entity alignment method based on Graph convolutinal neural network and Graph attention network. Specifically, it can capture more spatial information by assigning respective weights to the neighbors of different nodes through multi-level learning of entity structure, attributes, and attention. In addition, the weights of neighboring node features depend entirely on the node features, which gets rid of the dependence on the graph. The experiments show that our models outperform state-of-the-art methods at a fraction of the cost.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

Data availibility

The datasets generated during and analysed during the current study are available from the corresponding author on reasonable request.

Code Availability

Original model codes are available in GitHub (https://github.com/1049451037/GCN-Align).Initial datasets are from [JAPE](https://github.com/nju-websoft/JAPE.)

References

  1. Sowa JF (2014) Principles of semantic networks: explorations in the representation of knowledge. Morgan Kaufmann, Burlington

    MATH  Google Scholar 

  2. Lehmann J, Isele R, Jakob M (2015) Dbpedia-a large-scale, multilingual knowledge base extracted from wikipedia. Semantic Web 6(2):167–195

    Article  Google Scholar 

  3. Mahdisoltani F, Biega J, Suchanek F (2014) Yago3:A knowledge base from multilingual wikipedias. In: 7th biennial conference on innovative data systems research. CIDR Conference

  4. Navigli R, BabelNet PSP (2012) The automatic construction, evaluation and application of a wide-coverage multilingual semantic network. Artif Intell 193:217–250

    Article  MathSciNet  MATH  Google Scholar 

  5. Speer R, Chin J, Havasi C (2017) Conceptnet 5.5: an open multilingual graph of general knowledge. In: Proceedings of the AAAI conference on artificial intelligence. 31(1)

  6. Chen M, Tian Y, Yang M, Zaniolo C (2016) Multilingual knowledge graph embeddings for cross-lingual knowledge alignment. arXiv:1611.03954

  7. Sun Z, Hu W, Li C (2017) Cross-lingual entity alignment via joint attribute-preserving embedding, In: Proceedings of the Sixteen International Semantic Web Conference (ISWC2017), pp. 628–644

  8. Yang K, Liu S, Zhao J (2020) COTSAE: co-training of structure and attribute embeddings for entity alignment. In: Proceedings of the AAAI Conference on Artificial Intelligence 34(03) pp.3015–3032. https://doi.org/10.1609/aaai.v34i03.5696

  9. Chen B, Zhang J, Tang X et al (2020) JarKA: modeling attribute interactions for cross-lingual knowledge alignment. In: Advances in Knowledge Discovery and Data Mining: 24th Pacific-Asia Conference, PAKDD 2020, Singapore, May 11–14, 2020, Proceedings, Part I 24. Springer International Publishing 2020:845–856

  10. Indrajit B, Lise G (2006) A Latent dirichlet model for unsupervised entity resolution. In: Proceedings of the 2006 SIAM International Conference on Data Mining. Society for Industrial and Applied Mathematics, pp. 47–58 https://doi.org/10.1137/1.9781611972764.5

  11. Rob H , Charles S, Andrew M (2008) Unsupervised deduplication using cross-field dependencies. In :Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining. pp 310–317.https://doi.org/10.1145/1401890.1401931

  12. Andrew M, Ben W (2004) Conditional models of identity uncertainty with application to noun coreference. In: Advances in neural information processing systems. p. 17

  13. Domingos P (2004) Multi-relational record linkage. In: Proceedings of the KDD-2004 Workshop on Multi-Relational Data Mining. New York: ACM, pp. 31–48

  14. Hanna P, Marthi B, Milch B (2003) Identity uncertainty and citation matching. In: Proceedings of Advances in Neural Information Processing Systems 15. Cambridge,MA:MIT Press, pp. 1425–1432

  15. Tang J, Li J, Liang B (2006) Using Bayesian decision for ontology mapping. J Web Semantics 4(4):243–262. https://doi.org/10.1016/j.websem.2006.06.001

    Article  Google Scholar 

  16. Newcombe H, Kennedy J, Axford S (1959) Automatic linkage of vital records. Science 130(3381):954–959. https://doi.org/10.1126/science.130.3381.954

    Article  Google Scholar 

  17. Fellegi I, Sunter A (1969) A theory for record linkage. J Am Stat Assoc 64(328):1183–1210

    Article  MATH  Google Scholar 

  18. Elfeky M, Verykios V, Elmagarmid A (2002) TAILOR: a record linkage toolbox. In: International Confrence on Data Engineering. Purdue University, pp 17–28.IEEE

  19. Ye R ,Li X ,Fang Y (2019) A vectorized relational graph convolutional network for multi-relational network alignment. In: Twenty-Eighth International Joint Conference on Artificial Intelligence IJCAI-19

  20. Li C, Cao L, Hou L (2019) Semi-supervised entity alignment via joint knowledge embedding model and cross-graph model. In: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP),pp 2723–2732. https://doi.org/10.18653/v1/D19-1274

  21. Bordes A, Usunier N, GarciaDuran A (2013) Translating embeddings for modeling multi-relational data. In: Neural Information Processing Systems, Lake Tahoe USA? pp. 787–795

  22. Hao Y, Zhang Y, He S, (2016) A joint embedding method for entity alignment of knowledge bases. In: China Conference on Knowledge Graph and Semantic Computing, pp. 3–14 https://doi.org/10.1007/978-981-10-3168-7

  23. Zhu H, Xie R, Liu Z, et al (2017) Iterative entity alignment via knowledge embeddings .In: Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI)

  24. Chen M, Tian Y, Yang M (2016) Multilingual knowledge graph embeddings for cross-lingual knowledge alignment. arXiv:1611.03954

  25. Wang Z, Lv Q, Lan X, Zhang y (2018) Cross-lingual knowledge graph alignment via graph convolutional networks. In: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pp 349–357

  26. Trisedya BD, Qi J, Zhang R (2019) Entity alignment between knowledge graphs using attribute embeddings. In Proceedings of the AAAI Conference on Artificial Intelligence, Honolulu, HI, USA, 27 January-1 February. pp.297–304

  27. Chen B, Zhang J, Tang X, Chen H, Li C (2019) RAKA: co-training of relationships and attributes for cross-lingual knowledge alignment. arXiv:1910.13105

  28. Liu Z, Cao Y, Pan L (2020) Exploring and evaluating attributes, values, and structures for entity alignment. arXiv:2010.03249

  29. Zhang G, Zhou Y, Wu S, Zhang Z, Dou D (2021) Cross-lingual entity alignment with adversarial kernel embedding and adversarial knowledge translation. arXiv:2104.07837

  30. Liu F, Chen M, Roth D, Collier N (2021) Visual pivoting for (Unsupervised) entity alignment. In Proceedings of the AAAI Conference on Artificial Intelligence, Virtual Event, 2-9 February. pp. 4257–4266

  31. Zhang Q, Sun Z, Hu W, Chen M, Guo L, Qu Y (2019) Multi-view knowledge graph embedding for entity alignment. arXiv:1906.02390

  32. Wu T, Gao C, Li L (2022) Leveraging multi-modal information for cross-lingual entity matching across knowledge graphs. Appl Sci 12(19):10107

    Article  Google Scholar 

  33. Lu W, Wang P, Ma X (2020) Enrich cross-lingual entity links for online wikis via multi-modal semantic matching. Inf Process Manag 57(5):102271

    Article  Google Scholar 

  34. Chen M, Shi W, Zhou B, et al (2020) Cross-lingual entity alignment with incidental supervision. arXiv:2005.00171

  35. Sun J, Zhou Y, Zong C (2020) Dual attention network for cross-lingual entity alignment. In: Proceedings of the 28th International Conference on Computational Linguistics. pp.3190-3201

  36. Mao X, Wang W, Xu H (2020) MRAEA: an efficient and robust entity alignment approach for cross-lingual knowledge graph. In: Proceedings of the 13th International Conference on Web Search and Data Mining. pp.420-428

  37. Xie Z, Zhu R, Zhao K (2020) A contextual alignment enhanced cross graph attention network for cross-lingual entity alignment. In: Proceedings of the 28th International Conference on Computational Linguistics. pp.5918-5928

  38. El-Kishky A, Renduchintala A, Cross J (2021) XLEnt: mining a large cross-lingual entity dataset with lexical-semantic-phonetic word alignment. arXiv:2104.08597

  39. Qu M, Jian T, Yoshua B (2019) Weakly-supervised knowledge graph alignment with adversarial learning. arXiv:1907.03179

  40. Yu D, Yang Y, Zhang R (2020) Generalized multi-relational graph convolution network. arXiv:2020:07331

  41. Sun Z (2020) Knowledge graph alignment network with gated multi-hop neighborhood aggregation. In: Proceedings of the AAAI Conference on Artificial Intelligence 34(01) pp. 222–229 https://doi.org/10.1609/aaai.v34i01.5354

  42. Zhu Q, Hao W, Bunyamin S (2020) Collective multi-type entity alignment between knowledge graphs. Proceedings of The Web Conference 2020:2241–2252. https://doi.org/10.1145/3366423.3380289

    Article  Google Scholar 

  43. Wu Y, Liu X, Feng Y (2019) Relation-aware entity alignment for heterogeneous knowledge graphs, arXiv:1908.08210

  44. Joan B, Wojciech Z, Arthur S, Yann L (2013) Spectral networks and locally connected networks on graphs. arXiv:1312.6203

  45. Kipf T, Welling M (2016) Semi-supervised classification with graph convolutional networks. arXiv:1609.02907

  46. Sun Z, Hu W, Li C (2018) Cross-lingual entity alignment via joint attribute-preserving embedding. In: The Semantic Web-ISWC 2017: 16th International Semantic Web Conference, Vienna, Austria, October 21–25, 2017, Proceedings, Part I 16. Springer International Publishing 2017:628–644

  47. Gao J, Liu X, Chen Y, Xiong F (2022) Multiview highway graph convolutional network for cross-lingual entity alignment. Tsinghua Sci Technol 27(4):719–728. https://doi.org/10.26599/TST.2021.9010056

  48. Chen M, Tian Y, Yang M, Zaniolo C (2017) Multilingual knowledge graph embeddings for cross-lingual knowledge alignment. In Proceedings of IJCAI, pp. 1511–1517

Download references

Acknowledgements

The research was supported by National Natural Science Foundation of China(No:61976027); Liaoning Provincial Education Department 2021 Scientific Research Project (LJKZ1028); Bohai University 2021 Graduate Education Teaching Reform Project (YJG20210022); Bohai University 2021 National Security Research Institute Project (XK202134-31); Bohai University 2022 Teaching Reform Project (2-7-47).

Author information

Authors and Affiliations

  1. College of Information Science and Technology, Bohai University, Jinzhou, 121000, Liaoning, People’s Republic of China

    Zhen Zhao & Shuo Lin

Authors
  1. Zhen Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Shuo Lin
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zhen Zhao.

Ethics declarations

Conflict of interest

The authors declare no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhao, Z., Lin, S. A cross-linguistic entity alignment method based on graph convolutional neural network and graph attention network. Computing 105, 2293–2310 (2023). https://doi.org/10.1007/s00607-023-01178-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00607-023-01178-6

Keywords

Mathematics Subject Classification

Search

Navigation