Abstract
Entity alignment aims to connect equivalent entities between different knowledge graphs (KGs), which is an important step in knowledge fusion. The structural heterogeneity between KGs severely hinders the development of entity alignment. The existing researches mainly focus on alleviating the structural heterogeneity from the view of entity neighborhood heterogeneity, ignoring the important effect of the relation heterogeneity on it. To this end, we propose a Dual-view graph neural network (GNN) based on a gating mechanism named DvGNet, which comprehensively alleviates the structural heterogeneity of KG from the perspective of entity interaction and relation interaction. From the perspective of entity interaction, DvGNet gives important neighbors high weights to alleviate the heterogeneity of entity neighborhood. From the perspective of relation interaction, DvGNet obtains the relation matching degree between KGs according to the relation embeddings, so as to alleviate the relation heterogeneity. Furthermore, to learn the precise representation for the entity, we propose a concise and effective gating mechanism to aggregate the embeddings among the network layers. We conduct extensive experiments on three entity alignment datasets, as well as detailed ablation studies and analyses, demonstrating the effectiveness of DvGNet.
Similar content being viewed by others
References
Suchanek FM, Kasneci G, Weikum G (2007) Yago: a core of semantic knowledge. In: Proceedings of the 16th international conference on world wide web, pp. 697–706. https://doi.org/10.1145/1X00000.242572.1242667
Lehmann J, Isele R, Jakob M, Jentzsch A, Kontokostas D, Mendes PN, Hellmann S, Morsey M, Van Kleef P, Auer S et al (2015) Dbpedia–a large-scale, multilingual knowledge base extracted from wikipedia. Semantic web 6(2):167–195. https://doi.org/10.3233/SW-140134
Bollacker K, Evans C, Paritosh P, Sturge T, Taylor J (2008) Freebase: a collaboratively created graph database for structuring human knowledge. In: Proceedings of the 2008 ACM SIGMOD international conference on management of data, pp 1247–1250. https://doi.org/10.1145/1376616.1376746
Tong P, Zhang Q, Yao J (2019) Leveraging domain context for question answering over knowledge graph. Data Sci Eng 4(4):323–335. https://doi.org/10.1007/s41019-019-00109-w
Jiang Y, Wang X, Zheng H-T (2014) A semantic similarity measure based on information distance for ontology alignment. Inf Sci 278:76–87. https://doi.org/10.1016/j.ins.2014.03.021
Porter EH, Winkler WE, et al. (1997) Approximate string comparison and its effect on an advanced record linkage system. In: Advanced record linkage system. US bureau of the census, research report, pp 190–199
Raimond Y, Sutton C, Sandler MB (2008) Automatic interlinking of music datasets on the semantic web. In: Proceedings of the Linked Data on the Web (LDOW 2008) Workshop at 17th International World Wide Web Confernce, Beijing, China
Bordes A, Usunier N, Garcia-Duran A, Weston J, Yakhnenko O (2013) Translating embeddings for modeling multi-relational data. Advances in Neural Information Processing Systems, 26
Wang Y, Chen Y, Bhuiyan M, Han Y, Zhao S, Li J (2017) Gait-based human identification using acoustic sensor and deep neural network. Future Generation Computer Systems, 0167739–17314760. https://doi.org/10.1016/j.future.2017.07.012
Wang Z, Zhang J, Feng J, Chen Z (2014) Knowledge graph embedding by translating on hyperplanes. In: Proceedings of the AAAI conference on artificial intelligence, vol 28
Abu-El-Haija S, Perozzi B, Kapoor A, Alipourfard N, Lerman K, Harutyunyan H, Ver Steeg G, Galstyan A (2019) Mixhop: higher-order graph convolutional architectures via sparsified neighborhood mixing. In: International conference on machine learning, pp 21–29, https://doi.org/10.48550/arXiv.1905.00067
Ullah I, Manzo M, Shah M, Madden MG (2021) Graph convolutional networks: analysis, improvements and results. Appl Intell, 1–12. https://doi.org/10.1007/s10489-021-02973-4
Schlichtkrull M, Kipf TN, Bloem P, Van Den Berg R, Titov I, Welling M (2018) Modeling relational data with graph convolutional networks. In: European semantic web conference, pp 593–607. https://doi.org/10.1007/978-3-319-93417-4_38
Velickovic P, Cucurull G, Casanova A, Romero A, Liò P, Bengio Y (2018) Graph attention networks. In: 6th international conference on learning representations, ICLR 2018, vancouver, BC, Canada, April 30 – May 3, 2018, Conference Track Proceedings. https://doi.org/10.48550/arXiv.1710.10903
Sun Z, Wang C, Hu W, Chen M, Dai J, Zhang W, Qu Y (2020) Knowledge graph alignment network with gated multi-hop neighborhood aggregation. In: Proceedings of the AAAI conference on artificial intelligence, vol 34, pp 222–229. https://doi.org/10.48550/arXiv.1911.08936
Li C, Cao Y, Hou L, Shi J, Li J, Chua T-S (2019) Semi-supervised entity alignment via joint knowledge embedding model and cross-graph model. In: Proceedings of the 2019 conference on empirical methods in natural language processing and the 9th international joint conference on natural language processing (EMNLP-IJCNLP), pp 2723–2732. https://doi.org/10.18653/v1/D19-1274
Chen W, Chen X, Xiong S (2021) Global entity alignment with gated latent space neighborhood aggregation. In: China national conference on Chinese computational linguistics, pp 371–384. Springer. https://doi.org/10.1007/978-3-030-84186-7_25
Cao Y, Liu Z, Li C, Li J, Chua T-S (2019) Multi-channel graph neural network for entity alignment. In: Proceedings of the 57th annual meeting of the association for computational linguistics, pp 1452–1461. https://doi.org/10.18653/v1/P19-1140
Bhattacharya I, Getoor L (2007) Collective entity resolution in relational data. ACM Transactions on Knowledge Discovery from Data (TKDD) 1(1):5. https://doi.org/10.1145/1217299.1217304
Song D, Heflin J (2011) Automatically generating data linkages using a domain-independent candidate selection approach. In: International semantic web conference, pp 649–664. https://doi.org/10.1007/978-3-642-25073-6_41
Papadakis G, Alexiou G, Papastefanatos G, Koutrika G (2015) Schema-agnostic vs schema-based configurations for blocking methods on homogeneous data. Proc VLDB endowment 9(4):312–323. https://doi.org/10.14778/2856318.2856326
Cochinwala M, Kurien V, Lalk G, Shasha D (2001) Efficient data reconciliation. Inf Sci 137(1-4):1–15. https://doi.org/10.1016/S0020-0255(00)00070-0
Lu X, Wang L, Jiang Z, He S, Liu S (2021) Mmkrl: a robust embedding approach for multi-modal knowledge graph representation learning. Appl Intell, 1–18. https://doi.org/10.1007/s10489-021-02693-9
Chen M, Tian Y, Yang M, Zaniolo C (2017) Multilingual knowledge graph embeddings for cross-lingual knowledge alignment. In: Proceedings of the 26th international joint conference on artificial intelligence, pp 1511–1517. https://doi.org/10.24963/ijcai.2017/209
Sun M, Zhu H, Xie R, Liu Z (2017) Iterative entity alignment via joint knowledge embeddings [c]. In: International joint conference on artificial intelligence. AAAI Press. https://doi.org/10.24963/ijcai.2017/595
Sun Z, Hu W, Li C (2017) Cross-lingual entity alignment via joint attribute-preserving embedding. In: International semantic web conference, pp 628–644. https://doi.org/10.1007/978-3-319-68288-4_37
Sun Z, Hu W, Zhang Q, Qu Y (2018) Bootstrapping entity alignment with knowledge graph embedding. In: IJCAI, vol 18, pp 4396–4402. https://doi.org/10.24963/ijcai.2018/611
Song X., Zhang H., Bai L. (2021) Entity alignment between knowledge graphs using entity type matching. In: International conference on knowledge science, engineering and management, pp 578–589. Springer. https://doi.org/10.1007/978-3-030-82136-4_47
Lu G, Zhang L, Jin M, Li P, Huang X (2021) Entity alignment via knowledge embedding and type matching constraints for knowledge graph inference. Journal of Ambient Intelligence and Humanized Computing, 1–11, https://doi.org/10.1007/s12652-020-02821-2
Marcheggiani D, Titov I (2017) Encoding sentences with graph convolutional networks for semantic role labeling. In: EMNLP 2017: conference on empirical methods in natural language processing, pp 1506–1515. https://doi.org/10.18653/v1/D17-1159
Bastings J, Titov I, Aziz W, Marcheggiani D, Sima’an K (2017) Graph convolutional encoders for syntax-aware neural machine translation. In: Proceedings of the 2017 conference on empirical methods in natural language processing, pp 1957–1967. https://doi.org/10.18653/v1/D17-1209
Kipf T N, Welling M (2017) Semi-supervised classification with graph convolutional networks. In: 5th International conference on learning representations, ICLR 2017, Toulon, France, April 24–26, 2017, Conference track proceedings. https://doi.org/10.48550/arXiv.1609.02907
Wang Z, Lv Q, Lan X, Zhang Y (2018) Cross-lingual knowledge graph alignment via graph convolutional networks. In: Proceedings of the 2018 conference on empirical methods in natural language processing, pp 349–357. https://doi.org/10.18653/v1/D18-1032
Ye R, Li X, Fang Y, Zang H, Wang M (2019) A vectorized relational graph convolutional network for multi-relational network alignment. In: IJCAI, pp 4135–4141. https://doi.org/10.24963/ijcai.2019/574
Chen M, Tian Y, Chang K. -W., Skiena S, Zaniolo C (2018) Co-training embeddings of knowledge graphs and entity descriptions for cross-lingual entity alignment. In: Proceedings of the 27th international joint conference on artificial intelligence, pp 3998–4004. https://doi.org/10.24963/ijcai.2018/556
Trisedya B D, Qi J, Zhang R (2019) Entity alignment between knowledge graphs using attribute embeddings. In: Proceedings of the AAAI conference on artificial intelligence, vol 33, pp 297–304. https://doi.org/10.1609/aaai.v33i01.3301297
Zhang Q, Sun Z, Hu W, Chen M, Guo L, Qu Y (2019) Multi-view knowledge graph embedding for entity alignment. In: IJCAI. https://doi.org/10.24963/ijcai.2019/754
Peters M E, Neumann M, Iyyer M, Gardner M, Clark C, Lee K, Zettlemoyer L (2018) Deep contextualized word representations. In: Proceedings of the 2018 conference of the north american chapter of the association for computational linguistics: human language technologies, Volume 1 (Long Papers). https://doi.org/10.18653/v1/N18-1202
Lin X, Yang H, Wu J, Zhou C, Wang B (2019) Guiding cross-lingual entity alignment via adversarial knowledge embedding. In: 2019 IEEE International conference on data mining (ICDM), pp 429–438. https://doi.org/10.1109/ICDM.2019.00053
Pei S, Yu L, Hoehndorf R, Zhang X (2019) Semi-supervised entity alignment via knowledge graph embedding with awareness of degree difference. In: The world wide web conference, pp 3130–3136. https://doi.org/10.1145/3308558.3313646
Guo L, Sun Z, Hu W (2019) Learning to exploit long-term relational dependencies in knowledge graphs. In: International conference on machine learning, pp 2505–2514. https://doi.org/10.48550/arXiv.1905.04914
Duchi J, Hazan E, Singer Y (2011) Adaptive subgradient methods for online learning and stochastic optimization. J Mach Learn Res 12(7)
Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y (2014) Generative adversarial nets. Adv Neural Inf Process Syst, 27. https://doi.org/10.48550/arXiv.1406.2661
Friedman M (1940) A comparison of alternative tests of significance for the problem of m rankings. Ann Math Stat 11(1):86–92. https://doi.org/10.1214/aoms/1177731944
Wilcoxon F (1945) Individual comparison by ranking methods. Biometrics, 1
Demšar J (2006) Statistical comparisons of classifiers over multiple data sets. J Mach Learn Res 7:1–30. https://doi.org/10.1007/s10846-005-9016-2
Acknowledgements
This work is supported by grant from the Science and Technology Innovation Foundation of Dalian (2020JJ26GX035), the National Natural Science Foundation of China (No. 62076048).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Li, L., Dong, J. & Qin, X. Dual-view graph neural network with gating mechanism for entity alignment. Appl Intell 53, 18189–18204 (2023). https://doi.org/10.1007/s10489-022-04393-4
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10489-022-04393-4