Abstract
Deep neural networks, especially graph neural networks, have made great progress in aspect-based sentiment analysis. Knowledge graphs can provide rich auxiliary information for aspect-based sentiment analysis. However, existing models cannot effectively learn aspect-specific sentiment features from the review text and external knowledge. They cannot accurately select knowledge entities that are highly relevant to the aspect. They also ignore the semantic interaction between the review text and external knowledge. To address these issues, we propose a knowledge-enhanced interactive graph convolutional network (KE-IGCN). First, we introduce a subgraph construction strategy to construct a syntax-guided knowledge subgraph, which can guide KE-IGCN in selecting highly relevant knowledge entities. Second, we propose a knowledge interaction mechanism to exploit the semantic interaction between external knowledge and the review text. We then use multilayer graph convolutional networks to learn aspect-specific sentiment features from the review text and external knowledge jointly and interactively. We also use a multilevel feature fusion mechanism to aggregate aspect-specific sentiment features from semantic and syntactic information of the review and external knowledge. Experimental results on four public datasets demonstrate that KE-IGCN outperforms other state-of-the-art baseline models.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Data Availability
All the datasets gathered from other sources has been publicly available.
Human and Animal Ethics
Not Applicable
References
Cambria, E., Fu, J., Bisio, F., et al. (2015). Affectivespace 2: Enabling affective intuition for concept-level sentiment analysis. In: Proceedings of the AAAI conference on artificial intelligence, (Vol. 29). https://doi.org/10.1609/aaai.v29i1.9230.
Cambria, E., Poria, S., Hazarika, D., et al. (2018). Senticnet 5: Discovering conceptual primitives for sentiment analysis by means of context embeddings. In: Proceedings of the AAAI conference on artificial intelligence, (Vol. 32). https://doi.org/10.1609/aaai.v32i1.11559.
Chen, C., Teng, Z., Wang, Z., et al. (2022). Discrete opinion tree induction for aspect-based sentiment analysis. In: Proceedings of the 60th annual meeting of the association for computational linguistics (Vol. 1: Long Papers, pp. 2051–2064). https://doi.org/10.18653/v1/2022.acl-long.145.
Chen, F., & Huang, Y. (2019). Knowledge-enhanced neural networks for sentiment analysis of Chinese reviews. Neurocomputing, 368, 51–58. https://doi.org/10.1016/j.neucom.2019.08.054.
Chen, F., Yuan, Z., & Huang, Y. (2020). Multi-source data fusion for aspect-level sentiment classification. Knowledge-Based Systems, 187, 104831. https://doi.org/10.1016/j.knosys.2019.07.002.
Glorot, X., & Bengio, Y. (2010). Understanding the difficulty of training deep feedforward neural networks. In: Proceedings of the 13th international conference on artificial intelligence and statistics, (pp. 249–256). JMLR Workshop and Conference Proceedings.
Hou, X., Huang, J., Wang, G., et al. (2021). Selective attention based graph convolutional networks for aspect-level sentiment classification. In: Proceedings of the 15th workshop on graph-based methods for natural language processing (TextGraphs-15), (pp. 83–93). https://doi.org/10.18653/v1/2021.textgraphs-1.8.
Huang, B., & Carley, K.M. (2019). Syntax-aware aspect level sentiment classification with graph attention networks. In: Proceedings of the 2019 conference on empirical methods in natural language processing and the 9th international joint conference on natural language processing (EMNLP-IJCNLP), (pp. 5469–5477). https://doi.org/10.48550/arXiv.1909.02606.
Kingma, D.P., & Ba, J. (2014). Adam: A method for stochastic optimization. arXiv:1412.6980.
Li, Y., Sun, X., & Wang, M. (2021). Embedding extra knowledge and a dependency tree based on a graph attention network for aspect-based sentiment analysis. In: 2021 international joint conference on neural networks (IJCNN), (pp. 1–8). IEEE. https://doi.org/10.1109/IJCNN52387.2021.9533695.
Ma, D., Li, S., Zhang, X., et al. (2017). Interactive attention networks for aspect-level sentiment classification. arXiv:1709.00893. Accessed 20 July 2019.
Pontiki, M., Galanis, D., Papageorgiou, H., et al (2016). Semeval-2016 task 5: Aspect based sentiment analysis. In: Proceedings of the 10th international workshop on semantic evaluation (SemEval 2016), (pp. 19–30). https://doi.org/10.18653/v1/S16-1002.
Pontiki, M., Galanis, D., Papageorgiou, H., et al. (2015). Semeval-2015 task 12: Aspect based sentiment analysis. In: Proceedings of the 9th international workshop on semantic evaluation (SemEval 2015), (pp. 486–495). https://doi.org/10.18653/v1/S15-2082.
Pontiki, M., Papageorgiou, H., Galanis, D., et al. (2014). Semeval-2014 task 4: Aspect based sentiment analysis. SemEval, 2014, 27. https://doi.org/10.3115/v1/S14-2004.
Ramaswamy, S. L., & Chinnappan, J. (2022). Recognet-lstm+cnn: a hybrid network with attention mechanism for aspect categorization and sentiment classification. Journal of Intelligent Information Systems, 58(2), 379–404. https://doi.org/10.1007/s10844-021-00692-3.
Shuang, K., Ren, X., Yang, Q., et al. (2019). Aela-dlstms: attention-enabled and location-aware double LSTMS for aspect-level sentiment classification. Neurocomputing, 334, 25–34. https://doi.org/10.1016/j.neucom.2018.11.084.
Shuang, K., Gu, M., Li, R., et al. (2021). Interactive pos-aware network for aspect-level sentiment classification. Neurocomputing, 420, 181–196. https://doi.org/10.1016/j.neucom.2020.08.013.
Song, M., Park, H., & Shin, K.-S. (2019b). Attention-based long short-term memory network using sentiment lexicon embedding for aspect-level sentiment analysis in Korean. Information Processing & Management, 56(3), 637–653. https://doi.org/10.1016/j.ipm.2018.12.005.
Song, Y., Wang, J., Jiang, T., et al. (2019a). Targeted sentiment classification with attentional encoder network. In: International conference on artificial neural networks, (pp. 93–103). Springer. https://doi.org/10.1007/978-3-030-30490-4_9.
Song, W., Wen, Z., Xiao, Z., et al. (2021). Semantics perception and refinement network for aspect-based sentiment analysis. Knowledge-Based Systems, 214, 106755. https://doi.org/10.1016/j.knosys.2021.106755.
Sun, K., Zhang, R., Mensah, S., et al. (2019). Aspect-level sentiment analysis via convolution over dependency tree. In: Proceedings of the 2019 conference on empirical methods in natural language processing and the 9th international joint conference on natural language processing (EMNLP-IJCNLP), (pp. 5679–5688). https://doi.org/10.18653/v1/D19-1569.
Tang, H., Ji, D., Li, C., et al. (2020). Dependency graph enhanced dual-transformer structure for aspect-based sentiment classification. In: Proceedings of the 58th annual meeting of the association for computational linguistics, (pp. 6578–6588). https://doi.org/10.18653/v1/2020.acl-main.588.
Tang, D., Qin, B., & Liu, T. (2016). Aspect level sentiment classification with deep memory network. In: Proceedings of the 2016 conference on empirical methods in natural language processing, (pp. 214–224). https://doi.org/10.48550/arXiv.1605.08900.
Vaswani, A., Shazeer, N., Parmar, N., et al (2017). Attention is all you need. Advances in Neural Information Processing Systems, 30.
Wang, K., Shen, W., Yang, Y., et al. (2020). Relational graph attention network for aspect-based sentiment analysis. In: Proceedings of the 58th annual meeting of the association for computational linguistics, (pp. 3229–3238). https://doi.org/10.18653/v1/2020.acl-main.295.
Wang, X., Tang, M., Yang, T., et al. (2021). A novel network with multiple attention mechanisms for aspect-level sentiment analysis. Knowledge-Based Systems, 227, 107196. https://doi.org/10.1016/j.knosys.2021.107196.
Wu, D., Yang, R., & Shen, C. (2021). Sentiment word co-occurrence and knowledge pair feature extraction based LDA short text clustering algorithm. Journal of Intelligent Information Systems, 56(1), 1–23. https://doi.org/10.1007/s10844-020-00597-7.
Wu, C., Xiong, Q., Yang, Z., et al. (2021). Residual attention and other aspects module for aspect-based sentiment analysis. Neurocomputing, 435, 42–52. https://doi.org/10.1016/j.neucom.2021.01.019.
Xiao, L., Xue, Y., Wang, H., et al. (2022). Exploring fine-grained syntactic information for aspect-based sentiment classification with dual graph neural networks. Neurocomputing, 471, 48–59. https://doi.org/10.1016/j.neucom.2021.10.091.
Xu, M., Zeng, B., Yang, H., et al. (2022). Combining dynamic local context focus and dependency cluster attention for aspect-level sentiment classification. Neurocomputing, 478, 49–69. https://doi.org/10.1016/j.neucom.2021.12.084.
Xue, W., & Li, T. (2018). Aspect based sentiment analysis with gated convolutional networks. In: Proceedings of the 56th annual meeting of the association for computational linguistics, (Vol. 1: Long Papers pp. 2514–2523). https://doi.org/10.48550/arXiv.1805.07043.
Yan, X., Jian, F., & Sun, B. (2021). Sakg-bert: Enabling language representation with knowledge graphs for Chinese sentiment analysis. IEEE Access, 9, 101695–101701. https://doi.org/10.1109/ACCESS.2021.3098180.
Zeng, J., Liu, T., Jia, W., et al. (2022). Relation construction for aspect-level sentiment classification. Information Sciences, 586, 209–223. https://doi.org/10.1016/j.ins.2021.11.081.
Zhang, C., Li, Q., & Song, D. (2019). Aspect-based sentiment classification with aspect-specific graph convolutional networks. arXiv:1909.03477.
Zhang, D., Zhu, Z., Kang, S., et al. (2021). Syntactic and semantic analysis network for aspect-level sentiment classification. Applied Intelligence, 51(8), 6136–6147. https://doi.org/10.1007/s10489-021-02189-6.
Zhang, Y., Ding, Q., Zhu, Z., et al. (2022). Enhancing aspect and opinion terms semantic relation for aspect sentiment triplet extraction. Journal of Intelligent Information Systems, 1–20. https://doi.org/10.1007/s10844-022-00710-y.
Zhao, A., & Yu, Y. (2021). Knowledge-enabled bert for aspect-based sentiment analysis. Knowledge-Based Systems, 227, 107220. https://doi.org/10.1016/j.knosys.2021.107220.
Zhao, P., Hou, L., & Wu, O. (2020). Modeling sentiment dependencies with graph convolutional networks for aspect-level sentiment classification. Knowledge-Based Systems, 193, 105443. https://doi.org/10.1016/j.knosys.2019.105443.
Zhou, J., Huang, J. X., Hu, Q. V., et al. (2020). Sk-gcn: Modeling syntax and knowledge via graph convolutional network for aspect-level sentiment classification. Knowledge-Based Systems, 205, 106292. https://doi.org/10.1016/j.knosys.2020.106292.
Acknowledgements
This work was supported in part by the National Natural Science Foundation of China under Grant 61672158, 61972097 and U21A20472, in part by the Major Science and Technology project of Fujian Province (China) under Granted No. 2021HZ022007, in part by the Industry-Academy Cooperation Project under Grant 2021H6022, in part by the Natural Science Foundation of Fujian Province under Grant 2020J01494.
Funding
This work was supported in part by the National Natural Science Foundation of China under Grant 61672158, 61972097 and U21A20472, in part by the Major Science and Technology project of Fujian Province (China) under Granted No. 2021HZ022007, in part by the Industry-Academy Cooperation Project under Grant 2021H6022, in part by the Natural Science Foundation of Fujian Province under Grant 2020J01494.
Author information
Authors and Affiliations
Contributions
Wan Yujie: Conceptualization, Methodology, Software, Investigation, Formal Analysis, Writing - Original Draft; Chen Yuzhong: Conceptualization, Funding Acquisition, Resources, Supervision, Writing - Review and Editing; Shi Liyuan: Data Curation, Writing - Original Draft; Liu Lvmin: Visualization, Investigation, Software, Validation. All authors reviewed the manuscript.
Corresponding author
Ethics declarations
Ethical Approval and Consent to participate
Not Applicable
Consent for publication
Not Applicable
Competing interests
The authors declare that there are no competing interests with anybody or any institution regarding the publication of this paper.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Wan, Y., Chen, Y., Shi, L. et al. A knowledge-enhanced interactive graph convolutional network for aspect-based sentiment analysis. J Intell Inf Syst 61, 343–365 (2023). https://doi.org/10.1007/s10844-022-00761-1
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10844-022-00761-1