Skip to main content
SpringerLink
Log in

Aspect-location attention networks for aspect-category sentiment analysis in social media

  • Published:
Journal of Intelligent Information Systems Aims and scope Submit manuscript

Abstract

As a fine-grained sentiment analysis, aspect-category sentiment classification aims to explore the implicit aspect information in text and analyze its sentiment polarity. When researching review data in social media, this task can often gain insight into the specific needs of users for a certain aspect of products, which is of great significance for commercial companies to improve their products. However, most aspect-level sentiment analysis targets aspect objects that appear directly in the text, which is limited in many scenarios. Furthermore, existing methods for aspect-category sentiment analysis rarely focus on the implicit location of aspect-category information in the context. To this end, the concept of Aspect-Location Attention Networks (ALAN) is proposed to integrate aspect-specific sentiment features for sentiment classification. In ALAN, a novel module is designed to differentially integrate aspect-category information into various locations of the context. The proposed models and their ablation models have been evaluated on three publicly available social review datasets, including two in English and one in Chinese. The experimental results show that ALAN and its variants outperform compared baseline models in terms of accuracy and macro F1-score.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

Data Availability

The datasets and the code used in the current study are available from https://github.com/Yflyfly/ALAN. All the datasets gathered from other sources has been publicly available.

Notes

  1. https://s3.amazonaws.com/dl4j-distribution/GoogleNews-vectors-negative300.bin.gz

  2. https://github.com/Embedding/Chinese-Word-Vectors

  3. https://huggingface.co/bert-base-uncased

  4. https://huggingface.co/bert-base-chinese

  5. https://github.com/google-research/bert

References

  • Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., Isard, M., & et al. (2016). Tensorflow: a system for large-scale machine learning. In 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI 16). https://doi.org/10.48550/arXiv.1605.08695 (pp. 265–283).

  • Al-Smadi, M., Qawasmeh, O., Al-Ayyoub, M., Jararweh, Y., & Gupta, B. (2017). Deep recurrent neural network vs. support vector machine for aspect-based sentiment analysis of arabic hotels’ reviews. International Journal of Computational Science and Engineering. https://doi.org/10.1016/j.jocs.2017.11.006.

  • Bahdanau, D., Cho, K.H., & Bengio, Y. (2015). Neural machine translation by jointly learning to align and translate. In 3rd International conference on learning representations. https://doi.org/10.48550/arXiv.1409.0473.

  • Berka, P. (2020). Sentiment analysis using rule-based and case-based reasoning. Journal of Intelligent Information Systems, 55(1), 51–66. https://doi.org/10.1007/s10844-019-00591-8.

    Article  Google Scholar 

  • Bu, J., Ren, L., Zheng, S., Yang, Y., Wang, J., Zhang, F., & Wu, W. (2021). Asap: a chinese review dataset towards aspect category sentiment analysis and rating prediction. In Proceedings of the 2021 conference of the North American chapter of the association for computational linguistics: human language technologies. https://doi.org/10.18653/v1/2021.naacl-main.167 (pp. 2069–2079).

  • Cambria, E. (2016). Affective computing and sentiment analysis. IEEE Intelligent Systems, 31(2), 102–107. https://doi.org/10.1109/MIS.2016.31.

    Article  Google Scholar 

  • Chen, Z., Cao, Y., Lu, X., Mei, Q., & Liu, X. (2019). Sentimoji: an emoji-powered learning approach for sentiment analysis in software engineering. In Proceedings of the 2019 27th ACM joint meeting on european software engineering conference and symposium on the foundations of software engineering. https://doi.org/10.1145/3338906.3338977 (pp. 841–852).

  • Chung, J., Gulcehre, C., Cho, K., & Bengio, Y. (2014). Empirical evaluation of gated recurrent neural networks on sequence modeling. In NIPS 2014 Workshop on deep learning. https://doi.org/10.48550/arXiv.1412.3555.

  • Colbrook, M.J., Antun, V., & Hansen, A.C. (2022). The difficulty of computing stable and accurate neural networks: On the barriers of deep learning and smale’s 18th problem. Proceedings of the National Academy of Sciences, 119(12), 2107151119. https://doi.org/10.1073/pnas.2107151119.

    Article  MathSciNet  Google Scholar 

  • Dai, J., Yan, H., Sun, T., Liu, P., & Qiu, X. (2021). Does syntax matter? A strong baseline for aspect-based sentiment analysis with roberta. In Proceedings of the 2021 conference of the North American chapter of the association for computational linguistics: human language technologies. https://doi.org/10.18653/v1/2021.naacl-main.146 (pp. 1816–1829).

  • Dietterich, T.G. (1998). Approximate statistical tests for comparing supervised classification learning algorithms. Neural Computation, 10(7), 1895–1923. https://doi.org/10.1162/089976698300017197.

    Article  Google Scholar 

  • Fei, H., Li, J., Ren, Y., Zhang, M., & Ji, D. (2022). Making decision like human: joint aspect category sentiment analysis and rating prediction with fine-to-coarse reasoning. In Proceedings of the ACM web conference 2022. https://doi.org/10.1145/3485447.3512024 (pp. 3042–3051).

  • Gao, Z., Feng, A., Song, X., & Wu, X. (2019). Target-dependent sentiment classification with bert. IEEE Access, 7, 154290–154299. https://doi.org/10.1109/ACCESS.2019.2946594.

    Article  Google Scholar 

  • Geed, K., Frasincar, F., & Truçsǎ, M.M. (2022). Explaining a deep neural model with hierarchical attention for aspect-based sentiment classification using diagnostic classifiers. In International conference on web engineering (pp. 268–282). https://doi.org/10.1007/978-3-031-09917-5_18.

  • Hermann, K.M., Kočiskỳ, T., Grefenstette, E., Espeholt, L., Kay, W., Suleyman, M., & Blunsom, P. (2015). Teaching machines to read and comprehend. In Proceedings of the 28th international conference on neural information processing systems (pp. 1693–1701). https://doi.org/10.48550/arXiv.1506.03340.

  • Hochreiter, S., Urgen Schmidhuber, J., & Elvezia, C. (1997). Long short-term memory. Neural Computation, 9(8), 1735–1780. https://doi.org/10.1162/neco.1997.9.8.1735.

    Article  Google Scholar 

  • Karagoz, P., Kama, B., Ozturk, M., Toroslu, I.H., & Canturk, D. (2019). A framework for aspect based sentiment analysis on turkish informal texts. Journal of Intelligent Information Systems, 53(3), 431–451. https://doi.org/10.1007/s10844-019-00565-w.

    Article  Google Scholar 

  • Kenton, J.D.M.-W.C., & Toutanova, L.K. (2019). Bert: pre-training of deep bidirectional transformers for language understanding. In Proceedings of NAACL-HLT (pp. 4171–4186). https://doi.org/10.48550/arXiv.1810.04805.

  • Kim, Y. (2014). Convolutional neural networks for sentence classification. In Proceedings of the 2014 conference on empirical methods in natural language processing. https://doi.org/10.3115/v1/D14-1181https://doi.org/10.3115/v1/D14-1181(pp. 1746–1751).

  • Li, S., Zhao, Z., Hu, R., Li, W., Liu, T., & Du, X. (2018). Analogical reasoning on chinese morphological and semantic relations. In Proceedings of the 56th annual meeting of the association for computational linguistics (volume 2: short papers) (pp. 138–143), DOI https://doi.org/10.18653/v1/P18-2023, (to appear in print).

  • Liang, B., Li, X., Gui, L., Fu, Y., He, Y., Yang, M., & Xu, R. (2022). Few-shot aspect category sentiment analysis via meta-learning. ACM Transactions on Information Systems (TOIS). https://doi.org/10.1145/3529954.

  • Liang, B., Su, H., Yin, R., Gui, L., Yang, M., Zhao, Q., Yu, X., & Xu, R. (2021). Beta distribution guided aspect-aware graph for aspect category sentiment analysis with affective knowledge. In Proceedings of the 2021 conference on empirical methods in natural language processing (pp. 208–218). https://doi.org/10.18653/v1/2021.emnlp-main.19.

  • Liu, J., Teng, Z., Cui, L., Liu, H., & Zhang, Y. (2021). Solving aspect category sentiment analysis as a text generation task. In Proceedings of the 2021 conference on empirical methods in natural language processing (pp. 4406–4416). https://doi.org/10.18653/v1/2021.emnlp-main.361.

  • Ma, D., Li, S., Zhang, X., & Wang, H. (2017). Interactive attention networks for aspect-level sentiment classification. In Proceedings of the 26th international joint conference on artificial intelligence. https://doi.org/10.24963/ijcai.2017/568 (pp. 4068–4074).

  • Manandhar, S. (2014). Semeval-2014 task 4: aspect based sentiment analysis. In Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014) (pp. 27–35). https://doi.org/10.3115/v1/S14-2004.

  • Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013). Efficient estimation of word representations in vector space. In Proc. Int. Conf.Learn. Representations. https://doi.org/10.48550/arXiv.1301.3781 (pp. 1–12).

  • Ozyurt, B., & Akcayol, M.A. (2021). A new topic modeling based approach for aspect extraction in aspect based sentiment analysis: Ss-lda. Expert Systems with Applications, 168, 114231. https://doi.org/10.1016/j.eswa.2020.114231.

    Article  Google Scholar 

  • Pennington, J., Socher, R., & Manning, C.D. (2014). Glove: global vectors for word representation. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP). https://doi.org/10.3115/v1/D14-1162 (pp. 1532–1543).

  • Pontiki, M., Galanis, D., Papageorgiou, H., Androutsopoulos, I., Manandhar, S., Al-Smadi, M., Al-Ayyoub, M., Zhao, Y., Qin, B., De Clercq, O., & et al. (2016). Semeval-2016 task 5: aspect based sentiment analysis. In Proceedings of the 10th International Workshop on Semantic Evaluation (SemEval 2016) (pp. 19–30). https://doi.org/10.18653/v1/S16-1002.

  • Pontiki, M., Galanis, D., Papageorgiou, H., Manandhar, S., & Androutsopoulos, I. (2015). Semeval-2015 task 12: aspect based sentiment analysis. In Proceedings of the 9th International Workshop on Semantic Evaluation (SemEval 2015) (pp. 486–495). https://doi.org/10.18653/v1/S15-2082.

  • Qiu, Y., Li, H., Li, S., Jiang, Y., Hu, R., & Yang, L. (2018). Revisiting correlations between intrinsic and extrinsic evaluations of word embeddings. In Chinese computational linguistics and natural language processing based on naturally annotated big data (pp. 209–221), DOI https://doi.org/10.1007/978-3-030-01716-3_18.

  • Ramaswamy, S.L., & Chinnappan, J. (2022). Recognet-lstm+cnn: a hybrid network with attention mechanism for aspect categorization and sentiment classification. Journal of Intelligent Information Systems, 58, 379–404. https://doi.org/10.1007/s10844-021-00692-3.

    Article  Google Scholar 

  • Singh, V., Piryani, R., Uddin, A., & Waila, P. (2013). Sentiment analysis of movie reviews: a new feature-based heuristic for aspect-level sentiment classification. In 2013 International mutli-conference on automation, computing, communication, control and compressed sensing (iMac4s) (pp. 712–717). https://doi.org/10.1109/iMac4s.2013.6526500.

  • Singh, L.G., & Singh, S.R. (2021). Empirical study of sentiment analysis tools and techniques on societal topics. Journal of Intelligent Information Systems, 56(2), 379–407. https://doi.org/10.1007/s10844-020-00616-7.

    Article  Google Scholar 

  • Tang, D., Qin, B., Feng, X., & Liu, T. (2016). Effective lstms for target-dependent sentiment classification. In Proceedings of COLING 2016, the 26th international conference on computational linguistics: technical papers. https://doi.org/10.48550/arXiv.1512.01100 (pp. 3298–3307).

  • Tripathy, A., Agrawal, A., & Rath, S.K. (2016). Classification of sentiment reviews using n-gram machine learning approach. Expert Systems with Applications, 57, 117–126. https://doi.org/10.1016/j.eswa.2016.03.028.

    Article  Google Scholar 

  • Varghese, R., & Jayasree, M. (2013). Aspect based sentiment analysis using support vector machine classifier. In 2013 International Conference on Advances in Computing, Communications and Informatics (ICACCI). https://doi.org/10.1109/ICACCI.2013.6637416 (pp. 1581–1586).

  • Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, Ł, & Polosukhin, I (2017). Attention is all you need. Advances in Neural Information Processing Systems, 30, 5998–6008. https://doi.org/10.48550/arXiv.1706.03762.

    Google Scholar 

  • Wang, Y., Huang, M., Zhu, X., & Zhao, L. (2016). Attention-based lstm for aspect-level sentiment classification. In Proceedings of the 2016 conference on empirical methods in natural language processing. (pp. 606–615) https://doi.org/10.18653/v1/D16-1058.

  • Xiao, L., Hu, X., Chen, Y., Xue, Y., Chen, B., Gu, D., & Tang, B. (2020). Multi-head self-attention based gated graph convolutional networks for aspect-based sentiment classification. Multimedia Tools and Applications, 1–20. https://doi.org/10.1007/s11042-020-10107-0.

  • Xu, H., Liu, B., Shu, L., & Yu, P.S. (2019). Bert post-training for review reading comprehension and aspect-based sentiment analysis. In Proceedings of NAACL-HLT (pp. 2324–2335). https://doi.org/10.18653/v1/N19-1242.

  • Xue, W., & Li, T. (2018). Aspect based sentiment analysis with gated convolutional networks. In Proceedings of the 56th annual meeting of the association for computational linguistics (volume 1: long papers)(pp. 2514–2523). https://doi.org/10.18653/v1/P18-1234.

  • Zhu, L., Zhu, X., Guo, J., & Dietze, S. (2022). Exploring rich structure information for aspect-based sentiment classification. Journal of Intelligent Information Systems. https://doi.org/10.1007/s10844-022-00729-1.

Download references

Acknowledgements

This work was jointly supported by National Natural Science Foundation of China under Grants (No. 61672022 and No. U1904186), Research Project of Shanghai Graduate Education Association under Grants (ShsgeG202207).

Author information

Authors and Affiliations

  1. School of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, Nanjing, 211106, China

    Pengfei Yu, Wenan Tan, Weinan Niu & Bing Shi

  2. School of Computer and Information Engineering, Shanghai Polytechnic University, Shanghai, 201209, China

    Wenan Tan

Authors
  1. Pengfei Yu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Wenan Tan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Weinan Niu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Bing Shi
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Pengfei Yu: Conceptualization, Methodology, Validation, Writing - original draft, Writing - review & editing. Wenan Tan: Conceptualization, Methodology, Writing - review & editing, Supervision. Weinan Niu: Conceptualization, Methodology. Bing Shi: Writing - review & editing, Supervision.

Corresponding author

Correspondence to Wenan Tan.

Ethics declarations

Consent for Publication

Submissions have not been previously published and all co-authors agree to publish.

Competing interests

The authors declare that there is no conflict of interest with anybody or any institution regarding the publication of this paper.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yu, P., Tan, W., Niu, W. et al. Aspect-location attention networks for aspect-category sentiment analysis in social media. J Intell Inf Syst 61, 395–419 (2023). https://doi.org/10.1007/s10844-022-00760-2

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10844-022-00760-2

Keywords

Search

Navigation