Abstract
Aspect-based sentiment analysis (ABSA) is a fast-growing research area in natural language processing (NLP) that provides more fine-grained information, considering the aspect as the fundamental item. The ABSA primarily measures sentiment towards a given aspect, but does not quantify the intensity of that sentiment. For example, intensity of positive sentiment expressed for service in service is good is comparatively weaker than in service is excellent. Thus, aspect sentiment intensity will assist the stakeholders in mining user preferences more precisely. Our current work introduces a novel task called aspect based sentiment intensity analysis (ABSIA) that facilitates research in this direction. An annotated review corpus for ABSIA is introduced by labelling the benchmark SemEval ABSA restaurant dataset with the seven (7) classes in a semi-supervised way. To demonstrate the effective usage of corpus, we cast ABSIA as a natural language generation task, where a natural sentence is generated to represent the output in order to utilize the pre-trained language models effectively. Further, we propose an effective technique for the joint learning where ABSA is used as a secondary task to assist the primary task, i.e. ABSIA. An improvement of 2 points is observed over the single task intensity model. To explain the actual decision process of the proposed framework, model explainability technique is employed that extracts the important opinion terms responsible for generation (Source code and the dataset has been made available on https://www.iitp.ac.in/~ai-nlp-ml/resources.html#ABSIA, https://github.com/20118/ABSIA)
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
References
Akhtar, M.D., Ekbal, A., Bhattacharyya, P.: Aspect Based Sentiment Analysis: Category Detection and Sentiment Classification for Hindi. In: Gelbukh, A. (ed.) CICLing 2016. LNCS, vol. 9624, pp. 246–257. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-75487-1_19
Akhtar, M.S., Ekbal, A., Bhattacharyya, P.: Aspect based sentiment analysis in Hindi: resource creation and evaluation. In: Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC’16), pp. 2703–2709 (2016)
Akhtar, M.S., Kumar, A., Ekbal, A., Bhattacharyya, P.: A hybrid deep learning architecture for sentiment analysis. In: Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics, Tech. Pap, pp. 482–493 (2016)
Chen, P., Sun, Z., Bing, L., Yang, W.: Recurrent attention network on memory for aspect sentiment analysis. In: Proceedings of the 2017 conference on empirical methods in natural language processing, pp. 452–461 (2017)
Cheng, J., Zhao, S., Zhang, J., King, I., Zhang, X., Wang, H.: Aspect-level sentiment classification with heat (hierarchical attention) network. In: Proceedings of the 2017 ACM on Conference on Information and Knowledge Management, pp. 97–106 (2017)
Daza, A., Frank, A.: A sequence-to-sequence model for semantic role labeling. arXiv preprint arXiv:1807.03006 (2018)
Devlin, J., Chang, M.W., Lee, K., Toutanova, K.: Bert: pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018)
Jiang, Q., Chen, L., Xu, R., Ao, X., Yang, M.: A challenge dataset and effective models for aspect-based sentiment analysis. In: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pp. 6280–6285 (2019)
Kingma, D.P., Ba, J.: Adam: A method for stochastic optimization. In: Bengio, Y., LeCun, Y. (eds.) 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7–9, 2015, Conference Track Proceedings (2015). https://arxiv.org/abs/1412.6980
Kumar, S., De, K., Roy, P.P.: Movie recommendation system using sentiment analysis from microblogging data. IEEE Trans. Comput. Soc. Syst. 7(4), 915–923 (2020)
Lei, Z., Yang, Y., Yang, M., Zhao, W., Guo, J., Liu, Y.: A human-like semantic cognition network for aspect-level sentiment classification. In: Proceedings of the AAAI Conference on Artificial Intelligence. vol. 33, pp. 6650–6657 (2019)
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., Zettlemoyer, L.: BART: denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Assoc. Comput. Linguist, pp. 7871–7880. (2020). 10.18653/v1/2020.acl-main.703. https://aclanthology.org/2020.acl-main.703
Li, R., Chen, H., Feng, F., Ma, Z., Wang, X., Hovy, E.: Dual graph convolutional networks for aspect-based sentiment analysis. In: Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Long Papers). 1 pp. 6319–6329. Assoc. Comput. Linguist. (2021). 10.18653/v1/2021.acl-long.494. https://aclanthology.org/2021.acl-long.494
Li, X., et al.: Entity-relation extraction as multi-turn question answering. arXiv preprint arXiv:1905.05529 (2019)
Liu, J., Teng, Z., Cui, L., Liu, H., Zhang, Y.: Solving aspect category sentiment analysis as a text generation task. In: Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing. Assoc. Comput. Linguist. Punta Cana, Dominican Republic , pp. 4406–4416(2021). 10.18653/v1/2021.emnlp-main.361, https://aclanthology.org/2021.emnlp-main.361
Lundberg, S.M., Lee, S.I.: A unified approach to interpreting model predictions. In: Proceedings of the 31st international conference on neural information processing systems, pp. 4768–4777 (2017)
Ma, D., Li, S., Zhang, X., Wang, H.: Interactive attention networks for aspect-level sentiment classification. arXiv preprint arXiv:1709.00893 (2017)
Maia, M., et al.: Www’18 open challenge: financial opinion mining and question answering. In: Companion proceedings of the the web conference 2018, pp. 1941–1942 (2018)
Majumder, N., Poria, S., Gelbukh, A., Akhtar, M.S., Cambria, E., Ekbal, A.: Iarm: Inter-aspect relation modeling with memory networks in aspect-based sentiment analysis. In: Proceedings of the 2018 conference on empirical methods in natural language processing, pp. 3402–3411 (2018)
Mamta, Ekbal, A., Bhattacharyya, P.: Exploring multi-lingual, multi-task and adversarial learning for low-resource sentiment analysis. Transactions on Asian and Low-Resource Language Information Processing (2022)
Mamta, Ekbal, A., Bhattacharyya, P., Srivastava, S., Kumar, A., Saha, T.: Multi-domain tweet corpora for sentiment analysis: Resource creation and evaluation. In: Calzolari, N., et al., (eds.) Proceedings of The 12th Language Resources and Evaluation Conference, LREC 2020, Marseille, France, May 11–16, 2020, European Lang. Resour. Assoc, pp. 5046–5054. (2020). https://aclanthology.org/2020.lrec-1.621/
Meena, A., Prabhakar, T.V.: Sentence Level Sentiment Analysis in the Presence of Conjuncts Using Linguistic Analysis. In: Amati, G., Carpineto, C., Romano, G. (eds.) ECIR 2007. LNCS, vol. 4425, pp. 573–580. Springer, Heidelberg (2007). https://doi.org/10.1007/978-3-540-71496-5_53
Mohammad, S., Bravo-Marquez, F., Salameh, M., Kiritchenko, S.: SemEval-2018 task 1: Affect in tweets. In: Proceedings of The 12th International Workshop on Semantic Evaluation. Assoc. Comput. Linguist. New Orleans, Louisiana, pp. 1–17. (2018). 10.18653/v1/S18-1001. https://aclanthology.org/S18-1001
Mudalige, C.R et al.: SIGMALAW-ABSA: Dataset for aspect-based sentiment analysis in legal opinion texts. In: 2020 IEEE 15th International Conference on Industrial and Information Systems (ICIIS), pp. 488–493. IEEE (2020)
Oh, S., Lee, D., Whang, T., Park, I., Gaeun, S., Kim, E., Kim, H.: Deep context- and relation-aware learning for aspect-based sentiment analysis. In: Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Short Papers) 2, pp. 495–503. Assoc. Comput. Linguist. (Aug 2021). 10.18653/v1/2021.acl-short.63, https://aclanthology.org/2021.acl-short.63
Pontiki, M., et al.: Semeval-2016 task 5: Aspect based sentiment analysis. In: International workshop on semantic evaluation, pp. 19–30 (2016)
Pontiki, M., Galanis, D., Papageorgiou, H., Manandhar, S., Androutsopoulos, I.: Semeval-2015 task 12: Aspect based sentiment analysis. In: Proceedings of the 9th international workshop on semantic evaluation (SemEval 2015), pp. 486–495 (2015)
Pontiki, M., Galanis, D., Pavlopoulos, J., Papageorgiou, H., Androutsopoulos, I., Manandhar, S.: Semeval-2014 task 4: Aspect based sentiment analysis. In: Nakov, P., Zesch, T. (eds.) Proceedings of the 8th International Workshop on Semantic Evaluation, SemEval@COLING 2014, Dublin, Ireland, August 23–24, 2014, Assoc. Comput. Linguist, pp. 27–35. (2014). https://doi.org/10.3115/v1/s14-2004,https://doi.org/10.3115/v1/s14-2004
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., Liu, P.J., et al.: Exploring the limits of transfer learning with a unified text-to-text transformer. J. Mach. Learn. Res. 21(140), 1–67 (2020)
Román, J.V., Cámara, E.M., Morera, J.G., Zafra, S.M.J.: Tass 2014-the challenge of aspect-based sentiment analysis. Procesamiento del Lenguaje Natural 54, 61–68 (2015)
Socher, R., et al.: Recursive deep models for semantic compositionality over a sentiment treebank. In: Proceedings of the 2013 conference on empirical methods in natural language processing, pp. 1631–1642 (2013)
Spitzer, R.L., Cohen, J., Fleiss, J.L., Endicott, J.: Quantification of agreement in psychiatric diagnosis: A new approach. Arch. Gen. Psychiatry 17(1), 83–87 (1967)
Štrumbelj, E., Kononenko, I.: Explaining prediction models and individual predictions with feature contributions. Knowl. Inf. syst. 41(3), 647–665 (2014)
Tang, D., Qin, B., Feng, X., Liu, T.: Effective lSTMs for target-dependent sentiment classification. arXiv preprint arXiv:1512.01100 (2015)
Tian, H., et al.: Skep: Sentiment knowledge enhanced pre-training for sentiment analysis. arXiv preprint arXiv:2005.05635 (2020)
Tian, L., Lai, C., Moore, J.D.: Polarity and intensity: the two aspects of sentiment analysis. arXiv preprint arXiv:1807.01466 (2018)
Wang, W., Pan, S.J.: Recursive neural structural correspondence network for cross-domain aspect and opinion co-extraction. In: Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Long Papers) 1, pp. 2171–2181 (2018)
Wang, Y., Huang, M., Zhu, X., Zhao, L.: Attention-based LSTM for aspect-level sentiment classification. In: Proceedings of the 2016 conference on empirical methods in natural language processing, pp. 606–615 (2016)
Wojatzki, M., Ruppert, E., Holschneider, S., Zesch, T., Biemann, C.: Germeval 2017: Shared task on aspect-based sentiment in social media customer feedback. Proceedings of the GermEval, pp. 1–12 (2017)
Xu, H., Liu, B., Shu, L., Yu, P.S.: Bert post-training for review reading comprehension and aspect-based sentiment analysis. arXiv preprint arXiv:1904.02232 (2019)
Yan, H., Dai, J., Ji, T., Qiu, X., Zhang, Z.: A unified generative framework for aspect-based sentiment analysis. In: Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Long Papers) 1, pp. 2416–2429. Assoc. Comput. Linguist. (2021). 10.18653/v1/2021.acl-long.188, https://aclanthology.org/2021.acl-long.188
Yang, M., Jiang, Q., Shen, Y., Wu, Q., Zhao, Z., Zhou, W.: Hierarchical human-like strategy for aspect-level sentiment classification with sentiment linguistic knowledge and reinforcement learning. Neural Networks 117, 240–248 (2019)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Mamta, Ekbal, A. (2023). Service Is Good, Very Good or Excellent? Towards Aspect Based Sentiment Intensity Analysis. In: Kamps, J., et al. Advances in Information Retrieval. ECIR 2023. Lecture Notes in Computer Science, vol 13980. Springer, Cham. https://doi.org/10.1007/978-3-031-28244-7_43
Download citation
DOI: https://doi.org/10.1007/978-3-031-28244-7_43
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-28243-0
Online ISBN: 978-3-031-28244-7
eBook Packages: Computer ScienceComputer Science (R0)