Abstract
Aspect level sentiment analysis (ALSA) is a fine-grained task in sentiment analysis. It classifies the different polarities (positive, negative) for the specific aspects of each review. In general, document and sentence level sentiment analysis has achieved remarkable results, but they can’t make the right prediction for the specific aspects in the given review. In the past few years, many researchers have worked sentiment analysis using machine learning approaches, but they have a problem in polarity detection for each aspect in the sentence. Therefore, this paper proposes to classify the sentiment polarity for each aspect by using Bi-directional LSTM (Bi-LSTM) encoder combining with the attention mechanism. The attention mechanism pays attention to the aspect of a specific target in the given review. It is a type of deep learning model and also an extension of the LSTM network, which can learn the long sequences of text. Deep learning models take a long time to train and when the network is deep, it encounters the vanishing gradient problem, a long-standing issue in the neural network model. This paper also considers the hyperparameter tuning approach to solve the vanishing gradient problem for ALSA task. Hyperparameter may be the weight, bias, the number of epochs, batch size, and so on. Experiments are conducted on IMDB and SemEval 2014 Task 4 datasets and the results show that the accuracy of our sentiment model reaches 88.5%, which is higher than other LSTM-based methods like standard AE-LSTM, AT-LSTM, standard LSTM, TC-LSTM, and TD-LSTM.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Tang, D., Qin, B., Feng, X., Liu, T.: Effective LSTMs for target-dependent sentiment classification. In: Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics, 11–17 December 2016, Osaka, Japan, pp. 3298–3307 (2016)
Wang, Y., Huang, M., Zhao, L., Zhu, X.: Attention-based LSTM for aspect-level sentiment classification. In: Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, 1–5 November 2016, Austin, Texas, pp. 606–615 (2016)
Pontiki, M., et al.: SemEval-2016 task 5: aspect based sentiment analysis. In: Proceedings of SemEval-2016, 2016 Association for Computational Linguistics, 16–17 June 2016, San Diego, California, pp. 19–30 (2016)
Burn, C., Nikoulina, V.: Aspect based sentiment analysis into the wild. In: Proceedings of the 9th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis, Brussels, 2018 Association for Computational Linguistics, Belgium, pp. 116–122, 31 October 2018
He, R., Lee, W.S., Ng, H.T., Dahlmeier, D.: Effective attention modeling for aspect-level sentiment classification. In: Proceedings of the 27th International Conference on Computational Linguistics, 20–26 August 2018, Santa Fe, New Mexico, USA, pp. 1121–1131 (2018)
Pennington, J., Socher, R., Manning, C.: GloVe: global vectors for word representation. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 1532–1543 (2014)
Wagner, J., et al.: DCU: aspect-based polarity classification for SemEval task 4 (2014). In: Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014), 23–24 August 2014, Dublin, Ireland, pp. 223–229 (2014)
Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8), 1735–1780 (1997)
Smetanin, S.: EmoSense at SemEval-2019 task 3: bidirectional LSTM network for contextual emotion detection in textual conversations. In: Proceedings of the 13th International Workshop on Semantic Evaluation (SemEval-2019), 2019 Association for Computational Linguistics, Minneapolis, Minnesota, USA, pp. 210–214, 6–7 June 2019
Meng, W., Wei, Y., Liu, P., hu, Z., Yin, H.: Aspect based sentiment analysis with feature enhanced attention CNN-BiLSTM. IEEE Access 7, 167240–167249 (2019)
Dieng, A.B., Wang, C., Gao, J., Paisley, J.: TopicRNN: a recurrent neural network with long-range semantic dependency. In: ICLR (2017)
Rezaeinia, S.M., Rahmani, R., Ghodsi, A., Veisi, H.: Sentiment analysis based on improved pre-trained word embeddings. Expert Syst. Appl. 117, 139–147 (2019)
Mahapatra, S.: Why deep learning over traditional machine learning? (2018). https://towardsdatascience.com/why-deep-learning-is-needed-over-traditional-machine-learning-1b6a99177063
Acknowledgments
We thank anonymous reviewers for their valuable comments and suggestions. We would like to show our gratitude to the rector and course supervisor of the University of Information Technology (UIT), Yangon, Myanmar for submitting this paper.
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Kay Khine, W.L., Thwet Aung, N.T. (2020). Aspect Level Sentiment Analysis Using Bi-Directional LSTM Encoder with the Attention Mechanism. In: Nguyen, N.T., Hoang, B.H., Huynh, C.P., Hwang, D., Trawiński, B., Vossen, G. (eds) Computational Collective Intelligence. ICCCI 2020. Lecture Notes in Computer Science(), vol 12496. Springer, Cham. https://doi.org/10.1007/978-3-030-63007-2_22
Download citation
DOI: https://doi.org/10.1007/978-3-030-63007-2_22
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-63006-5
Online ISBN: 978-3-030-63007-2
eBook Packages: Computer ScienceComputer Science (R0)