Skip to main content

Aspect-Based Sentiment Analysis with Deep Learning: A Multidomain and Multitask Approach

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes on Data Engineering and Communications Technologies ((LNDECT,volume 148))

Abstract

Sentiment analysis aids in obtaining the opinion of the users towards a particular product, service or policy. Focusing on classifying the sentiment that corresponds to each aspect of the entity in the document will help to identify the sentiment more clearly. This is also the mission of aspect-based sentiment analysis (ABSA). The vast majority of prior studies in ABSA have implemented single-task execution models on single-domain datasets. This is inconvenient when it is necessary to perform the full range of tasks in ABSA and on domain-independent datasets. In this paper, we offer to operate the advanced arrangement of deep learning techniques for multidomain and multitask approach in ABSA. The main tasks in ABSA: aspect extraction, category identification, sentiment classification and domain classification are all finished by an integration framework of Convolutional Neural Network (CNN), Bidirectional Independent Long Short Term Memory (BiIndyLSTM) and Attention mechanism. In addition, we use a POS tag layer combined with GloVe in word embedding layer to get the morphological attributes of each token word from review sentences. Through the experimenting process in the Laptop_Restaurant_Hotel multidomain dataset, we found that our proposed model has achieved high precision in multitasking ABSA. With this approach, we hope our proposed model will lay the foundation for ensuring flexibility and multiutility compared to previous opinion analysis models.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    http://alt.qcri.org/semeval2016/task5/.

  2. 2.

    http://alt.qcri.org/semeval2016/task5/.

References

  1. Liu, B.: Sentiment Analysis: Mining Sentiments, Opinions and Emotions, 2nd edn. Cambridge University Press, Chicago (2020)

    Book  Google Scholar 

  2. Pennington, J., Socher, R., Manning, C.: GloVe: global vectors for word representation. In: EMNLP’14 Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing, pp. 1532–1543 (2014)

    Google Scholar 

  3. Hu, M., Liu, B.: Mining opinion features in customer reviews. In: AAAI’04 Proceedings of the 19th National Conference on Artificial Intelligence, pp. 755–760 (2004)

    Google Scholar 

  4. Hu, M., Liu, B.: Mining and summarizing customer reviews. In: KDD’04 Proceedings of the 10th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 168–177 (2004)

    Google Scholar 

  5. Turney, P.D., Littman, M.L.: Measuring praise and criticism: inference of semantic orientation from association. In: ACM Transactions on Information Systems, vol. 21, issue 4, pp. 315–346 (2003)

    Google Scholar 

  6. Kamps, J., Marx, M., Mokken, R., Rijke, M.: Using WordNet to measure semantic orientation of adjectives. In: Proceedings of LREC-04, 4th International Conference on Language Resources and Evaluation, vol. 4, pp. 1115–1118 (2004)

    Google Scholar 

  7. Ding, X., Liu, B., Yu, P.S.: A holistic lexicon-based approach to opinion mining. In: Proceedings of the 2008 International Conference on Web Search and Data Mining, pp. 231–240 (2008)

    Google Scholar 

  8. Liu, Q., Gao, Z., Liu, B., Zhang, Y.: Automated rule selection for opinion target extraction. Knowl. Based Syst. 104, 74–88 (2016)

    Article  Google Scholar 

  9. Almatarneh, S., Gamallo, P.: A lexicon based method to search for extreme opinions. PLoS One 13(5), e0197816 (2018)

    Article  Google Scholar 

  10. Li, F., et al.: Structure-aware review mining and summarization. In: COLING’10 Organizing Committee, pp. 653–661 (2010)

    Google Scholar 

  11. Kiritchenko, S., Zhu, X., Cherry, C., Mohammad, S.: NRC-Canada-2014: detecting aspects and sentiment in customer reviews. In: the 8th International Workshop on Semantic Evaluation (SemEval 2014), pp. 437–442 (2014)

    Google Scholar 

  12. Saeidi, M., Bouchard, G., Liakata, M., Riedel, S.: SentiHood: targeted aspect based sentiment analysis dataset for urban neighbourhoods. In: COLING 2016 arXiv:1601.03771v1 [cs.CL] (2016)

    Google Scholar 

  13. Han, H., Li, X., Zhi, S., Wang, H.: Multi-attention network for aspect sentiment analysis. In: Proceedings of the 2019 8th International Conference on Software and Computer Applications, pp. 22–26 (2019)

    Google Scholar 

  14. Tang, D., Qin, B., Liu, T.: Aspect Level Sentiment Classification with Deep Memory Network. In: arXiv: 1605.08900v2 [cs.CL] (2016)

    Google Scholar 

  15. Liu, N., Shen, B., Zhang, Z., Zhang, Z., Mi, K.: Attention-based Sentiment Reasoner for aspect-based sentiment analysis. Human-centric Comput. Inform. Sci. 9(1), 1–17 (2019)

    Google Scholar 

  16. Trang, T.U., Ha, H.T.T., Hiep, H.X.: Aspect Extraction with Bidirectional GRU and CRF. In: The 2019 IEEE-RIVF International Conference on Computing and Communication Technologies (RIVF) pp. 60–64 (2019)

    Google Scholar 

  17. Tran, T.U., Hoang, H.-T., Huynh, H.X.: Bidirectional independently long short-term memory and conditional random field integrated model for aspect extraction in sentiment analysis. In: Satapathy, S.C., Bhateja, V., Nguyen, B.L., Nguyen, N.G., Le, D.-N. (eds.) Frontiers in Intelligent Computing: Theory and Applications. AISC, vol. 1014, pp. 131–140. Springer, Singapore (2020). https://doi.org/10.1007/978-981-13-9920-6_14

    Chapter  Google Scholar 

  18. Trang, T.U., Ha, H.T.T.: Deep learning in aspect-based sentiment analysis. In: the 10th Conference on Information Technology and Its Application (2021)

    Google Scholar 

  19. Huang, B., Carley, K.: Parameterized convolutional neural networks for aspect level sentiment classification. In: arXiv: 1909.06276v1 [cs.CL] (2019)

    Google Scholar 

  20. Cho, K., et al.: Learning phrase representations using RNN Encoder-Decoder for statistical machine translation. In: arXiv:1406.1078v3 [cs.CL], 3 Sep 2014

    Google Scholar 

  21. Bengio, Y., Simard, P., Frasconi, P.: Learning long-term dependencies with gradient descent is difficult. IEEE Trans. Neural Networks 5(2), 157–166 (1994)

    Article  Google Scholar 

  22. Li, S., Li, W., Cook, C., Zhu, C., Gao, Y.: Independently recurrent neural network (IndRNN): building a longer and deeper RNN. In: arXiv: 1803.04831v3 [cs.CV], 22 May 2018

    Google Scholar 

  23. Poria, S., Cambria, E., Gelbukh, A.: Aspect extraction for opinion mining with a deep convolutional neural network. Knowl. Based Syst. 108, 42–49 (2016)

    Article  Google Scholar 

  24. Kim, Y.: Convolutional neural networks for sentence classification. In: EMNLP 2014, pp. 1746–1751 (2014)

    Google Scholar 

  25. Li, X., Lam, W.: Deep multi-task learning for aspect term extraction with memory interaction. In: EMNLP 2017, pp. 2886–2892 (2017)

    Google Scholar 

  26. Li, X., Bin, L., Li, P., Lam, W., Yang, Z.: Aspect term extraction with history attention and selective transformation. In: arXiv:1805.00760v1 [cs.CL] (2018)

    Google Scholar 

  27. Luo, H., Li, T., Liu, B.: Improving aspect term extraction with bidirectional dependency tree representation. In: IEEE/ACM Transactions on Audio, Speech and Language Processing, vol. 27, pp. 1201–1212 (2019)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Trang Uyen Tran .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Tran, T.U., Hoang, H.T.T., Dang, P.H., Riveill, M. (2022). Aspect-Based Sentiment Analysis with Deep Learning: A Multidomain and Multitask Approach. In: Nguyen, NT., Dao, NN., Pham, QD., Le, H.A. (eds) Intelligence of Things: Technologies and Applications . ICIT 2022. Lecture Notes on Data Engineering and Communications Technologies, vol 148. Springer, Cham. https://doi.org/10.1007/978-3-031-15063-0_12

Download citation

Publish with us

Policies and ethics