Skip to main content
SpringerLink
Log in

Attention Mechanism with Gated Recurrent Unit Using Convolutional Neural Network for Aspect Level Opinion Mining

  • Research Article-Computer Engineering and Computer Science
  • Published:
Arabian Journal for Science and Engineering Aims and scope Submit manuscript

Abstract

Deep neural network models are emerging in the area of natural language processing and have become a topic of interest in sentiment analysis. The participation of more social media users provides increased information which has made analysis challenging. Aspect level sentiment analysis is used in the identification of the sentiment polarity of a text in different aspects. This paper presents four deep neural network-based methods with varied input word vector representation for the aspect level opinion mining. A novel approach using an attention mechanism with a gated recurrent unit and a convolutional neural network for aspect level opinion mining with different input vector representations is proposed. This work is an addition to the existing research that includes novel approaches for the assessment of the quality of services based on customer reviews in the restaurant domain. Data accumulated on restaurant opinion have been chosen for experimental study, and the results obtained indicate achievement of good accuracy, precision, recall, and f-measure compared to other approaches.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  1. Rani, M.S.; Sumathy, S.: Online social networking services and spam detection approaches in opinion mining—a review. Int. J. Web Communities 14, 353–378 (2018)

    Article  Google Scholar 

  2. Rani, M.S.; Sumathy, S.: Perspectives of the performance metrics in lexicon and hybrid based approaches: a review. Int. J. Eng. Technol. 6, 108–115 (2017)

    Article  Google Scholar 

  3. Song, M.; Park, H.; Shin, K.: Attention-based long short-term memory network using sentiment lexicon embedding for aspect-level sentiment analysis in Korean. Inf. Process. Manag. 56, 637–653 (2019)

    Article  Google Scholar 

  4. Liu, B.: Sentiment analysis and opinion mining. Synth. Lect. Hum. Lang. Technol. 5(1), 1–167 (2012)

    Article  Google Scholar 

  5. Ravi, K.; Ravi, V.: A survey on opinion mining and sentiment analysis: tasks, approaches and applications. Knowledge-Based Syst. 89, 14–46 (2015)

    Article  Google Scholar 

  6. Liu, Y.; Ji, L.; Huang, R.; Ming, T.; Gao, C.; Zhang, J.: An attention-gated convolutional neural network for sentence classification. Intell. Data Anal. 23, 1091–1107 (2019)

    Article  Google Scholar 

  7. Pham, D.H.; Nguyen, T.T.T.; Le, A.C.: Fine-tuning word embeddings for aspect-based sentiment analysis. In: International Conference on Text, Speech, and Dialogue, pp. 500–508. Springer, Cham (2017)

  8. Pham, D.H.; Le, A.C.: Exploiting multiple word embeddings and one-hot character vectors for aspect-based sentiment analysis. Int. J. Approx. Reason. 103, 1–10 (2018)

    Article  MathSciNet  Google Scholar 

  9. Pham, D.H.; Le, A.C.: Learning multiple layers of knowledge representation for aspect based sentiment analysis. Data Knowl. Eng. 114, 26–39 (2018)

    Article  Google Scholar 

  10. Pham, D.H.; Le, A.C.; Le, T.K.C.: Learning word embeddings for aspect-based sentiment analysis. Commun. Comput. Inf. Sci. 781, 28–40 (2018)

    MATH  Google Scholar 

  11. Hyun, D.; Park, C.; Yang, M.C.; Song, I.; Lee, J.T.; Yu, H.: Target-aware convolutional neural network for target-level sentiment analysis. Inf. Sci. (NY) 491, 166–178 (2019)

    Article  Google Scholar 

  12. Do, H.H.; Prasad, P.W.C.; Maag, A.; Alsadoon, A.: Deep learning for aspect-based sentiment analysis: a comparative review. Expert Syst. Appl. 118, 272–299 (2019)

    Article  Google Scholar 

  13. Liu, N.; Shen, B.; Zhang, Z.; Zhang, Z.; Mi, K.: Attention-based sentiment reasoner for aspect-based sentiment analysis. Human-Centric Comput. Inf. Sci. 9, 35 (2019)

    Article  Google Scholar 

  14. Ma, X.; Zeng, J.; Peng, L.; Fortino, G.; Zhang, Y.: Modeling multi-aspects within one opinionated sentence simultaneously for aspect-level sentiment analysis. Future Gener. Comput. Syst. 93, 304–311 (2019)

    Article  Google Scholar 

  15. Yang, C.; Zhang, H.; Jiang, B.; Li, K.: Aspect-based sentiment analysis with alternating coattention networks. Inf. Process. Manag. 56, 463–478 (2019)

    Article  Google Scholar 

  16. Meng, W.; Wei, Y.; Liu, P.; Zhu, Z.; Yin, H.: Aspect based sentiment analysis with feature enhanced attention CNN-BiLSTM. IEEE Access. 7, 167240–167249 (2019)

    Article  Google Scholar 

  17. Park, H.; Song, M.; Shin, K.S.: Deep learning models and datasets for aspect term sentiment classification: Implementing holistic recurrent attention on target-dependent memories. Knowl.-Based Syst. 187, 104825 (2020)

    Article  Google Scholar 

  18. Wang, W.; Pan, S.J.; Dahlmeier, D.: Memory networks for fine-grained opinion mining. Artif. Intell. 265, 1–17 (2018)

    Article  Google Scholar 

  19. Fu, X.; Wei, Y.; Xu, F.; Wang, T.; Lu, Y.; Li, J.; Huang, J.Z.: Semi-supervised aspect-level sentiment classification model based on variational autoencoder. Knowl.-Based Syst. 171, 81–92 (2019)

    Article  Google Scholar 

  20. Al-Smadi, M.; Qawasmeh, O.; Al-Ayyoub, M.; Jararweh, Y.; Gupta, B.: Deep Recurrent neural network vs. support vector machine for aspect-based sentiment analysis of Arabic hotels’ reviews. J. Comput. Sci. 27, 386–393 (2018)

    Article  Google Scholar 

  21. Pasupa, K.; Seneewong Na Ayutthaya, T.: Thai sentiment analysis with deep learning techniques: a comparative study based on word embedding, POS-tag, and sentic features. Sustain. Cities Soc. 50, 101615 (2019)

    Article  Google Scholar 

  22. Yang, M.; Qu, Q.; Chen, X.; Guo, C.; Shen, Y.; Lei, K.: Feature-enhanced attention network for target-dependent sentiment classification. Neurocomputing 307, 91–97 (2018)

    Article  Google Scholar 

  23. Ray, P.; Chakrabarti, A.: A mixed approach of deep learning method and rule-based method to improve aspect level sentiment analysis. Appl. Comput. Inform. (2019). https://doi.org/10.1016/j.aci.2019.02.002

    Article  Google Scholar 

  24. Rezaeinia, S.M.; Rahmani, R.; Ghodsi, A.; Veisi, H.: Sentiment analysis based on improved pre-trained word embeddings. Expert Syst. Appl. 117, 139–147 (2019)

    Article  Google Scholar 

  25. Luo, L.: Network text sentiment analysis method combining LDA text representation and GRU-CNN. Pers. Ubiquitous Comput. 23, 405–412 (2019)

    Article  Google Scholar 

  26. Rani, S.; Kumar, P.: Deep learning based sentiment analysis using convolution neural network. Arab. J. Sci. Eng. 44, 3305–3314 (2019)

    Article  Google Scholar 

  27. Rehman, A.U.; Malik, A.K.; Raza, B.; Ali, W.: A hybrid CNN-LSTM model for improving accuracy of movie reviews sentiment analysis. Multimed. Tools Appl. 78, 26597–26613 (2019)

    Article  Google Scholar 

  28. Abdi, A.; Shamsuddin, S.M.; Hasan, S.; Piran, J.: Deep learning-based sentiment classification of evaluative text based on multi-feature fusion. Inf. Process. Manag. 56, 1245–1259 (2019)

    Article  Google Scholar 

  29. Pergola, G.; Gui, L.; He, Y.: TDAM: a topic-dependent attention model for sentiment analysis. Inf. Process. Manag. 56, 102084 (2019)

    Article  Google Scholar 

  30. Abid, F.; Alam, M.; Yasir, M.; Li, C.: Sentiment analysis through recurrent variants latterly on convolutional neural network of Twitter. Future Gener. Comput. Syst. 95, 292–308 (2019)

    Article  Google Scholar 

  31. Xiong, S.; Lv, H.; Zhao, W.; Ji, D.: Towards Twitter sentiment classification by multi-level sentiment-enriched word embeddings. Neurocomputing 275, 2459–2466 (2018)

    Article  Google Scholar 

  32. Pennington, J.; Socher, R.; Manning, C.D.: GloVe: global vectors for word representation. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 1532–1543 (2014)

  33. Chung, J.; Gulcehre, C.; Cho, K.; Bengio, Y.: Empirical evaluation of gated recurrent neural networks on sequence modeling, pp. 1–9. arXiv Preprint arXiv:1412.3555 (2014)

  34. Pontiki, M.; Galanis, D.; Pavlopoulos, J.; Papageorgiou, H.; Androutsopoulos, I.; Manandhar, S.: SemEval-2014 Task 4: aspect based sentiment analysis. In: Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014), pp. 27–35 (2014)

Download references

Author information

Authors and Affiliations

  1. School of Computer Science and Engineering, Vellore Institute of Technology, Vellore, Tamil Nadu, 632014, India

    Meesala Shobha Rani

  2. School of Information Technology and Engineering, Vellore Institute of Technology, Vellore, Tamil Nadu, 632014, India

    Sumathy Subramanian

Authors
  1. Meesala Shobha Rani
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sumathy Subramanian
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Sumathy Subramanian.

Appendix 1

Appendix 1

See Table 7.

Table 7 Notation and meaning
Full size table

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Rani, M.S., Subramanian, S. Attention Mechanism with Gated Recurrent Unit Using Convolutional Neural Network for Aspect Level Opinion Mining. Arab J Sci Eng 45, 6157–6169 (2020). https://doi.org/10.1007/s13369-020-04497-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13369-020-04497-4

Keywords

Search

Navigation