Skip to main content
SpringerLink
Log in

Multi-class Textual Emotion Categorization using Ensemble of Convolutional and Recurrent Neural Network

  • Original Research
  • Published:
SN Computer Science Aims and scope Submit manuscript

Abstract

Categorizing emotion refers to extracting the individuals’ behaviour from texts and assigning textual units into an emotion from predefined emotional connotations. Identification and categorization of emotion content have mostly been made for English, French, Chinese, Arabic, and other high-resource languages. However, very few studies have investigated emotion from the under-resourced language like Bengali. This work proposes an ensemble-based technique for classifying textual emotions into six classes: anger, disgust, fear, joy, sadness and surprise. An emotion corpus containing 9000 Bengali texts is developed to perform the emotion classification. This work investigates 22 standard classifier models developing based on three deep learning techniques (Convolutional Neural Network (CNN), Gated Recurrent Unit (GRU), Bidirectional Long Short Term Memory (BiLSTM) with different ensemble strategies and embedding models (i.e., Word2Vec, FastText). All the models are tuned, trained and tested on the developed dataset (EBEmoD-Extended Bengali Emotion Dataset) and a publicly available emotion dataset (BYCD-Bengali Youtube Comment dataset). The experimental result demonstrates that the ensemble of CNN and BiLSTM (i.e., CNN+BiLSTM) outdoes all other models by acquiring the highest weighted \(f_1\)-score of 62.46% (for EBEmoD) and 67.57% (for BYCD), respectively.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

References

  1. Abdullah M, Hadzikadicy M, Shaikhz S. Sedat: sentiment and emotion detection in Arabic text using cnn-lstm deep learning. In: 2018 17th IEEE international conference on machine learning and applications (ICMLA), pp. 835–840. IEEE (2018)

  2. Alswaidan N, Menai MEB. A survey of state-of-the-art approaches for emotion recognition in text. Knowledge Inf Syst 62(8) (2020).

  3. Alzu’bi S, Badarneh O, Hawashin B, Al-Ayyoub M, Alhindawi N, Jararweh Y. Multi-label emotion classification for arabic tweets. In: 2019 Sixth International Conference on Social Networks Analysis, Management and Security (SNAMS), pp. 499–504. IEEE (2019).

  4. Baali M, Ghneim N. Emotion analysis of Arabic tweets using deep learning approach. J Big Data. 2019;6(1):1–12.

    Article  Google Scholar 

  5. Bojanowski P, Grave E, Joulin A, Mikolov T. Enriching word vectors with subword information. Trans Assoc Comput Linguist. 2017;5:135–46.

    Article  Google Scholar 

  6. Cohen J. A coefficient of agreement for nominal scales. Educ Psychol Measur. 1960;20(1):37–46.

    Article  Google Scholar 

  7. Das A, Iqbal MA, Sharif O, Hoque MM. Bemod: development of Bengali emotion dataset for classifying expressions of emotion in texts. In: Vasant P, Zelinka I, Weber GW, editors. Intelligent computing and optimization. Cham: Springer International Publishing; 2021. p. 1124–36.

    Chapter  Google Scholar 

  8. Das A, Sharif O, Hoque MM, Sarker IH. Emotion classification in a resource constrained language using transformer-based approach. In: Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Student Research Workshop, pp. 150–158. Association for Computational Linguistics, Online (2021). https://doi.org/10.18653/v1/2021.naacl-srw.19. https://aclanthology.org/2021.naacl-srw.19

  9. Das SD, Basak A, Dutta S. A heuristic-driven uncertainty based ensemble framework for fake news detection in tweets and news articles. CoRR abs/2104.01791 (2021). arxiv:2104.01791.

  10. Ekman P. An argument for basic emotions. Cogn Emotion. 1992;6(3–4):169–200.

    Article  Google Scholar 

  11. Garcia-Garcia JM, Penichet VM, Lozano MD. Emotion detection: a technology review. In: Proceedings of the XVIII international conference on human computer interaction, pp. 1–8 (2017).

  12. Haryadi D, Kusuma GP. Emotion detection in text using nested long short-term memory. Int J Adv Comput Sci Appl. 2019;10(6):11480.

    Google Scholar 

  13. Hossain E, Sharif O, Hoque MM, Sarker IH. Sentilstm: a deep learning approach for sentiment analysis of restaurant reviews (2020).

  14. Kim Y. Convolutional neural networks for sentence classification. emnlp (2014).

  15. Lai Y, Zhang L, Han D, Zhou R, Wang G. Fine-grained emotion classification of Chinese microblogs based on graph convolution networks. World Wide Web. 2020;23(5):2771–87.

    Article  Google Scholar 

  16. Lora SK, Jahan N, Antora SA, Sakib N. Detecting emotion of users’ analyzing social media bengali comments using deep learning techniques. In: 2020 2nd International Conference on Advanced Information and Communication Technology (ICAICT), pp. 88–93. IEEE (2020).

  17. Lx Luo. Network text sentiment analysis method combining lda text representation and gru-cnn. Pers Ubiquitous Comput. 2019;23(3):405–12.

    Google Scholar 

  18. Mamta Ekbal A, Bhattacharyya P, Srivastava S, Kumar A, Saha T. Multi-domain tweet corpora for sentiment analysis: resource creation and evaluation. In: LREC (2020).

  19. Mikolov T, Sutskever I, Chen K, Corrado GS, Dean J. Distributed representations of words and phrases and their compositionality. In: Advances in neural information processing systems, pp. 3111–3119 (2013).

  20. Pal A, Karn B. Anubhuti—an annotated dataset for emotional analysis of Bengali short stories. arXiv preprint arXiv:2010.03065 (2020).

  21. Rahman M, Haque S, Saurav ZR. Identifying and categorizing opinions expressed in Bangla sentences using deep learning technique. Int J Comput Appl. 2020;975:8887.

    Google Scholar 

  22. Rahman M, Seddiqui M, et al. Comparison of classical machine learning approaches on Bangla textual emotion analysis. arXiv preprint arXiv:1907.07826 (2019).

  23. Rayhan MM, Al Musabe T, Islam MA. Multilabel emotion detection from bangla text using bigru and cnn-bilstm. In: 2020 23rd International Conference on Computer and Information Technology (ICCIT), pp. 1–6. IEEE (2020).

  24. Seyeditabari A, Tabari N, Zadrozny W. Emotion detection in text: a review. arXiv preprint arXiv:1806.00674 (2018).

  25. Sharif O, Hoque MM, Hossain E. Sentiment analysis of Bengali texts on online restaurant reviews using multinomial naïve bayes. In: 2019 1st International Conference on Advances in Science, Engineering and Robotics Technology (ICASERT), pp. 1–6 (2019). https://doi.org/10.1109/ICASERT.2019.8934655.

  26. Sharif O, Hossain E, Hoque MM. Techtexc: Classification of technical texts using convolution and bidirectional long short term memory network. CoRR abs/2012.11420 (2020). arxiv:2012.11420.

  27. Soleymani M, Garcia D, Jou B, Schuller B, Chang SF, Pantic M. A survey of multimodal sentiment analysis. Image Vis Comput. 2017;65:3–14.

    Article  Google Scholar 

  28. Tokunaga T, Makoto I. Text categorization based on weighted inverse document frequency. In: Special Interest Groups and Information Process Society of Japan (SIG-IPSJ. Citeseer (1994).

  29. Tripto NI, Ali ME. Detecting multilabel sentiment and emotions from bangla youtube comments. In: 2018 International Conference on Bangla Speech and Language Processing (ICBSLP), pp. 1–6. IEEE (2018).

  30. Zhang Y, Jin R, Zhou ZH. Understanding bag-of-words model: a statistical framework. Int J Mach Learn Cybern. 2010;1(1–4):43–52.

    Article  Google Scholar 

Download references

Acknowledgements

This work is conducted under the ICT Fellowship Program of ICT Division, Ministry of Posts, Telecommunications and Information Technology, Bangladesh.

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, Chittagong University of Engineering and Technology, Chittagong, 4349, Bangladesh

    Tanzia Parvin, Omar Sharif & Mohammed Moshiul Hoque

Authors
  1. Tanzia Parvin
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Omar Sharif
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mohammed Moshiul Hoque
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mohammed Moshiul Hoque.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

This article is part of the topical collection “Enabling Innovative Computational Intelligence Technologies for IOT” guest edited by Omer Rana, Rajiv Misra, Alexander Pfeiffer, Luigi Troiano and Nishtha Kesswani.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Parvin, T., Sharif, O. & Hoque, M.M. Multi-class Textual Emotion Categorization using Ensemble of Convolutional and Recurrent Neural Network. SN COMPUT. SCI. 3, 62 (2022). https://doi.org/10.1007/s42979-021-00913-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s42979-021-00913-0

Keywords

Search

Navigation