Skip to main content

An Ensemble and Deep Neural Network Based Approaches for Automated Sentiment Analysis

  • Conference paper
  • First Online:
Information, Communication and Computing Technology (ICICCT 2023)

Abstract

The rise of technology in social media has resulted in an enormous quantity of textual ambiguity. Sentiment analysis provides a crux of subjective opinions stored in a large amount of text such that the data gets segregated into positive and negative. In this research two datasets are used i.e., Amazon Reviews and IMDb wherein, first, implemented machine learning models such as Naive Bayes, XGBoost, etc. for the sentiment analysis out of which Linear SVC performed the best for the IMDb dataset and Amazon Reviews dataset. Furthermore, implemented a deep learning model i.e., Bi-LSTM that outperformed machine learning models for both datasets. Next, implemented BERT, a pre-trained language model, showed better results than Bi-LSTM for both datasets. Lastly, proposed a hybrid CNN-LSTM model, wherein, for feature extraction CNN is used, while LSTM is used for classification. The proposed hybrid model has given the best ROC score for both datasets among all the models used in this paper.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 49.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 64.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Nehme, F., Feldman, K.: Evolving role and future directions of natural language processing in gastroenterology. Dig. Dis. Sci. 66(1), 29–40 (2021)

    Article  Google Scholar 

  2. Vateekul, P., Koomsubha, T.: A study of sentiment analysis using deep learning techniques on Thai Twitter data. In: Proceedings of the 13th International Joint Conference on Computer Science and Software Engineering (JCSSE), pp. 1–6. IEEE, July 2016

    Google Scholar 

  3. Aydoğan, E., Akcayol, M.A.: A comprehensive survey for sentiment analysis tasks using machine learning techniques. In: International Symposium on Innovations in Intelligent Systems and Applications (INISTA), pp. 1–7. IEEE, August 2016

    Google Scholar 

  4. Fernandes, M., et al.: Classification of the disposition of patients hospitalized with COVID-19: reading discharge summaries using natural language processing. JMIR Med. Inform. 9(2), e25457 (2021)

    Article  Google Scholar 

  5. Acosta, J., Lamaute, N., Luo, M., Finkelstein, E., Andreea, C.: Sentimentanalysis of Twitter messages using word2vec. In: Proceedings of Student-Faculty Research Day, CSIS, vol. 7, pp. 1–7. Pace University (2017)

    Google Scholar 

  6. Qaisar, S.M.: Sentiment analysis of IMDb movie reviews using long short- term memory. In: Proceedings of the 2nd International Conference on Computer and Information Sciences (ICCIS), pp. 1–4. IEEE, October 2020

    Google Scholar 

  7. Zharmagambetov, A.S., Pak, A.A.: Sentiment analysis of a document using deep learning approach and decision trees. In: Twelve International Conference on Electronics Computer and Computation (ICECCO), pp. 1–4. IEEE, September 2015

    Google Scholar 

  8. Kanakaraj, M., Guddeti, R.M.R.: Performance analysis of ensemble methods on Twitter sentiment analysis using NLP techniques. In: Proceedings of the 2015 IEEE 9th International Conference on Semantic Computing (IEEE ICSC 2015), pp. 169–170. IEEE, February 2015

    Google Scholar 

  9. Phand, S.A., Phand, J.A.: Twitter sentiment classification using Stanford NLP. In: Proceedings of the 1st International Conference on Intelligent Systems and Information Management (ICISIM), pp. 1–5. IEEE, October 2017

    Google Scholar 

  10. Nowak, J., Taspinar, A., Scherer, R.: LSTM recurrent neural networks for short text and sentiment classification. In: Rutkowski, L., Korytkowski, M., Scherer, R., Tadeusiewicz, R., Zadeh, L.A., Zurada, J.M. (eds.) ICAISC 2017. LNCS (LNAI), vol. 10246, pp. 553–562. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-59060-8_50

    Chapter  Google Scholar 

  11. Fernandes, M., et al.: Predicting intensive care unit admission among patients presenting to the emergency department using machine learning and natural language processing. PloS One 15(3), e0229331 (2020)

    Google Scholar 

  12. Szlosek, D.A., Ferrett, J.: Using machine learning and natural language processing algorithms to automate the evaluation of clinical decision support in electronic medical record systems. eGEMs 4(3), 5 (2016)

    Google Scholar 

  13. Abu Kwaik, K., Saad, M., Chatzikyriakidis, S., Dobnik, S.: LSTM-CNN deep learning model for sentiment analysis of dialectal Arabic. In: Smaïli, K. (ed.) ICALP 2019. CCIS, vol. 1108, pp. 108–121. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-32959-4_8

    Chapter  Google Scholar 

  14. Ghourabi, A., Mahmood, M.A., Alzubi, Q.M.: A hybrid CNN-LSTM model for SMS spam detection in Arabic and english messages. Future Internet 12(9), 156 (2020)

    Article  Google Scholar 

  15. Schuster, M., Paliwal, K.K.: Networks bidirectional reccurent neural. IEEE Trans. Signal Process 45, 2673–2681 (1997)

    Article  Google Scholar 

  16. Prabhakar, E., Santhosh, M., Krishnan, A.H., Kumar, T., Sudhakar, R.: Sentiment analysis of US airline twitter data using new adaboost approach. Int. J. Eng. Res. Technol. (IJERT) 7(1), 1–6 (2019)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Riya .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Riya, Rai, S., Rupal, Rani, R., Niranjan, V., Sharma, A. (2023). An Ensemble and Deep Neural Network Based Approaches for Automated Sentiment Analysis. In: Abawajy, J., Tavares, J., Kharb, L., Chahal, D., Nassif, A.B. (eds) Information, Communication and Computing Technology. ICICCT 2023. Communications in Computer and Information Science, vol 1841. Springer, Cham. https://doi.org/10.1007/978-3-031-43838-7_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-43838-7_5

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-43837-0

  • Online ISBN: 978-3-031-43838-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics