Advertisement

Deep Learning Based Sentiment Analysis on Product Reviews on Twitter

  • Aytuğ OnanEmail author
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 1054)

Abstract

Sentiment analysis is the process of extracting an opinion about a particular subject from text documents. The immense quantity of text documents contain opinions or reviews towards a particular entity. The identification of sentiment can be useful for individual decision makers, business organizations and governments. Sentiment analysis is an important research direction. Deep learning is a recent research direction in machine learning, which builds learning models based on multiple layers of representations and features of data. Deep learning based frameworks can be employed in a wide range of applications, including natural language processing tasks, with encouraging prediction results. In this paper, we present a deep learning based scheme for sentiment analysis on Twitter messages. In the presented scheme, three-word embeddings based schemes (namely, GloVe, fastText and word2vec) and convolutional neural network (CNN) have been utilized. In the empirical analysis, different subsets of Twitter messages, ranging from 5000 to 50.000 are taken into consideration. The prediction results obtained by deep-learning based schemes have been compared to conventional classifiers (such as, Naïve Bayes and support vector machines).

Keywords

Sentiment analysis Deep learning Word embeddings Word2vec 

References

  1. 1.
    Turney, P.D.: Thumbs up or thumbs down?: semantic orientation applied to unsupervised classification of reviews. In: Proceedings of the 40th Annual Meeting on Association for Computational Linguistics, pp. 417–424. Association for Computational Linguistics, July 2002Google Scholar
  2. 2.
    Somasundaran, S., Wiebe, J. Recognizing stances in ideological on-line debates. In: Proceedings of the NAACL HLT 2010 Workshop on Computational Approaches to Analysis and Generation of Emotion in Text, pp. 116–124. Association for Computational Linguistics, June 2010Google Scholar
  3. 3.
    Jo, Y., Oh, A.H.: Aspect and sentiment unification model for online review analysis. In: Proceedings of the Fourth ACM International Conference on Web Search and Data Mining, pp. 815–824. ACM, February 2011Google Scholar
  4. 4.
    Onan, A., Korukoğlu, S., Bulut, H.: A hybrid ensemble pruning approach based on consensus clustering and multi-objective evolutionary algorithm for sentiment classification. Inf. Process. Manage. 53(4), 814–833 (2017)CrossRefGoogle Scholar
  5. 5.
    Fersini, E., Messina, E., Pozzi, F.A.: Sentiment analysis: Bayesian ensemble learning. Decis. Support Syst. 68, 26–38 (2014)CrossRefGoogle Scholar
  6. 6.
    Liu, B.: Sentiment analysis and opinion mining. Synth. Lect. Hum. Lang. Technol. 5, 1–167 (2012)CrossRefGoogle Scholar
  7. 7.
    Onan, A., Korukoğlu, S.: A feature selection model based on genetic rank aggregation for text sentiment classification. J. Inform. Sci. 43(1), 25–38 (2017)CrossRefGoogle Scholar
  8. 8.
    Medhat, W., Hassan, A., Korashy, H.: Sentiment analysis algorithms and applications: a survey. Ain Shams Eng. J. 5(4), 1093–1113 (2014)CrossRefGoogle Scholar
  9. 9.
    Hailong, Z., Wenyan, G., Bo, J.: Machine learning and lexicon based methods for sentiment classification: a survey. In: 2014 11th Web Information System and Application Conference, pp. 262–265. IEEE, September 2014Google Scholar
  10. 10.
    Onan, A., Korukoğlu, S., Bulut, H.: A multiobjective weighted voting ensemble classifier based on differential evolution algorithm for text sentiment classification. Expert Syst. Appl. 62, 1–16 (2016)CrossRefGoogle Scholar
  11. 11.
    Deng, L., Yu, D.: Deep learning: methods and applications. Found. Trends Signal Process. 7(3–4), 197–387 (2014)MathSciNetCrossRefGoogle Scholar
  12. 12.
    Glorot, X., Bordes, A., Bengio, Y.: Domain adaptation for large-scale sentiment classification: a deep learning approach. In: Proceedings of the 28th International Conference on Machine Learning (ICML-11), pp. 513–520 (2011)Google Scholar
  13. 13.
    dos Santos, C., Gatti, M. Deep convolutional neural networks for sentiment analysis of short texts. In: Proceedings of COLING 2014, the 25th International Conference on Computational Linguistics: Technical Papers, pp. 69–78 (2014)Google Scholar
  14. 14.
    Tang, D., Wei, F., Qin, B., Liu, T., Zhou, M.: Coooolll: a deep learning system for twitter sentiment classification. In: Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014), pp. 208–212 (2014)Google Scholar
  15. 15.
    Severyn, A., Moschitti, A.: Twitter sentiment analysis with deep convolutional neural networks. In: Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 959–962. ACM, August 2015Google Scholar
  16. 16.
    Hu, Z., Hu, J., Ding, W., Zheng, X.: Review sentiment analysis based on deep learning. In: 2015 IEEE 12th International Conference on e-Business Engineering (ICEBE), pp. 87–94. IEEE, October 2015Google Scholar
  17. 17.
    Johnson, R., Zhang, T.: Effective use of word order for text categorization with convolutional neural networks. arXiv preprint arXiv:1412.1058 (2014)
  18. 18.
    Tang, D., Qin, B., Liu, T. Document modeling with gated recurrent neural network for sentiment classification. In: Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, pp. 1422–1432 (2015)Google Scholar
  19. 19.
    Tang, D., Qin, B., Liu, T.: Learning semantic representations of users and products for document level sentiment classification. In: Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), vol. 1, pp. 1014–1023 (2015)Google Scholar
  20. 20.
    Ruder, S., Ghaffari, P., Breslin, J.G.: Insight-1 at semeval-2016 task 5: deep learning for multilingual aspect-based sentiment analysis. arXiv preprint arXiv:1609.02748 (2016)
  21. 21.
    Sun, X., Li, C., Ren, F.: Sentiment analysis for Chinese microblog based on deep neural networks with convolutional extension features. Neurocomputing 210, 227–236 (2016)CrossRefGoogle Scholar
  22. 22.
    Araque, O., Corcuera-Platas, I., Sanchez-Rada, J.F., Iglesias, C.A.: Enhancing deep learning sentiment analysis with ensemble techniques in social applications. Expert Syst. Appl. 77, 236–246 (2017)CrossRefGoogle Scholar
  23. 23.
    Paredes-Valverde, M.A., Colomo-Palacios, R., Salas-Zárate, M.D.P., Valencia-García, R.: Sentiment analysis in Spanish for improvement of products and services: A deep learning approach. Sci. Program. 2017, 6 (2017)Google Scholar
  24. 24.
    Koppel, M.: Automatically categorizing written texts by author gender. Lit. Ling. Comput. 17, 401–412 (2002)CrossRefGoogle Scholar
  25. 25.
    Onan, A.: Sarcasm identification on twitter: a machine learning approach. In: Silhavy, R., Senkerik, R., Kominkova Oplatkova, Z., Prokopova, Z., Silhavy, P. (eds.) CSOC 2017. AISC, vol. 573, pp. 374–383. Springer, Cham (2017).  https://doi.org/10.1007/978-3-319-57261-1_37CrossRefGoogle Scholar
  26. 26.
    Rezaeinia, S.M., Ghodsi, A., Rahmani, R.: Improving the accuracy of pre-trained word embeddings for sentiment analysis. arXiv preprint arXiv:1711.08609 (2017)
  27. 27.
    Mikolov, T., Chen, K., Corrado, G., Dean, J.: Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781 (2013)
  28. 28.
    Zhang, L., Wang, S., Liu, B.: Deep learning for sentiment analysis: a survey. Wiley Interdiscip. Rev. Data Min. Knowl. Discov. 8, e1253 (2018)CrossRefGoogle Scholar
  29. 29.
    Bairong, Z., Wenbo, W., Zhiyu, L., Chonghui, Z., Shinozaki, T.: Comparative analysis of word embedding methods for DSTC6 end-to-end conversation modeling track. In: Proceedings of the 6th Dialog System Technology Challenges (DSTC6) Workshop (2017)Google Scholar
  30. 30.
    Bojanowski, P., Grave, E., Joulin, A., Mikolov, T.: Enriching word vectors with subword information. arXiv preprint arXiv:1607.04606 (2016)
  31. 31.
    Pennington, J., Socher, R., Manning, C.: Glove: global vectors for word representation. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 1532–1543 (2014)Google Scholar
  32. 32.
    Young, T., Hazarika, D., Poria, S., Cambria, E.: Recent trends in deep learning based natural language processing. IEEE Comput. Intell. Mag. 13(3), 55–75 (2018)CrossRefGoogle Scholar
  33. 33.
    Kilimci, Z.H., Akyokus, S.: Deep learning-and word embedding-based heterogeneous classifier ensembles for text classification. Complexity 2018, 10 (2018)CrossRefGoogle Scholar
  34. 34.
    Cireşan, D., Meier, U., Schmidhuber, J.: Multi-column deep neural networks for image classification. arXiv preprint arXiv:1202.2745 (2012)

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.Faculty of Engineering and Architecture, Department of Computer EngineeringIzmir Katip Çelebi UniversityIzmirTurkey

Personalised recommendations