Advertisement

NStackSenti: Evaluation of a Multi-level Approach for Detecting the Sentiment of Users

  • Md Fahimuzzman SohanEmail author
  • Sheikh Shah Mohammad Motiur Rahman
  • Md Tahsir Ahmed Munna
  • Shaikh Muhammad Allayear
  • Md. Habibur Rahman
  • Md. Mushfiqur Rahman
Conference paper
First Online:
Part of the Communications in Computer and Information Science book series (CCIS, volume 922)

Abstract

Sentiment Detection plays a vital role worldwide to measure the acceptance level of any products, movies or facts in the market. Text vectorization (converting text from human readable to machine readable format) and machine learning algorithms are widely used to detect the sentiment of users. This paper presents and evaluates a multi-level architecture based approach using stacked generalization technique named NStackSenti. The presented approach enables the combination of machine learning algorithms to improve the accuracy of detection. Here, Extremely Randomized Tree (ET), Random Forest (RF), Gradient Boost (GB), ADA Boost (ADA), Decision Tree (DT) are used as base classifiers and XGBoost classifier is used as meta estimator. The NStackSenti is applied on two separate datasets to demonstrate the effectiveness in terms of accuracy. NStackSenti provides better accuracy with trigram than unigram and bigram. It provides 83.7% and 86.24% accuracy on 2000 and 50000 data respectively.

Keywords

Machine learning Sentiment detection N-gram Stacked generalization Ensemble learning 
This is a preview of subscription content, log in to check access.

References

  1. 1.
    Moraes, R., Valiati, J.F., Neto, W.P.G.: Document-level sentiment classification: an empirical comparison between SVM and ANN. Expert Syst. Appl. 40(2), 621–633 (2013)CrossRefGoogle Scholar
  2. 2.
    Xia, R., Xu, F., Yu, J., Qi, Y., Cambria, E.: Polarity shift detection, elimination and ensemble: a three-stage model for document-level sentiment analysis. Inf. Process. Manag. 52(1), 36–45 (2016)CrossRefGoogle Scholar
  3. 3.
    Pang, B., Lee, L.: Opinion mining and sentiment analysis. Found. Trends® Inf. Retrieval 2(1–2), 1–135 (2008)CrossRefGoogle Scholar
  4. 4.
    Tripathy, A., Agrawal, A., Rath, S.K.: Classification of sentiment reviews using n-gram machine learning approach. Expert Syst. Appl. 57, 117–126 (2016)CrossRefGoogle Scholar
  5. 5.
    Tripathy, A., Rath, S.K.: Classification of sentiment of reviews using supervised machine learning techniques. Int. J. Rough Sets Data Anal. (IJRSDA) 4(1), 56–74 (2017)CrossRefGoogle Scholar
  6. 6.
    Wang, G., Sun, J., Ma, J., Xu, K., Gu, J.: Sentiment classification: the contribution of ensemble learning. Decis. Support Syst. 57, 77–93 (2014)CrossRefGoogle Scholar
  7. 7.
    Tsutsumi, K., Shimada, K., Endo, T.: Movie review classification based on a multiple classifier. In: Proceedings of the 21st Pacific Asia Conference on Language, Information and Computation, pp. 481–488 (2007)Google Scholar
  8. 8.
    Tang, D., Qin, B., Liu, T.: Document modeling with gated recurrent neural network for sentiment classification. In: Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, pp. 1422–1432 (2015)Google Scholar
  9. 9.
    Dey, L., Chakraborty, S., Biswas, A., Bose, B., Tiwari, S.: Sentiment analysis of review datasets using Naive Bayes and K-NN classifier. Int. J. Inf. Eng. Electron. Bus. 8(4), 54–62 (2016)Google Scholar
  10. 10.
    Lu, B., Tsou, B.K.: Combining a large sentiment lexicon and machine learning for subjectivity classification. In: 2010 International Conference on Machine Learning and Cybernetics (ICMLC), vol. 6, pp. 3311–3316 (2010)Google Scholar
  11. 11.
    Pang, B., Lee, L.: A sentimental education: sentiment analysis using subjectivity summarization based on minimum cuts. In: Proceedings of the 42nd Annual Meeting on Association for Computational Linguistics, 271. Association for Computational Linguistics (2004)Google Scholar
  12. 12.
    Maas, A.L., Daly, R.E., Pham, P.T., Huang, D., Ng, A.Y., Potts, C.: Learning word vectors for sentiment analysis. In: Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, vol. 1, pp. 142–150. Association for Computational Linguistics (2011)Google Scholar
  13. 13.
    Pang, B., Lee, L., Vaithyanathan, S.: Thumbs up? Sentiment classification using machine learning techniques. In: Proceedings of the ACL-02 Conference on Empirical Methods in Natural Language Processing, vol. 10, pp. 79–86. Association for Computational Linguistics (2002)Google Scholar
  14. 14.
    Singh, J., Singh, G., Singh, R.: Optimization of sentiment analysis using machine learning classifiers. Hum.-Centric Comput. Inf. Sci. 7(1), 32 (2017)CrossRefGoogle Scholar
  15. 15.
    Zheng, L., Wang, H., Gao, S.: Sentimental feature selection for sentiment analysis of Chinese online reviews. Int. J. Mach. Learn. Cybern. 9(1), 75–84 (2018)CrossRefGoogle Scholar
  16. 16.
    Xia, R., Zong, C., Li, S.: Ensemble of feature sets and classification algorithms for sentiment classification. Inf. Sci. 181(6), 1138–1152 (2011)CrossRefGoogle Scholar
  17. 17.
    Tripathy, A., Anand, A., Rath, S.K.: Document-level sentiment classification using hybrid machine learning approach. Knowl. Inf. Syst. 53(3), 805–831 (2017)CrossRefGoogle Scholar
  18. 18.
    Poria, S., Cambria, E., Howard, N., Huang, G.B., Hussain, A.: Fusing audio, visual and textual clues for sentiment analysis from multimodal content. Neurocomputing 174, 50–59 (2016)CrossRefGoogle Scholar
  19. 19.
    Sobhani, P., Mohammad, S., Kiritchenko, S.: Detecting stance in tweets and analyzing its interaction with sentiment. In: Proceedings of the Fifth Joint Conference on Lexical and Computational Semantics, pp. 159–169 (2016)Google Scholar
  20. 20.
    Poria, S., Cambria, E., Winterstein, G., Huang, G.B.: Sentic patterns: dependency-based rules for concept-level sentiment analysis. Knowl.-Based Syst. 69, 45–63 (2014)CrossRefGoogle Scholar
  21. 21.
    Keshavarz, H., Abadeh, M.S.: ALGA: adaptive lexicon learning using genetic algorithm for sentiment analysis of microblogs. Knowl.-Based Syst. 122, 1–16 (2017)CrossRefGoogle Scholar
  22. 22.
    Carvalho, J., Prado, A., Plastino, A.: A statistical and evolutionary approach to sentiment analysis. In: Proceedings of the 2014 IEEE/WIC/ACM International Joint Conferences on Web Intelligence (WI) and Intelligent Agent Technologies (IAT), vol. 02, pp. 110–117 (2014)Google Scholar
  23. 23.
    Wolpert, D.H.: Stacked generalization. Neural Netw. 5(2), 241–259 (1992)CrossRefGoogle Scholar
  24. 24.
    Rahman, S.S.M.M., Rahman, M.H., Sarker, K., Rahman, M.S., Ahsan, N., Sarker, M.M.: Supervised ensemble machine learning aided performance evaluation of sentiment classification. In: Journal of Physics: Conference Series, vol. 1060, no. 1, p. 012036. IOP Publishing, July 2018Google Scholar
  25. 25.
    Python package for stacking (machine learning technique). https://github.com/vecxoz/vecstack. Accessed 12 July 2018
  26. 26.
    Su, Y., Zhang, Y., Ji, D., Wang, Y., Wu, H.: Ensemble learning for sentiment classification. In: Ji, D., Xiao, G. (eds.) CLSW 2012. LNCS (LNAI), vol. 7717, pp. 84–93. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-36337-5_10CrossRefGoogle Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2019

Authors and Affiliations

  • Md Fahimuzzman Sohan
    • 1
    Email author
  • Sheikh Shah Mohammad Motiur Rahman
    • 1
  • Md Tahsir Ahmed Munna
    • 2
  • Shaikh Muhammad Allayear
    • 2
  • Md. Habibur Rahman
    • 1
    • 3
  • Md. Mushfiqur Rahman
    • 1
  1. 1.Department of Software EngineeringDaffodil International UniversityDhakaBangladesh
  2. 2.Department of Multimedia and Creative TechnologyDaffodil International UniversityDhakaBangladesh
  3. 3.Department of Information and Communication TechnologyMawlana Bhashani Science and Technology UniversityTangailBangladesh

Personalised recommendations

Cite paper

Buy options