Neural Computing and Applications

, Volume 31, Issue 12, pp 8971–8983 | Cite as

Text emotion detection in social networks using a novel ensemble classifier based on Parzen Tree Estimator (TPE)

  • Fereshteh Ghanbari-Adivi
  • Mohammad MoslehEmail author
Original Article


The texts often express the emotions of the writers or cause emotions in the readers. In recent years, the development of the social networks has made emotional analysis of texts into an attractive topic for research. A sentiment analysis system for automatic detection of fine-grained emotions in text consists of three main parts of preprocessing, feature extraction and classification. The main focus of this paper is on presenting a novel ensemble classifier that is consisted of 1500 of k-Nearest Neighbor, Multilayer Perceptron and Decision Tree basic classifiers, which is able to systematically distinguish different fine-grained emotions between regular and irregular sentences with a proper accuracy. Moreover, Tree-structured Parzen Estimator is employed to tune parameters of the basic classifiers. The preprocessing and feature extraction operations are performed by natural language processing tools (Tokenization and Lemmatization) and Doc2Vector algorithm, respectively. Three different sets of ISEAR, OANC and CrowdFlower are used to evaluate the proposed method, which consists of regular and irregular sentences. The evaluation results show that accuracies of the proposed ensemble classifier are 99.49 and 88.49% in the detection of regular and irregular sentences, respectively.


Sentiment analysis Emotion classification Ensemble classifier Doc2Vector algorithm 


Compliance with ethical standards

Conflict of interest

The authors declare that there is no conflict of interest regarding the publication of this paper.


  1. 1.
    Ekman P (1972) Universal and cultural differences in facial expression of emotion. In: Nebraska symposium on motivation, vol 19, pp 207–284Google Scholar
  2. 2.
    Colombetti G (2009) From affect programs to dynamical discrete emotions. Philos Psychol 22(4):407–425CrossRefGoogle Scholar
  3. 3.
    Roseman IJ (1991) Appraisal determinants of discrete emotions. Cogn Emot 5(3):161–200CrossRefGoogle Scholar
  4. 4.
    Ekman P (1992) An argument for basic emotions. Cogn Emot 6(3–4):169–200CrossRefGoogle Scholar
  5. 5.
    Chaffar S, Inkpen D (2011) Using a heterogeneous dataset for emotion analysis in text. In: Canadian conference on artificial intelligence, pp 62–67CrossRefGoogle Scholar
  6. 6.
    Perikos I, Hatzilygeroudis I (2016) Recognizing emotions in text using ensemble of classifiers. Eng Appl Artif Intell 51:191–201CrossRefGoogle Scholar
  7. 7.
    Medhat W, Hassan A, Korashy H (2014) Sentiment analysis algorithms and applications: a survey. Ain Shams Eng J 5(4):1093–1113CrossRefGoogle Scholar
  8. 8.
    De Marneffe M-C, MacCartney B, Manning CD (2006) Generating typed dependency parses from phrase structure parses. In: Proceedings of LREC, pp 449–454Google Scholar
  9. 9.
    Strapparava C, Valitutti A (2004) Wordnet affect: an affective extension of wordnet. In: Lrec, pp 1083–1086Google Scholar
  10. 10.
    Xuegong Z (2000) Introduction to statistical learning theory and support vector machines. Acta Autom Sin 26(1):32–42MathSciNetGoogle Scholar
  11. 11.
    Wu X et al (2008) Top 10 algorithms in data mining. Knowl Inf Syst 14(1):1–37CrossRefGoogle Scholar
  12. 12.
    Murray AF (1995) Applications of neural networks. The University of Edinburgh UK: Springer, Boston, MACrossRefGoogle Scholar
  13. 13.
    Rokach L, Maimon O (2005) Top-down induction of decision trees classifiers—a survey. IEEE Trans Syst Man Cybern Part C (Appl Rev) 35(4):476–487CrossRefGoogle Scholar
  14. 14.
    Zhang Y, Jin R, Zhou Z-H (2012) Understanding bag-of-words model: a statistical framework. Int J Mach Learn Cybern 1(1–4):43–52Google Scholar
  15. 15.
    Mikolov T et al (2013) Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781
  16. 16.
    Le Q, Mikolov T (2014) Distributed representations of sentences and documents. In: International conference on machine learning, pp 1188–1196Google Scholar
  17. 17.
    Bergstra JS et al (2011) Algorithms for hyper-parameter optimization. In: Advances in neural information processing systems, pp 2546–2554Google Scholar
  18. 18.
    Hutter F, Hoos HH, Leyton-Brown K (2011) Sequential model-based optimization for general algorithm configuration. In: International conference on learning and intelligent optimization, pp 507–523Google Scholar
  19. 19.
    Zhao M, Li J (2018) Tuning the hyper-parameters of CMA-ES with tree-structured Parzen estimators. In: Tenth international conference on advanced computational intelligence (ICACI), pp 613–618Google Scholar
  20. 20.
    Hinz T et al (2018) Speeding up the hyperparameter optimization of deep convolutional neural networks. Int J Comput Intell Appl 17(2):1850008CrossRefGoogle Scholar
  21. 21.
    Ilievski I et al (2017) Efficient hyperparameter optimization for deep learning algorithms using deterministic RBF surrogates. In: AAAI, pp 822–829Google Scholar
  22. 22.
    Madrigal F, Maurice C, Lerasle F (2019) Hyper-parameter optimization tools comparison for Multiple Object Tracking applications. Mach Vis Appl 30(2):269–289CrossRefGoogle Scholar
  23. 23.
    Wang S et al (2018) A TPE based inversion of PROSAIL for estimating canopy biophysical and biochemical variables of oilseed rape. Comput Electron Agric 152:350–362CrossRefGoogle Scholar
  24. 24.
    Jones DR (2001) A taxonomy of global optimization methods based on response surfaces. J Glob Optim 21(4):345–383MathSciNetCrossRefGoogle Scholar
  25. 25.
    Quan C, Ren F (2010) Sentence emotion analysis and recognition based on emotion words using Ren-CECps. Int J Adv Intell 2(1):105–117Google Scholar
  26. 26.
    Balahur A, Hermida JM, Montoyo A (2011) Detecting implicit expressions of sentiment in text based on commonsense knowledge. In: Proceedings of the 2nd workshop on computational approaches to subjectivity and sentiment analysis, pp 53–60Google Scholar
  27. 27.
    Balahur A, Hermida JM, Montoyo A (2012) Building and exploiting emotinet, a knowledge base for emotion detection based on the appraisal theory model. IEEE Trans Affect Comput 3(1):88–101CrossRefGoogle Scholar
  28. 28.
    Badugu S, Suhasini M (2017) Emotion detection on twitter data using knowledge base approach. Int J Comput Appl 162(10):975–978Google Scholar
  29. 29.
    Danisman T, Alpkocak A (2008) Feeler: emotion classification of text using vector space model. In: AISB 2008 convention communication, interaction and social intelligence, p 53Google Scholar
  30. 30.
    Quan C, Ren F (2016) Weighted high-order hidden Markov models for compound emotions recognition in text. Inf Sci 329:581–596CrossRefGoogle Scholar
  31. 31.
    Webster JJ, Kit C (1992) Tokenization as the initial phase in NLP. In: Proceedings of the 14th conference on computational linguistics, vol 4, pp 1106–1110Google Scholar
  32. 32.
    Jivani AG (2011) A comparative study of stemming algorithms. Int J Comput Technol Appl 2(6):1930–1938Google Scholar
  33. 33.
    Efron B, Tibshirani RJ (1994) An introduction to the bootstrap. CRC Press, Boca RatonzbMATHGoogle Scholar
  34. 34.
  35. 35.
    Open American National Corpus, [online]. Accessed: Sept 2017
  36. 36.
    The Emotion in Text data set by CrowdFlower, [online]. Accessed Sept 2017

Copyright information

© Springer-Verlag London Ltd., part of Springer Nature 2019

Authors and Affiliations

  1. 1.Department of Computer Engineering, Dezful BranchIslamic Azad UniversityDezfulIran

Personalised recommendations