Encyclopedia of Social Network Analysis and Mining

2018 Edition
| Editors: Reda Alhajj, Jon Rokne

Multi-classifier System for Sentiment Analysis and Opinion Mining

  • Luana Batista
  • Sylvie Ratté
Reference work entry
DOI: https://doi.org/10.1007/978-1-4939-7131-2_351




Area Under Curve


Equal Error Rate


False-Positive Rate


Iterative Boolean Combination


Multi-classifier System


Maximum Realizable ROC


Receiver Operating Characteristics


True-Positive Rates


Sentiment Analysis and Opinion Mining is a subfield of Text Mining which aims at identifying the sentiment of people with respect to a specific subject. This subjective information is extracted from texts by using a combination of machine learning and natural language processing techniques.


Due to the large amount of information contained in Twitter messages, often consisting of opinions about different subjects, they quickly became an attractive source of data for Sentiment Analysis and Opinion Mining (Go et al. 2009; Tumasjan et al. 2010; Pak and Paroubek 2010; Davidov et al. 2010; Bifet and Frank 2010;...

This is a preview of subscription content, log in to check access.



We would like to thank Francis Quintal Lauzon from LIVIA (Laboratoire d’imagerie, de vision et d’intelligence artificielle) for his valuable advices.


  1. Agarwal A, Xie B, Vovsha I, Rambow O, Passonneau R (2011) Sentiment analysis of Twitter data. In: Workshop on languages in social media, LSM’11, Portland, pp 30–38Google Scholar
  2. Barbosa L, Feng J (2010) Robust sentiment detection on Twitter from biased and noisy data. In: 23rd international conference on computational linguistics: posters, COLING’10, Beijing, pp 36–44Google Scholar
  3. Batista L, Granger E, Sabourin R (2010) A multi-classifier system for off-line signature verification based on dissimilarity representation. In: El Gayar N, Kittler J, Roli F (eds) Multiple classifier systems. Springer, Berlin, pp 264–273CrossRefGoogle Scholar
  4. Bermingham A, Smeaton A (2010) Classifying sentiment in microblogs: is brevity an advantage? In: Proceedings of the 19th ACM international conference on information and knowledge management, CIKM’10, Toronto, pp 1833–1836Google Scholar
  5. Bifet A, Frank E (2010) Sentiment knowledge discovery in Twitter streaming data. In: 13th international conference on discovery science. Springer, Canberra, pp 1–15Google Scholar
  6. Bird S, Klein E, Loper E (2009) Natural language processing with Python: analyzing text with the natural language toolkit. O’Reilly, BeijingzbMATHGoogle Scholar
  7. Dave K, Lawrence S, Pennock D (2003) Mining the peanut gallery: opinion extraction and semantic classification of product reviews. In: 12th international conference on world wide web, Budapest, pp 519–528Google Scholar
  8. Davidov D, Tsur O, Rappoport A (2010) Enhanced sentiment learning using Twitter hashtags and smileys. In: 23rd international conference on computational linguistics: posters, COLING’10, Beijing, pp 241–249Google Scholar
  9. Fawcett T (2006) An introduction to roc analysis. Pattern Recogn Lett 27:861–874CrossRefGoogle Scholar
  10. Go A, Bhayani R, Huang L (2009) Twitter sentiment classification using distant supervision. Processing 150(12):1–6Google Scholar
  11. Khreich W, Granger E, Miri A, Sabourin R (2010) Iterative Boolean combination of classifiers in the ROC space: an application to anomaly detection with HMMs. Pattern Recogn 43:2732–2752zbMATHCrossRefGoogle Scholar
  12. Khreich W, Granger E, Miri A, Sabourin R (2011) Incremental Boolean combination of classifiers. In: Sansone C, Kittler J, Roli F (eds) Multiple classifier systems. Lecture notes in computer science, vol 6713. Springer, Berlin, pp 340–349CrossRefGoogle Scholar
  13. Khreich W, Granger E, Miri A, Sabourin R (2012) Adaptive ROC-based ensembles of HMMs applied to anomaly detection. Pattern Recogn 45(1):208–230zbMATHCrossRefGoogle Scholar
  14. Pak A, Paroubek P (2010) Twitter as a corpus for sentiment analysis and opinion mining. In: 7th conference on international language resources and evaluation, Valleta, European Language Resources AssociationGoogle Scholar
  15. Pang B, Lee L, Vaithyanathan S (2002) Thumbs up? Sentiment classification using machine learning techniques. In: ACL-02 conference on empirical methods in natural language processing, vol 10. Philadelphia, pp 79–86Google Scholar
  16. Prati R, Batista G, Monard M (2011) A survey on graphical methods for classification predictive performance evaluation. IEEE Trans Knowl Data Eng 23(11):1601–1618CrossRefGoogle Scholar
  17. Read J (2005) Using emoticons to reduce dependency in machine learning techniques for sentiment classification. In: ACL student research workshop, Ann Arbor, pp 43–48Google Scholar
  18. Russell M (2011) Mining the social web. O’Reilly, Beijing/SebastopolGoogle Scholar
  19. Tumasjan A, Sprenger T, Sandner P, Welpe I (2010) Predicting elections with Twitter: what 140 characters reveal about political sentiment. Word J Int Linguist Assoc 280(39):178–185Google Scholar
  20. Tumer K, Ghosh J (1996) Analysis of decision boundaries in linearly combined neural classifiers. Pattern Recogn 29(2):341–348CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media LLC, part of Springer Nature 2018

Authors and Affiliations

  1. 1.École de technologie supérieureMontreálCanada

Section editors and affiliations

  • Fakhreddine Karray
    • 1
  1. 1.Department of Electrical and Computer Engineering, Centre for Pattern Analysis and Machine Intelligence (CPAMI)University of WaterlooWaterlooCanada