Sentiment Mining Using SVM-Based Hybrid Classification Model

Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 246)


With the rapid growth of social networks, opinions expressed in social networks play an influential role in day-to-day life. A need for a sentiment mining model arises, so as to enable the retrieval of opinions for decision making. Though support vector machine (SVM) has been proved to provide a good classification result in sentiment mining, the practically implemented SVM is often far from the theoretically expected level because their implementations are based on the approximated algorithms due to the high complexity of time and space. To improve the limited classification performance of the real SVM, we propose to use the hybrid model of SVM and principal component analysis (PCA). In this paper, we apply the concept of reducing the data dimensionality using PCA to decrease the complexity of an SVM-based sentiment classification task. The experimental results for the product reviews show that the proposed hybrid model of SVM with PCA outperforms a single SVM in terms of classification accuracy and receiver-operating characteristic curve (ROC).


Sentiment Opinion Mining Hybrid model PCA 


  1. 1.
    Gamon, M. (2004). Sentiment classification on customer feedback data: Noisy data, large feature vectors, and the role of linguistic analysis. In Proceedings of the 20th International Conference on Computational Linguistics (p. 841).Google Scholar
  2. 2.
    Hatzivassiloglou, V., Wiebe, J. (2000). Effects of adjective orientation and gradability on sentence subjectivity. In International Conference on Computational Linguistics (COLING-2000).Google Scholar
  3. 3.
    Matjaz Majnik, Zoran Bosni, ROC Analysis of Classifiers in Machine Learning: A Survey,Technical report MM-1,2011.Google Scholar
  4. 4.
    Pang, B., Lee, L., Vaithyanathan, S. (2002). Thumbs up? Sentiment Classification Using Machine Learning Techniques. EMNLP’.Google Scholar
  5. 5.
    Prabowo, R., & Thelwall, M. (2009). Sentiment analysis: A combined approach. Journal of Informetrics, 3, 143–157.Google Scholar
  6. 6.
    Rui Xia, Chengqing Zong, Shoushan Li, Ensemble of feature sets and classification algorithms for sentiment classification, Information Sciences 181 (2011) 1138–1152.Google Scholar
  7. 7.
    Tan, S. B., & Zhang, J. (2008). An Empirical study of sentiment analysis for Chinese documents. Expert Systems with Application, 34(4), 2622–2629.Google Scholar
  8. 8.
    Tang, H., Tan, S., & Cheng, X. (2009). A survey on sentiment detection of reviews. Expert Systems with Applications, 36, 10760–10773.Google Scholar
  9. 9.
    Turney, P. D. (2002). Thumbs up or thumbs down? Semantic orientation applied to unsupervised classification of reviews. In Proceedings of the 40th Annual Meetings of the Association for Computational Linguistics, (pp. 417–424). Philadelphia, PA.Google Scholar
  10. 10.
    Wang, S. G., Wei, Y. J., Zhang, W., Li, D. Y., & Li, W. (2007). A hybrid method of feature selection for chinese text sentiment classification [C]. In Proceedings of the 4th International Conference on Fuzzy Systems and Knowledge Discovery (pp. 435–439). IEEE Computer Society.Google Scholar
  11. 11.
    Wilson,T., Wiebe, J., Hoffman, P. (2005). Recognizing contextual polarity in phrase level sentiment analysis. In Proceedings of the Human Language Technology Conference and Conference on Empirical Methods in Natural Language Processing (pp. 347–354). British Columbia, Canada.Google Scholar
  12. 12.
    Yang, Y. M., & Pedersen, J. O. (1997). A Comparative study on feature selection in text categorization. ICML, 412–420.Google Scholar
  13. 13.
    Ziqiong Zhang, Qiang Ye, Zili Zhang, Yijun Li, Sentiment classification of Internet restaurant reviews written in Cantonese, Expert Systems with Applications 38 (2011) 7674–7682.Google Scholar

Copyright information

© Springer India 2014

Authors and Affiliations

  1. 1.Department of Computer Science and EngineeringAnnamalai UniversityChidambaramIndia

Personalised recommendations