Skip to main content
View expanded cover

International Conference on Industrial, Engineering and Other Applications of Applied Intelligent Systems

IEA/AIE 2016: Trends in Applied Knowledge-Based Systems and Data Science pp 269–279Cite as

Twitter Feature Selection and Classification Using Support Vector Machine for Aspect-Based Sentiment Analysis

Part of the Lecture Notes in Computer Science book series (LNAI,volume 9799)

Abstract

In this paper, with regards to aspect-based sentiment classification accuracy problem, we propose a Principal Component Analysis (PCA) feature selection method that can determine the most relevant set of features for aspect-based sentiment classification. Feature selection helps to reduce redundant features and remove irrelevant features which affect classifier accuracy. In this paper we present a method for feature selection for twitter aspect-based sentiment classification based on Principal Component Analysis (PCA). PCA is combined with Sentiwordnet lexicon-based method which is incorporated with Support Vector Machine (SVM) learning framework to perform the classification. Experiments on our own Hate Crime Twitter Sentiment (HCTS) and benchmark Stanford Twitter Sentiment (STS) datasets yields accuracies of 94.53 % and 97.93 % respectively. The comparisons with other statistical feature selection methods shows that our proposed approach shows promising results in improving aspect-based sentiment classification performance.

Keywords

  • Twitter
  • Aspect-based feature extraction
  • Aspect-based sentiment classification
  • Feature selection
  • Principal component analysis
  • Support vector machine

This is a preview of subscription content, access via your institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-3-319-42007-3_23
  • Chapter length: 11 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
USD   109.00
Price excludes VAT (USA)
  • ISBN: 978-3-319-42007-3
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   149.99
Price excludes VAT (USA)
Learn about institutional subscriptions
Fig. 1.

References

  1. Pak, A., Paroubek, P.: Twitter as a corpus for sentiment analysis and opinion mining. In: Proceedings of the Seventh Conference on International Language Resources and Evaluation (LREC 2010), (Valletta, Malta), European Language Resources Association (ELRA), May 2010

    Google Scholar 

  2. Go, A., Bhayani, R.: Twitter sentiment classificationusing distant supervision. CS224N Project Rep. Stanford 1, 1–12 (2009)

    Google Scholar 

  3. Niu, Z., Yin, Z., Kong, X.: Sentiment classification formicroblog by machine learning. In: 2012 Fourth International Conference on Computational and Information Sciences (ICCIS), pp. 286–289, August 2012

    Google Scholar 

  4. Lek, H.H., Poo, D.: Aspect-based twitter sentimentclassification. In: 2013 IEEE 25th International Conference on Tools with Artificial Intelligence (ICTAI), pp. 366–373, November 2013

    Google Scholar 

  5. Ghiassi, M., Skinner, J., Zimbra, D.: Twitter brand sentiment analysis: a hybrid system using n-gram analysis and dynamic artificial neural network. Expert Syst. Appl. 40(16), 6266–6282 (2013)

    CrossRef  Google Scholar 

  6. Feldman, R.: Techniques and applications for sentiment analysis. Commun. ACM 56, 82–89 (2013)

    CrossRef  Google Scholar 

  7. Zhang, Y., Dang, Y., Chen, H.: Research note: examining gender emotional differences in web forum communication. Decis. Support Syst. 55(3), 851–860 (2013)

    CrossRef  Google Scholar 

  8. Bhuta, S., Doshi, A., Doshi, U., Narvekar, M.: A review oftechniques for sentiment analysis of twitter data. In: 2014 International Conference on Issues and Challenges in Intelligent Computing Techniques (ICICT), pp. 583–591, February 2014

    Google Scholar 

  9. Pang, B., Lee, L., Vaithyanathan, S.: Thumbs up?: sentiment classification using machine learning techniques. In: Proceedings of the ACL-02 Conference on Empirical Methods in Natural Language Processing, EMNLP 2002, vol. 10, pp. 79–86, Association for Computational Linguistics, Stroudsburg, PA, USA (2002)

    Google Scholar 

  10. Brychcin, T., Konkol, M., Steinberger, J.: UWB: machine learning approach to aspect-based sentiment analysis, SemEval 2014, p. 817 (2014)

    Google Scholar 

  11. Liu, K.L., Li, W.J., Guo, M.: Emoticon smoothed language modelsfor twitter sentiment analysis, vol. 2, pp. 1678–1684, 2012. cited By (since 1996)

    Google Scholar 

  12. Kansal, H., Toshniwal, D.: Aspect based summarization of context dependent opinion words. Procedia Comput. Sci. 35, 166–175 (2014). 2014 Proceedings of 18th Annual Conference on Knowledge-Based and Intelligent Information and amp; Engineering Systems, KES-2014 Gdynia, Poland, September

    CrossRef  Google Scholar 

  13. Zhang, W., Xu, H., Wan, W.: Weakness finder: find product weakness from chinese reviews by using aspects based sentiment analysis. Expert Syst. Appl. 39(11), 10283–10291 (2012)

    CrossRef  Google Scholar 

  14. Jmal, J., Faiz, R.: Customer review summarization approach using twitter and sentiwordnet. In: Proceedings of the 3rd International Conference on Web Intelligence, Mining and Semantics, WIMS 2013, pp. 33:1–33:8, New York, NY, USA. ACM (2013)

    Google Scholar 

  15. Marrese-Taylor, E., Velsquez, J.D., Bravo-Marquez, F.: A novel deterministic approach for aspect-based opinion mining in tourism products reviews. Expert Syst. Appl. 41(17), 7764–7775 (2014)

    CrossRef  Google Scholar 

  16. Baccianella, S., Esuli, A., Sebastiani, F.: Sentiwordnet 3.0: an enhanced lexical resource for sentiment analysis and opinion mining. In: Calzolari, N., Choukri, K., Maegaard, B., Mariani, J., Odijk, J., Piperidis, S., Rosner, M., Tapias, D. (eds.) LREC, European Language Resources Association (2010)

    Google Scholar 

  17. Zainuddin, N., Selamat, A., Ibrahim, R.: Improving twitter aspect-based sentiment analysis using hybrid approach. In: Nguyen, N.T., Trawiński, B., Fujita, H., Hong, T.P. (eds.) ACIIDS 2016, Part I. LNCS, vol. 9621, pp. 151–160. Springer, Heidelberg (2016)

    CrossRef  Google Scholar 

  18. Liu, B.: Sentiment Analysis and Subjectivity: Handbook of Natural Language Processing, 2nd edn. CRC Press, Boca Raton (2010)

    Google Scholar 

  19. Esuli, A., Sebastiani, F.: Sentiwordnet: a publicly available lexical resource for opinion mining. In: Proceedings of LREC, vol. 6, pp. 417–422 (2006)

    Google Scholar 

  20. Selamat, A., Omatu, S.: Web page feature selection and classification using neural networks. Inf. Sci. 158, 69–88 (2004)

    MathSciNet  CrossRef  Google Scholar 

  21. Vinodhini, G., Chandrasekaran, M.R.: Opinion mining using principal component analysis based ensemble model for e-commerce application. CSI Trans. ICT 2(3), 169–179 (2014)

    CrossRef  Google Scholar 

  22. Cortes, C., Vapnik, V.: Support-vector networks. Mach. Learn. 20(3), 273–297 (1995)

    MATH  Google Scholar 

  23. Joachims, T.: Text categorization with support vector machines: learning with many relevant features. In: Nédellec, C., Rouveirol, C. (eds.) ECML 1998. LNCS, vol. 1398, pp. 137–142. Springer, Heidelberg (1998)

    CrossRef  Google Scholar 

  24. Agarwal, A., Xie, B., Vovsha, I., Rambow, O., Passonneau, R.: Sentiment analysis of twitter data. In: Proceedings of the Workshop on Languages in Social Media, LSM 2011, pp. 30–38, Association for Computational Linguistics, Stroudsburg, PA, USA (2011)

    Google Scholar 

Download references

Acknowledgments

The authors wish to thank Universiti Teknologi Malaysia (UTM) under Research University Grant Vot- 02G31 and Ministry of Higher Education Malaysia (MOHE) under the Fundamental Research Grant Scheme (FRGS Vot-4F551) for the completion of the research.

Author information

Authors and Affiliations

  1. Faculty of Computing, Universiti Teknologi Malaysia, 81310, Johor Bahru, Johor, Malaysia

    Nurulhuda Zainuddin, Ali Selamat & Roliana Ibrahim

Authors
  1. Nurulhuda Zainuddin
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ali Selamat
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Roliana Ibrahim
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ali Selamat .

Editor information

Editors and Affiliations

  1. Iwate Prefectural University , Iwate, Japan

    Hamido Fujita

  2. Department Computer Science, Texas State University, San Marcos, Texas, USA

    Moonis Ali

  3. Universiti Teknologi Malaysis (UTM), Bahru, Malaysia

    Ali Selamat

  4. Iwate Prefectural University , Iwate, Japan

    Jun Sasaki

  5. Iwate Prefectural University , Iwate, Japan

    Masaki Kurematsu

Rights and permissions

Reprints and Permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this paper

Cite this paper

Zainuddin, N., Selamat, A., Ibrahim, R. (2016). Twitter Feature Selection and Classification Using Support Vector Machine for Aspect-Based Sentiment Analysis. In: Fujita, H., Ali, M., Selamat, A., Sasaki, J., Kurematsu, M. (eds) Trends in Applied Knowledge-Based Systems and Data Science. IEA/AIE 2016. Lecture Notes in Computer Science(), vol 9799. Springer, Cham. https://doi.org/10.1007/978-3-319-42007-3_23

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-42007-3_23

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-42006-6

  • Online ISBN: 978-3-319-42007-3

  • eBook Packages: Computer ScienceComputer Science (R0)