Abstract
Sentiment analysis process is about gaining insights into the consumer’s perception using the inputs like comments and opinions shared over the web platform. Most of the existing sentiment analysis models envisaged the complexities, which is due to high volume of features notified through standard selection/extraction process. In this manuscript, the proposed solution is about using statistical assessment strategies for selecting optimal features under sentiment lexicon context. The proposed solution relies on Wilcoxon signed score for finding significance of feature towards positive and negative sentiments. Concerning to performance analysis of the proposed solution, the experimental study is conducted using benchmark classifiers like SVM, NB and AdaBoost. Results from the experimental study depict that the proposed solution can support in attaining effective classification accuracy levels of 92%, upon using less than 40% of the features too.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Hu, Minqing, and Bing Liu. “Mining opinion features in customer reviews.” AAAI. Vol. 4. No. 4. 2004.
Liu, Yang, et al. “ARSA: a sentiment-aware model for predicting sales performance using blogs.” Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval. ACM, 2007.
Gangemi, Aldo, Valentina Presutti, and Diego Reforgiato Recupero. “Frame-based detection of opinion holders and topics: a model and a tool.” IEEE Computational Intelligence Magazine 9.1 (2014): 20–30.
Elawady, Rasheed M., Sherif Barakat, and Nora M. Elrashidy. “Different feature selection for sentiment classification.” International Journal of Information Science and Intelligent System 3.1 (2014): 137–150.
Liu, Huan, and Lei Yu. “Toward integrating feature selection algorithms for classification and clustering.” IEEE Transactions on knowledge and data engineering 17.4 (2005): 491–502.
Koncz, Peter, and Jan Paralic. “An approach to feature selection for sentiment analysis.” Intelligent Engineering Systems (INES), 2011 15th IEEE International Conference on IEEE, 2011.
Agarwal, Basant, and Namita Mittal. “Sentiment classification using rough set based hybrid feature selection.” Proceedings of the 4th workshop on computational approaches to subjectivity, sentiment and social media analysis (WASSA’13), NAACL-HLT. Atlanta. 2013.
Saeys, Yvan, IñakiInza, and Pedro Larrañaga. “A review of feature selection techniques in bioinformatics.” bioinformatics 23.19 (2007): 2507–2517.
Yousefpour, Alireza, et al. “A comparative study on sentiment analysis.” Advances in Environmental Biology (2014): 53–69.
Bharti, Kusum Kumari, and Pramod Kumar Singh. “Hybrid dimension reduction by integrating feature selection with feature extraction method for text clustering.” Expert Systems with Applications 42.6 (2015): 3105–3114.
Liu, Bing. “Sentiment analysis and opinion mining.” Synthesis lectures on human language technologies 5.1 (2012): 1–167.
Yousefpour, Alireza, Roliana Ibrahim, and Haza Nuzly Abdull Hamed. “A novel feature reduction method in sentiment analysis.” International Journal of Innovative Computing 4.1 (2014): 34–40.
Taboada, Maite, et al. “Lexicon-based methods for sentiment analysis.” Computational linguistics 37.2 (2011): 267–307.
McDonald, Ryan, et al. “Structured models for fine-to-coarse sentiment analysis.” Annual Meeting-Association for Computational Linguistics. Vol. 45. No. 1. 2007.
Nakagawa, Tetsuji, Kentaro Inui, and Sadao Kurohashi. “Dependency tree-based sentiment classification using CRFs with hidden variables.” Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics. Association for Computational Linguistics, 2010.
Dessì, Nicoletta, and Barbara Pes. “Similarity of feature selection methods: An empirical study across data intensive classification tasks.” Expert Systems with Applications 42.10 (2015): 4632–4642.
Rogati, Monica, and Yiming Yang. “High-performing feature selection for text classification.” Proceedings of the eleventh international conference on Information and knowledge management. ACM, 2002.
Yang, Yiming, and Jan O. Pedersen. “A comparative study on feature selection in text categorization.” Icml. Vol. 97. 1997.
Yousefpour, Alireza, et al. “Feature reduction using standard deviation with different subsets selection in sentiment analysis.” Asian Conference on Intelligent Information and Database Systems. Springer International Publishing, 2014.
Liao, T. Warren. “Feature extraction and selection from acoustic emission signals with an application in grinding wheel condition monitoring.” Engineering Applications of Artificial Intelligence 23.1 (2010): 74–84.
Tripathy, Abinash, Ankit Agrawal, and Santanu Kumar Rath. “Classification of sentiment reviews using n-gram machine learning approach.” Expert Systems with Applications 57 (2016): 117–126.
Murphy, Kevin P. “Naive bayes classifiers.” University of British Columbia (2006).
Speriosu, Michael, et al. “Twitter polarity classification with label propagation over lexical links and the follower graph.” Proceedings of the First workshop on Unsupervised Learning in NLP. Association for Computational Linguistics, 2011.
Suykens, Johan AK, and Joos Vandewalle. “Least squares support vector machine classifiers.” Neural processing letters 9.3 (1999): 293–300.
Guyon, Isabelle, et al. “Gene selection for cancer classification using support vector machines.” Machine learning 46.1–3 (2002): 389–422.
An, Tae-Ki, and Moon-Hyun Kim. “A new diverse AdaBoost classifier.” Artificial Intelligence and Computational Intelligence (AICI), 2010 International Conference on. Vol. 1. IEEE, 2010.
Rey, Denise, and Markus Neuhäuser. “Wilcoxon-signed-rank test.” International encyclopedia of statistical science. Springer Berlin Heidelberg, 2011. 1658–1659.
B. Pang, L. Lee, and S. Vaithyanathan. Thumbs up?: sentiment classification using machine learning techniques. In EMNLP ’02: Proc. of the ACL-02 conf. on Empirical methods in natural language processing, pages 79–86. ACL, 2002.
http://web.stanford.edu/class/cs424p/materials/ling287-handout-09–21-lexicons.pdf.
Sahoo, PK, and Riedel T. Mean Value Theorems. Functional Equations. World Scientific, 1998.
http://math.ucalgary.ca/files/math/wilcoxon_signed_rank_table.pdf.
Ihaka R, Gentleman R. R: a language for data analysis and graphics. Journal of computational and graphical statistics. 1996 Sep 1;5(3):299–314.
http://thinknook.com/wp-content/uploads/2012/09/Sentiment-Analysis-Dataset.zip.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Sayeedunnisa, S.F., Hegde, N.P., Khan, K.U.R. (2018). Wilcoxon Signed Rank Based Feature Selection for Sentiment Classification. In: Bhateja, V., Tavares, J., Rani, B., Prasad, V., Raju, K. (eds) Proceedings of the Second International Conference on Computational Intelligence and Informatics . Advances in Intelligent Systems and Computing, vol 712. Springer, Singapore. https://doi.org/10.1007/978-981-10-8228-3_27
Download citation
DOI: https://doi.org/10.1007/978-981-10-8228-3_27
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-10-8227-6
Online ISBN: 978-981-10-8228-3
eBook Packages: EngineeringEngineering (R0)