Skip to main content
Log in

A novel framework based on bi-objective optimization and LAN2FIS for Twitter sentiment analysis

  • Original Article
  • Published:
Social Network Analysis and Mining Aims and scope Submit manuscript

Abstract

Nowadays, opinion mining and sentiment analysis are the hot topics of research in social networks. Twitter is a popular social media that has general way of expressing opinions and interacting with other users in the online. Since the topics in Twitter are very diverse, it is difficult to collect data in the domain of sentiment classification. In this paper, a novel framework has been proposed which preprocesses information to enrich the tweet. Once the tweets are processed, a various features are extracted from the tweets. In this paper, we propose hybrid machine learning algorithms called LAN2FIS (logistic adaptive network based on neuro-fuzzy inference system) to utilize this huge information. The major challenge encountered in machine learning method-based sentiment classification is the abundant amount of data available. This amount makes the system complex and difficult to train the learning algorithms in a feasible time and degrades the system model in terms of classification accuracy. Hence, feature selection becomes an essential task in proposing robust and efficient classification models while increasing the accuracy. This paper presents a bi-objective optimization (minimum redundancy and maximum relevancy) for feature selection, which finds the more efficient feature subsets can be obtained. We performed our experiments using public tweets. Our overall work is implemented in a parallel and distributed way using the Hadoop framework with the MongoDB database to solve the problem of the computation time of the analysis when the dataset of the tweets is very large. Finally, we evaluate the following the performance in terms of accuracy, precision, recall, F-measure and error rate. Experimental evaluations show that our H-MLA is more efficient and has higher accuracy than that of other classifiers.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  • Asha M, Deepa Shenoy P, Chandra Mohan M, Venugopal KR (2016) Aspect term extraction for sentiment analysis in large movie reviews using Gini Index feature selection method and SVM classifier. World Wide Web, pp 1–20

  • Avinash Chandra P, Dharmveer Singh R, Saraswat M (2017) Twitter sentiment analysis using hybrid Cuckoo search method. Inf Process Manage 53(4):764–779. https://doi.org/10.1016/j.ipm.2017.02.004

    Article  Google Scholar 

  • Bhadane C, Dalal H, Doshi H (2015) Sentiment analysis: measuring opinions. Procedia Comput Sci 45:808–814

    Article  Google Scholar 

  • Caetano JA, Lima HS, Santos MF, Marques-Neto HT (2018) Using sentiment analysis to define twitter political user’s classes and their homophily during the 2016 American presidential election. J Internet Serv Appl

  • Chamansingh N, Hosein P (2016) Efficient sentiment classification of twitter feeds. In: IEEE international conference on knowledge engineering and applications

  • Che W, Zhao Y, Guo H, Su Z, Liu T (2015) Sentence compression for aspect based sentiment analysis. IEEE Trans Audio Speech Lang Process 23(12):2111–2124

    Article  Google Scholar 

  • Gull R, Shoaib U, Rasheed S, Abid W, Zahoor B (2016) Preprocessing of twitter’s data for opinion mining in political context. Procedia Comput Sci 96:1560–1570

    Article  Google Scholar 

  • Hai Z, Chang K, Kim J-J, Yang CC (2014) Identifying features in opinion mining via intrinsic and extrinsic domain relevance. IEEE Trans Knowl Data Eng 26(3):623–634

    Article  Google Scholar 

  • Hogenboom A, Bal D, Frasincar F (2013) Exploiting emoticons in sentiment analysis. In: SAC’13 proceedings of the 28th annual ACM symposium on applied computing, pp 703–710

  • Hridoy SAA, TahmidEkram M, Samiul Islam M, Ahmed F, Rahman RM (2015) Localized twitter opinion mining using sentiment analysis. Decis Anal 2(8):1–19

    Google Scholar 

  • Jumadi, Maylawati DS, Subaeki B, Ridwan T (2016) Opinion mining on twitter microblogging using support vector machine: public opinion about State Islamic University of Bandung. In: International conference on cyber and IT service management, Bandung, Indonesia

  • Kharde VA, Sonawane SS (2016) Sentiment analysis of twitter data: a survey of techniques. Int J Comput Appl 139(11):1–15

    Google Scholar 

  • Kim S, Van Der Weijde O, Frasincar F, Dekker R (2017) Supervised and unsupervised aspect category detection for sentiment analysis with co-occurrence data. IEEE Trans Cybern 99:1–13

    Google Scholar 

  • Liao S, Wang J, Yu R, Sato K, Cheng Z (2017) CNN for situations understanding based on sentiment analysis of twitter data. Procedia Comput Sci 111:376–381

    Article  Google Scholar 

  • Liu S, Cheng X, Li F, Li F (2014) TASC: topic-adaptive sentiment classification on dynamic tweets. IEEE Trans Knowl Data Eng 27(6):1696–1709

    Article  Google Scholar 

  • Madani Y, Erritali M, Bengourram J (2018) Sentiment analysis using semantic similarity and Hadoop MapReduce. Knowl Inf Syst 1–24

  • Mondher B, Tomoaki O (2017) A pattern based approach for multi-class sentiment analysis in twitter. IEEE Access

  • Munezero M, Montero CS, Sutinen E, Pajunen J (2014) Are they different? Affect, feeling, emotion, sentiment and opinion detection in text. IEEE Trans Affect Comput 5(2):101–111

    Article  Google Scholar 

  • Nagaarjuna Devi DV, Kishore Kumar CV, Prasad S (2016) A feature based approach for sentiment analysis by using support vector machine. In: IEEE 6th international conference on advanced computing

  • Onan A, Korukonglu S (2015) A feature selection model based on genetic rank aggregation for text sentiment classification. J Inf Sci 1–14

  • Panagiotou N, Katakis I, Gunopulos D (2016) Detecting events in online social networks: definitions, trends and challenge. Springer, Cham, pp 42–84

    Google Scholar 

  • Phand SA, Phand JA (2017) Twitter sentiment classification using Stanford NLP. In: 1st International conference on intelligent systems and information management (ICSIM), Aurangabad, India

  • Piryani R, Madhavi D, Singh VK (2017) Analytical mapping of opinion mining and sentiment analysis. Inf Process Manage 53:122–150. https://doi.org/10.1016/j.ipm.2016.07.001

    Article  Google Scholar 

  • Rana TA, Cheah Yu-N (2016) Aspect extraction in sentiment analysis: comparative analysis and survey. Artif Intell Rev 46(4):459–483

    Article  Google Scholar 

  • Ravi K, Ravi V (2015) A survey on opinion mining and sentiment analysis: tasks, approaches and applications. Knowl-Based Syst Elsevier 89:14–46. https://doi.org/10.1016/j.knosys.2015.06.015

    Article  Google Scholar 

  • Ruangkanokmas P, Achalakul T, Akkarajitsakul K (2017) Deep belief networks with feature selection for sentiment classification. In: 7th International conference on intelligent systems, modelling and simulations. IEEE

  • Sahni T, Chandak C, Reddy N, Singh M (2017) Efficient twitter sentiment classification using subjective distant supervision. In: 9th International conference on communication systems and networks (COMSNETS), Bangalore, India

  • Srivastava R (2017) Challenges with sentiment analysis of on-line micro-texts. Int J Intell Syst Appl 7:31–40

    Google Scholar 

  • Vyas V, Uma V (2017) An extensive study of sentiment analysis tools and binary classification of tweets using Rapid Miner. In: 6th International conference on smart computing and communications, ICSCC 2017, Puducherry, India

  • Wang B, Liu M (2015) Deep learning for aspect based sentiment analysis

  • Yadollahi A, Shahraki AG, Zaiane OR (2017) Current state of text sentiment analysis from opinion to emotion mining. ACM Comput Surv 50(2):1–33. https://doi.org/10.1145/3057270

    Article  Google Scholar 

  • Younis E (2015) Sentiment analysis and text mining for social media microblogs using open source tools: an empirical study. Int J Comput Appl 112(5):1–6

    Google Scholar 

  • Zhao W, Guan Z, Chen L, He X, Cai D, Wang B, Wang Q (2018) Weakly-supervised deep embedding for product sentiment analysis. IEEE Trans Knowl Data Eng 30(1):185–197

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to R. Nagamanjula.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Nagamanjula, R., Pethalakshmi, A. A novel framework based on bi-objective optimization and LAN2FIS for Twitter sentiment analysis. Soc. Netw. Anal. Min. 10, 34 (2020). https://doi.org/10.1007/s13278-020-00648-5

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s13278-020-00648-5

Keywords

Navigation