Abstract
Sarcastic tweets or reviews confuse the public those who interested to buy the products from online and prior know about the customer’s opinion about the products. E-Commerce business people also come across this problem to understand the customer’s sarcastic opinion. To remove this problem and to help the online customers also to help the business people to know the customer’s opinion is sarcastic or non sarcastic this research work carried out identify the sarcastic opinion. In many existing methods for detecting sarcastic statements commonly followed the part of speech (POS) -Tag, N-Gram methods for extract the features, as well as represented the features by Term Frequency-Inverse Document Frequency (TF-IDF) and binary methods, and for feature selection utilized chi squared, information gain methods. Other than the above mentioned methods authors didn’t use the features such as Likes count, ReTweet count, Replies count from Tweets. Outlier from the features can be identified and detected; typically the outlier removed features will provide the best performance. Not but least, many researchers followed imbalanced dataset for sarcastic detection. These limitations are identified by this proposed work. The novelty of this proposed work is followed the hybrid techniques such as agglomerative clustering method for outlier detection, and outlier removed dataset fed as input to stacked auto encoder (SAE), finally classification and prediction completed by Ensemble of Logistic Regression, Random forest and Bi-Directional Long Short Term Memory(Bi-LSTM). Existing work doesn’t follow the outlier removal method with Deep Learning (DL) method for sarcastic opinion detection. The proposed work is completed with aid of Natural Language Processing (NLP), Python Libraries and Tweets about E-Commerce Amazon products. Proposed model obtained 99.3% accuracy in sarcasm prediction, this outperforming existing sarcasm detection algorithm. This result suggests that the proposed model was successful in detecting and analyzing sarcastic sentiment.
Similar content being viewed by others
Data availability
Data has been collected in Real Time manner from Twitter. Data will be provided for the data requisition.
References
Prasanna MSM, Shaila SG, Vadivel A (2023) Polarity classification on twitter data for classifying sarcasm using clause pattern for sentiment analysis. Multimed Tools Appl:1–37
Burstein J, Doran C, Solorio T (2019) Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers). In: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers)
Ray P, Chakrabarti A (2017) Twitter sentiment analysis for product review using lexicon method. In: 2017 International Conference on Data Management, Analytics and Innovation (ICDMAI). IEEE, pp 211–216
Ding N, Tian SW, Yu L (2022) A multimodal fusion method for sarcasm detection based on late fusion. Multimedia Tools Appl 81(6):8597–8616
Goel P, Jain R, Nayyar A, Singhal S, Srivastava M (2022) Sarcasm detection using deep learning and ensemble learning. Multimedia Tools Appl 81(30):43229–43252
Bharti SK, Vachha B, Pradhan RK, Babu KS, Jena SK (2016) Sarcastic sentiment detection in tweets streamed in real time: a big data approach. Digit Commun Netw 2(3):108–121
Banfield SR, Richmond VP, McCroskey JC (2006) The effect of teacher misbehaviors on teacher credibility and affect for the teacher. Commun Educ 55(1):63–72
Saha S, Yadav J, Ranjan P (2017) Proposed approach for sarcasm detection in twitter. Indian J Sci Technol 10(25):1–8
Eke CI, Norman AA, Shuib L, Nweke HF (2020) Sarcasm identification in textual data: systematic review, research challenges and open directions. Artif Intell Rev 53:4215–4258
Samonte MJC, Dollete CJT, Capanas PMM, Flores MLC, Soriano CB (2018) Sentence-level sarcasm detection in English and Filipino tweets. In: Proceedings of the 4th international conference on industrial and business engineering, pp 181–186
Eke CI, Norman AA, Shuib L, Nweke HF (2019) A survey of user profiling: state-of-the-art, challenges, and solutions. IEEE Access 7:144907–144924
Kumar HK, Harish BS (2018) Sarcasm classification: a novel approach by using content based feature selection method. Procedia Comput Sci 143:378–386
Schifanella R, De Juan P, Tetreault J, Cao L (2016) Detecting sarcasm in multimodal social platforms. In: Proceedings of the 24th ACM international conference on multimedia, pp 1136–1145
Dharwal P, Choudhury T, Mittal R, Kumar P (2017) Automatic sarcasm detection using feature selection. In: 2017 3rd International Conference on Applied and Theoretical Computing and Communication Technology (iCATccT). IEEE, pp 29–34
Suhaimin MSM, Hijazi MHA, Alfred R, Coenen F (2019) Modified framework for sarcasm detection and classification in sentiment analysis. Indones J Electr Eng Comput Sci 13(3):1175–1183
Kumar A, Sangwan SR, Arora A, Nayyar A, Abdel-Basset M (2019) Sarcasm detection using soft attention-based bidirectional long short-term memory model with convolution network. IEEE access 7:23319–23328
Karthik E, Sethukarasi T (2022) Sarcastic user behavior classification and prediction from social media data using firebug swarm optimization-based long short-term memory. J Supercomputing:1–25
Yavanoglu U, Ibisoglu TY, Wıcana SG (2018) Sarcasm detection algorithms. Int J Semant Comput 12(03):457–478
Tarigan J, Girsang AS (2018) Word similarity score as augmented feature in sarcasm detection using deep learning. Int J Adv Comput Res 8(39):354–363
Vinoth D, Prabhavathy P (2022) An intelligent machine learning-based sarcasm detection and classification model on social networks. J Supercomput 78(8):10575–10594
Kumar A, Garg G (2019) Empirical study of shallow and deep learning models for sarcasm detection using context in benchmark datasets. J Ambient Intell Humaniz Comput:1–16
Banerjee A, Bhattacharjee M, Ghosh K, Chatterjee S (2020) Synthetic minority oversampling in addressing imbalanced sarcasm detection in social media. Multimedia Tools Appl 79(47–48):35995–36031
Abarna S, Sheeba JI, Devaneyan SP (2022) An ensemble model for idioms and literal text classification using knowledge-enabled BERT in deep learning. Measurement: Sensors 24:100434
Tan YY, Chow CO, Kanesan J, Chuah JH, Lim Y (2023) Sentiment analysis and sarcasm detection using deep multi-task learning. Wirel Pers Commun 129(3):2213–2237
Kandasamy V, Trojovský P, Machot FA, Kyamakya K, Bacanin N, Askar S, Abouhawwash M (2021) Sentimental analysis of COVID-19 related messages in social networks by involving an N-gram stacked autoencoder integrated in an ensemble learning scheme. Sensors 21(22):7582
Ahmed K, Nadeem MI, Li D, Zheng Z, Ghadi YY, Assam M, Mohamed HG (2022) Exploiting stacked autoencoders for improved sentiment analysis. Appl Sci 12(23):12380
Mehndiratta P, Soni D (2019) Identification of sarcasm in textual data: a comparative study. J Data Inf Sci 4(4):56–83
Mehndiratta P, Sachdeva S, Soni D (2017) Detection of sarcasm in text data using deep convolutional neural networks. Scalable Comput 18(3):219–228
Kumar A, Narapareddy VT, Srikanth VA, Malapati A, Neti LBM (2020) Sarcasm detection using multi-head attention based bidirectional LSTM. IEEE Access 8:6388–6397
Bark O, Grigoriadis A, Pettersson JAN, Risne V, Siitova A, Yang H (2017) A deep learning approach for identifying sarcasm in text
Du Y, Li T, Pathan MS, Teklehaimanot HK, Yang Z (2022) An effective sarcasm detection approach based on sentimental context and individual expression habits. Cognit Comput:1–13
Manohar MY, Kulkarni P (2017) Improvement sarcasm analysis using NLP and corpus based approach. In: 2017 international conference on intelligent computing and control systems (ICICCS). IEEE, pp 618–622
Pandey AC, Seth SR, Varshney M (2019) Sarcasm detection of amazon alexa sample set. In: Advances in Signal Processing and Communication: Select Proceedings of ICSC 2018. Springer Singapore, pp 559–564
Alita D, Priyanta S, Rokhman N (2019) Analysis of emoticon and sarcasm effect on sentiment analysis of indonesian language on twitter. J Inf Syst Eng Bus Intell 5(2):100–109
Shrawankar U, Chandankhede C (2019) Sarcasm detection for workplace stress management. Int J Synth Emot 10(2):1–17
Hiai S, Shimada K (2019) Sarcasm detection using RNN with relation vector. Int J Data Warehous Min 15(4):66–78
Majumder N, Poria S, Peng H, Chhaya N, Cambria E, Gelbukh A (2019) Sentiment and sarcasm classification with multitask learning. IEEE Intell Syst 34(3):38–43
Naz F, Kamran M, Mehmood W, Khan W, Alkatheiri MS, Alghamdi AS, Alshdadi AA (2019) Automatic identification of sarcasm in tweets and customer reviews. J Intell Fuzzy Syst 37(5):6815–6828
Jain D, Kumar A, Garg G (2020) Sarcasm detection in mash-up language using soft-attention based bi-directional LSTM and feature-rich CNN. Appl Soft Comput 91:106198
Ren L, Xu B, Lin H, Liu X, Yang L (2020) Sarcasm detection with sentiment semantics enhanced multi-level memory network. Neurocomputing 401:320–326
Sundararajan K, Palanisamy A (2020) Multi-rule based ensemble feature selection model for sarcasm type detection in twitter. Comput Intell Neurosci 2020
Prasanna MSM, Shaila SG, Vadivel A (2021) Phrase-level sentence patterns for estimating positive and negative emotions using neuro-fuzzy model for information retrieval applications. Multimedia Tools Appl 80:20151–20190
Pandey R, Kumar A, Singh JP, Tripathi S (2021) Hybrid attention-based long short-term memory network for sarcasm identification. Appl Soft Comput 106:107348
Pandey R, Singh JP (2023) BERT-LSTM model for sarcasm detection in code-mixed social media post. J Intell Inf Syst 60(1):235–254
Chawla V, Kapoor Y (2023) A hybrid framework for bot detection on twitter: fusing digital DNA with BERT. Multimedia Tools Appl:1–24
Demšar J (2006) Statistical comparisons of classifiers over multiple data sets. J Mach Learn Res 7:1–30
Dong X, Yu Z, Cao W, Shi Y, Ma Q (2020) A survey on ensemble learning. Front Comp Sci 14:241–258
Potamias RA, Siolas G, Stafylopatis AG (2020) A transformer-based approach to irony and sarcasm detection. Neural Comput Appl 32:17309–17320
Amelio A, Bonifazi G, Corradini E, Di Saverio S, Marchetti M, Ursino D, Virgili L (2022) Defining a deep neural network ensemble for identifying fabric colors. Appl Soft Comput 130:109687
Zia T, Akram MS, Nawaz MS, Shahzad B, Abdullatif AM, Mustafa RU, Lali MI (2016) Identification of hatred speeches on Twitter. In: Proceedings of 52nd, The IRES International Conference, pp 27–32
Ahuja R, Bansal S, Prakash S, Venkataraman K, Banga A (2018) Comparative study of different sarcasm detection algorithms based on behavioral approach. Procedia Comput Sci 143:411–418
Tungthamthiti P, Shirai K, Mohd M (2014) Recognition of sarcasms in tweets based on concept level sentiment analysis and supervised learning approaches. In: Proceedings of the 28th Pacific Asia conference on language, information and computing, pp 404–413
Rajadesingan A, Zafarani R, Liu H (2015) Sarcasm detection on twitter: a behavioral modeling approach. In: Proceedings of the eighth ACM international conference on web search and data mining, pp 97–106
Funding
This proposed research work did not receive any fund from external resources.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The author declares that there is no conflict of interest regarding the publication of this paper.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Maheswari, S.U., Dhenakaran, S.S. Improved ensemble based deep learning approach for sarcastic opinion classification. Multimed Tools Appl 83, 38267–38289 (2024). https://doi.org/10.1007/s11042-023-16891-9
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-023-16891-9