Skip to main content
SpringerLink
Log in

FANCFIS: ensemble deep learning based features learning with a novel fuzzy approach for sentiment analysis

  • Original Research
  • Published:
International Journal of Information Technology Aims and scope Submit manuscript

Abstract

In the past decade, sentiment analysis has been a popular study area in data mining and natural language processing. In sentiment analysis, deep neural network (DNN) approaches have recently been used in tasks with encouraging results. The usage of deep neural networks for this purpose has grown significantly over the past few years, and the results have been considerable. DNN is showing promise as an approach. Because DNN can independently extract features from data, intermediate representations produced by these networks can also be employed as appropriate features. Therefore, we suggested an ensemble of ConvNeXt and PCFAN in this research to extract both low-level and high-level features. While many deep neural networks can extract different kinds of information because of their unique topologies, we merge features obtained from hybrid neural networks. To improve the entire effectiveness of sentiment analysis by considering their association. A multi-scale classifier called the Hierarchical Multi-scale LSTM (HMLSTM) receives intermediate representations from both introduced deep neural networks. Using the Sentiment140 and SST2 datasets, we simulate and assess the suggested approach. Our suggested model can outperform state-of-the-art approaches, as demonstrated by experimental findings on numerous public benchmark datasets.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16

Similar content being viewed by others

Availability of data and material

Data will be available when requested.

References

  1. Zhang T, Gong X, Chen CP (2021) BMT-Net: Broad multitask transformer network for sentiment analysis. IEEE Trans Cybern 52(7):6232–6243. https://doi.org/10.1109/TCYB.2021.3050508

    Article  Google Scholar 

  2. Arevalillo-Herráez M, Arnau-González P, Ramzan N (2022) On adapting the DIET architecture and the Rasa conversational toolkit for the sentiment analysis task. IEEE Access 10:107477–107487. https://doi.org/10.1109/ACCESS.2022.3213061

    Article  Google Scholar 

  3. Zulqarnain M, Ghazali R, Aamir M, Hassim YMM (2022) An efficient two-state GRU based on feature attention mechanism for sentiment analysis. Multimed Tools Appl. https://doi.org/10.1007/s11042-022-13339-4

    Article  Google Scholar 

  4. Usama M, Xiao W, Ahmad B, Wan J, Hassan MM, Alelaiwi A (2019) Deep learning based weighted feature fusion approach for sentiment analysis. IEEE Access 7:140252–140260. https://doi.org/10.1109/ACCESS.2019.2940051

    Article  Google Scholar 

  5. Tam S, Said RB, Tanriöver ÖÖ (2021) A convbilstm deep learning model-based approach for twitter sentiment classification. IEEE Access 9:41283–41293. https://doi.org/10.1109/ACCESS.2021.3064830

    Article  Google Scholar 

  6. Leng XL, Miao XA, Liu T (2021) Using recurrent neural network structure with enhanced multi-head self-attention for sentiment analysis. Multimed Tools Appl 80:12581–12600. https://doi.org/10.1007/s11042-020-10336-3

    Article  Google Scholar 

  7. Xiang R, Chersoni E, Lu Q, Huang CR, Li W, Long Y (2021) Lexical data augmentation for sentiment analysis. J Am Soc Inf Sci 72(11):1432–1447. https://doi.org/10.1002/asi.24493

    Article  Google Scholar 

  8. Biesialska M, Biesialska K, Rybinski H (2021) Leveraging contextual embeddings and self-attention neural networks with bi-attention for sentiment analysis. J Intell Inform Syst 57(3):601–626. https://doi.org/10.1007/s10844-021-00664-7

    Article  Google Scholar 

  9. Hameed Z, Garcia-Zapirain B (2020) Sentiment classification using a single-layered BiLSTM model. IEEE Access 8:73992–74001. https://doi.org/10.1109/ACCESS.2020.2988550

    Article  Google Scholar 

  10. Duan Y, Edwards JS, Dwivedi YK (2019) Artificial intelligence for decision making in the era of big data–evolution, challenges and research agenda. Int J Inf Manag 48:63–71

    Article  Google Scholar 

  11. Khasanah IN (2021) Sentiment classification using fasttext embedding and deep learning model. Procedia Comput Sci 189:343–350. https://doi.org/10.1016/j.procs.2021.05.103

    Article  Google Scholar 

  12. Cai Y, Huang Q, Lin Z, Xu J, Chen Z, Li Q (2020) Recurrent neural network with pooling operation and attention mechanism for sentiment analysis: a multi-task learning approach. Knowl-Based Syst 203:105856. https://doi.org/10.1016/j.knosys.2020.105856

    Article  Google Scholar 

  13. Ekinci E, Türkmen H, Omurca Sİ (2017) Multi-word aspect term extraction using Turkish user reviews. Int J Comput Eng Inform Technol 9(1):15

    Google Scholar 

  14. Xiang R, Li J, Wan M, Gu J, Lu Q, Li W, Huang CR (2021) Affective awareness in neural sentiment analysis. Knowl-Based Syst 226:107137. https://doi.org/10.1016/j.knosys.2021.107137

    Article  Google Scholar 

  15. Munikar M, Shakya S, Shrestha A (2019) Fine-grained sentiment classification using BERT. In: 2019 Artificial Intelligence for Transforming Business and Society (AITB), vol 1, pp 1–5, IEEE, https://doi.org/10.1109/AITB48515.2019.8947435

  16. Ali O, Ally M, Dwivedi Y (2020) The state of play of blockchain technology in the financial services sector: a systematic literature review. Int J Inf Manag 54:102199

    Article  Google Scholar 

  17. Thanawala P, Pareek J (2018) MwTExt: automatic extraction of multi-word terms to generate compound concepts within ontology. Int J Inf Technol 10:303–311

    Google Scholar 

  18. Khanday AMUD, Rabani ST, Khan QR, Rouf N, Mohi Ud Din M (2020) Machine learning based approaches for detecting COVID-19 using clinical text data

  19. Kasri M, Birjali M, Beni-Hssane A (2021) Word2Sent: a new learning sentiment-embedding model with low dimension for sentence level sentiment classification. Concurr Comput Pract Exp 33(9):e6149. https://doi.org/10.1002/cpe.6149

    Article  Google Scholar 

  20. Hama Aziz RH, Dimililer N (2021) SentiXGboost: enhanced sentiment analysis in social media posts with ensemble XGBoost classifier. J Chin Inst Eng 44(6):562–572. https://doi.org/10.1080/02533839.2021.1933598

    Article  Google Scholar 

  21. Liang B, Su H, Gui L, Cambria E, Xu R (2022) Aspect-based sentiment analysis via affective knowledge enhanced graph convolutional networks. Knowl-Based Syst 235:107643. https://doi.org/10.1016/j.knosys.2021.107643

    Article  Google Scholar 

  22. Jing N, Wu Z, Wang H (2021) A hybrid model integrating deep learning with investor sentiment analysis for stock price prediction. Expert Syst Appl 178:115019. https://doi.org/10.1016/j.eswa.2021.115019

    Article  Google Scholar 

  23. Xu G, Yu Z, Yao H, Li F, Meng Y, Wu X (2019) Chinese text sentiment analysis based on extended sentiment dictionary. IEEE Access 7:43749–43762. https://doi.org/10.1109/ACCESS.2019.2907772

    Article  Google Scholar 

  24. Li W, Shao W, Ji S, Cambria E (2022) BiERU: bidirectional emotional recurrent unit for conversational sentiment analysis. Neurocomputing 467:73–82. https://doi.org/10.1016/j.neucom.2021.09.057

    Article  Google Scholar 

  25. Onan A (2021) Sentiment analysis on product reviews based on weighted word embeddings and deep neural networks. Concurr Comput Pract Exp 33(23):e5909. https://doi.org/10.1002/cpe.5909

    Article  Google Scholar 

  26. Kaur H, Ahsaan SU, Alankar B, Chang V (2021) A proposed sentiment analysis deep learning algorithm for analyzing COVID-19 tweets. Inform Syst Front. https://doi.org/10.1007/s10796-021-10135-7

    Article  Google Scholar 

  27. Rhanoui M, Mikram M, Yousfi S, Barzali S (2019) A CNN-BiLSTM model for document-level sentiment analysis. Mach Learn Knowl Extr 1(3):832–847. https://doi.org/10.3390/make1030048

    Article  Google Scholar 

  28. Tian H, Gao C, Xiao X, Liu H, He B, Wu H, Wu F (2020) SKEP: sentiment knowledge enhanced pre-training for sentiment analysis. arXiv preprint https://arXiv.org/2005.05635

  29. Basiri ME, Nemati S, Abdar M, Cambria E, Acharya UR (2021) “ABCDM: An attention-based bidirectional CNN-RNN deep model for sentiment analysis. Futur Gener Comput Syst 115:279–294

    Article  Google Scholar 

  30. https://huggingface.co/datasets/sst2

  31. https://www.kaggle.com/datasets/kazanova/sentiment140

  32. https://www.kaggle.com/datasets/saurabhbagchi/amazon-electronics-data

Download references

Funding

The authors received no financial support for the research, authorship, and/or publication of this article.

Author information

Authors and Affiliations

  1. School of Computer Science and Engineering, VIT-AP University, Amaravati, India

    Potu Bharath & Dasari Venkatalakshmi

Authors
  1. Potu Bharath
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Dasari Venkatalakshmi
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

The author confirms sole responsibility for the following: study conception and design, data collection, analysis and interpretation of results, and manuscript preparation.

Corresponding author

Correspondence to Dasari Venkatalakshmi.

Ethics declarations

Conflict of interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Ethical approval

This material is the authors’ own original work, which has not been previously published elsewhere. The paper reflects the authors’ own research and analysis in a truthful and complete manner.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Bharath, P., Venkatalakshmi, D. FANCFIS: ensemble deep learning based features learning with a novel fuzzy approach for sentiment analysis. Int. j. inf. tecnol. (2024). https://doi.org/10.1007/s41870-024-01882-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s41870-024-01882-2

Keywords

Search

Navigation