Skip to main content
SpringerLink
Log in

Towards better representation learning using hybrid deep learning model for fake news detection

  • Original Article
  • Published:
Social Network Analysis and Mining Aims and scope Submit manuscript

Abstract

Detection of Fake news articles over the internet is a difficult task due to huge amount of content being proliferated. Fake news proliferation is a major issue as it has socio-political impacts and it may change the opinion of the people. The easy dissemination of information through social media has added to exponential growth of fake news. Thus, it is challenging task to detect the fake news on the internet. In the literature, fake news detection techniques have been developed using machine learning approaches. Usually, fake news consists of sequential data. Recently, different variants of the Recurrent Neural Networks have been used for fake news detection due to better handling of sequential data and preserving better context information. Due to diversity in fake news data there is still need to develop the fake news detection techniques with better performance. In this work, we have developed a hybrid fake news detection model which aims at better representation learning to enhance the fake news detection performance. The proposed hybrid model has been developed using N-gram with TF-IDF to extract the content-based features then sequential features have been extracted using deep learning model [LSTM or bidirectional Encoder representation from transformers (BERT)]. The performance of the proposed approach has been evaluated using two publicly available datasets. It is observed from results that the proposed approach performs better the fake news detection approaches developed in the literature. The proposed approach has given the accuracies of 96.8% and 94% for the WELFAKE and KaggleFakeNews datasets, respectively.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

Data availability

The datasets used in this work are publically available on the following links: https://zenodo.org/record/4561253#.YPK5megzZdg =  = . https://www.kaggle.com/c/fake-news/data?select=train.csv.

References

  • Abdullah All T et al (2019) Detecting fake news using machine learning and deep learning algorithms. In: 2019 7th international conference on smart computing & communications (ICSCC)

  • Ahmed H, Traoré I, Saad S (2017) Detection of online fake news using n-gram analysis and machine learning techniques. In: ISDDC

  • Ahn Y, Jeong C (2019) Natural language contents evaluation system for detecting fake news using deep learning. In: 2019 16th international joint conference on computer science and software engineering (JCSSE)

  • Aphiwongsophon S, Chongstitvatana P (2018) Detecting fake news with machine learning method. In: 2018 15th international conference on electrical engineering/electronics, computer, telecommunications and information technology (ECTI-CON)

  • Aurpa TT, Sadik R, Ahmed MS (2021) Abusive Bangla comments detection on Facebook using transformer-based deep learning models. Soc Netw Anal Min 12(1):24

    Article  Google Scholar 

  • Castillo C, Mendoza M, Poblete B (2011) Information credibility on twitter. In: Proceedings of the 20th international conference on World wide web. Association for Computing Machinery, Hyderabad, pp 675–684

  • Devlin J et al (2018) Bert: pre-training of deep bidirectional transformers for language understanding. https://arxiv.org/abs/1810.04805

  • Elhadad K, Li F (2019) A novel approach for selecting hybrid features from online news textual metadata for fake news detection. In: International conference on P2P, Parallel, Grid, Cloud and Internet Computing 2019. Springer

  • Ghanem B, Rosso P, Rangel F (2020) An emotional analysis of false information in social media and news articles. ACM Trans Internet Technol 20(2):19

    Article  Google Scholar 

  • Giachanou A, Rosso P, Crestani F (2019) Leveraging emotional signals for credibility detection. In: Proceedings of the 42nd international ACM SIGIR conference on research and development in information retrieval. Association for Computing Machinery, Paris, pp 877–880

  • Girgis S, Amer E, Gadallah M (2018) Deep learning algorithms for detecting fake news in online text. In: 2018 13th international conference on computer engineering and systems (ICCES)

  • Gravanis G et al (2019) Behind the cues: a benchmarking study for fake news detection. Expert Syst Appl 128:201–213

    Article  Google Scholar 

  • Hosseini S, Zandvakili A (2022) Information dissemination modeling based on rumor propagation in online social networks with fuzzy logic. Soc Netw Anal Min 12(1):34

    Article  MATH  Google Scholar 

  • Hu G et al (2019) Multi-depth graph convolutional networks for fake news detection. In: CCF International conference on natural language processing and Chinese computing. Springer

  • Jain A et al (2019) A smart system for fake news detection using machine learning. In: 2019 international conference on issues and challenges in intelligent computing techniques (ICICT)

  • Jwa H et al (2019) exBAKE: automatic fake news detection model based on bidirectional encoder representations from transformers (BERT). Appl Sci 9(19):4062

    Article  Google Scholar 

  • Kaliyar RK, Goswami A, Narang P (2021) FakeBERT: Fake news detection in social media with a BERT-based deep learning approach. Multimedia Tools Appl 80(8):11765–11788

    Article  Google Scholar 

  • Keuschnigg M, Lovsjö N, Hedström P (2018) Analytical sociology and computational social science. J Comput Soc Sci 1(1):3–14

    Article  Google Scholar 

  • Kong SH et al (2020) Fake news detection using deep learning. In: 2020 IEEE 10th symposium on computer applications & industrial electronics (ISCAIE)

  • Kumar S et al. (2020) Fake news detection using deep learning models: a novel approach. Trans Emerg Telecommun Technol 31

  • Le Q, Mikolov T (2014) Distributed representations of sentences and documents. In: Eric PX, Tony J (eds) Proceedings of the 31st international conference on machine learning. PMLR: Proceedings of Machine Learning Research, pp 1188–1196

  • Mameli M et al (2022) Social media analytics system for action inspection on social networks. Soc Netw Anal Min 12(1):33

    Article  Google Scholar 

  • Mikolov T et al (2013) Efficient estimation of word representations in vector space. https://arxiv.org/abs/1301.3781

  • Monti F et al. (2019) Fake news detection on social media using geometric deep learning. https://arxiv.org/abs/abs/1902.06673

  • Nasir JA, Khan OS, Varlamis I (2021) Fake news detection: a hybrid CNN-RNN based deep learning approach

  • Pennington J, Socher R, Manning CD (2014) GloVe: global vectors for word representation. In: EMNLP

  • Peters ME et al (2018) Dissecting contextual word embeddings: architecture and representation. https://arxiv.org/abs/1808.08949

  • Qian S et al (2021) Knowledge-aware multi-modal adaptive graph convolutional networks for fake news detection. ACM Trans Multimedia Comput Commun Appl 17(3):98

    Article  Google Scholar 

  • Ruchansky N, Seo S, Liu Y (2017) CSI: a hybrid deep model for fake news detection. In: Proceedings of the 2017 ACM on conference on information and knowledge management

  • Seo Y, Seo D, Jeong C (2018) FaNDeR: fake news detection model using media reliability. In: TENCON 2018: 2018 IEEE region 10 conference

  • Shu K, Wang S, Liu H (2017) Exploiting tri-relationship for fake news detection

  • Sun C et al (2019) How to fine-tune bert for text classification? In: China national conference on Chinese computational linguistics. Springer

  • Varlamis I et al (2022) A survey on the use of graph convolutional networks for combating fake news. Future Internet 14(3):70

    Article  Google Scholar 

  • Verma PK et al (2021) WELFake: word embedding over linguistic features for fake news detection. IEEE Trans Comput Soc Syst 8(4):881–893

    Article  Google Scholar 

  • Verma A, Mittal V, Dawn S (2019) FIND: fake information and news detections using deep learning. In: 2019 twelfth international conference on contemporary computing (IC3)

  • Wang Y et al (2020) Fake news detection via knowledge-driven multimodal graph convolutional networks. In: Proceedings of the 2020 international conference on multimedia retrieval

  • Wang WY (2017) “Liar, liar pants on fire": a new benchmark dataset for fake news detection. In: ACL

  • Zhou X, Zafarani R (2019) Network-based fake news detection: a pattern-driven approach. https://arxiv.org/abs/abs/1906.04210

Download references

Author information

Authors and Affiliations

  1. Department of Computing and Technology, Iqra University Islamabad Campus, Islamabad, Pakistan

    Nabeela Kausar & Asghar AliKhan

  2. Data Science Lab, Artificial Intelligence Technology Center, National Center for Physics, Islamabad, Pakistan

    Mohsin Sattar

Authors
  1. Nabeela Kausar
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Asghar AliKhan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mohsin Sattar
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Nabeela Kausar.

Ethics declarations

Conflict of interest

The authors have no conflict of interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kausar, N., AliKhan, A. & Sattar, M. Towards better representation learning using hybrid deep learning model for fake news detection. Soc. Netw. Anal. Min. 12, 165 (2022). https://doi.org/10.1007/s13278-022-00986-6

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s13278-022-00986-6

Keywords

Search

Navigation