Abstract
Society is now situated in an epoch where the creation and spread of fake news have become remarkably effortless. Hence, conducting early rumor detection tasks is imperative. To handle this task, a key ideal is to model the interactive information between users who spread the news. To this end, existing methods usually use multiple stacked GNN layers to capture long-range user information. However, recent work has shown that traditional GNNs may struggle to capture important information when dealing with k-hop neighbors of users, thus hurting the performance of models. To address this problem, we propose a Long-range Graph Transformer for early rumor detection (LGT), which uses transformers to capture long-range dependencies between users. First, we use a graph convolutional attentive network to extract the publishing features. Second, we combine graph neural network and transformer to capture the long-range interaction features of users. Then, we employ the convolutional neural network to extract the text features and use the attention mechanism to fuse with the interactive information to obtain the aggregated interaction features. In addition, we collect the user’s credibility score as additional information. Finally, the above three features are fused to generate a new representation. Extensive experiments using three authentic datasets demonstrate that, in comparison to the baseline, LGT has achieved significant improvement. It effectively identifies rumors quickly while maintaining an accuracy rate exceeding 94%.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Data availability and access
The datasets and code used during this study are available upon reasonable request to the authors.
References
Alon U, Yahav E (2020) On the bottleneck of graph neural networks and its practical implications. In: international conference on learning representations
Bian T, Xiao X, Xu T, Zhao P, Huang W, Rong Y, Huang J (2020) Rumor detection on social media with bi-directional graph convolutional networks. In: proceedings of the AAAI conference on artificial intelligence, vol. 34, pp. 549–556
Castillo C, Mendoza M, Poblete B (2011) Information credibility on twitter. In: Proceedings of the 20th international conference on world wide web, pp. 675–684
Chen T, Wong RC-W (2020) Handling information loss of graph neural networks for session-based recommendation. In: Proceedings of the 26th ACM SIGKDD international conference on knowledge discovery & data mining, pp. 1172–1180
Chen T, Li X, Yin H, Zhang J (2018) Call attention to rumors: Deep attention based recurrent neural networks for early rumor detection. In: trends and applications in knowledge discovery and data mining: PAKDD 2018 Workshops, BDASC, BDM, ML4Cyber, PAISI, DaMEMO, Melbourne, VIC, Australia, June 3, 2018, Revised Selected Papers 22, pp. 40–52. Springer
Giachanou A, Rosso P, Crestani F (2019) Leveraging emotional signals for credibility detection. In: proceedings of the 42nd international ACM sigir conference on research and development in information retrieval, pp. 877–880
Huang Z, Lv Z, Han X, Li B, Lu M, Li D (2022) Social bot-aware graph neural network for early rumor detection. In: proceedings of the 29th international conference on computational linguistics, pp. 6680–6690
Hu L, Yang T, Zhang L, Zhong W, Tang D, Shi C, Duan N, Zhou M (2021) Compare to the knowledge: graph neural fake news detection with external knowledge. In: proceedings of the 59th annual meeting of the association for computational linguistics and the 11th international joint conference on natural language processing (Volume 1: Long Papers), pp. 754–763
Jin Z, Cao J, Zhang Y, Luo J (2016) News verification by exploiting conflicting social viewpoints in microblogs. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 30
Kwon S, Cha M, Jung K (2017) Rumor detection over varying time windows. PloS one 12(1):0168344
Liu Y, Wu Y-F (2018) Early detection of fake news on social media through propagation path classification with recurrent and convolutional networks. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 32
Liu B, Sun X, Ni Z, Cao J, Luo J, Liu B, Fu X (2020) Co-detection of crowdturfing microblogs and spammers in online social networks. World Wide Web 23:573–607
Liu B, Sun X, Meng Q, Yang X, Lee Y, Cao J, Luo J, Lee RK-W (2022) Nowhere to hide: Online rumor detection based on retweeting graph neural networks. IEEE transactions on neural networks and learning systems
Li Q, Han Z, Wu X-M (2018) Deeper insights into graph convolutional networks for semi-supervised learning. In: proceedings of the AAAI conference on artificial intelligence, vol. 32
Li G, Müller M, Ghanem B, Koltun V (2021) Training graph neural networks with 1000 layers. In: international conference on machine learning, pp. 6437–6449. PMLR
Mann WC, Thompson SA, INST UOSCMDRIS (1987) Rhetorical structure theory: a theory of text organization
Ma J, Gao W, Wei Z, Lu Y, Wong K-F (2015) Detect rumors using time series of social context information on microblogging websites. In: Proceedings of the 24th ACM international on conference on information and knowledge management, pp. 1751–1754
Ma J, Gao W, Mitra P, Kwon S, Jansen BJ, Wong K-F, Cha M (2016) Detecting rumors from microblogs with recurrent neural networks
Ma J, Gao W, Wong K-F (2017) Detect rumors in microblog posts using propagation structure via kernel learning. Assoc Computat Lingu
Ma J, Gao W, Wong K-F (2018) Rumor detection on twitter with tree-structured recursive neural networks. Association for Computational Linguistics
Meng Q, Yan H, Liu B, Sun X, Hu M, Cao J (2023) Recognize news transition from collective behavior for news recommendation. ACM Trans Inform Syst 41(4):1–30
Przybyla P (2020) Capturing the style of fake news. In: proceedings of the AAAI conference on artificial intelligence, 34:490–497
Sayyadiharikandeh M, Varol O, Yang K-C, Flammini A, Menczer F (2020) Detection of novel social bots by ensembles of specialized classifiers. In: proceedings of the 29th ACM international conference on information & knowledge management, pp. 2725–2732
Shu K, Sliva A, Wang S, Tang J, Liu H (2017) Fake news detection on social media: a data mining perspective. ACM SIGKDD Explorat Newslett 19(1):22–36
Shu K, Cui L, Wang S, Lee D, Liu H (2019) defend: explainable fake news detection. In: proceedings of the 25th ACM SIGKDD international conference on knowledge discovery & data mining, pp. 395–405
Song C, Shu K, Wu B (2021) Temporally evolving graph neural network for fake news detection. Inform Process Manag 58(6):102712
Sun X, Yin H, Liu B, Chen H, Cao J, Shao Y, Viet Hung NQ (2021) Heterogeneous hypergraph embedding for graph classification. In: proceedings of the 14th ACM international conference on web search and data mining, pp. 725–733
Sun X, Yin H, Liu B, Meng Q, Cao J, Zhou A, Chen H (2022) Structure learning via meta-hyperedge for dynamic rumor detection. IEEE transactions on knowledge and data engineering
Sun X, Cheng H, Liu B, Li J, Chen H, Xu G, Yin H (2023) Self-supervised hypergraph representation learning for sociological analysis. IEEE Transon Knowl Data Eng
Sun X, Cheng H, Dong H, Qiao B, Qin S, Lin Q (2023) Counter-empirical attacking based on adversarial reinforcement learning for time-relevant scoring system. IEEE Trans Knowl Data Eng
Sun X, Zhang J, Wu X, Cheng H, Xiong Y, Li J (2023) Graph prompt learning: A comprehensive survey and beyond. arXiv preprint arXiv:2311.16534
Sun X, Cheng H, Li J, Liu B, Guan J (2023) All in one: multi-task prompting for graph neural networks
Wu L, Rao Y, Zhao Y, Liang H, Nazir A (2020) Dtca: Decision tree-based co-attention networks for explainable claim verification. arXiv preprint arXiv:2004.13455
Wu Z, Jain P, Wright M, Mirhoseini A, Gonzalez JE, Stoica I (2021) Representing long-range context for graph neural networks with global attention. Adv Neural Inform Process Syst 34:13266–13279
Xia R, Xuan K, Yu J (2020) A state-independent and time-evolving network for early rumor detection in social media. In: proceedings of the 2020 conference on empirical methods in natural language processing (EMNLP), pp. 9042–9051
Xu K, Li C, Tian Y, Sonobe T, Kawarabayashi K-i, Jegelka S (2018) Representation learning on graphs with jumping knowledge networks. In: international conference on machine learning, pp. 5453–5462. PMLR
Yang F, Liu Y, Yu X, Yang M (2012) Automatic detection of rumor on sina weibo. In: proceedings of the ACM SIGKDD workshop on mining data semantics, pp. 1–7
Yuan C, Ma Q, Zhou W, Han J, Hu S (2019) Jointly embedding the local and global relations of heterogeneous graph for rumor detection. In: 2019 IEEE international conference on data mining (ICDM), pp. 796–805. IEEE
Yuan C, Ma Q, Zhou W, Han J, Hu S (2020) Early detection of fake news by utilizing the credibility of news, publishers, and users based on weakly supervised learning. arXiv preprint arXiv:2012.04233
Yu F, Liu Q, Wu S, Wang L, Tan T, et al (2017) A convolutional approach for misinformation identification. In: IJCAI, pp. 3901–3907
Zhao Z, Resnick P, Mei Q (2015) Enquiring minds: Early detection of rumors in social media from enquiry posts. In: proceedings of the 24th international conference on world wide web, pp. 1395–1405
Zhou X, Zafarani R (2019) Network-based fake news detection: a pattern-driven approach. ACM SIGKDD Explorat Newslett 21(2):48–60
Author information
Authors and Affiliations
Contributions
All authors contributed to the study conception and design.
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no Conflict of interest.
Ethical and informed consent for data used
Not applicable.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Xia, J., Li, Y. & Yu, K. Lgt: long-range graph transformer for early rumor detection. Soc. Netw. Anal. Min. 14, 100 (2024). https://doi.org/10.1007/s13278-024-01263-4
Received:
Revised:
Accepted:
Published:
DOI: https://doi.org/10.1007/s13278-024-01263-4