Abstract
The detection of fake news has become essential in recent years. This paper presents a new technique that is highly effective in identifying fake news articles. We assume a scenario where the relationship between a news article and a statement has already been classified as either agreeing or disagreeing with the statement, being uncertain about it, or being unrelated to it. Using this information, we focus on selecting the news articles that are most likely to be fake. We propose two models: the first one uses only the agree and disagree classifications; the second uses a subjective opinions based model that can also handle the uncertain cases. Our experiments on a real-world dataset (the Fake News Challenge 1 dataset) and a simulated dataset validate that both proposed models achieve state-of-the-art performance. Furthermore, we show which model to use in different scenarios to get the best performance.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Data Availability
The data that support the findings of this study are openly available.Footnote 6
References
Alcott, H., & Gentzkow, M. (2017). Social media and fake news in the 2016 election. Journal of Economic Perspectives, 31(2), 211–36.
Afroz, S., Brennan, M., & Greenstadt, R. (2012). Detecting hoaxes, frauds, and deception in writing style online. In 2012 IEEE symposium on security and privacy (pp. 461–475). IEEE.
Bondielli, A., & Marcelloni, F. (2019). A survey on fake news and rumour detection techniques. Information Sciences, 497, 38–55.
Bindu, P.V., Mishra, Rahul, & Santhi Thilagam, P. (2018). Discovering spammer communities in Twitter. Journal of Intelligent Information Systems, 51 (3), 503–527.
Balakrishnan, V., Vijay, V., & Uday, T. (2008). Subjective logic based trust model for mobile ad hoc networks. Proceedings of the 4th international conference on Security and privacy in communication networks. (pp. 1–11).
Chen, Y., Niall, J.C., & Victoria, L.R. (2015). Misleading online content: recognizing clickbait as false news. Proceedings of the 2015 ACM workshop on multimodal deception detection. (pp. 15–19).
Conroy, N. K., Rubin, V. L., & Chen, Y. (2015). Automatic deception detection: Methods for finding fake news. Proceedings of the Association for Information Science and Technology, 52(1), 1–4.
Dietzel, S., van der Heijden, R., Decke, H., & Kargl, F. (2014). A flexible, subjective logic-based framework for misbehavior detection in V2V networks. In Proceeding of IEEE international symposium on a world of wireless, mobile and multimedia networks 2014 (pp. 1–6). IEEE.
Della Vedova, M.L., Tacchini, E., Moret, S., Ballarin, G., DiPierro, M., & de Alfaro, L (2018). Automatic online fake news detection combining content and social signals. In 2018 22nd conference of open innovations association (FRUCT) (pp. 272–279). IEEE.
Dewang, R.K., & Singh, A.K. (2018). State-of-art approaches for review spammer detection: a survey. Journal of Intelligent Information Systems, 50(2), 231–264.
Gupta, M., Zhao, P., & Han, J. (2012). Evaluating event credibility on twitter. Proceedings of the 2012 SIAM International conference on data mining. (pp.153–164).
Hassan, N., Li, C., & Tremayne, M. (2015). Detecting check-worthy factual claims in presidential debates. In Proceedings of the 24th ACM international on conference on information and knowledge management (pp. 1835–1838). ACM.
Hanselowski, A., PVS, A., Schiller, B., Caspelherr, F., Chaudhuri, D., Meyer, C.M., & Gurevych, I. (2018). A retrospective analysis of the fake news challenge stance detection task. arXiv:1806.05180.
Jøsang, A. (2001). A logic for uncertain probabilities. International Journal of Uncertainty Fuzziness and Knowledge-Based Systems, 9(03), 279–311.
Jøsang, A. (2002). The consensus operator for combining beliefs. Artificial Intelligence, 141(1-2), 157–170.
Jøsang, A. (2016). Subjective logic. Heidelberg: Springer.
Kumar, S., West, R., & Leskovec, J. (2016). Disinformation on the web: Impact, characteristics, and detection of Wikipedia hoaxes. In Proceedings of the 25th international conference on World Wide Web (pp. 591–602).
Kumar, S., & Shah, N. (2018). False information on web and social media: A survey. arXiv:1804.08559.
Liu, Y., Jin, X., & Shen, H. (2019). Towards early identification of online rumors based on long short-term memory networks. Information Processing and Management, 56(4), 1457–1467.
Li, Q., Zhang, Q., & Si, L. (2019). Rumor detection by exploiting user credibility information, attention and multi-task learning. In Proceedings of the 57th annual meeting of the Association for Computational Linguistics (pp. 1173–1179).
Oleshchuk, V., & Zadorozhny, V. (2007). Trust-aware query processing in data intensive sensor networks. In International conference on sensor technologies and applications (SENSORCOMM 2007) (pp. 176–180). IEEE.
Pasternack, J., & Roth, D. (2010). Knowing what to believe (when you already know something). Proceedings of the 23rd International Conference on Computational Linguistics, (pp. 877–885).
Pelechrinis, K., Zadorozhny, V., Kounev, V., Oleshchuk, V., Anwar, M., & Lin, Y. (2015). Automatic evaluation of information provider reliability and expertise. World Wide Web, 18(1), 33–72.
Rubin, V.L., & Lukoianova, T. (2015). Truth and deception at the rhetorical structure level. Journal of the Association for Information Science and Technology, 66(5), 905–917.
Riedel, B., Augenstein, I., Spithourakis, G.P., & Riedel, S. (2017). A simple but tough-to-beat baseline for the Fake News Challenge stance detection task. arXiv:1707.03264.
Shu, K., Wang, S., & Liu, H. (2017). Exploiting tri-relationship for fake news detection. arXiv:1712.07709.
Shu, K., Sliva, A., Wang, S., Tang, J., & Liu, H. (2017). Fake news detection on social media: A data mining perspective. ACM SIGKDD Explorations Newsletter, 19(1), 22–36.
Song, C., Yang, C., Chen, H., Tu, C., Liu, Z., & Sun, M. (2018). CED: Credible early detection of social media rumors. arXiv:1811.04175.
Tacchini, E., Ballarin, G., Della Vedova, M.L., Moret, S., & De Alfaro, L. (2017). Some like it Hoax: Automated fake news detection in social networks. In Proceedings of the second workshop on data science for social good (SoGood). Skopje, Macedonia: CEUR Workshop Proceedings, (Vol. 1960 pp. 1–11).
Xu, J., Zadorozhny, V., Zhang, D., & Grant, J. (2020). FaNDS: Fake news detection system using energy flow. arXiv:2010.02097.
Zhang, D., & Zadorozhny, V.I. (2020). Fake news detection based on subjective opinions. European Conference on Advances in Databases and Information Systems, (p. 108121). Cham: Springer.
Zhang, D., Zadorozhny, V.I., & Oleshchuk, V.A. (2019). Slftd: a subjective logic based framework for truth discovery. European Conference on Advances in Databases and Information Systems. (pp. 102-110). Cham: Springer.
Zubiaga, A., Kochkina, E., Liakata, M., Procter, R., Lukasik, M., Bontcheva, K., Cohn, T., & Augenstein, I. (2018). Discourse-aware rumour stance classification in social media using sequential classifiers. Information Processing and Management, 54(2), 273–290.
Acknowledgements
We wish to thank the reviewers for many helpful comments and suggestions.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Zhang, D., Xu, J., Zadorozhny, V. et al. Fake news detection based on statement conflict. J Intell Inf Syst 59, 173–192 (2022). https://doi.org/10.1007/s10844-021-00678-1
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10844-021-00678-1