Abstract
The amount of fake news present on the internet poses a great challenge for many online communities including manual fact-checkers who struggle to prevent the spread of misinformation and its negative impact. Detecting the stance of a news article involves classifying its perspective (e.g. agree, disagree, discuss, or unrelated) to a particular claim or headline which could support human fact-checkers to determine the veracity of the claims. Prior work on fake-news stance detection has proposed one-stage multi-class classification solutions which have limited success in detecting related pairs due to imbalanced class distributions in the data. This paper describes an improved approach to the stance detection of Fake News Challenge (FNC-1) based on multi-stage feature-assisted Deep Learning approaches. We break down the multi-class classification problem into two-stage and three-stage classifiers by combining the lexical-overlap features with Deep Learning techniques in an effort to mitigate the class imbalance problem. The experimental results demonstrate that the proposed models improve upon the state-of-the-art Accuracy and F1 score for stance detection. We also experimentally show that our models achieve solid results on minority classes i.e. agree and disagree without using fine-tuning approach or adding more training samples.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Baird, S., Sibley, D., Pan, Y.: Talos targets disinformation with fake news challenge (2017). https://blog.talosintelligence.com/2017/06/talos-fake-news-challenge.html
Bhatt, G., Sharma, A., Sharma, S., Nagpal, A., Raman, B., Mittal, A.: Combining neural, statistical and external features for fake news stance identification. In: Companion Proceedings of the The Web Conference 2018, pp. 1353–1357. International World Wide Web Conferences Steering Committee (2018)
Borges, L., Martins, B., Calado, P.: Combining similarity features and deep representation learning for stance detection in the context of checking fake news. J. Data Inf. Q. (JDIQ) 11(3), 1–26 (2019)
Bourgonje, P., Schneider, J.M., Rehm, G.: From clickbait to fake news detection: an approach based on detecting the stance of headlines to articles. In: Proceedings of the 2017 EMNLP Workshop: Natural Language Processing meets Journalism, pp. 84–89 (2017)
Cer, D., Yang, Y., Kong, S.y., Hua, N., Limtiaco, N., John, R.S., Constant, N., Guajardo-Cespedes, M., Yuan, S., Tar, C., et al.: Universal sentence encoder. arXiv preprint arXiv:1803.11175 (2018)
Fang, W., Nadeem, M., Mohtarami, M., Glass, J.: Neural multi-task learning for stance prediction. In: Proceedings of the Second Workshop on Fact Extraction and VERification (FEVER), pp. 13–19 (2019)
Ferreira, W., Vlachos, A.: Emergent: a novel data-set for stance classification. In: Proceedings of the 2016 Conference of the North American chapter of the Association for Computational Linguistics: Human Language Technologies, pp. 1163–1168 (2016)
Ghanem, B., Cignarella, A.T., Bosco, C., Rosso, P., Pardo, F.M.R.: UPV-28-unito at semeval-2019 task 7: exploiting post’s nesting and syntax information for rumor stance classification. In: Proceedings of the 13th International Workshop on Semantic Evaluation, pp. 1125–1131 (2019)
Hanselowski, A., Avinesh, P., Schiller, B., Caspelherr, F., Chaudhuri, D., Meyer, C.M., Gurevych, I.: A retrospective analysis of the fake news challenge stance-detection task. In: Proceedings of the 27th International Conference on Computational Linguistics, pp. 1859–1874 (2018)
Hanselowski, A., PVS, A., Schiller, B., Caspelherr, F.: Description of the system developed by team Athene in the FNC-1 (2017). https://medium.com/@andre134679/team-athene-on-the-fake-news-challenge-28a5cf5e017b
Hassan, F.M., Lee, M.: Imbalanced stance detection by combining neural and external features. In: International Conference on Statistical Language and Speech Processing, pp. 273–285. Springer (2019)
Jwa, H., Oh, D., Park, K., Kang, J.M., Lim, H.: exBAKE: automatic fake news detection model based on bidirectional encoder representations from transformers (bert). Appl. Sci. 9(19), 4062 (2019)
Masood, R., Aker, A.: The fake news challenge: stance detection using traditional machine learning approaches. In: Proceedings of the 10th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management (KMIS), pp. 128–135 (2018)
Mohammad, S.M., Sobhani, P., Kiritchenko, S.: Stance and sentiment in tweets. ACM Trans. Internet Technol. (TOIT) 17(3), 1–23 (2017)
Pennington, J., Socher, R., Manning, C.: Glove: global vectors for word representation. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 1532–1543 (2014)
Pomerleau, D., Rao, D.: Fake News Challenge (2017). http://www.fakenewschallenge.org/
Riedel, B., Augenstein, I., Spithourakis, G.P., Riedel, S.: A simple but tough-to-beat baseline for the fake news challenge stance detection task. arXiv preprint arXiv:1707.03264 (2017)
Saikh, T., Anand, A., Ekbal, A., Bhattacharyya, P.: A novel approach towards fake news detection: deep learning augmented with textual entailment features. In: International Conference on Applications of Natural Language to Information Systems, pp. 345–358. Springer (2019)
Shu, K., Sliva, A., Wang, S., Tang, J., Liu, H.: Fake news detection on social media: a data mining perspective. ACM SIGKDD Explorat. Newsl. 19(1), 22–36 (2017)
Zhang, Q., Liang, S., Lipani, A., Ren, Z., Yilmaz, E.: From stances’ imbalance to their hierarchical representation and detection. In: The World Wide Web Conference, pp. 2323–2332 (2019)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Hassan, F.M., Lee, M. (2021). Multi-stage News-Stance Classification Based on Lexical and Neural Features. In: Herrero, Á., Cambra, C., Urda, D., Sedano, J., Quintián, H., Corchado, E. (eds) 13th International Conference on Computational Intelligence in Security for Information Systems (CISIS 2020). CISIS 2019. Advances in Intelligent Systems and Computing, vol 1267. Springer, Cham. https://doi.org/10.1007/978-3-030-57805-3_21
Download citation
DOI: https://doi.org/10.1007/978-3-030-57805-3_21
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-57804-6
Online ISBN: 978-3-030-57805-3
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)