Abstract
Detection of check-worthy statements is a subtask in the fact-checking process, automation of which would decrease the time and burden required to fact-check a statement. This paper proposes an approach focused on the classification of statements into check-worthy and not check-worthy. For the current paper, a dataset is constructed by consulting different fact-checking organizations. It contains debates and speeches in the domain of politics. Thus, even the ability of check worthy approach is evaluated on this domain. It starts with extracting sentence-level and context features from the sentences, and classifying them based on these features. The feature set and context were chosen after several experiments, based on how well they differentiate check-worthy statements. The findings indicated that the context in the approach gives considerable contribution in the classification, while also using more general features to capture information from the sentences. The results were analyzed by examining all features used, assessing their contribution in classification, and how well the approach performs in speeches and debates separately to detect the check worthy statements to reduce the time and burden of fact checking process.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
- 2.
- 3.
- 4.
- 5.
- 6.
- 7.
- 8.
- 9.
References
Lazer, D.M., Baum, M.A., Benkler, Y., Berinsky, A.J., Greenhill, K.M., Menczer, F., Metzger, M.J., Zittrain, J.L.: The science of fake news. Science 359(6380), 1094–1096 (2018)
Allcott, H., Gentzkow, M.: Social media and fake news in the 2016 election. J. Econ. Perspect. 31(2), 211–236 (2017)
Flintham, M., Karner, C., Bachour, K., Creswick, H., Gupta, N., Moran, S.: Falling for fake news: investigating the consumption of news via social media. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, pp. 1–10, April 2018
Castillo, C., Mendoza, M., Poblete, B.: Information credibility on twitter. In: Proceedings of the 20th International Conference on World Wide Web - WWW 2011 (2011). https://doi.org/10.1145/1963405.1963500
Popat, K., et al.: Credibility assessment of textual claims on the Web. In: Proceedings of the 25th ACM International on Conference on Information and Knowledge Management - CIKM 2016 (2016). https://doi.org/10.1145/2983323.2983661
Wu, Y., et al.: Toward computational fact-checking. In: Proceedings of the VLDB Endowment (2014). https://doi.org/10.14778/2732286.2732295
Vlachos, A., Riedel, S.: Fact checking: task definition and dataset construction. In: Proceedings of the ACL 2014 Workshop on Language Technologies and Computational Social Science (2014) https://doi.org/10.3115/v1/w14-2508
Ciampaglia, G.L., et al.: Computational fact checking from knowledge networks. PLoS ONE 10(6), 1–13 (2015). https://doi.org/10.1371/journal.pone.0128193
Patwari, A., Goldwasser, D., Bagchi, S.: TATHYA: a multi-classifier system for detecting check-worthy statements in political debates. In: Proceedings of the 2017 ACM on Conference on Information and Knowledge Management (2017). https://doi.org/10.1145/3132847.3133150
Gencheva, P., et al.: A context-aware approach for detecting worth-checking claims in political debates. In: International Conference Recent Advances in Natural Language Processing, RANLP (2017). https://doi.org/10.26615/978-954-452-049-6-037
Jaradat, I., et al.: ClaimRank: detecting check-worthy claims in Arabic and English, April 2018. arXiv:1804.07587v1
Vlachos, A., Riedel, S.: Fact checking: task definition and dataset construction. In: Proceedings of the ACL 2014 Workshop on Language Technologies and Computational Social Science, pp. 18–22. Association for Computational Linguistics, Baltimore, June 2014
Wu, Y., et al.: Computational fact checking through query perturbations. ACM Trans. Database Syst. 42(1), 1–41 (2017). https://doi.org/10.1145/2996453
Hassan, N., Li, C., Tremayne, M.: Detecting check-worthy factual claims in presidential debates. In: Proceedings of the 24th ACM International on Conference on Information and Knowledge Management - CIKM 2015, pp. 1835–1838 (2015). https://doi.org/10.1145/2806416.2806652
Graves, L.: Deciding what’s true: fact-checking journalism and the new ecology of news (Doctoral dissertation). ProQuest (UMI 3549415), pp. 130–132, and 136 (2013)
Wu, L., Liu, H.: Tracing fake-news footprints: characterizing social media messages by how they propagate. In: Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining - WSDM 2018 (2018). https://doi.org/10.1145/3159652.3159677
Shu, K., Sliva, A., Wang, S., Tang, J., Liu, H.: Fake news detection on social media: a data mining perspective CoRR abs/1708.01967 (2017). arXiv preprint arXiv:1708.01967
Elizondo, D.: The linear separability problem: Some testing methods. IEEE Trans. Neural Netw. (2006). https://doi.org/10.1109/TNN.2005.860871
Stehman, S.V.: Selecting and interpreting measures of thematic classification accuracy. Remote Sens. Env. 62(1), 77–89 (1997)
Stepinski, A., Mittal, V.: A fact/opinion classifier for news articles. In: Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 807–808, July 2007
Sun, A., Lim, E.P., Liu, Y.: On strategies for imbalanced text classification using SVM: a comparative study. Decis. Support Syst. 48(1), 191–201 (2009)
Thorne, J., Vlachos, A., Christodoulopoulos, C., Mittal, A.: FEVER: a large-scale dataset for fact extraction and verification. arXiv preprint arXiv:1803.05355 (2018)
Visa, S., Ramsay, B., Ralescu, A., Van Der Knaap, E.: confusion matrix-based feature selection. In: MAICS, vol. 710, pp. 120–127 (2011)
Wiebe, J., Riloff, E.: Creating subjective and objective sentence classifiers from unannotated texts. In: International Conference o Intelligent Text Processing and Computational Linguistics, pp. 486–497. Springer, Berlin, Heidelberg, February 2005
Joachims, T.: Text categorization with support vector machines: learning with many relevant features. In: LNCS (Including subseries LNAI and LNB) (1998). https://doi.org/10.1007/s13928716
Bengio, Y., et al.: A neural probabilistic language model. J. Mach. Learn. Res. (2003). https://doi.org/10.1162/153244303322533223
Yang, B., Cardie, C.: Context-aware learning for sentence-level sentiment analysis with posterior regularization. In: Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pp. 325–335, June 2014
Yu, H., Hatzivassiloglou, V.: Towards answering opinion questions: separating facts from opinions and identifying the polarity of opinion sentences. In: Proceedings of the 2003 Conference on Empirical Methods in Natural Language Processing, pp. 129–136 (2003)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Ahmed, S., Balla, K., Hinkelmann, K., Corradini, F. (2021). Fact Checking: Detection of Check Worthy Statements Through Support Vector Machine and Feed Forward Neural Network. In: Arai, K. (eds) Advances in Information and Communication. FICC 2021. Advances in Intelligent Systems and Computing, vol 1364. Springer, Cham. https://doi.org/10.1007/978-3-030-73103-8_37
Download citation
DOI: https://doi.org/10.1007/978-3-030-73103-8_37
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-73102-1
Online ISBN: 978-3-030-73103-8
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)