Abstract
In digital environments where substantial amounts of information are shared online, news headlines play essential roles in the selection and diffusion of news articles. Some news articles attract audience attention by showing exaggerated or misleading headlines. This study addresses the headline incongruity problem, in which a news headline makes claims that are either unrelated or opposite to the contents of the corresponding article. We present BaitWatcher, which is a lightweight web interface that guides readers in estimating the likelihood of incongruence in news articles before clicking on the headlines. BaitWatcher utilizes a hierarchical recurrent encoder that efficiently learns complex textual representations of a news headline and its associated body text. For training the model, we construct a million scale dataset of news articles, which we also release for broader research use. Based on the results of a focus group interview, we discuss the importance of developing an interpretable AI agent for the design of a better interface for mitigating the effects of online misinformation.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Allcott, H., Gentzkow, M.: Social media and fake news in the 2016 election. J. Econ. Perspect. 31(2), 211–36 (2017)
Allport, F.H., Lepkin, M.: Building war morale with news-headlines. Public Opin. Q. 7(2), 211–221 (1943)
Blom, J.N., Hansen, K.R.: Click bait: forward-reference as lure in online news headlines. J. Pragmat. 76, 87–100 (2015)
Chakraborty, A., Paranjape, B., Kakarla, S., Ganguly, N.: Stop clickbait: detecting and preventing clickbaits in online news media. In: Proceedings of the ASONAM (2016)
Chen, T., Guestrin, C.: Xgboost: a scalable tree boosting system. In: Proceedings of the KDD (2016)
Chen, Y., Conroy, N.J., Rubin, V.L.: Misleading online content: recognizing clickbait as false news. In: Proceedings of the ACM Workshop on Multimodal Deception Detection (2015)
Chesney, S., Liakata, M., Poesio, M., Purver, M.: Incongruent Headlines: yet another way to mislead your readers. In: Proceedings of the EMNLP Workshop, pp. 56–61 (2017)
Chopra, S., Jain, S., Sholar, J.M.: Towards automatic identification of fake news: Headline-article stance detection with LSTM attention models. In Stanford CS224d Deep Learning for NLP final project (2017)
Clayton, K., Blair, S., Busam, J.A., Forstner, S., Glance, J., Green, G., Kawata, A., Kovvuri, A., Martin, J., Morgan, E.: Real Solutions for fake news? Measuring the effectiveness of general warnings and fact-check tags in reducing belief in false stories on social media. Polit. Behav. 1–23 (2019)
Clickbait Challenge. http://www.clickbait-challenge.org (2017). [Online; Accessed 15 April 2019]
Ecker, U.K., Lewandowsky, S., Chang, E.P., Pillai, R.: The effects of subtle misinformation in news headlines. J. Exp. Psychol. Appl. 20(4), 323 (2014)
English, E.: A study of the readability of four newspaper headline types. Journal. Bull. 21(3), 217–229 (1944)
Fake News Challenge. http://www.fakenewschallenge.org/ (2017). [Online; Accessed 15 April 2019]
Ferreira, W., Vlachos, A.: Emergent: a novel data-set for stance classification. In: Proceedings of the NAACL-HLT (2016)
Ferrucci, D.A.: Introduction to “this is Watson”. IBM J. Res. Dev. 56(3–4), 1–1 (2012)
Gabielkov, M., Ramachandran, A., Chaintreau, A., Legout, A.: Social clicks: what and who gets read on Twitter? ACM SIGMETRICS Perform. Eval. Rev. 44(1), 179–192 (2016)
Gao, M., Xiao, Z., Karahalios, K., Fu, W.T.: To label or not to label: the effect of stance and credibility labels on readers’ selection and perception of news articles. Proc. ACM Hum. Comput. Interact. 2(CSCW), 55 (2018)
Gillani, N., Yuan, A., Saveski, M., Vosoughi, S., Roy, D.: Me, my echo chamber, and i: introspection on social media polarization. In: Proceedings of the WWW, pp. 823–831 (2018)
Go, A., Bhayani, R., Huang, L.: Twitter sentiment classification using distant supervision. CS224N project report, Stanford, 1(12), (2009)
Grinberg, N., Joseph, K., Friedland, L., Swire-Thompson, B., Lazer, D.: Fake news on Twitter during the 2016 US presidential election. Science 363(6425), 374–378 (2019)
Horne, B.D., Nevo, D., O’Donovan, J., Cho, J.H., Adali, S.: Rating reliability and bias in news articles: does AI assistance help everyone? arXiv preprint arXiv:1904.01531 (2019)
Hu, Z., Yang, Z., Liang, X., Salakhutdinov, R., Xing, E.P.: Toward controlled generation of text. In: Proceedings of the ICML, pp. 1587–1596 (2017)
Kim, Y.: Convolutional neural networks for sentence classification. In: Proceedings of the EMNLP, pp. 1746–1751 (2014)
Kuiken, J., Schuth, A., Spitters, M., Marx, M.: Effective headlines of newspaper articles in a digital environment. Digit. Journal. 5(10), 1300–1314 (2017)
Kwon, S., Cha, M., Jung, K., Chen, W., Wang, Y.: Prominent features of rumor propagation in online social media. In: Proceedings of the ICDM (2013)
Lovering, C., Lu, A., Nguyen, C., Nguyen, H., Hurley, D., Agu, E.: Fact or fiction. Proc. ACM Hum. Comput. Interact. (CSCW) 2, 111 (2018)
Lowe, R., Pow, N., Serban, I.V., Pineau, J.: The ubuntu dialogue corpus: a large dataset for research in unstructured multi-turn dialogue systems. In: Proceedings of the SIGDIAL (2015)
Munson, S.A., Lee, S.Y., Resnick, P.: Encouraging reading of diverse political viewpoints with a browser widget. In: Proceedings of the ICWSM (2013)
Naver News. http://news.naver.com (2019). [Online; Accessed 15 April 2019]
Park, S., Kang, S., Chung, S., Song, J.: Newscube: delivering multiple aspects of news to mitigate media bias. In: Proceedings of the CHI, pp. 443–452. ACM (2009)
Pascanu, R., Mikolov, T., Bengio, Y.: On the difficulty of training recurrent neural networks. In: Proceedings of the ICML (2013)
Reis, J., Benevenuto, F., de Melo, P.V., Prates, R., Kwak, H., An, J.: Breaking the news: first impressions matter on online news. In: Proceedings of the ICWSM (2015)
Reuters Institute Digital Report. http://www.digitalnewsreport.org/survey/2016/ (2016). [Online; Accessed 15 April 2019]
Riedel, B., Augenstein, I., Spithourakis, G., Riedel, S.: A simple but tough-to-beat baseline for the fake news challenge stance detection task. corr abs/1707.03264 (2017)
Rony, M.M.U., Hassan, N., Yousuf, M.: Diving deep into clickbaits: who use them to what extents in which topics with what effects? In: Proceedings of the ASONAM, pp. 232–239. ACM (2017)
Samek, W., Wiegand, T., Müller, K.R.: Explainable artificial intelligence: understanding, visualizing and interpreting deep learning models. arXiv preprint arXiv:1708.08296 (2017)
Shen, T., Lei, T., Barzilay, R., Jaakkola, T.: Style transfer from non-parallel text by cross-alignment. In: Proceedings of the NIPS, pp. 6830–6841 (2017)
Smith, E.J., Fowler, G.L. Jr.: How comprehensible are newspaper headlines? SAGE Publications: Los Angeles (1982)
Tai, K.S., Socher, R., Manning, C.D.: Improved semantic representations from tree-structured long short-term memory networks. In: Proceedings of the ACL, vol. 1, pp. 1556–1566 (2015)
Talos, C.: Fake news challenge – team SOLAT IN THE SWEN. https://github.com/Cisco-Talos/fnc-1 (2017). [Online; Accessed 15 April 2019]
Tannenbaum, P.H.: The effect of headlines on the interpretation of news stories. Journal. Bull. 30(2), 189–197 (1953)
Wang, Z., Hamza, W., Florian, R.: Bilateral multi-perspective matching for natural language sentences. In: Proceedings of the ICJAI, pp. 4144–4150. AAAI Press (2017)
Wei, W., Wan, X.: Learning to identify ambiguous and misleading news headlines. In: Proceedings of the IJCAI, pp. 4172–4178. AAAI Press (2017)
Yang, Z., Yang, D., Dyer, C., He, X., Smola, A., Hovy, E.: Hierarchical attention networks for document classification. In: Proceedings of the NAACL, pp. 1480–1489 (2016)
Yoon, S., Shin, J., Jung, K.: Learning to rank question-answer pairs using hierarchical recurrent encoder with latent topic clustering. In: Proceedings of the NAACL-HLT, vol. 1, pp. 1575–1584 (2018)
Zhou, P., Shi, W., Tian, J., Qi, Z., Li, B., Hao, H., Xu, B.: Attention-based bidirectional long short-term memory networks for relation classification. In: Proceedings of the ACL, pp. 207–212 (2016)
Acknowledgements
This research was supported by Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Science and ICT (No. NRF-2017R1E1A1A01076400).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this chapter
Cite this chapter
Park, K., Kim, T., Yoon, S., Cha, M., Jung, K. (2020). BaitWatcher: A Lightweight Web Interface for the Detection of Incongruent News Headlines. In: Shu, K., Wang, S., Lee, D., Liu, H. (eds) Disinformation, Misinformation, and Fake News in Social Media. Lecture Notes in Social Networks. Springer, Cham. https://doi.org/10.1007/978-3-030-42699-6_12
Download citation
DOI: https://doi.org/10.1007/978-3-030-42699-6_12
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-42698-9
Online ISBN: 978-3-030-42699-6
eBook Packages: Computer ScienceComputer Science (R0)