In this brief research note, we propose a set of concepts and methods for identifying and operationalizing controversial news items. Based on an analysis of online readers’ comments posted in response to political news articles in the lead-up to the most recent South Korean presidential election (May 9, 2017), we develop what we term as “controversy indicator.” We calculate a controversy score using the total number of reader comments and the proportion of “upvotes” (indicating approval) and “downvotes” (indicating disapproval) a given news article elicits. Our findings demonstrate the potential usefulness of the controversy indicator in understanding the contemporary news environment, which is becoming increasingly divisive and polluted with disinformation.
This is a preview of subscription content, log in to check access.
Buy single article
Instant access to the full article PDF.
Price includes VAT for USA
Subscribe to journal
Immediate online access to all issues from 2019. Subscription will auto renew annually.
This is the net price. Taxes to be calculated in checkout.
Bakir, V., McStay, A.: Fake news and the economy of emotions: problems, causes, solutions. Digit. Journal. 6(2), 154–175 (2018)
Bedeski, R.: The Korean state and candlelight democracy: paradigms and evolution. J. Contem. East. Asia 16(2), 82–92 (2017)
Cho, S.S.: A content analysis of reple in on-line newspaper: a type and disposition. Korean J. Commun. Stud. 15(2), 65–84 (2007) (in Korean)
Cho, H.N., Jung, Y.O., Lee, J.D., Lee, J.H.: Semantic analysis using news comments for public opinion mining. Proc. KIIS Spring Conf. 23(1), 149–150 (2013) (in Korean)
Choi, J.S.: French press, efforts to filter out fake news. Newsp. Broadcast. 555, 108–111 (2017) (in Korean)
Freedom House: Freedom on the Net 2017: Manipulating Social Media to Undermine Democracy. Freedom House. Retrieved from https://freedomhouse.org/report/freedom-net/freedom-net-2017 (2017)
Howard, P.N., Kollanyi, B.: Bots, #StrongerIn, and #Brexit: Computational propaganda during the UK–EU referendum. Retrieved from http://arxiv.org/abs/1606.06356 (2016)
Jeon, M.J.: French presidential coverage and fake news. War with fake news in the press, SNS, politics, and education. Newsp. Broadcast. 557, 14–19 (2017) (in Korean)
Julie, A., Leiott, S.: Evaluating the public information: shaping news coverage of the silicone implant controversy. Public Relat. Rev. 24(2), 183–201 (1998)
Jung, I.K., Kim, Y.S.: Impact of “Datgeul” of online media on public opinion: an examination of perception of public opinion and third person effect. Korean J. Journal. Commun. Stud. 50(4), 302–327 (2006) (in Korean)
Kang, J.W., Kim, S.J.: A study on the effect of comments posted under Internet news articles. Korean J. Journal. Commun. Stud. 56(2), 143–166 (2012) (in Korean)
Kim, S.H., Kim, W.G.: Digital news report 2016: Korea. Report of Korea Press Foundation (2016) (in Korean)
Kim, S.T., Lee, Y.H.: New functions of Internet mediated agenda-setting: agenda-rippling and reversed agenda-setting. Korean J. Journal. Commun. Stud. 50(3), 175–204 (2006) (in Korean)
Kim, E.M., Sun, Y.H.: The effect of replies in Internet new on the audience. Korean J. Journal. Commun. Stud. 50(4), 33–64 (2006) (in Korean)
Kim, J.H., Song, Y.E., Jin, Y.S., Kwon, O.B.: Applying text mining to identify factors which affect likes and dislikes of online news comments. J. Korea Soc. IT Serv. 14(2), 159–176 (2015) (in Korean)
Kim, C.W., Park, H.J., Yun, H.W., Park, H.W.: Developing a controversy indicator using online news and replies: a case of the 2017 presidential campaign in South Korea. J. Korean Data Anal. Soc. 20(2), 937–948 (2018) (in Korean)
Knobloch-Westerwick, S., Johnson, B., Westerwick, A.: Confirmation bias in online searchers: impacts of selective exposure before an election on political attitude strength and shifts. J. Comput. Med. Commun. 20(2), 171–187 (2015)
Korea Press Foundation Media Research Analysis Team: 2016 Analysis of News Users: The 21th Analysis of the News Users in Media-Environmental Change (2016) (in Korean)
Lazer, D., et al.: The science of fake news. Addressing fake news requires a multidisciplinary effort. Science 359(6380), 1094–1096 (2018)
Lee, E.J., Jang, Y.J.: Effects of others’ comments on Internet news sites on perceptions of reality: perceived public opinion, presumed media influence, and self-opinion. Korean J. Journal. Commun. Stud. 53(4), 50–71 (2009) (in Korean)
Lee, Y.-O., Park, H.W.: The reconfiguration of e-campaign practices in Korea: a case study of the presidential primaries of 2007. Int. Sociol. 25(1), 29–53 (2010)
Lee, J.S., Sung, M.J.: The effects of reading replies on the perception of online news articles: focusing on the PR perspective. Korean J. Advert. 9(4), 7–45 (2007) (in Korean)
Lee, G.J., Kim, J.H., Seo, H.W., Ryu, G.S.: Feature weighting for opinion classification of comments on news articles. J. Korea Soc. Mar. Eng. 34(6), 871–879 (2010) (in Korean)
Lee, Y.-O., Park, H.C., Park, H.W., Kluver, R.: The 2016 candlelight protest in a hybrid media system. J. Korean Data Anal. Soc. 19(2), 885–896 (2017) (in Korean)
MeCab: Retrieved February 4, 2018, from https://bitbucket.org/eunjeon/mecab-ko (2018)
Park, C.H.: The violence of replies in Internet news: focused on a happening of franchise restaurant Chasundang. Korean J. Soc. Theory 42, 93–120 (2012) (in Korean)
Park, C.H.: An analysis on the pros and cons presented in the responses of replies as intermediated interaction of the Internet. Discourse 201, 16(2), 135–164 (2013) (in Korean)
Park, H.W.: Mapping election campaigns through negative entropy: triple and quadruple helix approach to South Korea’s 2012 presidential election. Scientometrics 99(1), 187–197 (2014)
Park, H.W., Lee, Y.-O.: The Korean presidential election of 2007: five years on from the “Internet election”. J. Contem. East. Asia 7(1), 1–4 (2008)
Park, H.W., Lee, Y.-O.: A mixed text analysis of user comments on a portal site: the ‘BBK scandal’ in the 2007 presidential election of South Korea. J. Korean Data Anal. Soc. 11(2), 731–744 (2009) (in Korean)
Park, S.J., Park, J.Y., Lim, Y.S., Park, H.W.: Expanding the presidential debate by Tweeting: the 2012 presidential debate in South Korea. Telemat. Inform. 33, 557–569 (2016)
Sanborn, H.: Democratic participation under authoritarianism in Hong Kong and Singapore. J. Contem. East. Asia 16(2), 44–58 (2017)
Shapiro, M.A., Park, H.W.: More than entertainment: YouTube and public responses to the science of global warming and climate change. Soc. Sci. Inf. 54(1), 115–145 (2015)
Shapiro, M.A., Park, H.W.: Climate change and YouTube: deliberation potential in post-video discussions. Environ. Commun. 12(1), 115–131 (2018)
Silverman, C. This analysis shows how viral fake election news stories outperformed real news on Facebook. BuzzFeed News. Retrieved from https://www.buzzfeed.com/craigsilverman/viral-fake-election-news-outperformed-real-news-on-facebook (2016)
Son, J.M.: U.S. presidential coverage and fake news of U.S. press. Kwanhun J. 142, 26–33 (2017) (in Korean)
Soon, C., How, T.T.: All rants and no substance?: A new framework for studying the rationality of cyberspace. J. Contem. East. Asia 16(2), 20–43 (2017)
Vosoughi, S., Roy, D., Aral, S.: The spread of true and false news online. Science 359(6380), 1146–1151 (2018)
Weeks, B.E., Lane, D.S., Kim, D.H., Lee, S.S., Kwak, N.: Incidental exposure, selective exposure, and political information sharing: integrating online exposure patterns and expression on social media. J. Comput. Med. Commun. 22(6), 363–379 (2017)
We thank Hui Wung Woon, who had collaborated on an earlier piece in Korean. This work was supported by the 2018 Yeungnam University Research Grant (Grant No. 218A380075).
Hyejin Park is regarded as co-first author.
About this article
Cite this article
Kim, C.W., Park, H., Lee, Y. et al. Towards the operationalization of controversial news: a study of online news articles and reader comments during the 2017 presidential election in South Korea. Qual Quant 53, 1097–1108 (2019). https://doi.org/10.1007/s11135-018-0804-8
- Controversy indicator
- News consumption polarization
- Online news
- Reader comment
- South Korea