Skip to main content

Identifying Similar Opinions in News Comments Using a Community Detection Algorithm

  • Conference paper
  • First Online:
Social Informatics (SocInfo 2015)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 9471))

Included in the following conference series:

Abstract

Despite playing many important roles in society, the news media have been frequently criticised for failing to represent a wide range of viewpoints. Online news systems have the potential to allow readers to add additional information and perspectives. However, due to the simplicity of the filtering mechanisms typically employed, these systems can themselves be prone to over-promoting popular viewpoints at the expense of others. Previous research has attempted to diversify news comments through the use of content similarity, sentiment analysis, named entity recognition, and other factors. In this paper we propose the use of a commonly used community detection algorithm on a network of voting data to identify sentiment groups in news discussion threads, with the eventual goal that these groups may be used to present diverse content. In a controlled experiment with 154 participants, we verify that the Louvain Community Detection algorithm is able to group users with accuracy comparable to an average human. This produces groups containing users who share similar sentiment on a given topic. This is an important step towards ensuring that each group is represented, as by using this method future news systems can ensure that more diverse views are represented in open comment threads.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Abu-Jbara, A., King, B., Diab, M.T., Radev, D.R.: Identifying opinion subgroups in arabic online discussions. ACL 2, 829–835 (2013)

    Google Scholar 

  2. Anderson, P.J., Williams, M., Ogola, G.: The Future of Quality News Journalism: A Cross-continental Analysis, vol. 7. Routledge (2013)

    Google Scholar 

  3. Arguello, J., Butler, B.S., Joyce, E., Kraut, R., Ling, K.S., Rosé, C., Wang, X.: Talk to me: foundations for successful individual-group interactions in online communities. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 959–968. ACM (2006)

    Google Scholar 

  4. Bennett, W.L.: News: The Politics of Illusion. Longman, New York (1988)

    Google Scholar 

  5. Blondel, V.D., Guillaume, J.-L., Lambiotte, R., Lefebvre, E.: Fast unfolding of communities in large networks. Journal of Statistical Mechanics: Theory and Experiment 2008(10) (2008)

    Google Scholar 

  6. Cheng, J., Danescu-Niculescu-Mizil, C., Leskovec, J.: How community feedback shapes user behavior. In: ICWSM 2014 (2014)

    Google Scholar 

  7. Clauset, A., Newman, M.E., Moore, C.: Finding community structure in very large networks. Physical Review E 70(6), 066111 (2004)

    Article  Google Scholar 

  8. Davies, N.: Flat Earth news: an award-winning reporter exposes falsehood, distortion and propaganda in the global media. Random House, London (2011)

    Google Scholar 

  9. Fortunato, S.: Community detection in graphs. Physics Reports 486(3), 75–174 (2010)

    Article  MathSciNet  Google Scholar 

  10. Fortunato, S., Barthelemy, M.: Resolution limit in community detection. Proceedings of the National Academy of Sciences 104(1), 36–41 (2007)

    Article  Google Scholar 

  11. Giannopoulos, G., Koniaris, M., Weber, I., Jaimes, A., Sellis, T.: Algorithms and criteria for diversification of news article comments. Journal of Intelligent Information Systems 44(1), 1–47 (2014)

    Article  Google Scholar 

  12. Hampton, K., Goulet, L.S., Rainie, L., Purcell, K.: Social networking sites and our lives. Technical report, Pew Internet and American Life Project (2011)

    Google Scholar 

  13. Herman, E.S., Chomsky, N.: Manufacturing consent: The political economy of the mass media. Random House, London (1988)

    Google Scholar 

  14. Ipsos MORI: Perceptions are not reality: The top 10 we get wrong (2013). https://www.ipsos-mori.com/researchpublications/researcharchive/3188/Perceptions-are-not-reality-the-top-10-we-get-wrong.aspx

  15. Jaffali, S., Jamoussi, S., Hamadou, A.B.: Grouping like-minded users based on text and sentiment analysis. In: Hwang, D., Jung, J.J., Nguyen, N.-T. (eds.) ICCCI 2014. LNCS, vol. 8733, pp. 83–93. Springer, Heidelberg (2014)

    Google Scholar 

  16. Kovach, B., Rosenstiel, T.: The elements of journalism: What newspeople should know and the public should expect (2007). Random House LLC

    Google Scholar 

  17. Kriplean, T., Toomim, M., Morgan, J., Borning, A., Ko, A.: Is this what you meant?: promoting listening on the web with reflect. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1559–1568. ACM (2012)

    Google Scholar 

  18. McCombs, M.: A look at agenda-setting: Past, present and future. Journalism Studies 6(4), 543–557 (2005)

    Article  Google Scholar 

  19. McCombs, M.E., Shaw, D.L.: The agenda-setting function of mass media. Public Opinion Quarterly 36(2), 176–187 (1972)

    Article  Google Scholar 

  20. Meier, F., Elsweiler, D., Wilson, M.L.: More than liking and bookmarking? towards understanding twitter favouriting behaviour. In: ICWSM 2014 (2014)

    Google Scholar 

  21. Mills, R.: Researching social news - is reddit.com a mouthpiece for the ‘hive mind’, or a collective intelligence approach to information overload? In: Proceedings of the ETHICOMP 2011. Sheffield Hallam University (2011)

    Google Scholar 

  22. Mitchell, A.: State of the news media 2014: Overview. Pew Research Journalism Project (2014)

    Google Scholar 

  23. Muchnik, L., Aral, S., Taylor, S.J.: Social influence bias: A randomized experiment. Science 341(6146), 647–651 (2013)

    Article  Google Scholar 

  24. Nardelli, A., Arnett, G.: You are probably wrong about almost everything. The Guardian, October 29, 2014. http://www.theguardian.com/news/datablog/2014/oct/29/todays-key-fact-you-are-probably-wrong-about-almost-everything

  25. Papadopoulos, S., Kompatsiaris, Y., Vakali, A., Spyridonos, P.: Community detection in social media. Data Mining and Knowledge Discovery 24(3), 515–554 (2012)

    Article  Google Scholar 

  26. Parau, P., Stef, A., Lemnaru, C., Dinsoreanu, M., Potolea, R.: Using community detection for sentiment analysis. In: 2013 IEEE International Conference on Intelligent Computer Communication and Processing, pp. 51–54. IEEE (2013)

    Google Scholar 

  27. Schultz, J.: Reviving the fourth estate: Democracy, accountability and the media. Cambridge University Press (1998)

    Google Scholar 

  28. Scott, J., Millard, D., Leonard, P.: Citizen participation in news: An analysis of the landscape of online journalism. Digital Journalism, (ahead-of-print), 1–22 (2014)

    Google Scholar 

  29. Strömbäck, J.: Four phases of mediatization: An analysis of the mediatization of politics. The International Journal of Press/Politics 13(3), 228–246 (2008)

    Article  Google Scholar 

  30. Wanta, W., Golan, G., Lee, C.: Agenda setting and international news: Media influence on public perceptions of foreign nations. Journalism & Mass Communication Quarterly 81(2), 364–377 (2004)

    Article  Google Scholar 

  31. Whiteley, P., Clarke, H. D., Sanders, D., Stewart, M.: The economic and electoral consequences of austerity policies in britain. In: EPSA 2013 Annual General Conference Paper, vol. 138 (2013)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jonathan Scott .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Scott, J., Millard, D., Leonard, P. (2015). Identifying Similar Opinions in News Comments Using a Community Detection Algorithm. In: Liu, TY., Scollon, C., Zhu, W. (eds) Social Informatics. SocInfo 2015. Lecture Notes in Computer Science(), vol 9471. Springer, Cham. https://doi.org/10.1007/978-3-319-27433-1_7

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-27433-1_7

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-27432-4

  • Online ISBN: 978-3-319-27433-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics