Skip to main content
Log in

Bias-aware news analysis using matrix-based news aggregation

  • Published:
International Journal on Digital Libraries Aims and scope Submit manuscript

Abstract

Media bias describes differences in the content or presentation of news. It is an ubiquitous phenomenon in news coverage that can have severely negative effects on individuals and society. Identifying media bias is a challenging problem, for which current information systems offer little support. News aggregators are the most important class of systems to support users in coping with the large amount of news that is published nowadays. These systems focus on identifying and presenting important, common information in news articles, but do not reveal different perspectives on the same topic. Due to this analysis approach, current news aggregators cannot effectively reveal media bias. To address this problem, we present matrix-based news aggregation, a novel approach for news exploration that helps users gain a broad and diverse news understanding by presenting various perspectives on the same news topic. Additionally, we present NewsBird, an open-source news aggregator that implements matrix-based news aggregation for international news topics. The results of a user study showed that NewsBird more effectively broadens the user’s news understanding than the list-based visualization approach employed by established news aggregators, while achieving comparable effectiveness and efficiency for the two main use cases of news consumption: getting an overview of and finding details on current news topics.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Source: [25]

Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

Notes

  1. https://www.microsoft.com/en-us/translator/translatorapi.aspx.

  2. https://en.wikipedia.org/wiki/Portal:Current_events/2014_November_7  https://en.wikipedia.org/wiki/Portal:Current_events/2015_June_7.

References

  1. Alexander, E., Gleicher, M.: Task-driven comparison of topic models. IEEE Trans. Vis. Comput. Graph. 22(1), 320–329 (2016)

    Article  Google Scholar 

  2. Atkinson, M., der Goot, E.: Near real time information mining in multilingual news. In: Proceedings of the 18th International Conference on World Wide Web, pp. 1153–1154 (2009)

  3. Baker, B.H., et al.: How to Identify, Expose & Correct Liberal Media Bias. Media Research Center, Alexandria, VA (1994)

    Google Scholar 

  4. Balahur, A., et al.: Sentiment analysis in the news. arXiv:1309.6202. (2013)

  5. Baron, D.P.: Persistent media bias. J. Public Econ. 90(1), 1–36 (2006)

    Article  Google Scholar 

  6. Bernhardt, D., et al.: Political polarization and the electoral effects of media bias. J. Public Econ. 92(5), 1092–1104 (2008)

    Article  Google Scholar 

  7. Besley, T.J., Prat, A.: Handcuffs for the grabbing hand? Media capture and government accountability. Am. Econ. Rev. 96(3), 720–736 (2002)

    Article  Google Scholar 

  8. Best, C., et al.: Europe media monitor. Technical report, Technical Report EUR 22173 EN, European Commission (2005)

  9. Blei, D.M.: Probabilistic topic models. Commun. ACM. 55(4), 77–84 (2012)

    Article  Google Scholar 

  10. Bui, C.: How online gatekeepers guard our view: news portals’ inclusion and ranking of media and events. Global Media J. 9(16), 1–41 (2010)

    Google Scholar 

  11. Business insider 2014: these 6 corporations control 90% of the media in America. https://www.businessinsider.de/these-6-HrBcorporations-control-90-of-the-media-in-america-2012-6?r=USHrB&IR=T. Accessed 16 May 2018

  12. Cambria, E., White, B.: Jumping NLP curves: a review of natural language processing research. IEEE Comput. Intell. Mag. 9(2), 48–57 (2014)

    Article  Google Scholar 

  13. Cuthill, E., McKee, J.: Reducing the bandwidth of sparse symmetric matrices. In: Proceedings of the 1969 24th National Conference of the ACM, pp. 157–172 (1969)

  14. Domke, D., et al.: The politics of conservative elites and the "liberal media" argument. J. Commun. 49(4), 35–58 (1999)

    Article  Google Scholar 

  15. Esser, F., et al.: Spin doctors in the United States, Great Britain, and Germany metacommunication about media manipulation. Int. J. Press/Polit. 6(1), 16–45 (2001)

    Google Scholar 

  16. Evans, D.K., et al.: Columbia newsblaster: multilingual news summarization on the web. Demonstration Papers at HLT-NAACL 2004, pp. 1–4 (2004)

  17. Flaounas, I., et al.: The structure of the EU mediasphere. PLoS ONE 5, 12 (2010)

    Article  Google Scholar 

  18. Gabrilovich, E., Markovitch, S.: Feature generation for text categorization using world knowledge. In: Proceedings 19th International Journal Conference for Artificial Intelligence, pp. 1048–1053 (2005)

  19. GALLUP: Americans’ trust in media remains at historical low (2015)

  20. Gauthier, G.: In defence of a supposedly outdated notion: the range of application of journalistic objectivity. Can. J. Commun. 18(4), 497 (1993)

    Article  Google Scholar 

  21. Gentzkow, M., Shapiro, J.M.: Media bias and reputation. J. Polit. Econ. 114(2), 280–316 (2006)

    Article  Google Scholar 

  22. Griffiths, T.L., Steyvers, M.: Finding scientific topics. Proc. Natl. Acad. Sci. 101(suppl 1), 5228–5235 (2004)

    Article  Google Scholar 

  23. Hamborg, F., et al.: Extraction of main event descriptors from news articles by answering the journalistic five W and one H questions. In: Proceedings of the ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL) (2018)

  24. Hamborg, F., et al.: Giveme5W: main event retrieval from news articles by extraction of the five journalistic W questions. In: Proceedings of the iConference 2018, Sheffield, UK (2018)

  25. Hamborg, F., et al.: Identification and analysis of media bias in news articles. In: Proceedings of the 15th International Symposium of Information Science (2017)

  26. Hamborg, F., et al.: Matrix-based News Aggregation: Exploring Different News Perspectives. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries, vol. 10(17) (2017)

  27. Hamborg, F., et al.: News-please: a generic news crawler and extractor. In: Proceedings of the 15th International Symposium of Information Science, pp. 218–223 (2017)

  28. Harcup, T., O’neill, D.: What is news? Galtung and ruge revisited. Journal Stud 2(2), 261–280 (2001)

    Google Scholar 

  29. Harrower, M., Brewer, C.A.: ColorBrewer.org: an online tool for selecting colour schemes for maps. The Cartograph. J. 40(1), 27–37 (2003)

    Article  Google Scholar 

  30. Hatcher, E., Gospodnetic, O.: Lucene in action. Manning Publications (2004)

  31. Hu, M., Liu, B.: Mining and summarizing customer reviews. In: Proceedings of the 10th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 168–177 (2004)

  32. Huang, X., et al.: Comparative news summarization using linear programming. In: Proceedings of the 49th Annual Meeting of the ACL: Human Language Techniques: vol. 2, pp. 648–653 (2011)

  33. Klimt, B., Yang, Y.: The enron corpus: a new dataset for email classification research. In: Boulicaut, J.-F., Esposito, F., Giannotti, F., Pedreschi, D. (eds.) Machine Learning: ECML 2004, pp. 217–226. Springer, Berlin, Heidelberg (2004)

    Chapter  Google Scholar 

  34. Kohlschütter, C., et al.: Boilerplate detection using shallow text features. In: Proceedings of the Third ACM International Conference on Web Search and Data Mining, pp. 441–450 (2010)

  35. Krstaji, M.: Cloudlines: compact display of event episodes in multiple time-series. IEEE Trans. Vis. Comput. Graph. 17(12), 2432–2439 (2011)

    Article  Google Scholar 

  36. Krstajic, M., et al.: Story Tracker: incremental visual text analytics of news story development. Inf. Vis. 12(3–4), 308–323 (2013)

    Article  Google Scholar 

  37. Kull, S., et al.: Misperceptions, the media, and the Iraq war. Polit. Sci. Q. 118(4), 569–598 (2003)

    Article  Google Scholar 

  38. Lin, C.-Y., Hovy, E.: From single to multi-document summarization: A prototype system and its evaluation. In: Proceedings of the 40th Annual Meeting on ACL, pp. 457–464 (2002)

  39. Mahdisoltani, F., et al.: YAGO3: A knowledge base from multilingual Wikipedias. In: Proceedings of CIDR, pp. 1–11 (2015)

  40. McKeown, K.R., et al.: Tracking and summarizing news on a daily basis with Columbia’s Newsblaster. In: Proceedings of the 2nd International Conference on HLTR, pp. 280–285 (2002)

  41. Meuschke, N., et al.: An adaptive image-based plagiarism detection approach. In: ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL) (2018)

  42. Meuschke, N. et al.: Analyzing semantic concept patterns to detect academic plagiarism. In: Proceedings of the 6th International Working on Mining Scientific Publications, pp. 46–53 (2017)

  43. Mitchell, R.: Web Scraping with Python: Collecting Data from the Modern Web. O’Reilly Media, Inc, Newton (2015)

    Google Scholar 

  44. Mullainathan, S., Shleifer, A.: The market for news. Am. Econ. Rev. 95, 1031–1053 (2005)

    Article  Google Scholar 

  45. Munson, S.A., et al.: Encouraging reading of diverse political viewpoints with a browser widget. In: ICWSM (2013)

  46. Munson, S.A., et al.: Sidelines: an algorithm for increasing diversity in news and opinion aggregators. In: ICWSM (2009)

  47. Newman, N. et al.: Reuters Institute Digital News Report 2015 (2015). http://reutersinstitute.politics.ox.ac.uk/sites/default/files/research/files/Reuters%2520Institute%2520Digital%2520News%2520Report%25202015_Full%2520Report.pdf. Accessed 16 May 2018

  48. News Bias Explored—the art of reading the news (2014). http://umich.edu/newsbias/. Accessed 22 Sept 2017

  49. Oelke, D. et al.: Visual analysis of explicit opinion and news bias in German Soccer Articles. In: EuroVA 2012, pp. 49–53 (2012)

  50. Paliouras, G. et al.: PNS: a personalized news aggregator on the web. In: Virvou, M., Jain, L.C. (eds.) Intelligent Interactive Systems in Knowledge-Based Environments, pp. 175–197. Springer Berlin, Heidelberg (2008) https://doi.org/10.1007/978-3-540-77471-6_10

    Chapter  Google Scholar 

  51. Park, S. et al.: NewsCube: delivering multiple aspects of news to mitigate media bias. In: Proceedings of CHI’09, The SIGCHI Conference on Human Factors in CS (2009)

  52. Park, S. et al.: NewsCube 2.0: an exploratory design of a social news website for media bias mitigation. In: Workshop on Social Recommender Systems (2011)

  53. Park, S. et al.: The politics of comments: predicting political orientation of news stories with commenters’ sentiment patterns. In: Proceedings of the ACM 2011 Conference on Computer Supported Cooperative Work, pp. 113–122 (2011)

  54. Radev, D.R., et al.: Centroid-based summarization of multiple documents: sentence extraction, utility-based evaluation, and user studies. In: Proceedings of the 2000 NAACL-ANLP Workshop on Automatic summarization, pp. 21–30 (2000)

  55. Recasens, M., et al.: Linguistic models for analyzing and detecting biased language. In: Proceedings of the 51st Annual Meeting on Association for Computational Linguistics, pp. 1650–1659 (2013)

  56. Salton, G., et al.: A vector space model for automatic indexing. Commun. ACM 18(11), 613–620 (1975)

    Article  MathSciNet  Google Scholar 

  57. Smith, A., et al.: Hiérarchie: interactive visualization for hierarchical topic models. In: Proceedings of the Work on Interactive Language Learning, Visual, and Interfaces, pp. 71–78 (2014)

  58. Straubhaar, J.D.: Media Now: Communication Media in Information Age. Thomson Learning (2000)

  59. Sundar, S.S.: Exploring receivers’ criteria for perception of print and online news. Journal. Mass Commun. Q. 76(2), 373–386 (1999)

    Article  Google Scholar 

  60. Weskamp, M.: newsmap (2016)

  61. (2014) Moscow to Kiev: Stick to Minsk ceasefire, stop making false “invasion” claims. RT. https://www.rt.com/news/203203-ukraine-russia-troops-border/. Accessed 16 May 2018

  62. (2014) Tank column crosses from Russia into Ukraine: Kiev military. CNBC. https://www.cnbc.com/2014/11/05/tank-column-crosses-from-russia-into-ukraine-kiev-military.html. Accessed 16 May 2018

Download references

Acknowledgements

This work has been supported by the Carl Zeiss Foundation. We also thank the Microsoft Corporation for allowing us to translate our datasets to English. Furthermore, we thank the participants of our studies. Finally, we thank the anonymous reviewers for their valuable comments that significantly helped to improve this article.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Felix Hamborg.

Additional information

Part of the research described in this article has been published in the proceedings of the ACM/IEEE-CS Joint Conference on Digital Libraries 2017 [26].

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hamborg, F., Meuschke, N. & Gipp, B. Bias-aware news analysis using matrix-based news aggregation. Int J Digit Libr 21, 129–147 (2020). https://doi.org/10.1007/s00799-018-0239-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00799-018-0239-9

Keywords

Navigation