Bias-aware news analysis using matrix-based news aggregation

  • Felix Hamborg
  • Norman Meuschke
  • Bela Gipp


Media bias describes differences in the content or presentation of news. It is an ubiquitous phenomenon in news coverage that can have severely negative effects on individuals and society. Identifying media bias is a challenging problem, for which current information systems offer little support. News aggregators are the most important class of systems to support users in coping with the large amount of news that is published nowadays. These systems focus on identifying and presenting important, common information in news articles, but do not reveal different perspectives on the same topic. Due to this analysis approach, current news aggregators cannot effectively reveal media bias. To address this problem, we present matrix-based news aggregation, a novel approach for news exploration that helps users gain a broad and diverse news understanding by presenting various perspectives on the same news topic. Additionally, we present NewsBird, an open-source news aggregator that implements matrix-based news aggregation for international news topics. The results of a user study showed that NewsBird more effectively broadens the user’s news understanding than the list-based visualization approach employed by established news aggregators, while achieving comparable effectiveness and efficiency for the two main use cases of news consumption: getting an overview of and finding details on current news topics.


Media bias News aggregation Frame analysis Google News 



This work has been supported by the Carl Zeiss Foundation. We also thank the Microsoft Corporation for allowing us to translate our datasets to English. Furthermore, we thank the participants of our studies. Finally, we thank the anonymous reviewers for their valuable comments that significantly helped to improve this article.


  1. 1.
    Alexander, E., Gleicher, M.: Task-driven comparison of topic models. IEEE Trans. Vis. Comput. Graph. 22(1), 320–329 (2016)CrossRefGoogle Scholar
  2. 2.
    Atkinson, M., der Goot, E.: Near real time information mining in multilingual news. In: Proceedings of the 18th International Conference on World Wide Web, pp. 1153–1154 (2009)Google Scholar
  3. 3.
    Baker, B.H., et al.: How to Identify, Expose & Correct Liberal Media Bias. Media Research Center, Alexandria, VA (1994)Google Scholar
  4. 4.
    Balahur, A., et al.: Sentiment analysis in the news. arXiv:1309.6202. (2013)
  5. 5.
    Baron, D.P.: Persistent media bias. J. Public Econ. 90(1), 1–36 (2006)MathSciNetCrossRefGoogle Scholar
  6. 6.
    Bernhardt, D., et al.: Political polarization and the electoral effects of media bias. J. Public Econ. 92(5), 1092–1104 (2008)CrossRefGoogle Scholar
  7. 7.
    Besley, T.J., Prat, A.: Handcuffs for the grabbing hand? Media capture and government accountability. Am. Econ. Rev. 96(3), 720–736 (2002)CrossRefGoogle Scholar
  8. 8.
    Best, C., et al.: Europe media monitor. Technical report, Technical Report EUR 22173 EN, European Commission (2005)Google Scholar
  9. 9.
    Blei, D.M.: Probabilistic topic models. Commun. ACM. 55(4), 77–84 (2012)CrossRefGoogle Scholar
  10. 10.
    Bui, C.: How online gatekeepers guard our view: news portals’ inclusion and ranking of media and events. Global Media J. 9(16), 1–41 (2010)Google Scholar
  11. 11.
    Business insider 2014: these 6 corporations control 90% of the media in America. Accessed 16 May 2018
  12. 12.
    Cambria, E., White, B.: Jumping NLP curves: a review of natural language processing research. IEEE Comput. Intell. Mag. 9(2), 48–57 (2014)CrossRefGoogle Scholar
  13. 13.
    Cuthill, E., McKee, J.: Reducing the bandwidth of sparse symmetric matrices. In: Proceedings of the 1969 24th National Conference of the ACM, pp. 157–172 (1969)Google Scholar
  14. 14.
    Domke, D., et al.: The politics of conservative elites and the "liberal media" argument. J. Commun. 49(4), 35–58 (1999)CrossRefGoogle Scholar
  15. 15.
    Esser, F., et al.: Spin doctors in the United States, Great Britain, and Germany metacommunication about media manipulation. Int. J. Press/Polit. 6(1), 16–45 (2001)Google Scholar
  16. 16.
    Evans, D.K., et al.: Columbia newsblaster: multilingual news summarization on the web. Demonstration Papers at HLT-NAACL 2004, pp. 1–4 (2004)Google Scholar
  17. 17.
    Flaounas, I., et al.: The structure of the EU mediasphere. PLoS ONE 5, 12 (2010)CrossRefGoogle Scholar
  18. 18.
    Gabrilovich, E., Markovitch, S.: Feature generation for text categorization using world knowledge. In: Proceedings 19th International Journal Conference for Artificial Intelligence, pp. 1048–1053 (2005)Google Scholar
  19. 19.
    GALLUP: Americans’ trust in media remains at historical low (2015)Google Scholar
  20. 20.
    Gauthier, G.: In defence of a supposedly outdated notion: the range of application of journalistic objectivity. Can. J. Commun. 18(4), 497 (1993)CrossRefGoogle Scholar
  21. 21.
    Gentzkow, M., Shapiro, J.M.: Media bias and reputation. J. Polit. Econ. 114(2), 280–316 (2006)CrossRefGoogle Scholar
  22. 22.
    Griffiths, T.L., Steyvers, M.: Finding scientific topics. Proc. Natl. Acad. Sci. 101(suppl 1), 5228–5235 (2004)CrossRefGoogle Scholar
  23. 23.
    Hamborg, F., et al.: Extraction of main event descriptors from news articles by answering the journalistic five W and one H questions. In: Proceedings of the ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL) (2018)Google Scholar
  24. 24.
    Hamborg, F., et al.: Giveme5W: main event retrieval from news articles by extraction of the five journalistic W questions. In: Proceedings of the iConference 2018, Sheffield, UK (2018)Google Scholar
  25. 25.
    Hamborg, F., et al.: Identification and analysis of media bias in news articles. In: Proceedings of the 15th International Symposium of Information Science (2017)Google Scholar
  26. 26.
    Hamborg, F., et al.: Matrix-based News Aggregation: Exploring Different News Perspectives. In: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries, vol. 10(17) (2017)Google Scholar
  27. 27.
    Hamborg, F., et al.: News-please: a generic news crawler and extractor. In: Proceedings of the 15th International Symposium of Information Science, pp. 218–223 (2017)Google Scholar
  28. 28.
    Harcup, T., O’neill, D.: What is news? Galtung and ruge revisited. Journal Stud 2(2), 261–280 (2001)Google Scholar
  29. 29.
    Harrower, M., Brewer, C.A.: an online tool for selecting colour schemes for maps. The Cartograph. J. 40(1), 27–37 (2003)CrossRefGoogle Scholar
  30. 30.
    Hatcher, E., Gospodnetic, O.: Lucene in action. Manning Publications (2004)Google Scholar
  31. 31.
    Hu, M., Liu, B.: Mining and summarizing customer reviews. In: Proceedings of the 10th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 168–177 (2004)Google Scholar
  32. 32.
    Huang, X., et al.: Comparative news summarization using linear programming. In: Proceedings of the 49th Annual Meeting of the ACL: Human Language Techniques: vol. 2, pp. 648–653 (2011)Google Scholar
  33. 33.
    Klimt, B., Yang, Y.: The enron corpus: a new dataset for email classification research. In: Boulicaut, J.-F., Esposito, F., Giannotti, F., Pedreschi, D. (eds.) Machine Learning: ECML 2004, pp. 217–226. Springer, Berlin, Heidelberg (2004)CrossRefGoogle Scholar
  34. 34.
    Kohlschütter, C., et al.: Boilerplate detection using shallow text features. In: Proceedings of the Third ACM International Conference on Web Search and Data Mining, pp. 441–450 (2010)Google Scholar
  35. 35.
    Krstaji, M.: Cloudlines: compact display of event episodes in multiple time-series. IEEE Trans. Vis. Comput. Graph. 17(12), 2432–2439 (2011)CrossRefGoogle Scholar
  36. 36.
    Krstajic, M., et al.: Story Tracker: incremental visual text analytics of news story development. Inf. Vis. 12(3–4), 308–323 (2013)CrossRefGoogle Scholar
  37. 37.
    Kull, S., et al.: Misperceptions, the media, and the Iraq war. Polit. Sci. Q. 118(4), 569–598 (2003)CrossRefGoogle Scholar
  38. 38.
    Lin, C.-Y., Hovy, E.: From single to multi-document summarization: A prototype system and its evaluation. In: Proceedings of the 40th Annual Meeting on ACL, pp. 457–464 (2002)Google Scholar
  39. 39.
    Mahdisoltani, F., et al.: YAGO3: A knowledge base from multilingual Wikipedias. In: Proceedings of CIDR, pp. 1–11 (2015)Google Scholar
  40. 40.
    McKeown, K.R., et al.: Tracking and summarizing news on a daily basis with Columbia’s Newsblaster. In: Proceedings of the 2nd International Conference on HLTR, pp. 280–285 (2002)Google Scholar
  41. 41.
    Meuschke, N., et al.: An adaptive image-based plagiarism detection approach. In: ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL) (2018)Google Scholar
  42. 42.
    Meuschke, N. et al.: Analyzing semantic concept patterns to detect academic plagiarism. In: Proceedings of the 6th International Working on Mining Scientific Publications, pp. 46–53 (2017)Google Scholar
  43. 43.
    Mitchell, R.: Web Scraping with Python: Collecting Data from the Modern Web. O’Reilly Media, Inc, Newton (2015)Google Scholar
  44. 44.
    Mullainathan, S., Shleifer, A.: The market for news. Am. Econ. Rev. 95, 1031–1053 (2005)CrossRefGoogle Scholar
  45. 45.
    Munson, S.A., et al.: Encouraging reading of diverse political viewpoints with a browser widget. In: ICWSM (2013)Google Scholar
  46. 46.
    Munson, S.A., et al.: Sidelines: an algorithm for increasing diversity in news and opinion aggregators. In: ICWSM (2009)Google Scholar
  47. 47.
  48. 48.
    News Bias Explored—the art of reading the news (2014). Accessed 22 Sept 2017
  49. 49.
    Oelke, D. et al.: Visual analysis of explicit opinion and news bias in German Soccer Articles. In: EuroVA 2012, pp. 49–53 (2012)Google Scholar
  50. 50.
    Paliouras, G. et al.: PNS: a personalized news aggregator on the web. In: Virvou, M., Jain, L.C. (eds.) Intelligent Interactive Systems in Knowledge-Based Environments, pp. 175–197. Springer Berlin, Heidelberg (2008)
  51. 51.
    Park, S. et al.: NewsCube: delivering multiple aspects of news to mitigate media bias. In: Proceedings of CHI’09, The SIGCHI Conference on Human Factors in CS (2009)Google Scholar
  52. 52.
    Park, S. et al.: NewsCube 2.0: an exploratory design of a social news website for media bias mitigation. In: Workshop on Social Recommender Systems (2011)Google Scholar
  53. 53.
    Park, S. et al.: The politics of comments: predicting political orientation of news stories with commenters’ sentiment patterns. In: Proceedings of the ACM 2011 Conference on Computer Supported Cooperative Work, pp. 113–122 (2011)Google Scholar
  54. 54.
    Radev, D.R., et al.: Centroid-based summarization of multiple documents: sentence extraction, utility-based evaluation, and user studies. In: Proceedings of the 2000 NAACL-ANLP Workshop on Automatic summarization, pp. 21–30 (2000)Google Scholar
  55. 55.
    Recasens, M., et al.: Linguistic models for analyzing and detecting biased language. In: Proceedings of the 51st Annual Meeting on Association for Computational Linguistics, pp. 1650–1659 (2013)Google Scholar
  56. 56.
    Salton, G., et al.: A vector space model for automatic indexing. Commun. ACM 18(11), 613–620 (1975)MathSciNetCrossRefzbMATHGoogle Scholar
  57. 57.
    Smith, A., et al.: Hiérarchie: interactive visualization for hierarchical topic models. In: Proceedings of the Work on Interactive Language Learning, Visual, and Interfaces, pp. 71–78 (2014)Google Scholar
  58. 58.
    Straubhaar, J.D.: Media Now: Communication Media in Information Age. Thomson Learning (2000)Google Scholar
  59. 59.
    Sundar, S.S.: Exploring receivers’ criteria for perception of print and online news. Journal. Mass Commun. Q. 76(2), 373–386 (1999)CrossRefGoogle Scholar
  60. 60.
    Weskamp, M.: newsmap (2016)Google Scholar
  61. 61.
    (2014) Moscow to Kiev: Stick to Minsk ceasefire, stop making false “invasion” claims. RT. Accessed 16 May 2018
  62. 62.
    (2014) Tank column crosses from Russia into Ukraine: Kiev military. CNBC. Accessed 16 May 2018

Copyright information

© Springer-Verlag GmbH Germany, part of Springer Nature 2018

Authors and Affiliations

  1. 1.University of KonstanzConstanceGermany

Personalised recommendations