Revisionista.PT: Uncovering the News Cycle Using Web Archives
- 2.9k Downloads
In this demo, we present a meta-journalistic tool that reveals post-publication changes in articles of Portuguese online news media. Revisionista.PT can uncover the news cycle of online media, offering a glimpse into an otherwise unknown dynamic edit history. We leverage on article snapshots periodically collected by Web archives to reconstruct an approximate timeline of the changes: additions, edits, and corrections. Revisionista.PT is currently tracking changes in about 140,000 articles published by 12 selected news sources and has a user-friendly interface that will be familiar to users of version control systems. In addition, an open source browser extension can be installed by users so that they can be alerted of changes to articles they may be reading. Initial work on this demo was started as an entry submitted into Arquivo.PT ’s 2019 Prize, where it received an award for second place.
Nowadays, online media plays a critical role in the dissemination of the news. In the age of online first and the 24 h news cycle, news publishing has been deeply transformed to allow more agility and flexibility, and (online) news articles are now updated seamlessly as new information becomes available. However, the desire to be first to publish and achieve high click-through rates has led to an increase in clickbait, both pre- and post-publication editorialization of titles and headlines that may misrepresent the actual content of the articles . These trends may have contributed to the increased media mistrust that is discussed today under the controversial term fake news, described as “a poorly-defined and misleading term that conflates a variety of false information, from genuine error through to foreign interference in democratic processes” .
In some instances, undisclosed post-publication changes have swung the overall message and tone of news articles and, when revealed, have angered readers . How can news readers be sure that the articles they are reading were not altered secretly after their original publication? Can we trust publishers to guarantee that a link you share with a friend will contain the same content you have read?
Revisionista.PT1 allows readers to see all kinds of post-publication changes, and allows scholars to research this phenomenon and reason about how these changes affect the readers perception of news in the age of social media.
2 Proposed Solution
In this demo paper, we propose a meta-journalistic tool that reveals post-publication changes in articles published by Portuguese online news media. The goal of Revisionista.PT is to discover significant post-publication changes in news articles and to present them in a transparent auditable timeline. The most important raw materials to achieve this objective are historical collections of web page snapshots from news outlets that are preserved by the Portuguese Web Archive, Arquivo.PT2.
To create this project, we had to build solutions to solve a number of technical challenges: Given a web page, how to extract the textual content of the article?, What are the significant differences between article revisions?, and, most importantly, What dimensions can be used to classify the changes found?.
News Article URLs. To build a list of news article URLs our strategy was to develop URL slug templates that are matched when fetching news articles of a given news source (e. g., https://observador.pt/<YYYY>/<MM>/<DD>/<title>. We used a semi-automatic interactive process to create the slug templates that we then used to whitelist URLs that will be fetched from each news source. The Portuguese Web Archive (Arquivo.PT) is currently the main data source. Using an established Web archive allowed us to focus on tasks that are orthogonal to the preservation of the web and leverage on their preserved web page snapshots.
Fetch HTML Snapshots. Given a list of news article URLs, our crawler downloads multiple snapshots for each of the URLs in the list. We adopted a more conservative crawling strategy that can be described as a bisection method over the largest time span (furthest pair of snapshots), with downloads proceeding only on the branches where changes are found.
Text Extraction from HTML. At this stage, the goal is to extract the textual content and other interesting metadata such as title, author names and publication date, that we want to consider for version control. News web pages contain a myriad of extra content, such as sidebars with breaking news, and comment sections that are undesirable for our purposes and not to be included.
To guarantee a high-fidelity at this stage, we opted to build site-specific specialised content extractors for each target news source. The extractors essentially select the main HTML element containing the article (e. g., <div class=“article”>) and extracts all the text inside all the inner HTML elements except from known site-specific undesired elements identified semi-automatically.
In addition, we normalised relative time expressions such as, Hoje, 20:21 (Today, 20:21) into a standard format (27-01-2018, 20:21:00).
Changes Extraction from Text. Diffs for prose are different from code diffs. Character-based diffs are not as useful on prose. Diffs on word boundaries or even concept boundaries are more useful. After extracting diff at multiple levels (char, word and line), we decided that word based level offered the best balance between conciseness and usability. For Revisionista.PT, we opted to customise an algorithm that is used in Google Docs to Track Changes Google  but in word-based mode. Word-based level diffs are important to allow interpreting the differences between versions (e. g., entities changes, typos corrected, etc. ), improving readability and enabling simple browsing and search on diff text.
Republished: The publishing date of the article changed.
Undisclosed correction: Text changes not explicitly disclosed.
Disclosed correction: Text changes are accompanied by a note.
Disclosed update: Updates the article with a note and new text only.
Live: Coverage of live events or ongoing developments.
Revisionista.PT allows search and browsing of online news articles that were found to have post-publication changes. We examined 139,561 articles, of which 6,793 were edited after publication (4.87%), for a total number of edits of 7,405 (some articles were edited more than once). These articles are a part of 12 online Portuguese news platforms, from 2015 to 2018. In Fig. 3, we show the search interface, where relevance-based ranking can be overridden (edit date, number of edits, edit size) and results can be filtered by publication and edit type. In addition to showing added and removed text inline with the revisions, a special article view presents the changes contextualised within the article (see Fig. 2).
Revisionista.PT Companion Extension3 is open source and can check on Arquivo.PT for different snapshots of the current page and show the changes. Our goal is to enable users to find undisclosed post-publication edits in the wild.
We intend to continue building new features into Revisionista.PT to provide more assurances and help journalists do their job with confidence. Our goal is to build automatic classifiers to help identify articles that need correction and significant changes that are too important to not include an explicit disclosure. Following this direction, we will create an interface to allow expert journalists to annotate changes found by Revisionista.PT according to different parameters to build a useful dataset. In addition, we will create a new tool that will allow journalists to subscribe to alerts helping them to keep their articles up-to-date with fresh information arriving from other news sources and published articles.
- 2.Digital, Culture, Media and Sport Committee: Disinformation and “fake news”: Final report, vol. HC 1791. British House of Commons (2018)Google Scholar
- 3.Google: google/diff-match-patch: diff match patch is a high-performance library in multiple languages that manipulates plain text (2019). https://github.com/google/diff-match-patch
- 4.VillageVoice: Why did the New York times change their Brooklyn bridge arrests story? (2011). https://web.archive.org/web/20111003160551/blogs.villagevoice.com/runninscared/2011/10/why_did_the_new_1.php