Overview of the INEX 2010 Link the Wiki Track
The INEX 2010 Link-the-Wiki track examined link-discovery in the Te Ara collection, a previously unlinked document collection. Te Ara is structured more a digital cultural history than as a set of entities. With no links and no automatic entity identification, previous Link-the-Wiki algorithms could not be used. Assessment was also necessarily manual. In total 29 runs were submitted by 2 institutes. 70 topics were assessed, but only 52 had relevant target documents and only 45 had relevant links in the pool. This suggests that the pool was not diverse enough. The best performing run had a MAP of less than 0.1 suggesting that the algorithms tested in 2010 were not very effective.
KeywordsDocument Collection Mean Average Precision Relevant Target Result List Manual Assessment
Unable to display preview. Download preview PDF.
- 1.Geva, S.: GPX: Ad-Hoc Queries and Automated Link Discovery in the Wikipedia. In: Focused Access to XML Documents, pp. 404–416. Springer, Heidelberg (2007)Google Scholar
- 2.Itakura, K.Y., Clarke, C.L.: University of Waterloo at INEX2007: Adhoc and Link-the-Wiki Tracks. In: Focused Access to XML Document, pp. 417–425. Springer, Heidelberg (2007)Google Scholar
- 5.Milne, D., Witten, I.H.: Learning to link with wikipedia. In: Proceeding of the 17th ACM Conference on Information and Knowledge Management, pp. 509–518. ACM, Napa Valley (2008)Google Scholar