Overview of the INEX 2007 Entity Ranking Track

  • Arjen P. de Vries
  • Anne-Marie Vercoustre
  • James A. Thom
  • Nick Craswell
  • Mounia Lalmas
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4862)


Many realistic user tasks involve the retrieval of specific entities instead of just any type of documents. Examples of information needs include ‘Countries where one can pay with the euro’ or ‘Impressionist art museums in The Netherlands’. The Initiative for Evaluation of XML Retrieval (INEX) started the XML Entity Ranking track (INEX-XER) to create a test collection for entity retrieval in Wikipedia. Entities are assumed to correspond to Wikipedia entries. The goal of the track is to evaluate how well systems can rank entities in response to a query; the set of entities to be ranked is assumed to be loosely defined either by a generic category (entity ranking) or by some example entities (list completion). This track overview introduces the track setup, and discusses the implications of the new relevance notion for entity ranking in comparison to ad hoc retrieval.


Test Collection Relevance Assessment Relevant Entity Category Graph Entity Ranking 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Pehcevski, J., Vercoustre, A.-M., Thom, J.: Exploiting locality of wikipedia links in entity ranking. In: Macdonald, C., Ounis, I., Plachouras, V., Ruthven, I., White, R.W. (eds.) ECIR 2008. LNCS, vol. 4956, pp. 258–269. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  2. 2.
    Zaragoza, H., Rode, H., Mika, P., Atserias, J., Ciaramita, M., Attardi, G.: Ranking very many typed entities on wikipedia. In: Proceedings of the 16th ACM CIKM International Conference on Information and Knowledge Management, Lisbon, Portugal, pp. 1015–1018 (2007)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Arjen P. de Vries
    • 1
    • 2
  • Anne-Marie Vercoustre
    • 3
  • James A. Thom
    • 4
  • Nick Craswell
    • 5
  • Mounia Lalmas
    • 6
  1. 1.CWIAmsterdamThe Netherlands
  2. 2.Technical University DelftDelftThe Netherlands
  3. 3.INRIA-RocquencourtLe Chesnay CedexFrance
  4. 4.RMIT UniversityMelbourneAustralia
  5. 5.Microsoft Research CambridgeCambridgeUK
  6. 6.Queen Mary, University of LondonLondonUK

Personalised recommendations