Overview of the INEX 2009 Entity Ranking Track

  • Gianluca Demartini
  • Tereza Iofciu
  • Arjen P. de Vries
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6203)


In some situations search engine users would prefer to retrieve entities instead of just documents. Example queries include “Italian Nobel prize winners”, “Formula 1 drivers that won the Monaco Grand Prix”, or “German spoken Swiss cantons”. The XML Entity Ranking (XER) track at INEX creates a discussion forum aimed at standardizing evaluation procedures for entity retrieval. This paper describes the XER tasks and the evaluation procedure used at the XER track in 2009, where a new version of Wikipedia was used as underlying collection; and summarizes the approaches adopted by the participants.


Category Information Relevant Entity Entity Ranking Pool Coverage 16th International World Wide 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Charles, L.A., Clarke, G.V., Lynam, T.R.: Exploiting redundancy in question answering. In: SIGIR ’01: Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval, pp. 358–365. ACM, New York (2001)Google Scholar
  2. 2.
    de Vries, A.P., Vercoustre, A.-M., Thom, J.A., Craswell, N., Lalmas, M.: Overview of the INEX 2007 Entity Ranking Track. In: Fuhr, N., Kamps, J., Lalmas, M., Trotman, A. (eds.) INEX 2007. LNCS, vol. 4862, pp. 245–251. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  3. 3.
    Demartini, G., de Vries, A.P., Iofciu, T., Zhu, J.: Overview of the INEX 2008 Entity Ranking Track. In: Geva, S., Kamps, J., Trotman, A. (eds.) INEX 2008. LNCS, vol. 5631, pp. 243–252. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  4. 4.
    Schenkel, R., Suchanek, F.M., Kasneci., G.: YAWN: A semantically annotated Wikipedia XML corpus. In: Symposium on Database Systems for Business, Technology and the Web of the German Socienty for Computer science, BTW 2007 (2007)Google Scholar
  5. 5.
    Suchanek, F.M., Kasneci, G., Weikum, G.: Yago: A Core of Semantic Knowledge. In: 16th international World Wide Web conference (WWW 2007). ACM Press, New York (2007)Google Scholar
  6. 6.
    Yilmaz, E., Kanoulas, E., Aslam, J.A.: A simple and efficient sampling method for estimating AP and NDCG. In: Myaeng, S.-H., Oard, D.W., Sebastiani, F., Chua, T.-S., Leong, M.-K. (eds.) SIGIR, pp. 603–610. ACM, New York (2008)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Gianluca Demartini
    • 1
  • Tereza Iofciu
    • 1
  • Arjen P. de Vries
    • 2
  1. 1.L3S Research CenterLeibniz Universität HannoverHannoverGermany
  2. 2.CWI & Delft University of TechnologyThe Netherlands

Personalised recommendations