Overview of INEX 2013

  • Patrice Bellot
  • Antoine Doucet
  • Shlomo Geva
  • Sairam Gurajada
  • Jaap Kamps
  • Gabriella Kazai
  • Marijn Koolen
  • Arunav Mishra
  • Véronique Moriceau
  • Josiane Mothe
  • Michael Preminger
  • Eric SanJuan
  • Ralf Schenkel
  • Xavier Tannier
  • Martin Theobald
  • Matthew Trappett
  • Qiuyue Wang
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8138)

Abstract

INEX investigates focused retrieval from structured documents by providing large test collections of structured documents, uniform evaluation measures, and a forum for organizations to compare their results. This paper reports on the INEX 2013 evaluation campaign, which consisted of four activities addressing three themes: searching professional and user generated data (Social Book Search track); searching structured or semantic data (Linked Data track); and focused retrieval (Snippet Retrieval and Tweet Contextualization tracks). INEX 2013 was an exciting year for INEX in which we consolidated the collaboration with (other activities in) CLEF and for the second time ran our workshop as part of the CLEF labs in order to facilitate knowledge transfer between the evaluation forums. This paper gives an overview of all the INEX 2013 tracks, their aims and task, the built test-collections, and gives an initial analysis of the results.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Amer-Yahia, S., Lalmas, M.: XML search: languages, INEX and scoring. SIGMOD Record 35 (2006)Google Scholar
  2. 2.
    Bellot, P., Moriceau, V., Mothe, J., Sanjuan, E., Tannier, X.: Overview of the INEX 2013 tweet contextualization track. In: CLEF 2013 Evaluation Labs and Workshop, Online Working Notes (2013)Google Scholar
  3. 3.
    Doucet, A., Kazai, G., Colutto, S., Muehlberger, G.: Overview of the ICDAR 2013 Competition on Book Structure Extraction. In: Proceedings of the Twelfth International Conference on Document Analysis and Recognition (ICDAR 2013), Washington, USA (September 2013)Google Scholar
  4. 4.
    Gurajada, S., Kamps, J., Mishra, A., Schenkel, R., Theobald, M., Wang, Q.: Overview of the INEX 2013 linked data track. In: CLEF 2013 Evaluation Labs and Workshop, Online Working Notes (2013)Google Scholar
  5. 5.
    Kamps, J., Pehcevski, J., Kazai, G., Lalmas, M., Robertson, S.: INEX 2007 evaluation measures. In: Fuhr, N., Kamps, J., Lalmas, M., Trotman, A. (eds.) INEX 2007. LNCS, vol. 4862, pp. 24–33. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  6. 6.
    Koolen, M., Kamps, J., Kazai, G.: Social Book Search: The Impact of Professional and User-Generated Content on Book Suggestions. In: Proceedings of the International Conference on Information and Knowledge Management (CIKM 2012). ACM (2012)Google Scholar
  7. 7.
    Koolen, M., Kazai, G., Preminger, M., Doucet, A.: Overview of the INEX 2013 social book search track. In: CLEF 2013 Evaluation Labs and Workshop, Online Working Notes (2013)Google Scholar
  8. 8.
    SanJuan, E., Bellot, P., Moriceau, V., Tannier, X.: Overview of the INEX 2010 question answering track (QA@INEX). In: Geva, S., Kamps, J., Schenkel, R., Trotman, A. (eds.) INEX 2010. LNCS, vol. 6932, pp. 269–281. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  9. 9.
    Trappett, M., Geva, S., Trotman, A., Scholer, F., Sanderson, M.: Overview of the INEX 2013 snippet retrieval track. In: CLEF 2013 Evaluation Labs and Workshop, Online Working Notes (2013)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Patrice Bellot
    • 1
  • Antoine Doucet
    • 1
  • Shlomo Geva
    • 1
  • Sairam Gurajada
    • 1
  • Jaap Kamps
    • 2
  • Gabriella Kazai
    • 1
  • Marijn Koolen
    • 1
  • Arunav Mishra
    • 1
  • Véronique Moriceau
    • 1
  • Josiane Mothe
    • 1
  • Michael Preminger
    • 1
  • Eric SanJuan
    • 1
  • Ralf Schenkel
    • 3
  • Xavier Tannier
    • 1
  • Martin Theobald
    • 1
  • Matthew Trappett
    • 1
  • Qiuyue Wang
    • 1
  1. 1.INEX co-chair and QUTAustralia
  2. 2.INEX co-chair and University of AmsterdamThe Netherlands
  3. 3.INEX co-chair and University of PassauGermany

Personalised recommendations