Overview of INEX 2014

  • Patrice Bellot
  • Toine Bogers
  • Shlomo Geva
  • Mark Hall
  • Hugo Huurdeman
  • Jaap Kamps
  • Gabriella Kazai
  • Marijn Koolen
  • Véronique Moriceau
  • Josiane Mothe
  • Michael Preminger
  • Eric SanJuan
  • Ralf Schenkel
  • Mette Skov
  • Xavier Tannier
  • David Walsh
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8685)

Abstract

INEX investigates focused retrieval from structured documents by providing large test collections of structured documents, uniform evaluation measures, and a forum for organizations to compare their results. This paper reports on the INEX 2014 evaluation campaign, which consisted of three tracks: The Interactive Social Book Search Track investigated user information seeking behavior when interacting with various sources of information, for realistic task scenarios, and how the user interface impacts search and the search experience. The Social Book Search Track investigated the relative value of authoritative metadata and user-generated content for search and recommendation using a test collection with data from Amazon and LibraryThing, including user profiles and personal catalogues. The Tweet Contextualization Track investigated tweet contextualization, helping a user to understand a tweet by providing him with a short background summary generated from relevant Wikipedia passages aggregated into a coherent summary. INEX 2014 was an exciting year for INEX in which we for the third time ran our workshop as part of the CLEF labs. This paper gives an overview of all the INEX 2014 tracks, their aims and task, the built test-collections, the participants, and gives an initial analysis of the results.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Beckers, T., Fuhr, N., Pharo, N., Nordlie, R., Fachry, K.N.: Overview and results of the INEX 2009 interactive track. In: Lalmas, M., Jose, J., Rauber, A., Sebastiani, F., Frommholz, I. (eds.) ECDL 2010. LNCS, vol. 6273, pp. 409–412. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  2. 2.
    Bellot, P., Moriceau, V., Mothe, J., Sanjuan, E., Tannier, X.: Overview of the INEX 2014 tweet contextualization track. In: Cappellato, L., Ferro, N., Halvey, M., Kraaij, W. (eds.) CLEF 2014 Labs and Workshops, Notebook Papers. CEUR Workshop Proceedings, vol. 1180 (2014), http://ceur-ws.org/Vol-1180/
  3. 3.
    Borlund, P., Ingwersen, P.: The development of a method for the evaluation of interactive information retrieval systems. Journal of Documentation 53(3), 225–250 (1997)CrossRefGoogle Scholar
  4. 4.
    Hall, M., Huurdeman, H., Koolen, M., Skov, M., Walsh, D.: Overview of the INEX 2014 interactive social book search track. In: Cappellato, L., Ferro, N., Halvey, M., Kraaij, W. (eds.) CLEF 2014 Labs and Workshops, Notebook Papers. CEUR Workshop Proceedings, vol. 1180 (2014), http://ceur-ws.org/Vol-1180/
  5. 5.
    Koolen, M., Bogers, T., Kazai, G., Kamps, J., Preminger, M.: Overview of the INEX 2014 social book search track. In: Cappellato, L., Ferro, N., Halvey, M., Kraaij, W. (eds.) CLEF 2014 Labs and Workshops, Notebook Papers. CEUR Workshop Proceedings, vol. 1180 (2014), http://ceur-ws.org/Vol-1180/
  6. 6.
    O’Brien, H.L., Toms, E.G.: The development and evaluation of a survey to measure user engagement. Journal of the American Society for Information Science and Technology 61(1), 50–69 (2009)CrossRefGoogle Scholar
  7. 7.
    Petras, V., Bogers, T., Toms, E., Hall, M., Savoy, J., Malak, P., Pawłowski, A., Ferro, N., Masiero, I.: Cultural heritage in CLEF (CHiC) 2013. In: Forner, P., Müller, H., Paredes, R., Rosso, P., Stein, B. (eds.) CLEF 2013. LNCS, vol. 8138, pp. 192–211. Springer, Heidelberg (2013)CrossRefGoogle Scholar
  8. 8.
    Skov, M., Ingwersen, P.: Exploring information seeking behaviour in a digital museum context. In: Proceedings of the Second International Symposium on Information Interaction in Context, pp. 110–115. ACM (2008)Google Scholar
  9. 9.
    Toms, E.G., Hall, M.M.: The CHiC interactive task (CHiCi) at CLEF2013. In: CLEF 2013 Evaluation Labs and Workshop, Online Working Notes (2013)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Patrice Bellot
    • 1
  • Toine Bogers
    • 1
  • Shlomo Geva
    • 1
  • Mark Hall
    • 1
  • Hugo Huurdeman
    • 1
  • Jaap Kamps
    • 2
  • Gabriella Kazai
    • 1
  • Marijn Koolen
    • 1
  • Véronique Moriceau
    • 1
  • Josiane Mothe
    • 1
  • Michael Preminger
    • 1
  • Eric SanJuan
    • 1
  • Ralf Schenkel
    • 3
  • Mette Skov
    • 1
  • Xavier Tannier
    • 1
  • David Walsh
    • 1
  1. 1.INEX co-chair & QUTAustralia
  2. 2.INEX co-chair & University of AmsterdamThe Netherlands
  3. 3.INEX co-chair & University of PassauGermany

Personalised recommendations