Overview of the INEX 2008 Efficiency Track

  • Martin Theobald
  • Ralf Schenkel
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5631)

Abstract

This paper presents an overview of the Efficiency Track that was newly introduced to INEX in 2008. The new INEX Efficiency Track is intended to provide a common forum for the evaluation of both the effectiveness and efficiency of XML ranked retrieval approaches on real data and real queries. As opposed to the purely synthetic XMark or XBench benchmark settings that are still prevalent in efficiency-oriented XML retrieval tasks, the Efficiency Track continues the INEX tradition using a rich pool of manually assessed relevance judgments for measuring retrieval effectiveness. Thus, one of the main goals is to attract more groups from the DB community to INEX, being able to study effectiveness/efficiency trade-offs in XML ranked retrieval for a broad audience from both the DB and IR communities. The Efficiency Track significantly extends the Ad-Hoc Track by systematically investigating different types of queries and retrieval scenarios, such as classic ad-hoc search, high-dimensional query expansion settings, and queries with a deeply nested structure (with all topics being available in both the NEXI-style CO and CAS formulations, as well as in their XPath 2.0 Full-Text counterparts).

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Overview of the INitiative for the Evaluation of XML retrieval (INEX). In: Fuhr, N., Gövert, N., Kazai, G., Lalmas, M. (eds.) INitiative for the Evaluation of XML Retrieval (INEX). Proceedings of the First INEX Workshop, Dagstuhl, Germany, December 8–11 (2002); ERCIM Workshop Proceedings, Sophia Antipolis, France, ERCIM (March 2003), http://www.ercim.org/publication/ws-proceedings/INEX2002.pdf
  2. 2.
    Denoyer, L., Gallinari, P.: The Wikipedia XML Corpus. In: SIGIR Forum (2006)Google Scholar
  3. 3.
    Fuhr, N., Kamps, J., Lalmas, M., Malik, S., Trotman, A.: Overview of the INEX 2007 Ad Hoc Track. In: Fuhr, N., Kamps, J., Lalmas, M., Trotman, A. (eds.) INEX 2007. LNCS, vol. 4862, pp. 1–23. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  4. 4.
    Kamps, J., Pehcevski, J., Kazai, G., Lalmas, M., Robertson, S.: INEX 2007 Evaluation Measures. In: Fuhr, N., Kamps, J., Lalmas, M., Trotman, A. (eds.) INEX 2007. LNCS, vol. 4862, pp. 24–33. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  5. 5.
    Malik, S., Larsen, B., Tombros, A.: Report on the INEX 2005 Interactive Track. SIGIR Forum 41(1), 67–74 (2006)CrossRefGoogle Scholar
  6. 6.
    Malik, S., Tombros, A., Larsen, B.: The Interactive Track at INEX 2006. In: INEX, pp. 387–399 (2006)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Martin Theobald
    • 1
  • Ralf Schenkel
    • 1
    • 2
  1. 1.Max Planck Institute for InformaticsSaarbrückenGermany
  2. 2.Saarland UniversitySaarbrückenGermany

Personalised recommendations