Chapter

Evaluating Systems for Multilingual and Multimodal Information Access

Volume 5706 of the series Lecture Notes in Computer Science pp 15-37

CLEF 2008: Ad Hoc Track Overview

  • Eneko AgirreAffiliated withCarnegie Mellon UniversityComputer Science Department, University of the Basque Country
  • , Giorgio Maria Di NunzioAffiliated withCarnegie Mellon UniversityDepartment of Information Engineering, University of Padua
  • , Nicola FerroAffiliated withCarnegie Mellon UniversityDepartment of Information Engineering, University of Padua
  • , Thomas MandlAffiliated withCarnegie Mellon UniversityInformation Science, University of Hildesheim
  • , Carol PetersAffiliated withCarnegie Mellon UniversityISTI-CNR, Area di Ricerca

* Final gross prices may vary according to local VAT.

Get Access

Abstract

We describe the objectives and organization of the CLEF 2008 Ad Hoc track and discuss the main characteristics of the tasks offered to test monolingual and cross-language textual document retrieval systems. The track was changed considerably this year with the introduction of tasks with new document collections consisting of (i) library catalog records derived from The European Library, and (ii) and non-European language data, plus a task offering the chance to test retrieval with word sense disambiguated data. The track was thus structured in three distinct streams denominated: TEL@CLEF, Persian@CLEF and Robust WSD. The results obtained for each task are presented and statistical analyses are given.