Multilingual Information Access Evaluation I - Text Retrieval Experiments

1. Front Matter

   PDF

2. What Happened in CLEF 2009

   1. What Happened in CLEF 2009

      • Carol Peters

      Pages 1-12

3. I: Multilingual Textual Document Retrieval (AdHoc)

   1. CLEF 2009 Ad Hoc Track Overview: TEL and Persian Tasks

      • Nicola Ferro, Carol Peters

      Pages 13-35

   2. CLEF 2009 Ad Hoc Track Overview: Robust-WSD Task

      • Eneko Agirre, Giorgio Maria Di Nunzio, Thomas Mandl, Arantxa Otegi

      Pages 36-49

   3. AdHoc-TEL

      1. Evaluating Cross-Language Explicit Semantic Analysis and Cross Querying

         • Maik Anderka, Nedim Lipka, Benno Stein

         Pages 50-57

      2. Document Expansion, Query Translation and Language Modeling for Ad-Hoc IR

         • Johannes Leveling, Dong Zhou, Gareth J. F. Jones, Vincent Wade

         Pages 58-61

      3. Smoothing Methods and Cross-Language Document Re-ranking

         • Dong Zhou, Vincent Wade

         Pages 62-69

      4. Cross-Language Information Retrieval Using Meta-language Index Construction and Structural Queries

         • Amir Hossein Jadidinejad, Fariborz Mahmoudi

         Pages 70-77

      5. Sampling Precision to Depth 10000 at CLEF 2009

         • Stephen Tomlinson

         Pages 78-85

      6. Multilingual Query Expansion for CLEF Adhoc-TEL

         • Ray R. Larson

         Pages 86-89

      7. Experiments with N-Gram Prefixes on a Multinomial Language Model versus Lucene’s Off-the-Shelf Ranking Scheme and Rocchio Query Expansion (TEL@CLEF Monolingual Task)

         • Jorge Machado, Bruno Martins, José Borbinha

         Pages 90-97

   4. AdHoc-Persian

      1. Evaluation of Perstem: A Simple and Efficient Stemming Algorithm for Persian

         • Amir Hossein Jadidinejad, Fariborz Mahmoudi, Jon Dehdari

         Pages 98-101

      2. Ad Hoc Retrieval with the Persian Language

         • Ljiljana Dolamic, Jacques Savoy

         Pages 102-109

      3. Ad Hoc Information Retrieval for Persian

         • AmirHossein Habibian, Abolfazl AleAhmad, Azadeh Shakery

         Pages 110-119

   5. AdHoc-Robust

      1. Combining Probabilistic and Translation-Based Models for Information Retrieval Based on Word Sense Annotations

         • Elisabeth Wolf, Delphine Bernhard, Iryna Gurevych

         Pages 120-127

      2. Indexing with WordNet Synonyms May Improve Retrieval Results

         • Davide Buscaldi, Paolo Rosso

         Pages 128-134

      3. UFRGS@CLEF2009: Retrieval by Numbers

         • Thyago Bohrer Borges, Viviane P. Moreira

         Pages 135-141

      4. Evaluation of Axiomatic Approaches to Crosslanguage Retrieval

         • Roman Kern, Andreas Juffinger, Michael Granitzer

         Pages 142-149

      5. UNIBA-SENSE @ CLEF 2009: Robust WSD Task

         • Pierpaolo Basile, Annalina Caputo, Giovanni Semeraro

         Pages 150-157

      6. Using WordNet Relations and Semantic Classes in Information Retrieval Tasks

         • Javi Fernández, Rubén Izquierdo, José M. Gómez

         Pages 158-165

The tenth campaign of the Cross Language Evaluation Forum (CLEF) for European languages was held from January to September 2009. There were eight main eval- tion tracks in CLEF 2009 plus a pilot task. The aim, as usual, was to test the perfo- ance of a wide range of multilingual information access (MLIA) systems or system components. This year, about 150 groups, mainly but not only from academia, reg- tered to participate in the campaign. Most of the groups were from Europe but there was also a good contingent from North America and Asia. The results were presented at a two-and-a-half day workshop held in Corfu, Greece, September 30 to October 2, 2009, in conjunction with the European Conference on Digital Libraries. The workshop, attended by 160 researchers and system developers, provided the opportunity for all the groups that had participated in the evaluation campaign to get together, compare approaches and exchange ideas.

• Access
• Scoring
• algorithms
• classification
• clustering
• computer linguistics
• cross-language queries
• data mining
• filtering
• information retrieval
• multilingual
• performance
• performance evaluation
• semantic analysis
• visualization

• ISTI-CNR, Area Ricerca CNR, Pisa, Italy

  Carol Peters

• Department of Information Engineering, University of Padua, Padova, Italy

  Giorgio Maria Nunzio

• Aalto Univesity, Aalto, Finland

  Mikko Kurimo

• University of Hildesheim, Hildesheim, Germany

  Thomas Mandl

• ELDA/ELRA, Paris, France

  Djamel Mostefa

• LSI-UNED, Madrid, Spain

  Anselmo Peñas

• Matrixware, Vienna, Austria

  Giovanna Roda

Policies and ethics