Evaluating Systems for Multilingual and Multimodal Information Access

9th Workshop of the Cross-Language Evaluation Forum, CLEF 2008, Aarhus, Denmark, September 17-19, 2008, Revised Selected Papers

  • Carol Peters
  • Thomas Deselaers
  • Nicola Ferro
  • Julio Gonzalo
  • Gareth J. F. Jones
  • Mikko Kurimo
  • Thomas Mandl
  • Anselmo Peñas
  • Vivien Petras
Conference proceedings CLEF 2008

Part of the Lecture Notes in Computer Science book series (LNCS, volume 5706)

Table of contents

  1. Front Matter
  2. What Happened in CLEF 2008

    1. Carol Peters
      Pages 1-14
  3. Part I: Multilingual Textual Document Retrieval (Ad Hoc)

    1. Eneko Agirre, Giorgio Maria Di Nunzio, Nicola Ferro, Thomas Mandl, Carol Peters
      Pages 15-37

    1. Alessio Bosca, Luca Dini
      Pages 42-49
    2. Dong Nguyen, Arnold Overwijk, Claudia Hauff, Dolf R. B. Trieschnigg, Djoerd Hiemstra, Franciska de Jong
      Pages 58-65
    3. André Pinto Geraldo, Viviane P. Moreira
      Pages 66-74
    4. Jens Kürsten, Thomas Wilhelm, Maximilian Eibl
      Pages 75-82
  5. Persian@CLEF

    1. Reza Karimpour, Amineh Ghorbani, Azadeh Pishdad, Mitra Mohtarami, Abolfazl AleAhmad, Hadi Amiri et al.
      Pages 89-96
    2. Zahra Aghazade, Nazanin Dehghani, Leili Farzinvash, Razieh Rahimi, Abolfazl AleAhmad, Hadi Amiri et al.
      Pages 97-104
    3. Abolfazl AleAhmad, Ehsan Kamalloo, Arash Zareh, Masoud Rahgozar, Farhad Oroumchian
      Pages 105-112
  6. Robust-WSD

    1. Fernando Martínez-Santiago, José M. Perea-Ortega, Miguel A. García-Cumbreras
      Pages 113-117
    2. Annalina Caputo, Pierpaolo Basile, Giovanni Semeraro
      Pages 126-133
    3. Sergio Navarro, Fernando Llopis, Rafael Muñoz
      Pages 134-137
    4. José R. Pérez-Agüera, Hugo Zaragoza
      Pages 138-145
    5. Jacques Guyot, Gilles Falquet, Saïd Radhouani, Karim Benzineb
      Pages 146-154
    6. Andreas Juffinger, Roman Kern, Michael Granitzer
      Pages 155-162
  7. Ad Hoc Mixed: TEL and Persian

    1. Stephen Tomlinson
      Pages 163-169
    2. Paul McNamee
      Pages 170-177
    3. Ljiljana Dolamic, Claire Fautsch, Jacques Savoy
      Pages 178-185
  8. Part II: Mono- and Cross-Language Scientific Data Retrieval (Domain-Specific)

    1. Vivien Petras, Stefan Baerisch
      Pages 186-198
    2. Claire Fautsch, Ljiljana Dolamic, Jacques Savoy
      Pages 199-202
    3. Edgar Meij, Maarten de Rijke
      Pages 207-214
    4. Jens Kürsten, Thomas Wilhelm, Maximilian Eibl
      Pages 215-218
    5. Christof Müller, Iryna Gurevych
      Pages 219-226
  9. Part III: Interactive Cross-Language Retrieval (iCLEF)

    1. Julio Gonzalo, Paul Clough, Jussi Karlgren
      Pages 227-235
    2. Víctor Peinado, Julio Gonzalo, Javier Artiles, Fernando López-Ostenero
      Pages 236-242
    3. Evgenia Vassilakaki, Frances Johnson, Richard J. Hartley, David Randall
      Pages 251-259
  10. Part IV: Multiple Language Question Answering (QA@CLEF)

    1. Pamela Forner, Anselmo Peñas, Eneko Agirre, Iñaki Alegria, Corina Forăscu, Nicolas Moreau et al.
      Pages 262-295
    2. Álvaro Rodrigo, Anselmo Peñas, Felisa Verdejo
      Pages 296-313
    3. Jordi Turmo, Pere R. Comas, Sophie Rosset, Lori Lamel, Nicolas Moreau, Djamel Mostefa
      Pages 314-324
  11. Mono and Bilingual QA

    1. Luís Sarmento, Jorge Teixeira, Eugénio Oliveira
      Pages 325-332
    2. Sandra Roger, Katia Vila, Antonio Ferrández, María Pardiño, José Manuel Gómez, Marcel Puchol-Blasco et al.
      Pages 333-336
    3. Carlos Amaral, Adán Cassan, Helena Figueira, André Martins, Afonso Mendes, Pedro Mendes et al.
      Pages 337-344
    4. Gracinda Carvalho, David Martins de Matos, Vitor Rocio
      Pages 345-352
    5. Sisay Fissaha Adafre, Josef van Genabith
      Pages 353-360
    6. Olatz Ansa, Xabier Arregi, Arantxa Otegi, Ander Soraluze
      Pages 369-376
    7. Luísa Coheur, Ana Mendes, João Guimarães, Nuno J. Mamede, Ricardo Ribeiro
      Pages 377-384
    8. Adrian Iftene, Diana Trandabăţ, Ionuţ Pistol, Alex-Mihai Moruz, Maria Husarciuc, Dan Cristea
      Pages 385-392
    9. Radu Ion, Dan Ştefănescu, Alexandru Ceauşu, Dan Tufiş
      Pages 393-400
    10. Ingo Glöckner, Björn Pelzer
      Pages 401-408
    11. Ángel Martínez-González, César de Pablo-Sánchez, Concepción Polo-Bayo, María Teresa Vicente-Díez, Paloma Martínez-Fernández, José Luís Martínez-Fernández
      Pages 409-420
    12. Sven Hartrumpf, Ingo Glöckner, Johannes Leveling
      Pages 421-428

About these proceedings


The ninth campaign of the Cross-Language Evaluation Forum (CLEF) for European languages was held from January to September 2008. There were seven main eval- tion tracks in CLEF 2008 plus two pilot tasks. The aim, as usual, was to test the p- formance of a wide range of multilingual information access (MLIA) systems or s- tem components. This year, 100 groups, mainly but not only from academia, parti- pated in the campaign. Most of the groups were from Europe but there was also a good contingent from North America and Asia plus a few participants from South America and Africa. Full details regarding the design of the tracks, the methodologies used for evaluation, and the results obtained by the participants can be found in the different sections of these proceedings. The results of the CLEF 2008 campaign were presented at a two-and-a-half day workshop held in Aarhus, Denmark, September 17–19, and attended by 150 resear- ers and system developers. The annual workshop, held in conjunction with the European Conference on Digital Libraries, plays an important role by providing the opportunity for all the groups that have participated in the evaluation campaign to get together comparing approaches and exchanging ideas. The schedule of the workshop was divided between plenary track overviews, and parallel, poster and breakout sessions presenting this year’s experiments and discu- ing ideas for the future. There were several invited talks.


Cross-Language Evaluation Forum Wiki answer validation cross-language cross-language queries cross-lingual data mining image retrieval information retrieval machine learning medical images natural language processing semantic analysis video retrieval

Editors and affiliations

  • Carol Peters
    • 1
  • Thomas Deselaers
    • 2
  • Nicola Ferro
    • 3
  • Julio Gonzalo
    • 4
  • Gareth J. F. Jones
    • 5
  • Mikko Kurimo
    • 6
  • Thomas Mandl
    • 7
  • Anselmo Peñas
    • 4
  • Vivien Petras
    • 8
  1. 1.Istituto di Scienza e Tecnologie dell’InformazioneCNRPisaItaly
  2. 2.RWTH Aachen UniversityAachenGermany
  3. 3.University of PaduaPaduaItaly
  4. 4.LSI-UNEDMadridSpain
  5. 5.Dublin City UniversityDublin 9Ireland
  6. 6.Helsinki University of TechnologyEspooFinland
  7. 7.University of HildesheimHildesheimGermany
  8. 8.Humboldt University BerlinGermany

Bibliographic information

  • DOI
  • Copyright Information Springer-Verlag Berlin Heidelberg 2009
  • Publisher Name Springer, Berlin, Heidelberg
  • eBook Packages Computer Science Computer Science (R0)
  • Print ISBN 978-3-642-04446-5
  • Online ISBN 978-3-642-04447-2
  • Series Print ISSN 0302-9743
  • Series Online ISSN 1611-3349
  • Buy this book on publisher's site