Evaluation of Cross-Language Information Retrieval Systems

1. Mainly Cross-Language

   1. Thomson Legal and Regulatory at CLEF 2001: Monolingual and Bilingual Experiments

      • Hugo Molina-Salgado, Isabelle Moulinier, Mark Knudson, Elizabeth Lund, Kirat Sekhon

      Pages 226-234

   2. Working with Russian Queries for the GIRT, Bilingual, and Multilingual CLEF Tasks

      • Fredric C. Gey, Hailing Jiang, Natalia Perelman

      Pages 235-243

   3. IR-n: A Passage Retrieval System at CLEF-2001

      • Fernando Llopis, José L. Vicedo

      Pages 244-252

2. Monolingual Experiments

   1. Spanish Monolingual Track: The Impact of Stemming on Retrieval

      • Carlos G. Figuerola, Raquel Gómez, Angel F. Zazo Rodríguez, José Luis Alonso Berrocal

      Pages 253-261

   2. Shallow Morphological Analysis in Monolingual Information Retrieval for Dutch, German, and Italian

      • Christof Monz, Maarten de Rijke

      Pages 262-277

   3. Stemming Evaluated in 6 Languages by Hummingbird SearchServer™ at CLEF 2001

      • Stephen Tomlinson

      Pages 278-287

   4. Minimalistic Test Runs of the Eidetica Indexer

      • Teresita Frizzarin, Annius Groenink

      Pages 288-290

   5. Across the Bridge: CLEF 2001 — Non-english Monolingual Retrieval. The French Task

      • Eugenia Matoyo, Tony Valsamidis

      Pages 291-299

   6. Mpro-IR in CLEF 2001

      • Bärbel Ripplinger

      Pages 300-302

   7. Some Terms Are More Interchangeable than Others

      • Jakob Klok, Samuel Driessen, Marvin Brunner

      Pages 303-307

3. Interactive Track

   1. The CLEF 2001 Interactive Track

      • Douglas W. Oard, Julio Gonzalo

      Pages 308-319

   2. Noun Phrase Translations for Cross-Language Document Selection

      • Fernando López-Ostenero, Julio Gonzalo, Anselmo Peñas, Felisa Verdejo

      Pages 320-331

   3. iCLEF at Sheffield

      • Mark Sanderson, Zoë Bathie

      Pages 332-335

   4. iCLEF 2001 at Maryland: Comparing Term-for-Term Gloss and MT

      • Jianqiang Wang, Douglas W. Oard

      Pages 336-352

4. Evaluation Issues and Results

   1. The Philosophy of Information Retrieval Evaluation

      • Ellen M. Voorhees

      Pages 355-370

   2. CLIR System Evaluation at the Second NTCIR Workshop

      • Noriko Kando

      Pages 371-388

   3. Multilingual Topic Generation within the CLEF 2001 Experiments

      • Christa Womser-Hacker

      Pages 389-393

   4. CLEF Methodology and Metrics

      • Martin Braschler, Carol Peters

      Pages 394-404

5. Back Matter

   Pages 405-601

   PDF

The second evaluation campaign of the Cross Language Evaluation Forum (CLEF) for European languages was held from January to September 2001. This campaign proved a great success, and showed an increase in participation of around 70% com pared with CLEF 2000. It culminated in a two day workshop in Darmstadt, Germany, 3–4 September, in conjunction with the 5th European Conference on Digital Libraries (ECDL 2001). On the first day of the workshop, the results of the CLEF 2001 evalua tion campaign were reported and discussed in paper and poster sessions. The second day focused on the current needs of cross language systems and how evaluation cam paigns in the future can best be designed to stimulate progress. The workshop was attended by nearly 50 researchers and system developers from both academia and in dustry. It provided an important opportunity for researchers working in the same area to get together and exchange ideas and experiences. Copies of all the presentations are available on the CLEF web site at http://www. clef campaign. org. This volume con tains thoroughly revised and expanded versions of the papers presented at the work shop and provides an exhaustive record of the CLEF 2001 campaign. CLEF 2001 was conducted as an activity of the DELOS Network of Excellence for Digital Libraries, funded by the EC Information Society Technologies program to further research in digital library technologies. The activity was organized in collabo ration with the US National Institute of Standards and Technology (NIST).

• NLP queries
• S-Lang
• bilingual information
• cross-language information retrieval
• information extraction
• information retrieval
• machine translation
• multi-lingual information
• natural language processing
• nlp systems evaluation
• selection
• semantic analysis

• Consiglio Nazionale delle Ricerche, Istituto di Scienza e Tecnologie, Pisa, Italy

  Carol Peters

• Eurospider Information Technology AG, Zürich, Switzerland

  Martin Braschler

• E.T.S.I. Industriales, Universidad Nacional de Educación a Distancia, Madrid, Spain

  Julio Gonzalo

• Informations Zentrum Sozialwissenschaften, Bonn, Germany

  Michael Kluck

Policies and ethics