Evaluation of Cross-Language Information Retrieval Systems

1. Front Matter

   Pages I-X

   PDF

2. Introduction

   1. Introduction

      • Carol Peters

      Pages 1-5

3. System Evaluation Experiments at CLEF 2001

   1. CLEF 2001 — Overview of Results

      • Martin Braschler

      Pages 9-26

4. Mainly Cross-Language

   1. Report on CLEF-2001 Experiments: Effective Combined Query-Translation Approach

      • Jacques Savoy

      Pages 27-43

   2. Multilingual Information Retrieval Using English and Chinese Queries

      • Aitao Chen

      Pages 44-58

   3. Exeter at CLEF 2001: Experiments with Machine Translation for Bilingual Retrieval

      • Gareth J. F. Jones, Adenike M. Lam-Adesina

      Pages 59-77

   4. TNO at CLEF-2001: Comparing Translation Resources

      • Wessel Kraaij

      Pages 78-93

   5. ITC-irst at CLEF 2001: Monolingual and Bilingual Tracks

      • Nicola Bertoldi, Marcello Federico

      Pages 94-101

   6. Experiments with the Eurospider Retrieval System for CLEF 2001

      • Martin Braschler, Bärbel Ripplinger, Peter Schäuble

      Pages 102-110

   7. Using Co-occurrence, Augmented Restrictions, and C-E WordNet for Chinese-English Cross-Language Information Retrieval at CLEF 2001

      • Wen-Cheng Lin, Hsin-Hsi Chen

      Pages 111-117

   8. Utaclir @ CLEF 2001 — Effects of Compound Splitting and N-Gram Techniques

      • Turid Hedlund, Heikki Keskustalo, Ari Pirkola, Eija Airio, Kalervo Järvelin

      Pages 118-136

   9. Using Statistical Translation Models for Bilingual IR

      • Jian-Yun Nie, Michel Simard

      Pages 137-150

   10. Cross-Lingual Pseudo-Relevance Feedback Using a Comparable Corpus

       • Monica Rogati, Yiming Yang

       Pages 151-157

   11. Investigation on Disambiguation in CLIR: Aligned Corpus and Bi-directional Translation-Based Strategies

       • M. Boughanem, C. Chrisment, N. Nassr

       Pages 158-168

   12. Vector-Based Semantic Analysis Using Random Indexing for Cross-Lingual Query Expansion

       • Magnus Sahlgren, Jussi Karlgren

       Pages 169-176

   13. Query Expansion Techniques for the CLEF Bilingual Track

       • Fatiha Sadat, Akira Maeda, Masatoshi Yoshikawa, Shunsuke Uemura

       Pages 177-184

   14. Intelligent Information Access Systems (SINAI) at CLEF 2001: Calculating Translation Probabilities with SemCor

       • Fernando Martínez-Santiago, L. Alfonso Ureña-López, M. Carlos Díaz-Galiano, Maite Martín-Valdivia, Manuel García-Vega

       Pages 185-192

   15. JHU/APL Experiments at CLEF: Translation Resources and Score Normalization

       • Paul McNamee, James Mayfield

       Pages 193-208

   16. Dictionary-Based Thai CLIR: An Experimental Survey of Thai CLIR

       • Jaruskulchai Chuleerat

       Pages 209-218

   17. English-Dutch CLIR Using Query Translation Techniques

       • Mirna Adriani

       Pages 219-225

The second evaluation campaign of the Cross Language Evaluation Forum (CLEF) for European languages was held from January to September 2001. This campaign proved a great success, and showed an increase in participation of around 70% com pared with CLEF 2000. It culminated in a two day workshop in Darmstadt, Germany, 3–4 September, in conjunction with the 5th European Conference on Digital Libraries (ECDL 2001). On the first day of the workshop, the results of the CLEF 2001 evalua tion campaign were reported and discussed in paper and poster sessions. The second day focused on the current needs of cross language systems and how evaluation cam paigns in the future can best be designed to stimulate progress. The workshop was attended by nearly 50 researchers and system developers from both academia and in dustry. It provided an important opportunity for researchers working in the same area to get together and exchange ideas and experiences. Copies of all the presentations are available on the CLEF web site at http://www. clef campaign. org. This volume con tains thoroughly revised and expanded versions of the papers presented at the work shop and provides an exhaustive record of the CLEF 2001 campaign. CLEF 2001 was conducted as an activity of the DELOS Network of Excellence for Digital Libraries, funded by the EC Information Society Technologies program to further research in digital library technologies. The activity was organized in collabo ration with the US National Institute of Standards and Technology (NIST).

• NLP queries
• S-Lang
• bilingual information
• cross-language information retrieval
• information extraction
• information retrieval
• machine translation
• multi-lingual information
• natural language processing
• nlp systems evaluation
• selection
• semantic analysis

• Consiglio Nazionale delle Ricerche, Istituto di Scienza e Tecnologie, Pisa, Italy

  Carol Peters

• Eurospider Information Technology AG, Zürich, Switzerland

  Martin Braschler

• E.T.S.I. Industriales, Universidad Nacional de Educación a Distancia, Madrid, Spain

  Julio Gonzalo

• Informations Zentrum Sozialwissenschaften, Bonn, Germany

  Michael Kluck

Policies and ethics