Skip to main content
SpringerLink
Log in

CLIR Evaluation at TREC

  • Conference paper
  • First Online:
Cross-Language Information Retrieval and Evaluation (CLEF 2000)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 2069))

Included in the following conference series:

Abstract

Starting in 1997, the National Institute of Standards and Technology conducted 3 years of evaluation of cross-language information retrieval systems in the Text REtrieval Conference (TREC). Twentytwo participating systems used topics (test questions) in one language to retrieve documents written in English, French, German, and Italian. A large-scale multilingual test collection has been built and a new technique for building such a collection in a distributed manner was devised.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Sheridan, P. and Ballerini, J. P. and and Schäuble P.: Building a Large Multilingual Test Collection from Comparable News Documents. In: Grefenstette, G. (ed.): Cross-Language Information Retrieval. Kluwer Academic Publishers, Boston (1998) chapter 11.

    Google Scholar 

  2. Sheridan, P. and Ballerini, J. P.: Experiments in Multilingual Information Retrieval using the SPIDER System. In: Proceedings of the 19th ACM SIGIR Conference on Research and Development in Information Retrieval, Zurich, Switzerland, (1996), 58–65.

    Google Scholar 

  3. Voorhees, E. and Harman, D. (1998): Overview of the Sixth Text REtrieval Conference (TREC-6). In: Proceedings of the Sixth Text REtrieval Conference (TREC-6). NIST Special Publication 500-240 (1998), 1–24. Also at http://trec.nist.gov/pubs.html

  4. Schäuble, P. and Sheridan P. (1998): Cross-Language Information Retrieval (CLIR) Track Overview. In: Proceedings of the Sixth Text REtrieval Conference (TREC-6). NIST Special Publication 500-240 (1998), 31–44. Also at http://trec.nist.gov/pubs.html

  5. Braschler, M., Krause, J., Peters C., and Schäuble P.: Cross-Language Information Retrieval (CLIR) Track Overview. In: Proceedings of the Seventh Text REtrieval Conference (TREC-7). NIST Special Publication 500-242 (1999), 25–32. Also at http://trec.nist.gov/pubs.html

  6. Braschler, M., Peters C., and Schäuble P.: Cross-Language Information Retrieval (CLIR) Track Overview. In: Proceedings of the Eighth Text REtrieval Conference (TREC-8). NIST Special Publication 500-246 (2000), 25–34. Also at http://trec.nist.gov/pubs.html

  7. Voorhees, Ellen M.: Variations in Relevance Judgments and the Measurement of Retrieval Effectiveness. In: Proceedings of the 21st ACM SIGIR Conference on Research and Development in Information Retrieval, Melbourne, Australia (1998), 315–323.

    Google Scholar 

  8. Zobel, Justin: How Reliable are the Results of Large-Scale Information Retrieval Experiments? In: Proceedings of the 21st ACM SIGIR Conference on Research and Development in Information Retrieval, Melbourne, Australia (1998), 307–314.

    Google Scholar 

  9. Voorhees, E.M., and Harman, D.K.: Overview of the Eighth Text REtrieval Conference (TREC-8). In: Proceedings of the Eighth Text REtrieval Conference (TREC-8). NIST Special Publication 500-246 (2000), 1–24. Also at http://trec.nist.gov/pubs.html

Download references

Author information

Authors and Affiliations

  1. National Institute of Standards and Technology, Gaithersburg, Md, USA

    Donna Harman

  2. Eurospider Information Technology AG, Zürich, Switzerland

    Martin Braschler & Peter Schäuble

  3. Dept. of Computer Science, University of Zurich, Switzerland

    Michael Hess

  4. InformationsZentrum Sozialwissenschaften (IZ), Bonn, Germany

    Michael Kluck

  5. Istituto di Elaborazione della Informazione - CNR, Pisa, Italy

    Carol Peters

  6. MNIS-Textwise Labs, Syracuse, NY, USA

    Páraic Sheridan

Authors
  1. Donna Harman
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Martin Braschler
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Michael Hess
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Michael Kluck
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Carol Peters
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Peter Schäuble
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Páraic Sheridan
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Istituto di Elaborazione della Informazione, Via Moruzzi, 1, 56124, Pisa, Italy

    Carol Peters

Rights and permissions

Reprints and permissions

Copyright information

© 2001 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Harman, D. et al. (2001). CLIR Evaluation at TREC. In: Peters, C. (eds) Cross-Language Information Retrieval and Evaluation. CLEF 2000. Lecture Notes in Computer Science, vol 2069. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-44645-1_2

Download citation

  • DOI: https://doi.org/10.1007/3-540-44645-1_2

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-42446-8

  • Online ISBN: 978-3-540-44645-3

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation