Abstract
We give a detailed presentation of the organization of the CLEF 2002 evaluation campaign, focusing mainly on the core tracks. This includes a discussion of the evaluation approach adopted, explanations of the tracks and tasks and the underlying motivations, a description of the test collections, and an outline of the guidelines for the participants. The paper concludes with indications of the techniques used for results calculation and analysis.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Cleverdon, C.: The Cranfield Tests on Index Language Devices. In K. Sparck-Jones and P. Willett (Eds.): Readings in Information Retrieval, pages 47-59. Morgan Kaufmann, 1997.
Harman, D.: The TREC Conferences. In R. Kuhlen and M. Rittberger (Eds.): Hypertext — Information Retrieval — Multimedia: Synergieeffekte Elektronischer Informationssysteme, Proceedings of HIM’ 95, pages 9-28. Universitätsverlag Konstanz
Voorhees, E.: The Philosophy of Information Retrieval Evaluation. In Peters, C., Braschler, M., Gonzalo, J., and Kluck, M. (Eds.): Evaluation of Cross-Language Information Retrieval Systems. Second Workshop of the Cross-Language Evaluation Forum, CLEF 2001, Revised Papers, 2002, Pages 355-370.
Text REtrieval Conference (TREC) Series: http://trec.nist.gov/
NTCIR (NII-NACSIS Test Collection for IR Systems): http://research.nii.ac.jp/ntcir/
Braschler, M. CLEF 2002 — Overview of Results: This volume.
Peters, C. Introduction: This volume.
Gey, F.C. & Kluck, M.: The Domain-Specific Task of CLEF — Specific Evaluation Strategies in Cross-Language Information Retrieval. In C. Peters (Ed.). Cross-Language Information Retrieval and Evaluation. Lecture Notes in Computer Science 2069, Springer Verlag, pp 48-56.4.
Gonzalo, J and Oard, D.W.: The CLEF 2002 Interactive Track. This volume.
DELOS Network of Excellence on Digital Libraries: http://delos-noe.iei.pi.cnr.it/
Jones, G.J.F., Federico, M.: CLEF2002 Cross-Language Spoken Document Retrieval Pilot Track Report. This volume.
Womser-Hacker, C.: Multilingual Topic Generation within the CLEF 2001 Experiments.
Mandl, T., Womser-Hacker, C.: Linguistic and Statistical Analysis of the CLEF Topics. This volume.
Schäuble, P.: Content-Based Information Retrieval from Large Text and Audio Databases. Section 1.6 Evaluation Issues, Pages 22-29, Kluwer Academic Publishers, 1997.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Braschler, M., Peters, C. (2003). CLEF 2002 Methodology and Metrics. In: Peters, C., Braschler, M., Gonzalo, J., Kluck, M. (eds) Advances in Cross-Language Information Retrieval. CLEF 2002. Lecture Notes in Computer Science, vol 2785. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-45237-9_44
Download citation
DOI: https://doi.org/10.1007/978-3-540-45237-9_44
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-40830-7
Online ISBN: 978-3-540-45237-9
eBook Packages: Springer Book Archive