Skip to main content
SpringerLink
Log in

CLEF 2009 Ad Hoc Track Overview: TEL and Persian Tasks

  • Conference paper
Multilingual Information Access Evaluation I. Text Retrieval Experiments (CLEF 2009)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 6241))

Included in the following conference series:

Abstract

The design of the 2009 Ad Hoc track was to a large extent a repetition of the previous year’s track, with the same three tasks: Tel@CLEF, Persian@CLEF, and Robust-WSD. In this first of the two track overviews, we describe the objectives and results of the TEL and Persian tasks and provide some statistical analyses.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Agosti, M., Di Nunzio, G.M., Ferro, N.: The Importance of Scientific Data Curation for Evaluation Campaigns. In: Thanos, C., Borri, F. (eds.) DELOS Conference 2007 Working Notes, February 2007, pp. 185–193. ISTI-CNR, Gruppo ALI, Pisa, Italy (2007)

    Google Scholar 

  2. Alonso, O., Mizzaro, S.: Can we get rid of TREC assessors? Using Mechanical Turk for relevance assessment. In: Geva, S., Kamps, J., Peters, C., Sakai, T., Trotman, A., Voorhees, E. (eds.) Proc. SIGIR 2009 Workshop on The Future of IR Evaluation (2009), http://staff.science.uva.nl/~kamps/ireval/papers/paper_22.pdf

  3. Braschler, M.: CLEF 2002 – Overview of Results. In: Braschler, M., Gonzalo, J., Kluck, M. (eds.) CLEF 2002. LNCS, vol. 2785, pp. 9–27. Springer, Heidelberg (2003)

    Chapter  Google Scholar 

  4. Braschler, M., Peters, C.: CLEF 2003 Methodology and Metrics. In: Peters, C., Gonzalo, J., Braschler, M., Kluck, M. (eds.) CLEF 2003. LNCS, vol. 3237, pp. 7–20. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  5. Cleverdon, C.W.: The Cranfield Tests on Index Languages Devices. In: Spärck Jones, K., Willett, P. (eds.) Readings in Information Retrieval, pp. 47–60. Morgan Kaufmann Publisher, Inc., San Francisco (1997)

    Google Scholar 

  6. Di Nunzio, G.M., Ferro, N.: Appendix A: Results of the TEL@CLEF Task. In: Borri, F., Nardi, A., Peters, C. (eds.) Working Notes for the CLEF 2009 Workshop (2009), http://www.clef-campaign.org/

  7. Di Nunzio, G.M., Ferro, N.: Appendix B: Results of the Persian@CLEF Task. In: Borri, F., Nardi, A., Peters, C. (eds.) Working Notes for the CLEF 2009 Workshop (2009), http://www.clef-campaign.org/

  8. Sanderson, M., Joho, H.: Forming Test Collections with No System Pooling. In: Sanderson, M., Järvelin, K., Allan, J., Bruza, P. (eds.) Proc. 27th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2004), pp. 33–40. ACM Press, New York (2004)

    Google Scholar 

  9. Tomlinson, S.: Sampling Precision to Depth 10000 at CLEF 2008. In: Peters, C., et al. (eds.) Evaluating Systems for Multilingual and Multimodal Information Access. LNCS, vol. 5706, pp. 163–169. Springer, Heidelberg (2009)

    Chapter  Google Scholar 

  10. Tomlinson, S.: Sampling Precision to Depth 10000 at CLEF 2009. In: Peters, C., et al. (eds.) CLEF 2009 Workshop, Part I. LNCS, vol. 6241, pp. 78–85. Springer, Heidelberg (2010)

    Google Scholar 

  11. Anderka, M., Lipka, N., Stein, B.: Evaluating Cross-Language Explicit Semantic Analysis and Cross Querying. In: Peters, C., et al. (eds.) CLEF 2009 Workshop, Part I. LNCS, vol. 6241, pp. 50–57. Springer, Heidelberg (2010)

    Google Scholar 

  12. Zhou, D., Wade, V.: Smoothing Methods and Cross-Language Document Re-Ranking. In: Peters, C., et al. (eds.) CLEF 2009 Workshop, Part I. LNCS, vol. 6241, pp. 62–69. Springer, Heidelberg (2010)

    Google Scholar 

  13. Habibian, A., AleAhmad, A., Shakery, A.: Ad Hoc Information Retrieval for Perisan. In: Peters, C., et al. (eds.) CLEF 2009 Workshop, Part I. LNCS, vol. 6241, pp. 110–119. Springer, Heidelberg (2010)

    Google Scholar 

  14. Larson, R.R.: Multilingual Query Expansion for CLEF Adhoc-TEL. In: Peters, C., et al. (eds.) CLEF 2009 Workshop, Part I. LNCS, vol. 6241, pp. 86–89. Springer, Heidelberg (2010)

    Google Scholar 

  15. McNamee, P.: JHU Experiments in Monolingual Farsi Document Retrieval at CLEF 2009. In: Borri, F., Nardi, A., Peters, C. (eds.) Working Notes for the CLEF 2009 Workshop 2009, http://www.clef-campaign.org/

  16. Kuersten, J.: Chemnitz at CLEF 2009 Ad-Hoc TEL Task: Combining Different Retrieval Models and Addressing the Multilinguality. In: Borri, F., Nardi, A., Peters, C. (eds.) Working Notes for the CLEF 2009 Workshop 2009, http://www.clef-campaign.org/

  17. Sorg, P., Braun, M., Nicolay, D., Cimiano, P.: Cross-lingual Information Retrieval based on Multiple Indexes. In: Borri, F., Nardi, A., Peters, C. (eds.) Working Notes for the CLEF 2009 Workshop (2009), http://www.clef-campaign.org/

  18. Katsiouli, P., Kalamboukis, T.: An Evaluation of Greek-English Cross Language Retrieval within the CLEF Ad-Hoc Bilingual Task. In: Borri, F., Nardi, A., Peters, C. (eds.) Working Notes for the CLEF 2009 Workshop (2009), http://www.clef-campaign.org/

  19. Jadidinejad, A.H., Mahmoudi, F.: Cross-Language Information Retrieval Using Meta-Language Index Construction and Structural Queries. In: Peters, C., et al. (eds.) CLEF 2009 Workshop, Part I. LNCS, vol. 6241, pp. 70–77. Springer, Heidelberg (2010)

    Google Scholar 

  20. Jadidinejad, A.H., Mahmoudi, F.: Query Wikification: Mining Structured Queries from Unstructured Information Needs using Wikipedia-based Semantic Analysis. In: Borri, F., Nardi, A., Peters, C. (eds.) Working Notes for the CLEF 2009 Workshop (2009), http://www.clef-campaign.org/

  21. Jadidinejad, A.H., Mahmoudi, F.: PerStem: A Simple and Efficient Stemming Algorithm for Persian Language. In: Peters, C., et al. (eds.) CLEF 2009 Workshop, Part I. LNCS, vol. 6241, pp. 98–101. Springer, Heidelberg (2010)

    Google Scholar 

  22. Iftne, A., Mihaila, A.-E., Epure, I.-P.: UAIC: Participation in TEL@CLEF task. In: Borri, F., Nardi, A., Peters, C. (eds.) Working Notes for the CLEF 2009 Workshop (2009), http://www.clef-campaign.org/

  23. Machado, J., Martins, B., Borbinha, J.: Experiments with N-Gram Prefixes on a Multinomial Language Model versus Lucene’s off-the-shelf ranking scheme and Rocchio Query Expansion (TEL@CLEF Monolingual Task). In: Peters, C., et al. (eds.) CLEF 2009 Workshop, Part I. LNCS, vol. 6241, pp. 90–97. Springer, Heidelberg (2010)

    Google Scholar 

  24. Bosca, A., Dini, L.: CACAO Project at the TEL@CLEF 2009 Task. In: Borri, F., Nardi, A., Peters, C. (eds.) Working Notes for the CLEF 2009 Workshop (2009), http://www.clef-campaign.org/

  25. Leveling, J., Zhou, D., Jones, G.F., Wade, V.: Document Expansion, Query Translation and Language Modeling for Ad-hoc IR. In: Peters, C., et al. (eds.) CLEF 2009 Workshop, Part I. LNCS, vol. 6241, pp. 58–61. Springer, Heidelberg (2010)

    Google Scholar 

  26. Dolamic, L., Savoy, J.: Ad Hoc Retrieval with the Persian Language. In: Peters, C., et al. (eds.) CLEF 2009 Workshop, Part I. LNCS, vol. 6241, pp. 102–109. Springer, Heidelberg (2010)

    Google Scholar 

  27. Dolamic, L., Fautsch, C., Savoy, J.: UniNE at CLEF 2008: TEL and Persian IT. In: Peters, C., et al. (eds.) CLEF 2008. LNCS, vol. 5706, pp. 178–185. Springer, Heidelberg (2009)

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Information Engineering, University of Padua, Italy

    Nicola Ferro

  2. ISTI-CNR, Area di Ricerca, Pisa, Italy

    Carol Peters

Authors
  1. Nicola Ferro
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Carol Peters
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. ISTI-CNR, Area Ricerca CNR, Via Moruzzi, 1, 56124, Pisa, Italy

    Carol Peters

  2. Department of Information Engineering, University of Padua, Via gradenigo, 6/a, 35131, Padova, Italy

    Giorgio Maria Di Nunzio

  3. Aalto Univesity, P.O. Box 15400, 00076, Aalto, Finland

    Mikko Kurimo

  4. University of Hildesheim, 31141, Hildesheim, Germany

    Thomas Mandl

  5. ELDA/ELRA, 75013, Paris, France

    Djamel Mostefa

  6. LSI-UNED, 28040, Madrid, Spain

    Anselmo Peñas

  7. Matrixware, 1060, Vienna, Austria

    Giovanna Roda

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Ferro, N., Peters, C. (2010). CLEF 2009 Ad Hoc Track Overview: TEL and Persian Tasks. In: Peters, C., et al. Multilingual Information Access Evaluation I. Text Retrieval Experiments. CLEF 2009. Lecture Notes in Computer Science, vol 6241. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-15754-7_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-15754-7_2

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-15753-0

  • Online ISBN: 978-3-642-15754-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation