Overview of the CLEF 2005 Interactive Track

  • Julio Gonzalo
  • Paul Clough
  • Alessandro Vallin
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4022)

Abstract

The CLEF Interactive Track (iCLEF) is devoted to the comparative study of user-inclusive cross-language search strategies. In 2005, we have studied two cross-language search tasks: retrieval of answers and retrieval of annotated images. In both tasks, no further translation or post-processing is needed after performing the tasks to fulfill the information need.

In the interactive Question Answering task, users are asked to find the answer to a number of questions in a foreign-language document collection, and write the answers in their own native language. In the interactive image retrieval task, a picture is shown to the user, and then the user is asked to find the picture in the collection.

This paper summarizes the task design, experimental methodology, and the results obtained by the research groups participating in the track.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Clough, P., Müeller, H., Desealers, T., Grubinger, M.: The CLEF 2005 Cross–Language Image Retrieval Track. In: Peters, C., Gey, F.C., Gonzalo, J., Müller, H., Jones, G.J.F., Kluck, M., Magnini, B., de Rijke, M., Giampiccolo, D. (eds.) CLEF 2005. LNCS, vol. 4022, pp. 535–557. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  2. 2.
    Cox, J., Miller, M.L., Omohundro, S.M., Yianilos, P.N.: Pichunter: Bayesian relevance feedback for image retrieval. Proceedings of the 13th International Conference on Pattern Recognition 3, 361–369 (1996)CrossRefGoogle Scholar
  3. 3.
    Hersh, W., Over, P.: TREC-9 interactive track report. In: The Ninth Text Retrieval Conference (TREC-9) (November 2000), http://trec.nist.gov
  4. 4.
    Peinado, V., López-Ostenero, F., Gonzalo, J., Verdejo, F.: UNED at iCLEF 2005: Automatic Highlighting of Potential Answers. In: Peters, C., Gey, F.C., Gonzalo, J., Müller, H., Jones, G.J.F., Kluck, M., Magnini, B., de Rijke, M., Giampiccolo, D. (eds.) CLEF 2005. LNCS, vol. 4022, pp. 283–292. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  5. 5.
    Navarro, B., Moreno-Monteagudo, L., Noguera, E., Vázquez, S., LLopis, F., Montoyo, A.: How Much Context Do You Need? In: Peters, C., Gey, F.C., Gonzalo, J., Müller, H., Jones, G.J.F., Kluck, M., Magnini, B., de Rijke, M., Giampiccolo, D. (eds.) CLEF 2005. LNCS, vol. 4022, pp. 273–282. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  6. 6.
    Oard, D.W., Gonzalo, J.: The CLEF 2003 interactive track. In: Peters, C. (ed.) Proceedings of the Fourth Cross-Language Evaluation Forum (2003)Google Scholar
  7. 7.
    Petrelli, D., Clough, P.D.: Using Concept Hierarchies in Text-Based Image Retrieval: A User Evaluation. In: Peters, C., Gey, F.C., Gonzalo, J., Müller, H., Jones, G.J.F., Kluck, M., Magnini, B., de Rijke, M., Giampiccolo, D. (eds.) CLEF 2005. LNCS, vol. 4022, pp. 297–306. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  8. 8.
    Villena-Román, R., Crespo-García, R.M., González-Cristóbal, J.C.: Boolean Operators in Interactive Search (in this volume)Google Scholar
  9. 9.
    Zazo, A., Figuerola, C., Alonso, J., Fernández, V.: iCLEF 2005, at REINA-USAL: Use of Free On-line Machine Translation Programs for Interactive Cross-Language Question Answering (2005) (In this volume)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Julio Gonzalo
    • 1
  • Paul Clough
    • 2
  • Alessandro Vallin
    • 3
  1. 1.Departamento de Lenguajes y Sistemas Informáticos, Escuela Técnica Superior de Ingeniería Informática de la UNEDMadrid
  2. 2.Department of Information StudiesSheffield UniversitySheffield
  3. 3.ITC-irstTrento

Personalised recommendations