The CLEF 2003 Cross Language Image Retrieval Track

  • Paul Clough
  • Mark Sanderson
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3237)


In this paper, we describe a pilot experiment run at CLEF 2003 for cross language image retrieval, called ImageCLEF. The task is this: given a user need expressed in a language different from the document collection, find as many relevant images as possible. To facilitate retrieval, textual captions are associated with each image, thereby enabling (but not limiting) retrieval using text-based retrieval methods. This paper describes our experiences of building a test collection for the ImageCLEF task, discusses the results from this campaign, and outlines our ideas for further ImageCLEF experiments.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Goodrum, A.: Image information retrieval: An overview of current research. Informing Science 3(2), 63–66 (2000)Google Scholar
  2. 2.
    Armitage, L., Enser, P.: Analysis of user need in image archives. Journal of Information Science 23(4), 287–299 (1997)CrossRefGoogle Scholar
  3. 3.
    Markkula, M., Tico, M., Sepponen, B., Nirkkonen, K., Sormunen, E.: A test collection for the evaluation of content-based image retrieval algorithms - a user and task-based approach. Information Retrieval 4(3/4), 275–294 (2001)MATHCrossRefGoogle Scholar
  4. 4.
    Cleverdon, C.: The Cranfield tests on index language devices. In: Spark-Jones, K., Willett, P. (eds.) Readings in Information Retrieval, pp. 47–59. Morgan Kaufmann, San Francisco (1997)Google Scholar
  5. 5.
    Voorhees, E., Harman, D.: Overview of TREC 2001. In: Proceedings of TREC 2001, NIST (2001)Google Scholar
  6. 6.
    Braschler, M., Peters, C.: CLEF methodology and metrics. In: Peters, C., Braschler, M., Gonzalo, J., Kluck, M. (eds.) CLEF 2001. LNCS, vol. 2406, pp. 394–404. Springer, Heidelberg (2002)CrossRefGoogle Scholar
  7. 7.
    Kuriyama, K., Kando, N., Nozue, T., Eguchi, K.: Pooling for a large-scale test collection: An analysis of the search results from the first NTCIR workshop. Information Retrieval 5(1), 41–59 (2002)MATHCrossRefGoogle Scholar
  8. 8.
    Voorhees, E.: The philosophy of information retrieval evaluation. In: Peters, C., Braschler, M., Gonzalo, J., Kluck, M. (eds.) CLEF 2001. LNCS, vol. 2406, pp. 355–370. Springer, Heidelberg (2002)CrossRefGoogle Scholar
  9. 9.
    Reid, N.: The photographic collections in St Andrews University Library. Scottish Archives 5, 83–90 (1999)Google Scholar
  10. 10.
    Peters, C., Braschler, M.: Cross-language system evaluation: The CLEF campaigns. Journal of the American Society for Information Science and Technology 52(12), 1067–1072 (2001)CrossRefGoogle Scholar
  11. 11.
    Goodrum, A., Spink, A.: Visual information seeking: A study of image queries on the World Wide Web. In: Proceedings of the 1999 Annual Meeting of the American Society for Information Science (1999)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2004

Authors and Affiliations

  • Paul Clough
    • 1
  • Mark Sanderson
    • 1
  1. 1.Department of Information StudiesUniversity of SheffieldSheffieldUK

Personalised recommendations