The CLEF Cross Language Image Retrieval Track (ImageCLEF) 2004

  • Paul Clough
  • Mark Sanderson
  • Henning Müller
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3115)


In this paper we describe ImageCLEF, the cross language image retrieval track of the Cross Language Evaluation Forum (CLEF). We instigated and ran a pilot experiment in 2003 where participants submitted entries for an ad hoc bilingual image retrieval task on a collection of historic photographs from St. Andrews University Library. This was designed to simulate the situation in which users would express their search request in natural language but require visual documents in return. For 2004 we have extended the tasks to include a medical image retrieval task and a user-centred evaluation.


Image Retrieval Relevance Feedback Retrieval Task Test Collection Image Retrieval System 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Armitage, L.H., Enser, P.: Analysis of User Need in Image Archives. In: Journal of Information Science, vol. 23(4), pp. 287–299 (1997)Google Scholar
  2. 2.
    Chen, F., Gargi, U., Niles, L., Schütze, H.: Multi-Modal Browsing of Images in Web Documents. In: Proceedings of SPIE Doc. Recognition and Retrieval VI, pp. 122–133 (1999)Google Scholar
  3. 3.
    Chen, K., Chen, H., Kando, N., Kuriyama, K., Lee, S., Myaeng, S.: Overview of CLIR Task. In: Third NTCIR Workshop, Japan (2002)Google Scholar
  4. 4.
    Cleverdon, C.W.: The Cranfield Tests on Index Language Devices. In: Spark-Jones, K., Willett, P. (eds.) Readings in Information Retrieval, pp. 47–59. Morgan Kaufmann, San Francisco (1997)Google Scholar
  5. 5.
    Clough, P., Sanderson, M.: The CLEF 2003 Cross Language Image Retrieval Track. In: Proceedings of the Cross Language Evaluation Forum (CLEF) Workshop, Norway (2003)Google Scholar
  6. 6.
    Cox, I.J., Miller, M.L., Omohundro, M., Yianilos, P.N.: Target Testing and the PicHunter Bayesian Multimedia Retrieval System. In: Proceedings of Advanced Digital Libraries (ADL1996), Forum, Washington D.C (1996)Google Scholar
  7. 7.
    Dunlop, M.: Reflections on MIRA: Interactive Evaluation in Information Retrieval. Journal of the American Society for Information Science 51(14), 1226–1274 (2000)CrossRefGoogle Scholar
  8. 8.
    Flank, S.: Cross language Multimedia Information Retrieval. In: Proceedings of Applied Natural Language Processing and the North American Chapter of the Association for Computational Linguistics (2000)Google Scholar
  9. 9.
    Forsyth, D.A.: Benchmarks for Storage and Retrieval in Multimedia Databases. In: Proceedings of SPIE International Society for Optical Engineering, vol. 4676, pp. 240–247 (2001)Google Scholar
  10. 10.
    Goodrum, A.A.: Image Information Retrieval: An Overview of Current Research. In: Informing Science, vol. 3(2), pp. 63–66 (2000)Google Scholar
  11. 11.
    Grefenstette, G.: Cross language Information Retrieval. Kluwer Academic Publishers, Norwell (1998)Google Scholar
  12. 12.
    Harmandas, V., Sanderson, M., Dunlop, M.D.: Image Retrieval by Hypertext Links. In: Proceedings of the 20th ACM SIGIR conference, pp. 296–303 (1997)Google Scholar
  13. 13.
    Markkula, M., Sormunen, E.: Searching for Photos – Journalist’s Practices in Pictorial IR. In: Proceedings of Conference on Image Retrieval (CIR 1998) (1998)Google Scholar
  14. 14.
    McDonald, S., Lai, T.S., Tait, J.: Evaluating a Content Based Image Retrieval System. In: Proceedings of SIGIR 2001, pp. 232–240 (2001)Google Scholar
  15. 15.
    Müller, H., Müller, W., Mc, G., Squire, D., Marchand-Mailet, S., Pun, T.: Performance Evaluation in Content-Based Image Retrieval: Overview and Proposals. Pattern Recognition Letters 22(5), 593–601 (2001)zbMATHCrossRefGoogle Scholar
  16. 16.
    Peters, C., Braschler, M.: Cross Language System Evaluation: The CLEF Campaigns. Journal of the American Soc. for Inf. Sci. and Tech. 52(12), 1067–1072 (2001)CrossRefGoogle Scholar
  17. 17.
    Reid, N.: The Photographic Collections in St Andrews University Library. Scottish Archives 5, 83–90 (1999)Google Scholar
  18. 18.
    Smeulders, A.W.M., Worring, M., Santini, S., Gupta, A., Jain, R.: Content-Based Image Retrieval at the End of the Early Years. IEEE Transactions on Pattern Analysis and Machine Intelligence 22(12), 1349–1380 (2000)CrossRefGoogle Scholar
  19. 19.
    Smith, J.R.: Image Retrieval Evaluation. In: Proceedings of the IEEE Workshop of Content- Based Access to Image and Video Databases, pp. 112–113 (2001)Google Scholar
  20. 20.
    Voorhees, E.M., Harman, D.: Overview of TREC 2001. In: NIST Special Publication 500-250: Proceedings of TREC2001, NIST (2001)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2004

Authors and Affiliations

  • Paul Clough
    • 1
  • Mark Sanderson
    • 1
  • Henning Müller
    • 2
  1. 1.Department of Information StudiesUniversity of Sheffield, Regent CourtSheffieldUK
  2. 2.Division of Medical InformaticsUniversity Hospitals of GenevaGeneva 4Switzerland

Personalised recommendations