Overview of the ImageCLEF 2006 Photographic Retrieval and Object Annotation Tasks

  • Paul Clough
  • Michael Grubinger
  • Thomas Deselaers
  • Allan Hanbury
  • Henning Müller
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4730)


This paper describes the general photographic retrieval and object annotation tasks of the ImageCLEF 2006 evaluation campaign. These tasks provided both the resources and the framework necessary to perform comparative laboratory-style evaluation of visual information systems for image retrieval and automatic image annotation. Both tasks offered something new for 2006 and attracted a large number of submissions: 12 groups participated in ImageCLEFphoto and 3 groups in the automatic annotation task. This paper summarises these two tasks including collections used in the benchmark, the tasks proposed, a summary of submissions from participating groups and the main findings.


Image Retrieval Relevance Feedback Query Expansion Mean Average Precision Relevant Image 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Voorhees, E.M., Harmann, D.: Overview of the seventh Text REtrieval Conference (TREC-7). In: The Seventh Text Retrieval Conference, Gaithersburg, MD, USA, pp. 1–23 (1998)Google Scholar
  2. 2.
    Clough, P., Müller, H., Sanderson, M.: Overview of the CLEF cross-language image retrieval track (ImageCLEF) 2004. In: Peters, C., Clough, P.D., Gonzalo, J., Jones, G.J.F., Kluck, M., Magnini, B. (eds.) CLEF 2004. LNCS, vol. 3491, pp. 597–613. Springer, Heidelberg (2005)Google Scholar
  3. 3.
    Grubinger, M., Clough, P., Müller, H., Deselears, T.: The IAPR-TC12 benchmark: A new evaluation resource for visual information systems. In: International Workshop OntoImage’2006 Language Resources for Content-Based Image Retrieval, held in conjunction with LREC 2006, Genoa, Italy, pp. 13–23 (2006)Google Scholar
  4. 4.
    Zhang, V., Rey, B., Stipp, E., Jones, R.: Geomodification in query rewriting. In: GIR 2006: Proceedings of the Workshop on Geographic Information Retrieval, SIGIR (2006)Google Scholar
  5. 5.
    Grubinger, M., Leung, C., Clough, P.D.: Linguistic estimation of topic difficulty in cross-language image retrieval. In: Peters, C., Gey, F.C., Gonzalo, J., Müller, H., Jones, G.J.F., Kluck, M., Magnini, B., de Rijke, M., Giampiccolo, D. (eds.) CLEF 2005. LNCS, vol. 4022, pp. 558–566. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  6. 6.
    Voorhees, E.M.: The trec robust retrieval track. SIGIR Forum 39, 11–20 (2005)CrossRefGoogle Scholar
  7. 7.
    Müller, H., Geissbuhler, A., Marty, J., Lovis, C., Ruch, P.: The Use of medGIFT and easyIR for ImageCLEF 2005. In: Peters, C., Gey, F.C., Gonzalo, J., Müller, H., Jones, G.J.F., Kluck, M., Magnini, B., de Rijke, M., Giampiccolo, D. (eds.) CLEF 2005. LNCS, vol. 4022, Springer, Heidelberg (2006)CrossRefGoogle Scholar
  8. 8.
    Everingham, M., Zisserman, A., Williams, C.K.I., van Gool, L., Allan, M., Bishop, C.M., Chapelle, O., Dalal, N., Deselaers, T., Dorko, G., Duffner, S., Eichhorn, J., Farquhar, J.D.R., Fritz, M., Garcia, C., Griffiths, T., Jurie, F., Keysers, D., Koskela, M., Laaksonen, J., Larlus, D., Leibe, B., Meng, H., Ney, H., Schiele, B., Schmid, C., Seemann, E., Shawe-Taylor, J., Storkey, A., Szedmak, S., Triggs, B., Ulusoy, I., Viitaniemi, V., Zhang, J.: The 2005 pascal visual object classes challenge. In: Quiñonero-Candela, J., Dagan, I., Magnini, B., d’Alché-Buc, F. (eds.) MLCW 2005. LNCS (LNAI), vol. 3944, pp. 117–176. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  9. 9.
    Müller, H., Deselaers, T., Lehmann, T., Clough, P., Hersh, W.: Overview of the imageclefmed 2006 medical retrieval and annotation tasks. In: CLEF working notes, Alicante, Spain (2006)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2007

Authors and Affiliations

  • Paul Clough
    • 1
  • Michael Grubinger
    • 2
  • Thomas Deselaers
    • 3
  • Allan Hanbury
    • 4
  • Henning Müller
    • 5
  1. 1.Sheffield University, SheffieldUK
  2. 2.Victoria University, MelbourneAustralia
  3. 3.Computer Science Department, RWTH Aachen UniversityGermany
  4. 4.Vienna University of Technology, ViennaAustria
  5. 5.University and Hospitals of GenevaSwitzerland

Personalised recommendations