Overview of the ImageCLEFphoto 2007 Photographic Retrieval Task

  • Michael Grubinger
  • Paul Clough
  • Allan Hanbury
  • Henning Müller
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5152)


The general photographic ad-hoc retrieval task of the ImageCLEF 2007 evaluation campaign is described. This task provides both the resources and the framework necessary to perform comparative laboratory-style evaluation of visual information retrieval from generic photographic collections. In 2007, the evaluation objective concentrated on retrieval of lightly annotated images, a new challenge that attracted a large number of submissions: a total of 20 participating groups submitted 616 system runs. This paper summarises the components used in the benchmark, including the document collection and the search tasks, and presents an analysis of the submissions and the results.


Image Retrieval Query Language Relevance Feedback Query Expansion Image Annotation 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Voorhees, E.M., Harmann, D.: Overview of the Seventh Text REtrieval Conference(TREC-7). In: The Seventh Text Retrieval Conference, Gaithersburg, MD, USA, pp. 1–23 (1998)Google Scholar
  2. 2.
    Clough, P.D., Grubinger, M., Deselaers, T., Hanbury, A., Müller, H.: Overview ofthe ImageCLEF 2006 photographic retrieval and object annotation tasks. In: Peters, C., Clough, P., Gey, F.C., Karlgren, J., Magnini, B., Oard, D.W., de Rijke, M., Stempfhuber, M. (eds.) CLEF 2006. LNCS, vol. 4730, pp. 579–594. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  3. 3.
    Grubinger, M., Clough, P.D., Müller, H., Deselears, T.: The IAPRTC12 Bench- mark: A New Evaluation Resource for Visual Information Systems. In: International Workshop OntoImage 2006 Language Resources for Content-Based Image Retrieval, held in conjunction with LREC 2006, Genoa, Italy, pp. 13–23 (2006)Google Scholar
  4. 4.
    Grubinger, M.: On the Creation of Query Topics for ImageCLEFphoto. In: Third MUSCLE / ImageCLEF Workshop on Image and Video Retrieval Evaluation, Budapest, Hungary, pp. 50–63 (2007)Google Scholar
  5. 5.
    Deselaers, T., Keysers, D., Ney, H.: Features for image retrieval: An experimental comparison. Information Retrieval (in press, 2008)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Michael Grubinger
    • 1
  • Paul Clough
    • 2
  • Allan Hanbury
    • 3
  • Henning Müller
    • 4
    • 5
  1. 1.Victoria UniversityMelbourneAustralia
  2. 2.Sheffield UniversitySheffieldUnited Kingdom
  3. 3.Vienna University of TechnologyViennaAustria
  4. 4.University and Hospitals of GenevaSwitzerland
  5. 5.University of Applied SciencesSierreSwitzerland

Personalised recommendations