International Journal of Computer Vision

, Volume 56, Issue 1, pp 7–16

Weakly Supervised Learning of Visual Models and Its Application to Content-Based Retrieval

  • Cordelia Schmid
Article

DOI: 10.1023/B:VISI.0000004829.38247.b0

Cite this article as:
Schmid, C. International Journal of Computer Vision (2004) 56: 7. doi:10.1023/B:VISI.0000004829.38247.b0

Abstract

This paper presents a method for weakly supervised learning of visual models. The visual model is based on a two-layer image description: a set of “generic” descriptors and their distribution over neighbourhoods. “Generic” descriptors represent sets of similar rotational invariant feature vectors. Statistical spatial constraints describe the neighborhood structure and make our description more discriminant. The joint probability of the frequencies of “generic” descriptors over a neighbourhood is multi-modal and is represented by a set of “neighbourhood-frequency” clusters. Our image description is rotationally invariant, robust to model deformations and characterizes efficiently “appearance-based” visual structure. The selection of distinctive clusters determines model features (common to the positive and rare in the negative examples). Visual models are retrieved and localized using a probabilistic score. Experimental results for “textured” animals and faces show a very good performance for retrieval as well as localization.

visual modeltwo-layer image descriptionweakly supervised learning

Copyright information

© Kluwer Academic Publishers 2004

Authors and Affiliations

  • Cordelia Schmid
    • 1
  1. 1.INRIA Rhône-AlpesMontbonnotFrance