Query Shifting Based on Bayesian Decision Theory for Content-Based Image Retrieval

  • Giorgio Giacinto
  • Fabio Roli
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2396)


Despite the efforts to reduce the so-called semantic gap between the user’s perception of image similarity and feature-based representation of images, the interaction with the user remains fundamental to improve performances of content-based image retrieval systems. To this end, relevance feedback mechanisms are adopted to refine image-based queries by asking users to mark the set of images retrieved in a neighbourhood of the query as being relevant or not. In this paper, Bayesian decision theory is used to compute a new query whose neighbourhood is more likely to fall in a region of the feature space containing relevant images. The proposed query shifting method outperforms two relevance feedback mechanisms described in the literature. Reported experiments also show that retrieval performances are less sensitive to the choice of a particular similarity metric when relevance feedback is used.


Feature Space Image Retrieval Relevance Feedback Query Point Retrieval Performance 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Bhanu, B., Dong, D.: Concepts Learning with Fuzzy Clustering and Relevance Feedback. In: Petra, P. (Ed.): Machine Learning and Data Mining in Pattern Recognition. LNAI 2123, Springer-Verlag, Berlin (2001) 102–116CrossRefGoogle Scholar
  2. 2.
    Ciocca G, Schettini R.: Content-based similarity retrieval of trademarks using relevance feedback. Pattern Recognition, 34(8) (2001) 1639–1655zbMATHCrossRefGoogle Scholar
  3. 3.
    Cox, I.J., Miller, MX., Minka T.P., Papathomas T.V., Yianilos, P.N.: The Bayesian image retrieval system, PicHunter: theory, implementation, and psychophysical experiments. IEEE Trans, on Image Processing 9(1) (2000) 20–37CrossRefGoogle Scholar
  4. 4.
    Del Bimbo A.: Visual Information Retrieval. Morgan Kaufmann Pub. Inc., San Francisco, CA( 1999)Google Scholar
  5. 5.
    Duda R.O., Hart P.E., Stork D.G.: Pattern Classification. J. Wiley & Sons (2000)Google Scholar
  6. 6.
    Frederix G., Caenen G., Pauwels E.J.: PARISS: Panoramic, Adaptive and Reconfigurable Interface for Similairty Search. Proc. of ICIP 2000 Intern. Conf. on Image Processing. WA 07.04, vol. III (2000) 222–225Google Scholar
  7. 7.
    Giacinto, G., Roli, F., Fumera, G.: Content-Based Image Retrieval with Adaptive Query Shifting. In: Petra, P. (Ed.): Machine Learning and Data Mining in Pattern Recognition. LNAI 2123, Springer-Verlag, Berlin, (2001) 337–346CrossRefGoogle Scholar
  8. 8.
    Hesterkamp DR, Peng J, Dai HK.: Feature relevance learning with query shifting for content-based image retrieval. In Proc. of the 15th IEEE International Conference on Pattern Recognition (ICPR 2000), vol 4. IEEE Computer Society (2000) 250–253CrossRefGoogle Scholar
  9. 9.
    Ishikawa Y., Subramanys R., Faloutsos C: MindReader: Querying databases through multiple examples. In Proceedings, of the 24th VLDB Conference (1998)433–438Google Scholar
  10. 10.
    McG Squire D, Müller W., Müller H., Pun T.: Content-based query of image databases: inspirations from text retrieval. Pattern Recognition Letters21(13–14) (2000)1193–1198zbMATHCrossRefGoogle Scholar
  11. 11.
    Nastar C, Mitschke M., Meilhac C: Efficient query refinement for Image Retrieval. Proc. of IEEE Conf. Computer Vision and Pattern Recognition, CA (1998) 547–552Google Scholar
  12. 12.
    Peng J., Bhanu B., Qing S.: Probabilistic feature relevance learning for content-based image retrieval. Computer Vision and Image Understanding 75(1–2) (1999) 150–164CrossRefGoogle Scholar
  13. 13.
    Rui Y., Huang T.S., Mehrotra S.: Content-based image retrieval with relevance feedback: in MARS. In Proceedings of the IEEE International Conference on Image Processing, IEEE Press (1997) 815–818Google Scholar
  14. 14.
    Rui Y., Huang T.S.: Relevance Feedback Techniques in Image retrieval. In Lew M.S. (ed.): Principles of Visual Information Retrieval. Springer-Verlag, London, (2001)219–258Google Scholar
  15. 15.
    Salton G, McGill M.J.: Introduction to modern information retrieval. McGraw-Hill, New York (1988)Google Scholar
  16. 16.
    Santini S., Jain R.: Integrated browsing and querying for image databases. IEEE Multimedia 7(3) (2000) 26–39CrossRefGoogle Scholar
  17. 17.
    Santini S., Jain R.: Similarity Measures. IEEE Trans. on Pattern Analysis and Machine Intelligence 21(9) (1999) 871–883CrossRefGoogle Scholar
  18. 18.
    Sclaroff S., La Cascia M., Sethi S., Taycher L.: Mix and Match Features in the ImageRover search engine. In Lew M.S. (ed.): Principles of Visual Information Retrieval. Springer-Verlag, London (2001) 219–258Google Scholar
  19. 19.
    Smeulders A.W.M., Worring M., Santini S., Gupta A., Jain R.: Content-based image retrieval at the end of the early years. IEEE Trans. on Pattern Analysis and Machine Intelligence 22(12) (2000 1349–1380CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2002

Authors and Affiliations

  • Giorgio Giacinto
    • 1
  • Fabio Roli
    • 1
  1. 1.Dept. of Electrical and Electronic EngineeringUniversity of CagliariCagliariItaly

Personalised recommendations