A Bayesian Method for Content-Based Image Retrieval by Use of Relevance Feedback

  • Ju-Lan Tao 
  • Yi-Ping Hung 
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2314)


This paper proposes a new Bayesian method for content-based image retrieval using relevance feedback. In this method, the problem of contentbased image retrieval is first formulated as a two-class classification problem, where each image in the database can be classified as “relevant” or “nonrelevant” with respect to the query and the goal is to minimize the misclassification error. Then, the problem of image retrieval is further transferred into a simpler problem of ranking each image in the database by using a similarity measure that is basically a likelihood ratio. Here, the likelihood of the relevant class is modeled by a mixture of Gaussian distribution determined by the positive samples, and the likelihood of the non-relevant class is assumed to be an average of Gaussian kernels centered at negative samples. The experimental results have indicated that the proposed method has potential to become practical for content-based image retrieval.


Image Retrieval Image Database Query Image Relevant Image Image Retrieval System 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Sabharwal and L. C. Potter, “Set Estimation via Ellispoidal approximation,” Proceedings of the International Conference on Acoustics, Speech, and Signal Proceeding, pp.897–900, May 1995.Google Scholar
  2. 2.
    Buckley and G. Salton, “Optimization of Relevance Feedback Weights,” Proceedings of SIGIR, pp.351–357, 1995.Google Scholar
  3. 3.
    Moghaddam and A. Pentland, “Probabilistic Visual Learning for Object Representation,” IEEE Transactions on Pattern Analysis and Machine Intelligence, PAMI-19(7):696–710, July 1997.CrossRefGoogle Scholar
  4. 4.
    J. Cox, M. L. Miller, S. M. Omohundro, and P. N. Yianilos, “PicHunter: Bayesian relevance feedback for image retrieval,” International Conference on Pattern Recognition, pp.361–369, 1996.Google Scholar
  5. 5.
    T. Jolliffe, Principal Component Analysis, Springer series in statistics. Springer-Verlag, New York, 1986.Google Scholar
  6. 6.
    N. Vasconcelos and A. Lippman, “Bayesian Relevance Feedback for Content-Based Image Retrieval,” Proceedings of the IEEE Workshop on Content-based Access of Image and Video Libraries, pp.63–67, 2000.Google Scholar
  7. 7.
    R. Baeza-Yates and B. Ribeiro-Neto, Modern Information Retrieval, ACM Press, New York, 1999.Google Scholar
  8. 8.
    R. O. Duda, P. E. Hart and D. G. Stork, Pattern Classification, 2nd Ed. John Wiley & Sons, Inc., 2000.Google Scholar
  9. 9.
    Y. Rui, T. Huang and S. Mehrotra, “Content-Based Image Retrieval with Relevance Feedback in MARS,” Proceedings of International Conference on Image Processing, vol.2, pp. 815–818, 1997.Google Scholar
  10. 10.
    J. Zachary and S. S Iyengar, “Content based image retrieval systems,” Application Specific Systems and Software Engineering and Technology, pp.136–143, 1999.Google Scholar
  11. 11.
    Z. Su, H. J. Zhang and S. Ma, “Using Bayesian Classifier in Relevant Feedback of Image Retrieval,” Proceedings of the 12th IEEE International Conference on Tools with Artificial Intelligence, pp.258–261, 2000.Google Scholar
  12. 12.
    R. V. Hogg and E. A. Tanis, Probability and Statistical Inference, 6th Ed. Prentice Hall International, Inc., 2001.Google Scholar
  13. 13.
    R. M. Haralick, K. Shanmugam and I. Dinstein, “Textural Features for Image Classification,” IEEE Transactions on System, Man, and Sybernetics, Vol. SMC-3, No. 6, pp.610–621, November 1973.CrossRefGoogle Scholar
  14. 14.
    M. Turk and A. Pentland, “Eigenfaces for Recognition,” Journal of Cognitive Neuroscience, 3(1), pp.71–86, 1991.CrossRefGoogle Scholar
  15. 15.
    W. Y. Ma and H. J. Zhang, “Benchmarking of image features for content-based retrieval,” Asilomar Conference on Signals, Systems & Computers, pp.253–257,1998.Google Scholar
  16. 16.
    V. N. Gudivada and V. V. Raghavan, “Content-Based Image Retrieval Systems,” IEEE Computer, 28(9): 18–22, Sept. 1995.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2002

Authors and Affiliations

  • Ju-Lan Tao 
    • 1
    • 2
  • Yi-Ping Hung 
    • 1
    • 2
  1. 1.Academic SinicaInstitute of Information ScienceUSA
  2. 2.Department of Computer Science and Information EngineeringNational Taiwan UniversityUSA

Personalised recommendations