Skip to main content

A Perceptual Subjectivity Notion in Interactive Content-Based Image Retrieval Systems

  • Chapter
Intelligent Multimedia Processing with Soft Computing

Part of the book series: Studies in Fuzziness and Soft Computing ((STUDFUZZ,volume 168))

Abstract

This chapter presents a new framework called fuzzy relevance feedback in interactive content-based image retrieval (CBIR) systems. Conventional binary labeling scheme in relevance feedback requires a hard-decision to be made on the relevance of each retrieved image. This is inflexible as user interpretation varies with respect to different information needs and perceptual subjectivity. In addition, users tend to learn from the retrieval results to further refine their information priority. It is, therefore, inadequate to describe the users’ fuzzy perception of image similarity with crisp logic. In view of this, a fuzzy framework is introduced to integrate the users’ imprecise interpretation of visual contents into relevance feedback. An efficient learning approach is developed using a fuzzy radial basis function network (FRBFN). The network is constructed based on hierarchical clustering algorithm. The underlying network parameters are optimized by adopting a gradient-descent-based training strategy due to its computational efficiency. Experimental results using a database of 10,000 images demonstrate the effectiveness of the proposed method.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Amarnath G, Ramesh J (1997) Visual information retrieval. Communications of ACM, vol. 40, no.5, pp. 70–79

    Article  Google Scholar 

  2. Cox IJ, Miller ML, Minka TP, Papathomas TV, Yianilos PN (2000) The Bayesian image retrieval system, PicHunter: Theory, implementation, and psychophysical experiments. IEEE Trans. on Image Processing, vol. 9, no. 1, pp. 20–37

    Article  Google Scholar 

  3. Flickher M, Sawhney H, Niblack W, Ashley J, Huang Q, Dom B, Gorkani M, Hafner J, Lee D, Petkovic D, Steele D, Yanker P (1995) Query by image and video content: The QBIC system. IEEE Computer, vol. 28, no. 9, pp. 23–32

    Google Scholar 

  4. Gevers T, Smeulders AWM (2000) PicToSeek: Combining color and shape invariant features for image retrieval. IEEE Trans. on Image Processing, vol. 9, pp. 102–119

    Article  Google Scholar 

  5. Haykin S (1999) Neural networks: A comprehensive foundation. Upper Saddle River, NJ: Prentice-Hall

    Google Scholar 

  6. He XF, King O, Ma WY, Li MJ, Zhang HJ (2003) Learning a semantic space from user’s relevance feedback for image retrieval. IEEE Trans. on Circuits and Systems for Video Technology, vol. 13, pp. 39–48

    Article  Google Scholar 

  7. Huang J, Kumar SR, Metra M (1997) Combining supervised learning with color correlograms for content-based image retrieval. Proc. of ACM Multimedia, pp. 325–334

    Google Scholar 

  8. Huang TS, Zhou XS, Munehiro N, Wu Y, Cohen I (2002) Learning in content-based image retrieval. 2nd Int. Conf. on Development and Learning

    Google Scholar 

  9. Ishikawa Y, Subramanya R (1998) MindReader: Query database through multiple examples. Proc. of Int. Conf. on Very Large Data Bases, New York, USA

    Google Scholar 

  10. Jain AK, Murty MN, Flynn PJ (1999) Data clustering: A review. ACM Computing Surveys, Vol. 31, No. 3, pp. 264–323

    Article  Google Scholar 

  11. Laaksonen J, Koskela M, Oja E (2002) PicSom-self-organizing image retrieval with MPEG-7 content descriptions. IEEE Trans. on Neural Network, vol. 13, no. 4, pp. 841–853

    Article  Google Scholar 

  12. Lee HK, Yoo SI (2001) A neural network-based image retrieval using nonlinear combination of heterogeneous features. International Journal of Computational Intelligence and Applications 1(2): 137–149

    Article  MATH  MathSciNet  Google Scholar 

  13. Manjunath BS, Ma WY (1996) Texture features for browsing and retrieval of image data. IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 18, pp. 837–842

    Article  Google Scholar 

  14. Markus S, Markus O (1995) Similarity of color images. Proc. SPIE Storage and Retrieval for Image and Video Databases

    Google Scholar 

  15. MĂĽller H, MĂĽller W, Marchand-Maillet S, McG Squire D (2000) Strategies for positive and negative relevance feedback in image retrieval. Proc. Int. Conf. on Pattern Recognition, Barcelona, Spain

    Google Scholar 

  16. Muneesawnag P, Guan L (2001) Interactive CBIR using RBF-based relevance feedback for WT/VQ coded images. Proc. of IEEE Int. Conf. on Acoustics, Speech and Signal Processing, Utah, USA

    Google Scholar 

  17. Muneesawnag P, Guan L (2002) Automatic machine interactions for content-based image retrieval using a self-organizing tree map architecture. IEEE Trans. on Neural Networks, vol. 13, no. 4, pp. 821–834

    Article  Google Scholar 

  18. Pentland A, Picard R, Sclaroff S (1994) Photobook: tools for content-based manipulation of image databases. Proc. SPIE, vol.2185, pp.34–47

    Google Scholar 

  19. Rui Y, Huang TS, Mehrotra S (1997) Content-based image retrieval with relevance feedback in MARS. IEEE Int. Conf. on Image Processing, Washington D.C., USA, pp. 815–818

    Google Scholar 

  20. Rui Y, Huang TS, Ortega M, Mehrotra S (1998) Relevance feedback: A power tool for interactive content-based image retrieval. IEEE Trans. on Circuits and Video Technology, vol. 8, no. 5, pp. 644–655

    Article  Google Scholar 

  21. Rui Y, Huang TS (2000) Optimizing learning in image retrieval. Proc. of IEEE Int. Conf. on Computer Vision and Pattern Recognition, vol.1, pp. 236–243

    Google Scholar 

  22. Salton G, McGill MJ (1982) Introduction to Modern Information Retrieval. New York: McGraw-Hill Book Company

    MATH  Google Scholar 

  23. Smith JR, Chang SF (1996) Automated binary texture feature sets for image retrieval. Proc. Int. Conf. on Acoustics, Speech and Signal Processing, Atlanta, GA

    Google Scholar 

  24. Smith JR, Chang SF (1996) VisualSEEk: a fully automated content based image query system. Proc. ACM Multimedia

    Google Scholar 

  25. Su Z, Zhang HJ, Li S, Ma SP (2003) Relevance feedback in content-based image retrieval: Bayesian framework, feature subspaces, and progressive learning. IEEE Trans. on. Image Processing, vol. 12, pp. 924–937

    Article  Google Scholar 

  26. Swain M, Ballard D (1991) Color indexing. International Journal of Computer Vision, Vol. 7, No. 1, pp. 11–32

    Article  Google Scholar 

  27. Tong S, Chang E (2001) Support vector machine active leaning for image retrieval. Proc. of 9th ACM Conf. on Multimedia, Ottawa Canada

    Google Scholar 

  28. Vasconcelos N, Lippman A (1999) Learning from user feedback in image retrieval systems. Proc. of Neural Information Processing Systems, Denver, Colorado

    Google Scholar 

  29. Wu Y, Tian Q, Huang TS (2000) Discriminant-EM algorithm with application to image retrieval. Proc. of IEEE Int. Conf. on Computer Vision and Pattern Recognition, South Carolina

    Google Scholar 

  30. Zhou XS, Huang TS (2001) Small sample learning during multimedia retrieval using BiasMap. Proc. of Int. Conf. on Computer Vision and Pattern Recognition. Hawaii

    Google Scholar 

  31. Zhou XS, Huang TS (2003) Relevance feedback in image retrieval: A comprehensive review. Multimedia System 8(6), pp. 536–544

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2005 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Wu, K., Yap, KH. (2005). A Perceptual Subjectivity Notion in Interactive Content-Based Image Retrieval Systems. In: Tan, YP., Yap, K.H., Wang, L. (eds) Intelligent Multimedia Processing with Soft Computing. Studies in Fuzziness and Soft Computing, vol 168. Springer, Berlin, Heidelberg . https://doi.org/10.1007/3-540-32367-8_3

Download citation

  • DOI: https://doi.org/10.1007/3-540-32367-8_3

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-23053-3

  • Online ISBN: 978-3-540-32367-9

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics