Effective Region-based Relevance Feedback for Interactive Content-based Image Retrieval

  • Walid Barhoumi
  • Abir Gallas
  • Ezzeddine Zagrouba
Part of the Studies in Computational Intelligence book series (SCI, volume 226)

Abstract

This paper proposes an effective framework for interactive region-based image retrieval. By utilizing fuzzy coarse segmentation and the graph structure for representing each image, the retrieval process was performed by measuring the image similarity according to the graph similarity. To assess the similarity between two graphs, fuzzy inter relations among regions feature vectors and spatial dispositions as well as fuzzy regions weights are explored. A region-based relevance feedback scheme was also incorporated into the retrieval process, by updating the importance of query image regions based on the user feedbacks, leading to a further performance improvement. Experimental study proves that the proposed region-based relevance feedback mechanism tailors the system semantic behavior relatively to each user personal preferences through the accumulation of the useful semantic information from the feedback information.

Keywords

Image Retrieval Query Image Relevance Feedback Salient Region Relevant Image 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    El-Kwae, E.A., Kabukai, M.R.: Efficient Content-Based Indexing of Large Image Databases. ACM Trans. Information Systems 18, 171–210 (2000)CrossRefGoogle Scholar
  2. 2.
    Ko, B.C., Byun, H.: Query-by-Gesture: An Alternative Content-Based Image Retrieval Query Scheme. J. Vis. Lang. Comput. 13, 375–390 (2002)CrossRefGoogle Scholar
  3. 3.
    Jiang, W., Er, G., Dai, O., Zhong, L., Hou, Y.: Relevance Feedback Learning with Feature Selection in Region-based Image Retrieval. In: IEEE International Conference on Acoustics, speech, and Signal, pp. 509–512. IEEE Press, Pennsylvania (2005)Google Scholar
  4. 4.
    Jing, F., Li, M., Zhang, H.J., Zhang, B.: An Efficient and Effective Region-based Image Retrieval Framework. IEEE Trans. Image Processing 13, 699–709 (2004)CrossRefGoogle Scholar
  5. 5.
    Jiang, F., Li, M., Zhang, H.J.: Entropy-based Active Learning with Support Vector Machines for Content-based Image Retrieval. In: IEEE International Conference on Multimedia and Expo., pp. 85–88. IEEE Press, Taipei (2004)Google Scholar
  6. 6.
    Su, W.T., Chu, W.S., James-Lien, J.J.: Heuristic Pre-clustering Relevance Feedback in Region-based Image Retrieval. In: Narayanan, P.J., Nayar, S.K., Shum, H.-Y. (eds.) ACCV 2006. LNCS, vol. 3852, pp. 294–304. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  7. 7.
    Zhang, R., Zhang, Z.: FAST: Fast and Semantics-Tailored Image Retrieval. In: Petrushin, V.A., Khan, L. (eds.) Multimedia Data Mining Knowledge Discovery. Springer, Heidelberg (2007)Google Scholar
  8. 8.
    Ko, B., Peng, J., Byun, H.: Region-based Image Retrieval using Feature Relevance Learning. J. Pattern Anal. 4, 174–184 (2002)MathSciNetGoogle Scholar
  9. 9.
    Dorado, A., Djordjevic, E., Izquierdo, E., Pedrycz, W.: Supervised Semantic Scene Classification based on Low-level Clustering and Relevance Feedback. In: European Workshop on the Integration of Knowledge, Semantics and Digital Media Technology, London, pp. 181–188 (2004)Google Scholar
  10. 10.
    Jing, F., Li, M., Zhang, L., Zhang, H.J., Zhang, B.: Learning in Region-based Image Retrieval. In: IEEE International Symposium on Circuits and Systems, pp. 206–215. IEEE Press, Cairo (2003)Google Scholar
  11. 11.
    Zagrouba, E., Ouni, S., Barhoumi, W.: A Reliable Image Retrieval System Based on Spatial Disposition Graph Matching. International Review on Computers and Software 2, 108–117 (2007)Google Scholar
  12. 12.
    Wang, T., Rui, Y., Sun, J.G.: Constraint Based Region Matching for Image Retrieval. J. Computer Vision 65, 37–45 (2004)CrossRefGoogle Scholar
  13. 13.
    Karouia, I., Zagrouba, E., Barhoumi, W.: Video Similarity Measurement Based on Attributed Relational Graph Matching. In: Nguyen, N.T., Katarzyniak, R. (eds.) New Challenges in Applied Intelligence Technologies, pp. 173–182. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  14. 14.
    Zhang, R., Zhang, Z.: Addressing CBIR Efficiency, Effectiveness, and Retrieval Subjectivity Simultaneously. In: ACM International Workshop on Multimedia Information Retrieval, pp. 71–78. ACM Press, New York (2003)CrossRefGoogle Scholar
  15. 15.
    Li, C.Y., Hsu, C.T.: Image Retrieval with Relevance Feedback based on Graph-theoretic Region Correspondence Estimation. IEEE Trans. Multimedia 10, 447–456 (2008)CrossRefGoogle Scholar
  16. 16.
    Jing, F., Li, M., Zhang, H.J., Zhang, B.: Learning Region Weighting from Relevance Feedback in Image Retrieval. In: IEEE International Conference on Acoustics. IEEE Press, Orlando (2002)Google Scholar
  17. 17.
    Muller, H., Muller, W., Squire, D.M., Maillet, M.S., Pun, T.: Performance-Evaluation in Content-based Image Retrieval: Overview and Proposals. Pattern Recognition Letters 22, 593–601 (2001)CrossRefGoogle Scholar
  18. 18.
    Jung, S.H.: Content-based Image Retrieval using Fuzzy Multiple Attribute Relational Graph. In: IEEE International Symposium on Industrial Electronics, pp. 1508–1513. IEEE Press, Aquila (2002)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Walid Barhoumi
    • 1
  • Abir Gallas
    • 1
  • Ezzeddine Zagrouba
    • 1
  1. 1.Institut Supérieur d’InformatiqueEquipe de Recherche “Systèmes Intelligents en Imagerie et Vision Artificielle” (SIIVA)ArianaTunisia

Personalised recommendations