Effective Region-based Relevance Feedback for Interactive Content-based Image Retrieval
Abstract
This paper proposes an effective framework for interactive region-based image retrieval. By utilizing fuzzy coarse segmentation and the graph structure for representing each image, the retrieval process was performed by measuring the image similarity according to the graph similarity. To assess the similarity between two graphs, fuzzy inter relations among regions feature vectors and spatial dispositions as well as fuzzy regions weights are explored. A region-based relevance feedback scheme was also incorporated into the retrieval process, by updating the importance of query image regions based on the user feedbacks, leading to a further performance improvement. Experimental study proves that the proposed region-based relevance feedback mechanism tailors the system semantic behavior relatively to each user personal preferences through the accumulation of the useful semantic information from the feedback information.
Keywords
Image Retrieval Query Image Relevance Feedback Salient Region Relevant ImagePreview
Unable to display preview. Download preview PDF.
References
- 1.El-Kwae, E.A., Kabukai, M.R.: Efficient Content-Based Indexing of Large Image Databases. ACM Trans. Information Systems 18, 171–210 (2000)CrossRefGoogle Scholar
- 2.Ko, B.C., Byun, H.: Query-by-Gesture: An Alternative Content-Based Image Retrieval Query Scheme. J. Vis. Lang. Comput. 13, 375–390 (2002)CrossRefGoogle Scholar
- 3.Jiang, W., Er, G., Dai, O., Zhong, L., Hou, Y.: Relevance Feedback Learning with Feature Selection in Region-based Image Retrieval. In: IEEE International Conference on Acoustics, speech, and Signal, pp. 509–512. IEEE Press, Pennsylvania (2005)Google Scholar
- 4.Jing, F., Li, M., Zhang, H.J., Zhang, B.: An Efficient and Effective Region-based Image Retrieval Framework. IEEE Trans. Image Processing 13, 699–709 (2004)CrossRefGoogle Scholar
- 5.Jiang, F., Li, M., Zhang, H.J.: Entropy-based Active Learning with Support Vector Machines for Content-based Image Retrieval. In: IEEE International Conference on Multimedia and Expo., pp. 85–88. IEEE Press, Taipei (2004)Google Scholar
- 6.Su, W.T., Chu, W.S., James-Lien, J.J.: Heuristic Pre-clustering Relevance Feedback in Region-based Image Retrieval. In: Narayanan, P.J., Nayar, S.K., Shum, H.-Y. (eds.) ACCV 2006. LNCS, vol. 3852, pp. 294–304. Springer, Heidelberg (2006)CrossRefGoogle Scholar
- 7.Zhang, R., Zhang, Z.: FAST: Fast and Semantics-Tailored Image Retrieval. In: Petrushin, V.A., Khan, L. (eds.) Multimedia Data Mining Knowledge Discovery. Springer, Heidelberg (2007)Google Scholar
- 8.Ko, B., Peng, J., Byun, H.: Region-based Image Retrieval using Feature Relevance Learning. J. Pattern Anal. 4, 174–184 (2002)MathSciNetGoogle Scholar
- 9.Dorado, A., Djordjevic, E., Izquierdo, E., Pedrycz, W.: Supervised Semantic Scene Classification based on Low-level Clustering and Relevance Feedback. In: European Workshop on the Integration of Knowledge, Semantics and Digital Media Technology, London, pp. 181–188 (2004)Google Scholar
- 10.Jing, F., Li, M., Zhang, L., Zhang, H.J., Zhang, B.: Learning in Region-based Image Retrieval. In: IEEE International Symposium on Circuits and Systems, pp. 206–215. IEEE Press, Cairo (2003)Google Scholar
- 11.Zagrouba, E., Ouni, S., Barhoumi, W.: A Reliable Image Retrieval System Based on Spatial Disposition Graph Matching. International Review on Computers and Software 2, 108–117 (2007)Google Scholar
- 12.Wang, T., Rui, Y., Sun, J.G.: Constraint Based Region Matching for Image Retrieval. J. Computer Vision 65, 37–45 (2004)CrossRefGoogle Scholar
- 13.Karouia, I., Zagrouba, E., Barhoumi, W.: Video Similarity Measurement Based on Attributed Relational Graph Matching. In: Nguyen, N.T., Katarzyniak, R. (eds.) New Challenges in Applied Intelligence Technologies, pp. 173–182. Springer, Heidelberg (2008)CrossRefGoogle Scholar
- 14.Zhang, R., Zhang, Z.: Addressing CBIR Efficiency, Effectiveness, and Retrieval Subjectivity Simultaneously. In: ACM International Workshop on Multimedia Information Retrieval, pp. 71–78. ACM Press, New York (2003)CrossRefGoogle Scholar
- 15.Li, C.Y., Hsu, C.T.: Image Retrieval with Relevance Feedback based on Graph-theoretic Region Correspondence Estimation. IEEE Trans. Multimedia 10, 447–456 (2008)CrossRefGoogle Scholar
- 16.Jing, F., Li, M., Zhang, H.J., Zhang, B.: Learning Region Weighting from Relevance Feedback in Image Retrieval. In: IEEE International Conference on Acoustics. IEEE Press, Orlando (2002)Google Scholar
- 17.Muller, H., Muller, W., Squire, D.M., Maillet, M.S., Pun, T.: Performance-Evaluation in Content-based Image Retrieval: Overview and Proposals. Pattern Recognition Letters 22, 593–601 (2001)CrossRefGoogle Scholar
- 18.Jung, S.H.: Content-based Image Retrieval using Fuzzy Multiple Attribute Relational Graph. In: IEEE International Symposium on Industrial Electronics, pp. 1508–1513. IEEE Press, Aquila (2002)Google Scholar