Skip to main content
SpringerLink
Log in

A new ROI based image retrieval system using an auxiliary Gaussian weighting scheme

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In state-of-the-art region of interest (ROI) based image retrieval systems, the user defined ROI query is considered more effectively reflecting the user’s intention than an ROI query automatically selected by the system. Compared with existing image retrieval method, the user defined ROI based image retrieval has two obvious characteristics: One, the target region is located at the center of the ROI query, and two, the ROI query contains hardly any noisy descriptors which do not belong to the target region. Based on these two characteristics and general bag-of-words image retrieval method, an auxiliary Gaussian weighting (AGW) scheme is incorporated into our ROI based image retrieval system. Each of the descriptor is weighted according to its distance between the center of the ROI query, using a 2-d Gaussian window function. The AGW scheme is used to compute the score of each image in database. Meanwhile, an efficient re-ranking algorithm is proposed based on the distribution consistency of the Gaussian weight between the matched descriptors of the ROI query and the candidate image, which is simply written as the DCGW re-ranking. The experimental results demonstrate that our system can obtain satisfactory retrieval results.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  1. Agrawal R, Wu C-H, Grosky WI, Fotouhi F (2007) Image clustering using visual and text keywords. In: CIRA, pp 20–23

  2. Baeza-Yates R, Neto B (1999) Modern information retrieval, 38. ACM Press

  3. Chan Y-K, Ho Y-A, Liu Y-T, Chen R-C (2008) A ROI image retrieval method based on CVAAO. Image Vis Comput 26(11):1540–1549

    Article  Google Scholar 

  4. Chi P-H, Scott GJ, Shyu C-R (2005) A fast protein structure retrieval system using image-based distance matrices and multidimensional index. IJSEKE 15(3):527–546

    Google Scholar 

  5. Chum O, Philbin J, Sivic J, Isard M, Zisserman A (2007) Total recall: automatic query expansion with a generative feature model for object retrieval. In: IEEE 11th International Conference on Computer Vision (ICCV), pp 1–8

  6. Coleman T, Li Y (1994) On the convergence of reflective Newton methods for large-scale nonlinear minimization subject to bounds. Math Program 67(2):189–224

    Article  MathSciNet  MATH  Google Scholar 

  7. Coleman T, Li Y (1996) An interior, trust region approach for nonlinear minimization subject to bounds. SIAM J Optim 6:418–445

    Article  MathSciNet  MATH  Google Scholar 

  8. Cui J-Y, Wen F, Tang X-O (2008) Real time Google and live image search re-ranking. In: ACM multimedia conference, pp 729–732

  9. Fischler M, Bolles R (1981) Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. CACM 24(6):381–395

    Article  MathSciNet  Google Scholar 

  10. Flickner M, Sawhney H, Niblack W, Ashley J, Huang Q, Dom B, Gorkani M, Hafner J, Lee D, Petkovic D, Steele D, Yanker P (1995) Query by image and video content: the QBIC system. IEEE Computer 28(9):23–32

    Article  Google Scholar 

  11. Forsyth D, Ponce J (2002) Computer vision, a modern approach, 720. Prentice Hall Professional Technical Reference

  12. Goldberger J, Gordon S, Greenspan H (2003) An efficient image similarity measure based on approximations of KL-divergence between two gaussian mixtures. In: ICCV, pp 487–493

  13. Gupta M (1996) The Virage image search engine: an open framework for image management. In: Proc SPIE, vol 2670, pp 76–87

  14. Hartley R, Zisserman A (2004) Multiple view geometry in computer vision, 2nd edn. Cambridge University Press

  15. Hua K, Vu K, Oh J (1999) Sammatch: a flexible and efficient sampling-based image retrieval technique for large image databases. In: ACM Multimedia Conference (MM), pp 225–234

  16. Jegou H, Douze M, Schmid C (2008) Hamming embedding and weak geometric consistency for large scale image search. ECCV 5302:304–317

    Google Scholar 

  17. Jegou H, Douze M, Schmid C (2010) Improving bag-of-features for large scale image search. IJCV 87:316–336

    Article  Google Scholar 

  18. Jiang Y-G, Ngo C-W, Yang J (2007) Towards optimal bag-of-features for object categorization and semantic video retrieval. In: The 6th ACM international conference on image and video retrieval (CIVR), pp 494–501

  19. Jing F, Li M-J, Zhang H-J, Zhang B (2005) A unified framework for image retrieval using keyword and visual features. Image Process 14(7):979–989

    Article  Google Scholar 

  20. Joachims T (2002) Learning to classify text using support vector machines: methods, theory, and algorithms. Comput Linguist 29(4):655–661

    Google Scholar 

  21. Kato T (1992) Database architecture for content-based image retrieval. In: Proc SPIE Image storage and retrieval systems, vol 1662, pp 112–123

  22. Kanungo T, Mount DM, Netanyahu NS, Piatko CD, Silverman R, Wu AY (2002) An efficient k-means clustering algorithm: analysis and implementation. IEEE Trans Pattern Anal Mach Intell 24(7):881–892

    Article  Google Scholar 

  23. Li F-F, Perona P (2005) A Bayesian hierarchical model for learning natural scene categories. In: IEEE computer society conference on Computer Vision and Pattern Recognition (CVPR), vol 2, pp 524–531

  24. Lowe D (2004) Distinctive image features from scale-invariant keypoints. IJCV 60(2):91–110

    Article  Google Scholar 

  25. Mikolajczyk K, Schmid C (2004) Scale and affine invariant interest point detectors. IJCV 60(1):63–86

    Article  Google Scholar 

  26. Niblack W, Barber R, Equitz W, Flickner MD, Glasman EH, Petkovic D, Yanker P, Faloutsos C, Taubin G (1993) QBIC project: querying images by content, using color, texture, and shape. In: Proc SPIE, vol 1908, pp 173–187

  27. Nister D, Stewenius H (2006) Scalable recognition with a vocabulary tree. In: IEEE conference on Computer Vision and Pattern Recognition (CVPR), pp 2161–2168

  28. Philbin J, Chum O, Isard M, Sivic J, Zisserman A (2007) Object retrieval with large vocabularies and fast spatial matching. In: IEEE conference on Computer Vision and Pattern Recognition (CVPR), pp 1–8

  29. Sadek S, Al-Hamadi A, Michaelis B, Sayed U (2009) An efficient approach for region-based image classification and retrieval. CCIS 61:56–64

    Google Scholar 

  30. Salton G, Buckley C (1988) Term-weighting approaches in automatic text retrieval. Inf Process Manag 24(5):513–523

    Article  Google Scholar 

  31. Tian Q, Wu Y, Thomas SH (2000) Combine user defined region-of-interest and spatial layout for image retrieval. Image Process 3:746–749

    Google Scholar 

  32. Torr P, Zisserman A, Maybank S (1998) Robust detection of degenerate configurations while estimating the fundamental matrix. CVIU 71(3):312–333

    Google Scholar 

  33. Vu K, Hua K, Tavanapong W (2003) Image retrieval based on regions of interest. IEEE Trans Knowl Data Eng 15(4):1045–1049

    Article  Google Scholar 

  34. Wallach HM (2006) Topic modeling: beyond bag-of-words. In: The 23rd International Conference on Machine Learning (ICML)

  35. Wang Z, Jia K, Liu P (2008) A novel image retrieval algorithm based on ROI by using SIFT feature matching. In: International conference on multimedia and information technology, pp 338–341

  36. Worring M, Smeulders AWM, Santini S (2000) Interaction in content-based image retrieval: an evaluation of the state of the art. In: VISUAL’2000, vol 1929, pp 26–36

  37. Wu Z, Ke Q, Isard M, Sun J (2009) Bundling features for large scale partial-duplicateWeb image search. In: IEEE conference on Computer Vision and Pattern Recognition (CVPR), pp 25–32

  38. Yang J, Jiang YG, Hauptmann AG (2007) Evaluating bag-of-visual-words representations in scene classification. In: International workshop on Multimedia Information Retrieval (MIR)

  39. Zhang J, Yoo C-W, Ha S-W (2007) ROI Based natural image retrieval using color and texture feature. In: Fourth international conference on Fuzzy Systems and Knowledge Discovery (FSKD), vol 4, pp 740–744

  40. Zhao W, Jiang Y-G, Ngo C-W (2006) Keyframe retrieval by keypoints: can point-to-point matching help? In: The 5th ACM international Conference on Image and Video Retrieval (CIVR), pp 72–81

  41. Zhou Q (2005) Content-based image retrieval based on ROI detection and relevance feedback. Multimed Tools Appl 27:251–281

    Article  Google Scholar 

Download references

Acknowledgements

This work is supported in part by National High Tech. Project No.2009AA01Z409, National Natural Science Foundation of China (NSFC) Project No.60903 121, and the National 973 Project No.2007CB311002. We would like to thank Prof. Tian Qi for providing database.

Author information

Authors and Affiliations

  1. Xi’an Jiaotong University, Xianning West Road No.28, Xi’an, Shaanxi, 710049, China

    Zhe Wang, Guizhong Liu & Yang Yang

Authors
  1. Zhe Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Guizhong Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yang Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Guizhong Liu.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Wang, Z., Liu, G. & Yang, Y. A new ROI based image retrieval system using an auxiliary Gaussian weighting scheme. Multimed Tools Appl 67, 549–569 (2013). https://doi.org/10.1007/s11042-012-1059-3

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-012-1059-3

Keywords

Search

Navigation