Skip to main content
SpringerLink
Log in

An object-based image retrieval system for digital libraries

  • Regular Paper
  • Published:
Multimedia Systems Aims and scope Submit manuscript

Abstract

A novel approach to clustering for image segmentation and a new object-based image retrieval method are proposed. The clustering is achieved using the Fisher discriminant as an objective function. The objective function is improved by adding a spatial constraint that encourages neighboring pixels to take on the same class label. A six-dimensional feature vector is used for clustering by way of the combination of color and busyness features for each pixel. After clustering, the dominant segments in each class are chosen based on area and used to extract features for image retrieval. The color content is represented using a histogram, and Haar wavelets are used to represent the texture feature of each segment. The image retrieval is segment-based; the user can select a query segment to perform the retrieval and assign weights to the image features. The distance between two images is calculated using the distance between features of the constituent segments. Each image is ranked based on this distance with respect to the query image segment. The algorithm is applied to a pilot database of natural images and is shown to improve upon the conventional classification and retrieval methods. The proposed segmentation leads to a higher number of relevant images retrieved, 83.5% on average compared to 72.8 and 68.7% for the k-means clustering and the global retrieval methods, respectively.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Rui, Y., Huang, T.S., Chang, S.F.: Image retrieval: Past, present, and future. In: Proceedings of ISMIP (December 1997)

  2. Tang, J., Avula, S.R., Acton, S.T.: DIRECT: A decentralized image retrieval system for the national STEM digital library. Inform. Technol. Libr. 23(1), 9–15 (2004)

  3. Avula, S.R., Tang, J., Acton, S. T.: Image retrieval using segmentation. In: Proceedings of the IEEE Systems and Information Engineering Design Symposium, Charlottesville, Virginia (April 2003)

  4. Hartigan, J.: Clustering Algorithms Wiley, New York (1975)

    MATH  Google Scholar 

  5. Duda, R.O., Hart, P.E.: Pattern Classification and Scene Analysis, Wiley (1973)

  6. Porter, R., Cangajarah, N.: A robust automatic clustering scheme for image segmentation using wavelets. IEEE Trans. Image Process. 5(4), 662–665 (1996)

    Google Scholar 

  7. Haralick, R.M., Shapiro, L.G.: Computer and Robot Vision, vol. 1. Addison Wesley Publishing Co., New York (1993)

    Google Scholar 

  8. Sahoo, P.K., Soltani, S., Wong, A.K.C.: A survey of thresholding techniques. Comput. Vis. Graph. Image Process. 41, 233—260 (1988)

    Article  Google Scholar 

  9. Acton, S.T., Mukherjee, D.P.: Scale space classification using area morphology. IEEE Trans. Image Process. 9, 623–635 (2000)

    Article  Google Scholar 

  10. Beucher, S., Lantuejoul, C.: Use of watersheds in contour detection. In: Proceedings of the International Workshop on Image Processing, Real-Times Edge and Motion Detection/Estimation. Rennes, France (September 17–21, 1979)

  11. Zhu, S.C., Yuille, A.: Region competition: Unifying snakes, region growing and Bayes/MDL for multiband and image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 18(9), 884–900 (1996)

    Google Scholar 

  12. Partha, P.M., Mukherjee, D.P., Acton, S.T.: Agglomerative clustering for image segmentation. In: Proceedings of IEEE International Conference on Image Processing, Rochester, New York (September 22–25 2002)

  13. Sethian, J.A.: Level Set Methods and Fast Marching Methods. Cambridge University Press (2000)

  14. Kass, M., Witkin, A., Terzopoulos, D.: Snakes – Active contour models. Int. J. Comput. Vis. 1(4), 321–331 (1987)

    Google Scholar 

  15. MacQueen, J.: Some methods for classification and analysis of multivariate observations. In: Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability, vol. 1, pp. 281–297. Berkeley, University of California Press (1967)

  16. Ray, S., Turi, R.H.: Determination of number of clusters in k-means clustering and application in color image segmentation. In: Proceedings of the 4th International Conference on Advances in Pattern Recognition and Digital Techniques (ICAPRDT'99), pp. 137–143 (1999)

  17. Berkhin, P.: Survey of clustering data mining techniques. Technical report, Accrue Software (2002)

  18. Liew, A.W.C., Leung, S.H., Lau, W.H.: Fuzzy image clustering incorporating spatial continuity. IEEE Proc. Visual Image Signal Process. 147(2), 185–192 (2000)

    Google Scholar 

  19. Flickner, M., Sawhney, H., Niblack, W., Ashley, J.: Query by image and video content: The QBIC system. IEEE Comput. 28, 23-33 (1995)

    Google Scholar 

  20. Bach, J.R., Fuller, C., Gupta, A., Hampapur, A., Horowitz, B., Humphrey, R., Jain, R.C., Shu, C.: Virage image search engine: an open framework for image management, In: Proceedings of SPIE (Storage and Retrieval for Image and Video Databases IV), 2670, pp. 76–87 (1996)

  21. Smith, J.R., Chang, S.F.: VisualSEEK. A Fully Automated Content Based Image Query System. ACM Multimedia, Boston, MA (1996)

  22. Ma, W.Y., Manjunath, B.S.: Netra: a tool box for navigating large image databases. In: Proceedings of IEEE International Conference on Image Processing (1997)

  23. Swain, M.J., Ballard, D.H.: Indexing via color histograms. In: Proceedings of the Third International Conference on Computer Vision (December 1990)

  24. Markus, A.S., Markus, O.: Similarity of color images. In: SPIE Proceedings, vol. 2420 (1995)

  25. Tay, P., Havelicek, J.P., De Brunner, V.: Discrete wavelet transform with optimal joint localization for determining the number of image texture segments. In: Proceedings of IEEE International Conference on Image Processing (2002)

  26. Manjunath, B.S., Ma, W.Y.: Texture features for browsing and retrieval of image data. IEEE Trans. Pattern Anal. Mach. Intell. (Special Issue on Digital Libraries) 18(8), 837–842 (1996)

    Google Scholar 

  27. Tang, J., Zhang, Y.G.: A perfect reconstruction, size-limited filter bank for orthogonal, wavelet-based, finite-signal subband processing. Digital Signal Process. 11(4), 304–328 (2001)

    Google Scholar 

  28. Shapiro, J.M.: Embedded image coding using zerotrees of wavelet coefficients. IEEE Trans. Signal Process. 41, 3445–3462 (1993)

    Article  MATH  Google Scholar 

  29. Do, M.N., Vetterli, M.: Wavelet-based texture retrieval using generalized Gaussian density and Kullback-Leibler distance. IEEE Trans. Image Process. 11, 146–158 (2002)

    Article  MathSciNet  Google Scholar 

  30. Tang, J., Action, S.T.: Locating human faces in a complex background including non-face skin colors. J. Electron. Imaging 12(3), 423–430 (2003)

    Google Scholar 

  31. http://www.cs.washington.edu/research/imagedatabase/groundtruth/

  32. Cassidy, D., Carthy, J., Drummond, A., Dunnion, J., Sheppard, J.: The use of data mining in the design and implementation of an incident report retrieval system. In: Proceedings of the IEEE Systems and Information Engineering Design Symposium, Charlottesville, Virginia (April 2003)

Download references

Author information

Authors and Affiliations

  1. Department of Electrical and Computer Engineering, Virginia Image and Video Analysis, University of Virginia, 351 McCormick Road, Charlottesville, VA, 22904-4743, USA

    Sridhar R. Avula, Jinshan Tang & Scott T. Acton

Authors
  1. Sridhar R. Avula
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jinshan Tang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Scott T. Acton
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Scott T. Acton.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Avula, S.R., Tang, J. & Acton, S.T. An object-based image retrieval system for digital libraries. Multimedia Systems 11, 260–270 (2006). https://doi.org/10.1007/s00530-006-0010-8

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00530-006-0010-8

Keywords

Search

Navigation