Skip to main content

Advertisement

SpringerLink
Log in

Capturing high-level image concepts via affinity relationships in image database retrieval

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In this paper, we present a mechanism called Markov Model Mediator (MMM) to facilitate the efficient and effective capturing of high-level image concepts in content-based image retrieval (CBIR). MMM serves as the retrieval engine of the CBIR system and uses affinity-based similarity measures. This mechanism is effective in capturing subjective user concepts in that it not only takes into consideration the global image features, but also learns the high-level concepts of the images from the history of user access patterns and access frequencies on the images in the image database, which differentiates it from the common methods in CBIR. The advantage of our proposed mechanism is that it exploits the richness in the structured description of visual contents as well as the relative affinity relationships among the images. Consequently, it provides the capability to bridge the gap between the low-level features and the high-level concepts. This mechanism is also efficient in that it integrates Principal Component Analysis (PCA) to significantly reduce the image search space at a low cost before performing exact similarity matching. An off-line training subsystem for this framework was implemented and integrated into our system. The experimental results demonstrate that MMM can effectively capture user’s high-level concept more quickly.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Aksoy S, Haralick RM (2000) A weighted distance approach to relevance feedback. In: Proceedings of the international conference on pattern recognition. Elsevier, New York, pp 812–815

    Google Scholar 

  2. Carson, C et al (2002) Blobworld: image segmentation using expectation–maximization and its application to image querying. IEEE Trans Pattern Anal Mach Intell 24(8):1026–1038

    Article  Google Scholar 

  3. Chen S-C, Sista S, Shyu M-L, Kashyap RL (2000) An indexing and searching structure for multimedia database systems. In: Proceedings of IS&T/SPIE conference on storage and retrieval for media databases, San Jose, California, pp 262–270

  4. Chen S-C, Shyu M-L, Zhao N, Zhang C (2003) An affinity-based image retrieval system for multimedia authoring and presentation. In: Proceedings of 11th ACM international conference on multimedia (MM’03), Berkeley, California, pp 446–447, 2–8 November 2003

  5. Chen Y, Wang JZ (2002) A region-based fuzzy feature matching approach to content-based image retrieval. IEEE Trans Pattern Anal Mach Intell 24:1252–1267

    Article  Google Scholar 

  6. Cheng HD, Sun Y (2001 December) A hierarchical approach to color image segmentation using homogeneity. IEEE Trans Image Process 9(12):2071–2082

    Google Scholar 

  7. Cox IJ, Minka TP, Papathomas TV, Yianilos PN (2000) The Bayesian image retrieval system, PicHunter: theory, implementation, and psychophysical experiments. IEEE Trans Image Process 9(1):20–27

    Article  Google Scholar 

  8. Deerwester S, Dumais ST, Landauer TK, Furnas GW, Harshman RA (1990) Indexing by latent semantic analysis. J. Soc. Inf. Sci. 41(6):391–407

    Article  Google Scholar 

  9. Fauqueur J, Boujemaa N (2002) Image retrieval by regions: Coarse segmentation and fine color description. Visual Information and Information Systems, pp 24–35

  10. Guttman A (1984 June) R-tree: A dynamic index structure for spatial search. In: Proceedings of ACM SIGMOD, Boston, Massachusetts, pp 47–57

  11. Huang X, Chen S-C, Shyu M-L (2003) Incorporating real-valued multiple instance learning into relevance feedback for image retrieval. In: Proceedings of the IEEE international conference on multimedia & expo (ICME), vol. 1, Baltimore, Maryland, pp 321–324, 6–9 July 2003

  12. Jing F, Li M, Zhang H-J, Zhang B (2002) An effective region-based image retrieval framework. In: Proceedings of the 2002 ACM workshops on multimedia, Juan-les-Pins, France, pp 456–465

  13. Jobson JD (1992) Applied multivariate data analysis volume II: Categorical and multivariate methods. Springer, Berlin Heidelberg New York

    MATH  Google Scholar 

  14. Johnson RA, Wichern DW (1998) Applied multivariate statistical analysis, 4th edn. Prentice-Hall, New Jersey

    Google Scholar 

  15. Jolliffe IT (2002) Principal component analysis, 2nd edn. Springer, Berlin Heidelberg New York

    MATH  Google Scholar 

  16. Lin HC, Wang LL, Yang SN (1997) Color image retrieval based on hidden Markov models. IEEE Trans Image Process 6(2):332–339

    Article  Google Scholar 

  17. Lu Y, Hu CH, Zhu XQ, Zhang HJ, Yang Q (2000) A unified framework for semantics and feature based relevance feedback in image retrieval systems. In: Proceedings of the 8th ACM international conference on multimedia, Los Angeles, California, pp 31–37

  18. Ma W-Y, Zhang HJ (1999) Content-based Image Indexing and Retrieval. Handbook of multimedia computing, Chapter 13, CRC Press, Boca Raton, Florida

    Google Scholar 

  19. Natsev A, Rastogi R, Shim K (2004) WALRUS: A similarity retrieval algorithm for image databases. IEEE Trans Knowl Data Eng 16(3):301–316

    Article  Google Scholar 

  20. Ortega M, Rui Y et al (1998) Supporting ranked boolean similarity queries in MARS. IEEE Trans Knowl Data Eng 10(6):905–925

    Article  Google Scholar 

  21. Rabiner LR, Huang BH (1986 January) An introduction to hidden Markov models. IEEE ASSP Mag 3(1):4–16

    Article  Google Scholar 

  22. Rui Y, Huang TS (1999) A novel relevance feedback technique in image retrieval. In: Proceedings of the 7th ACM international conference on multimedia, Part 2, Orlando, Florida, pp 67–70

  23. Shyu M-L, Chen S-C, Kashyap RL (2000) A probabilistic-based mechanism for video database management systems. In: Proceedings of IEEE international conference on multimedia and expo (ICME’00), New York, USA, pp 467–470

  24. Shyu M-L, Chen S-C, Haruechaiyasak C, Shu C-M, Li S-T (2001) Disjoint web document clustering and management in electronic commerce. In: Proceedings of the 7th international conference on distributed multimedia systems (DMS’01), Tamkang University, Taipei, Taiwan, pp 494–497

    Google Scholar 

  25. Shyu M-L, Chen S-C, Rubin, SH (2004) Stochastic clustering for organizing distributed information sources. IEEE Trans Syst Man Cybern, Part B, Cybern 34(5):2035–2047

    Article  Google Scholar 

  26. Su Z, Li S, Zhang H (2001) Extraction of feature subspaces for content-based retrieval using relevance feedback. In: Proceedings of the 9th ACM international conference on multimedia (MM’01), Ottawa, Canada, pp 98–106

  27. Wiederhold G (March 1992) Mediators in the architecture of future information systems. IEEE Computers 25:38–49

    Google Scholar 

  28. Zhang DS, Lu G (2002 August) Generic fourier descriptors for shape-based image retrieval. In: Proceedings of IEEE international conference on multimedia and expo (ICME’02), vol. 1. 562 Lausanne, Switzerland, pp 425–428

  29. Zhang Q, Goldman SA, Yu W, Fritts J (2002 July) Content-based image retrieval using multiple-instance learning. In: Proceedings of the 19th international conference on machine learning, Sydney, Australia, pp 682–689

Download references

Author information

Authors and Affiliations

  1. Department of Electrical and Computer Engineering, University of Miami, Coral Gables, FL, 33124, USA

    Mei-Ling Shyu & Kanoksri Sarinnapakorn

  2. Distributed Multimedia Information System Laboratory, School of Computer Science, Florida International University, Miami, FL, 33199, USA

    Shu-Ching Chen & Min Chen

  3. Department of Computer and Information Science, University of Alabama at Birmingham, Birmingham, AL, 35294, USA

    Chengcui Zhang

Authors
  1. Mei-Ling Shyu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Shu-Ching Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Min Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Chengcui Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Kanoksri Sarinnapakorn
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mei-Ling Shyu.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Shyu, ML., Chen, SC., Chen, M. et al. Capturing high-level image concepts via affinity relationships in image database retrieval. Multimed Tools Appl 32, 73–92 (2007). https://doi.org/10.1007/s11042-006-0059-6

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-006-0059-6

Keywords

Search

Navigation