Image Indexing and Retrieval Using Visual Terms and Text-Like Weighting

  • Giuseppe Amato
  • Pasquale Savino
  • Vanessa Magionami
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4877)


Image similarity is typically evaluated by using low level features such as color histograms, textures, and shapes. Image similarity search algorithms require computing similarity between low level features of the query image and those of the images in the database. Even if state of the art access methods for similarity search reduce the set of features to be accessed and compared to the query, similarity search has still an high cost.

In this paper we present a novel approach which processes image similarity search queries by using a technique that takes inspiration from text retrieval. We propose an approach that automatically indexes images by using visual terms chosen from a visual lexicon.

Each visual term represents a typology of visual regions, according to various criteria. The visual lexicon is obtained by analyzing a training set of images, to infer which are the relevant typology of visual regions. We have defined a weighting and matching schema that are able respectively to associate visual terms with images and to compare images by means of the associated terms.

We show that the proposed approach do not lose performance, in terms of effectiveness, with respect to other methods existing in literature, and at the same time offers higher performance, in terms of efficiency, given the possibility of using inverted files to support similarity searching.


Image Retrieval Query Image Color Histogram Text Retrieval Image Indexing 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Amato, G., Rabitti, F., Savino, P., Zezula, P.: Region proximity in metric spaces and its use for approximate similarity search. ACM Transactions on Information Systems (TOIS) 21(2), 192–227 (2003)CrossRefGoogle Scholar
  2. 2.
    Ciaccia, P., Patella, M., Zezula, P.: M-tree: An efficient access method for similarity search in metric spaces. In: Jarke, M., Carey, M.J., Dittrich, K.R., Lochovsky, F.H., Loucopoulos, P., Jeusfeld, M.A. (eds.) VLDB 1997. Proceedings of 23rd International Conference on Very Large Data Bases, Athens, Greece, August 25-29, 1997, pp. 426–435. Morgan Kaufmann, San Francisco (1997)Google Scholar
  3. 3.
    Fauqueur, J., Boujemaa, N.: Mental image search by boolean composition of region categories. Multimedia Tools and Applications 31(1), 95–117 (2004)CrossRefGoogle Scholar
  4. 4.
    Guttman, A.: R-trees: A dynamic index structure for spatial searching. In: Proceedings of the 1984 ACM SIGMOD International Conference on Management of Data, Boston, MA, pp. 47–57. ACM Press, New York (1984)Google Scholar
  5. 5.
    Hafner, J.L., Sawhney, H.S., Equitz, W., Flicknera, M., Niblack, W.: Efficient color histogram indexing for quadratic form distance functions. IEEE Transactions on Pattern Analysis and Machine Intelligence 17(7), 729–736 (1995)CrossRefGoogle Scholar
  6. 6.
    Lei Zhu, A.Z.: Theory of keyblock-based image retrieval. ACM Trans. Inf. Syst. 20(2), 224–257 (2002)CrossRefGoogle Scholar
  7. 7.
    Mezaris, V., Kompatsiaris, I., Strintzis, M.G.: Still image segmentation tools for object-based multimedia applications. International Journal of Pattern Recognition and Artificial Intelligence 18(4), 701–725 (2004)CrossRefGoogle Scholar
  8. 8.
    Niblack, W., Barber, R., Equitz, W., Flickner, M., Glasman, E.H., Petkovic, D., Yanker, P., Faloutsos, C., Taubin, G.: The qbic project: Querying images by content, using color, texture, and shape. In: SPIE 1993. Proceedings of Storage and Retrieval for Image and Video Databases, pp. 173–187 (1993)Google Scholar
  9. 9.
    Salembier, P., Sikora, T., Manjunath, B.: Introduction to MPEG-7: Multimedia Content Description Interface. John Wiley & Sons, Inc., New York, NY, USA (2002)Google Scholar
  10. 10.
    Salton, G., McGill, M.J.: Introduction to Modern Information Retrieval. McGraw-Hill Book Company, New York (1983)MATHGoogle Scholar
  11. 11.
    Smith, J.R.: Integrated Spatial and Feature Image Systems: Retrieval, Analysis, and compression. PhD thesis, Graduate School of Arts and Sciences, Columbia University (1997)Google Scholar
  12. 12.
    Wang, J.Z., Li, J., Wiederhold, G.: SIMPLIcity. IEEE Transactions on Pattern Analysis and Machine Intelligence 23(9), 947–963 (2001)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2007

Authors and Affiliations

  • Giuseppe Amato
    • 1
  • Pasquale Savino
    • 1
  • Vanessa Magionami
    • 1
  1. 1.ISTI-CNR, PisaItaly

Personalised recommendations