Abstract
Visual appearance is an important part of judging image similarity. We readily classify objects that share a visual appearance as similar, and reject those that do not. Our hypothesis is that image intensity surface features can be used to compute appearance similarity. In the first part of this paper, a technique to compute global appearance similarity is described. Images are filtered with Gaussian derivatives to compute two features, namely, local curvatures and orientation. Global image similarity is deduced by comparing distributions of these features. This technique is evaluated on a heterogeneous collection of 1600 images. The results support the hypothesis in that images similar in appearance are ranked close together. In the second part of this paper, appearance-based retrieval is applied to trademarks. Trademarks are generally binary images containing a single mark against a texture-less background. While moments have been proposed as a representation, we find that appearance-based retrieval yields better results. Two small databases containing 2,345 parametrically generated shapes, and 10,745 trademarks are used for evaluation. A retrieval system that combines a trademark database containing 68,000 binary images with textual information is discussed. Text and appearance features are jointly (or independently) queried to retrieve images.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Bach, J., Fuller, C., and et al (1996). The Virage image search engine: An open framework for image management. In SPIE Conference on Storage and Retrieval for Still Image and Video Databases IV, pages 133–156.
Callan, J. P., Croft, W. B., and Harding, S. M. (1992). The INQUERY retrieval system. In Proceedings of the 3rd International Conference on Database and Expert System Applications (DEXA), pages 78–83.
Cover, T. M. and Thomas, J. A. (1991). Elements of Information Theory. Wiley Series in Telecommunications. John Wiley and Sons.
Deerwester, S., Dumais, S., Fumas, G., Landauer, T., and Harshman, R. (1990). Indexing by Latent Semantic Analysis. Journal of the American Society for Information Science, 41(6):391–407.
Dorai, C. and Jain, A. (1995). Cosmos-a representation scheme for free form surfaces. In Proc. 5th International Conference on Computer Vision, pages 1024–1029.
Eakins, J., Shield, K., and Boardman, J. (1996). Artisan: A Shape Retrieval System Based on Boundary Family Indexing. In Sethi, J. and Jain, R. e., editors, Storage and Retrieval for Image Video and Databases IV, volume 2670 of Proc. SPIE, pages 17–28.
Flickner, M., Sawhney, H., Niblack, W., Ashley, J., Huang, Q., Dom, B., Gorkani, M., Lee, D., Petkovix, D., Steele, D., and Yanker, P. (Sept. 1995). Query by image and video content: The QBIC system. IEEE Computer Magazine, pages 23–30.
Florack, L. M. J. (1993). The Syntactic Structure of Scalar Images. PhD thesis, University of Utrecht.
Freeman, W. T. and Adelson, E. H. (1991). The design and use of steerable filters. IEEE Transactions on Pattern Analysis and Machine tntelligence (PAMI), 13(9):891–906.
Gorkani, M. M. and Picard, R. W. (1994). Texture orientation for sorting photos ‘at a glance’. In Proc. 12th International Conference on Pattern Recognition, pages A459–A464.
Hu, M. K. (1962). Visual pattern recognition by moment invariants. IRE Transactions of Information Theory, IT-8:179–187.
Jain, A. K. and Vailaya, A. (1998). Shape-based retrieval: A case study with trademark image databases. Pattern Recognition, 31(9):1369–1390.
Kato, T. (1992). Database architecture for content-based image retrieval. In Jambardino, A. A. and Niblack, W. R., editors, Image Storage and Retrieval Systems, 2185, pages 112–123. Proc. SPIE.
Kirby, M. and Sirovich, L. (1990). Application of the Kruhnen-loeve procedure for the characterization of human faces. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 12(1): 103–108.
Koenderink, J. J. (1984). The structure of images. Biological Cybernetics, 50:363–396.
Koenderink, J. J. and Doom, A. J. V. (1992). Surface shape and curvature scales. Image and Vision Computing, 10(8).
Koenderink, J. J. and van Doom, A. J. (1987). Representation of local geometry in the visual system. Biological Cybernetics, 55:367–375.
Lindeberg, T. (1994). Scale-Space Theory in Computer Vision. Kluwer Academic Publishers.
Liu, F. and Picard, R. W. (1996). Periodicity, directionality, and randomness: Wold features for image modeling and retrieval. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 18(7):722–733.
Ma, W. Y. and Manjunath, B. S. (1996). Texture-based pattern retrieval from image databases. Multimedia Tools and Applications, 2(1):35–51
Mahalanobis, P. C. (1936). On the generalized distance in statistics. Proceedings of the National Institute of Science, India, 12:49–55.
Methre, B., Kankanhalli, M., and Lee, W. (1997). Shape Measures for Content Based Image Retrieval: A Comparison. Information Processing and Management, 33(3):319–337.
Mokhtarian, F., Abbasi, S., and Kittler, J. (1996). Efficient and robust retrieval by shape content through curvature scale-space. In First International Workshop on Image Databases and Multi-media Search.
Nastar, C., Moghaddam, B., and Pentland, A. (1996). Generalized image matching: statistically learning of physically-based deformations. In Buxton, B. and Cipolla, R., editors, Computer Vision-ECCV’ 96, volume 1 of Lecture Notes in Computer Science, Cambridge, U.K. 4th European Conference on Computer Vision, Springer.
Nayar, S. K., Murase, H., and Nene, S. A. (1996). Parametric appearance representation. In Early Visual Learning. Oxford University Press.
Pentland, A., Picard, R. W., and Sclaroff, S. (1994). Photobook: Tools for content-based manipulation of databases. In Proceedings of Storage and Retrieval for Image and Video Databases II, SPIE, volume 185, pages 34–47.
Ravela, S. and Manmatha, R. (1997). Image retrieval by appearance. In Proceedings of the 20th International Conference on Research and Development in Information Retrieval (SIGIR’97), pages 278–285.
Reiss, T. H. (1993). Recognizing Planar Objects Using lnvariant Image Features, volume 676 of Lecture Notes in Computer Science. Springer-Verlag.
Schiele, B. and Crowley, J. L. (1996). Object recognition using multidimensional receptive field histograms. In Proc. 4th European Conference on Computer Vision, Cambridge, U.K.
Schmid, C. and Mohr, R. (1996). Combining greyvalue invariants with local constraints for object recognition. In Proceedings of the Computer Vision and Pattern Recognition Conference, pages 872–877.
Sclaroff, S. (1996). Encoding deformable shape categories for efficient content-based search. In Proceedings of the First International Workshop on Image Databases and Multi-Media Search.
Swain, M. and Ballard, D. (1991). Color indexing. International Journal of Computer Vision, 7(1):11–32.
Swets, D. L. and Weng, J. (1996). Using discriminant eigen features for retrieval. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 18:831–836.
ter Har Romeny, B. M. (1994). Geometry Driven Diffusion in Computer Vision. Kluwer Academic Publishers.
Turk, M. and Pentland, A. (1991). Eigenfaces for recognition. Journal of Cognitive NeuroScience, 3:71–86.
van Rijsbergen, C. J. (1979). Information Retrieval. Butterworths.
Witkin, A. P. (1983). Scale-space filtering. In Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI), pages 1019–1023.
Wu, J., Mehtre, B., Gao, Y., Lam, P., and Narasimhalu, A. (1994). Star-a multimedia database system for trademark registration. In Lecture Notes in Computer Science: Application of Database, volume 819, pages 109–122.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Kluwer Academic Publishers
About this chapter
Cite this chapter
Ravela, S., Luo, C. (2002). Appearance-Based Global Similarity Retrieval of Images. In: Croft, W.B. (eds) Advances in Information Retrieval. The Information Retrieval Series, vol 7. Springer, Boston, MA. https://doi.org/10.1007/0-306-47019-5_10
Download citation
DOI: https://doi.org/10.1007/0-306-47019-5_10
Publisher Name: Springer, Boston, MA
Print ISBN: 978-0-7923-7812-9
Online ISBN: 978-0-306-47019-6
eBook Packages: Springer Book Archive