Multimedia Tools and Applications

, Volume 47, Issue 3, pp 599–629

Building a web-scale image similarity search system

  • Michal Batko
  • Fabrizio Falchi
  • Claudio Lucchese
  • David Novak
  • Raffaele Perego
  • Fausto Rabitti
  • Jan Sedmidubsky
  • Pavel Zezula
Article

DOI: 10.1007/s11042-009-0339-z

Cite this article as:
Batko, M., Falchi, F., Lucchese, C. et al. Multimed Tools Appl (2010) 47: 599. doi:10.1007/s11042-009-0339-z

Abstract

As the number of digital images is growing fast and Content-based Image Retrieval (CBIR) is gaining in popularity, CBIR systems should leap towards Web-scale datasets. In this paper, we report on our experience in building an experimental similarity search system on a test collection of more than 50 million images. The first big challenge we have been facing was obtaining a collection of images of this scale with the corresponding descriptive features. We have tackled the non-trivial process of image crawling and extraction of several MPEG-7 descriptors. The result of this effort is a test collection, the first of such scale, opened to the research community for experiments and comparisons. The second challenge was to develop indexing and searching mechanisms able to scale to the target size and to answer similarity queries in real-time. We have achieved this goal by creating sophisticated centralized and distributed structures based purely on the metric space model of data. We have joined them together which has resulted in an extremely flexible and scalable solution. In this paper, we study in detail the performance of this technology and its evolvement as the data volume grows by three orders of magnitude. The results of the experiments are very encouraging and promising for future applications.

Keywords

Similarity search Content-based image retrieval Metric space MPEG-7 descriptors Peer-to-peer search network 

Copyright information

© Springer Science+Business Media, LLC 2009

Authors and Affiliations

  • Michal Batko
    • 1
  • Fabrizio Falchi
    • 2
  • Claudio Lucchese
    • 2
  • David Novak
    • 1
  • Raffaele Perego
    • 2
  • Fausto Rabitti
    • 2
  • Jan Sedmidubsky
    • 1
  • Pavel Zezula
    • 1
  1. 1.Masaryk UniversityBrnoCzech Republic
  2. 2.ISTI-CNRPisaItaly

Personalised recommendations