Perceptual Metrics for Image Database Navigation

  • Yossi Rubner
  • Carlo Tomasi

Table of contents

  1. Front Matter
    Pages i-xxiii
  2. Yossi Rubner, Carlo Tomasi
    Pages 1-11
  3. Yossi Rubner, Carlo Tomasi
    Pages 13-28
  4. Yossi Rubner, Carlo Tomasi
    Pages 29-38
  5. Yossi Rubner, Carlo Tomasi
    Pages 39-68
  6. Yossi Rubner, Carlo Tomasi
    Pages 69-78
  7. Yossi Rubner, Carlo Tomasi
    Pages 79-90
  8. Yossi Rubner, Carlo Tomasi
    Pages 91-102
  9. Yossi Rubner, Carlo Tomasi
    Pages 103-106
  10. Back Matter
    Pages 107-137

About this book

Introduction

The increasing amount of information available in today's world raises the need to retrieve relevant data efficiently. Unlike text-based retrieval, where keywords are successfully used to index into documents, content-based image retrieval poses up front the fundamental questions how to extract useful image features and how to use them for intuitive retrieval. We present a novel approach to the problem of navigating through a collection of images for the purpose of image retrieval, which leads to a new paradigm for image database search. We summarize the appearance of images by distributions of color or texture features, and we define a metric between any two such distributions. This metric, which we call the "Earth Mover's Distance" (EMD), represents the least amount of work that is needed to rearrange the mass is one distribution in order to obtain the other. We show that the EMD matches perceptual dissimilarity better than other dissimilarity measures, and argue that it has many desirable properties for image retrieval. Using this metric, we employ Multi-Dimensional Scaling techniques to embed a group of images as points in a two- or three-dimensional Euclidean space so that their distances reflect image dissimilarities as well as possible. Such geometric embeddings exhibit the structure in the image set at hand, allowing the user to understand better the result of a database query and to refine the query in a perceptually intuitive way.

Keywords

Navigation algorithms computer science computer vision data mining database digital libraries display distance electrical engineering image processing mouse programming psychophysics scaling

Authors and affiliations

  • Yossi Rubner
    • 1
  • Carlo Tomasi
    • 1
  1. 1.Stanford UniversityUSA

Bibliographic information

  • DOI https://doi.org/10.1007/978-1-4757-3343-3
  • Copyright Information Springer-Verlag US 2001
  • Publisher Name Springer, Boston, MA
  • eBook Packages Springer Book Archive
  • Print ISBN 978-1-4419-4863-2
  • Online ISBN 978-1-4757-3343-3
  • Series Print ISSN 0893-3405
  • About this book