Table of contents

  1. Front Matter
    Pages i-xviii
  2. Evaluation-as-a-Service

    1. Front Matter
      Pages 1-1
    2. Allan Hanbury, Henning Müller
      Pages 3-13 Open Access
    3. Ivan Eggel, Roger Schaer, Henning Müller
      Pages 15-30 Open Access
  3. VISCERAL Datasets

    1. Front Matter
      Pages 31-31
    2. Katharina Grünberg, Andras Jakab, Georg Langs, Tomàs Salas Fernandez, Marianne Winterstein, Marc-André Weber et al.
      Pages 33-43 Open Access
    3. Katharina Grünberg, Oscar Jimenez-del-Toro, Andras Jakab, Georg Langs, Tomàs Salas Fernandez, Marianne Winterstein et al.
      Pages 45-67 Open Access
    4. Markus Krenn, Katharina Grünberg, Oscar Jimenez-del-Toro, András Jakab, Tomàs Salas Fernandez, Marianne Winterstein et al.
      Pages 69-84 Open Access
  4. VISCERAL Benchmarks

    1. Front Matter
      Pages 85-85
    2. Abdel Aziz Taha, Allan Hanbury
      Pages 87-105 Open Access
    3. Orcun Goksel, Antonio Foncubierta-Rodríguez
      Pages 107-125 Open Access
    4. Oscar Jimenez-del-Toro, Henning Müller, Antonio Foncubierta-Rodriguez, Georg Langs, Allan Hanbury
      Pages 127-141 Open Access
  5. VISCERAL Anatomy Participant Reports

    1. Front Matter
      Pages 143-143
    2. Assaf B. Spanier, Leo Joskowicz
      Pages 145-164 Open Access
    3. Razmig Kéchichian, Sébastien Valette, Michel Desvignes
      Pages 185-201 Open Access
    4. Frida Fejne, Matilda Landgren, Jennifer Alvén, Johannes Ulén, Johan Fredriksson, Viktor Larsson et al.
      Pages 203-218 Open Access
  6. VISCERAL Retrieval Participant Reports

    1. Front Matter
      Pages 219-219
    2. Oscar Jimenez-del-Toro, Pol Cirujeda, Henning Müller
      Pages 221-236 Open Access
    3. Fan Zhang, Yang Song, Weidong Cai, Adrien Depeursinge, Henning Müller
      Pages 237-249 Open Access

About this book


This book is open access under a CC BY-NC 2.5 license.

This book presents the VISCERAL project benchmarks for analysis and retrieval of 3D medical images (CT and MRI) on a large scale, which used an innovative cloud-based evaluation approach where the image data were stored centrally on a cloud infrastructure and participants placed their programs in virtual machines on the cloud. The book presents the points of view of both the organizers of the VISCERAL benchmarks and the participants.

The book is divided into five parts. Part I presents the cloud-based benchmarking and Evaluation-as-a-Service paradigm that the VISCERAL benchmarks used. Part II focuses on the datasets of medical images annotated with ground truth created in VISCERAL that continue to be available for research. It also covers the practical aspects of obtaining permission to use medical data and manually annotating 3D medical images efficiently and effectively. The VISCERAL benchmarks are described in Part III, including a presentation and analysis of metrics used in evaluation of medical image analysis and search. Lastly, Parts IV and V present reports by some of the participants in the VISCERAL benchmarks, with Part IV devoted to the anatomy benchmarks and Part V to the retrieval benchmark.

This book has two main audiences: the datasets as well as the segmentation and retrieval results are of most interest to medical imaging researchers, while eScience and computational science experts benefit from the insights into using the Evaluation-as-a-Service paradigm for evaluation and benchmarking on huge amounts of data.


Image Processing Image Search Health Informatics Medical Sciences Performance Evaluation Cloud Computing

Editors and affiliations

  • Allan Hanbury
    • 1
  • Henning Müller
    • 2
  • Georg Langs
    • 3
  1. 1.Vienna University of TechnologyViennaAustria
  2. 2.University of Applied Sciences Western SwitzerlandSierreSwitzerland
  3. 3.Medical University of ViennaViennaAustria

Bibliographic information

  • DOI
  • Copyright Information The Editor(s) (if applicable) and The Author(s) 2017
  • Publisher Name Springer, Cham
  • eBook Packages Computer Science
  • Print ISBN 978-3-319-49642-9
  • Online ISBN 978-3-319-49644-3
  • About this book