A Latent Source Model for Patch-Based Image Segmentation

Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9351)


Despite the popularity and empirical success of patch-based nearest-neighbor and weighted majority voting approaches to medical image segmentation, there has been no theoretical development on when, why, and how well these nonparametric methods work. We bridge this gap by providing a theoretical performance guarantee for nearest-neighbor and weighted majority voting segmentation under a new probabilistic model for patch-based image segmentation. Our analysis relies on a new local property for how similar nearby patches are, and fuses existing lines of work on modeling natural imagery patches and theory for nonparametric classification. We use the model to derive a new patch-based segmentation algorithm that iterates between inferring local label patches and merging these local segmentations to produce a globally consistent image segmentation. Many existing patch-based algorithms arise as special cases of the new algorithm.


Mixture Model Image Segmentation Gaussian Mixture Model Image Patch Label Image 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Ailon, N., Chazelle, B.: Approximate nearest neighbors and the fast johnson-lindenstrauss transform. In: Symposium on Theory of Computing (2006)Google Scholar
  2. 2.
    Bai, W., et al.: A probabilistic patch-based label fusion model for multi-atlas segmentation with registration refinement: Application to cardiac MR images. Transactions in Medical Imaging (2013)Google Scholar
  3. 3.
    Barnes, C., et al.: Patchmatch: a randomized correspondence algorithm for structural image editing. Transactions on Graphics (2009)Google Scholar
  4. 4.
    Boyd, S., et al.: Distributed optimization and statistical learning via the alternating direction method of multipliers. Foundations & Trends in Machine Learning (2011)Google Scholar
  5. 5.
    Chen, G.H., Nikolov, S., Shah, D.: A latent source model for nonparametric time series classification. In: Neural Information Processing Systems (2013)Google Scholar
  6. 6.
    Coupé, P., et al.: Patch-based segmentation using expert priors: Application to hippocampus and ventricle segmentation. NeuroImage (2011)Google Scholar
  7. 7.
    Freeman, W.T., Liu, C.: Markov random fields for super-resolution and texture synthesis. In: Advances in Markov Random Fields for Vision and Image Proc. (2011)Google Scholar
  8. 8.
    Hanbury, A., Müller, H., Langs, G., Weber, M.A., Menze, B.H., Fernandez, T.S.: Bringing the algorithms to the data: Cloud–based benchmarking for medical image analysis. In: Catarci, T., Forner, P., Hiemstra, D., Peñas, A., Santucci, G. (eds.) CLEF 2012. LNCS, vol. 7488, pp. 24–29. Springer, Heidelberg (2012)CrossRefGoogle Scholar
  9. 9.
    Muja, M., Lowe, D.G.: Fast approximate nearest neighbors with automatic algorithm configuration. In: ICCVTA (2009)Google Scholar
  10. 10.
    Rousseau, F., Habas, P.A., Studholme, C.: A supervised patch-based approach for human brain labeling. Transactions on Medical Imaging (2011)Google Scholar
  11. 11.
    Sabuncu, M.R., et al.: A generative model for image segmentation based on label fusion. Transactions on Medical Imaging (2010)Google Scholar
  12. 12.
    Wachinger, C., et al.: On the importance of location and features for the patch-based segmentation of parotid glands. MIDAS Journal - IGART (2014)Google Scholar
  13. 13.
    Zoran, D., Weiss, Y.: From learning models of natural image patches to whole image restoration. In: International Conference on Computer Vision (2011)Google Scholar
  14. 14.
    Zoran, D., Weiss, Y.: Natural images, gaussian mixtures and dead leaves. In: Neural Information Processing Systems (2012)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  1. 1.Massachusetts Institute of TechnologyCambridgeUSA

Personalised recommendations