Advertisement

International Journal of Computer Vision

, Volume 70, Issue 3, pp 197–211 | Cite as

Multiscale Active Contours

  • Xavier Bresson
  • Pierre Vandergheynst
  • Jean-Philippe Thiran
Article

Abstract

We propose a new multiscale image segmentation model, based on the active contour/snake model and the Polyakov action. The concept of scale, general issue in physics and signal processing, is introduced in the active contour model, which is a well-known image segmentation model that consists of evolving a contour in images toward the boundaries of objects. The Polyakov action, introduced in image processing by Sochen-Kimmel-Malladi in Sochen et al. (1998), provides an efficient mathematical framework to define a multiscale segmentation model because it generalizes the concept of harmonic maps embedded in higher-dimensional Riemannian manifolds such as multiscale images. Our multiscale segmentation model, unlike classical multiscale segmentations which work scale by scale to speed up the segmentation process, uses all scales simultaneously, i.e. the whole scale space, to introduce the geometry of multiscale images in the segmentation process. The extracted multiscale structures will be useful to efficiently improve the robustness and the performance of standard shape analysis techniques such as shape recognition and shape registration. Another advantage of our method is to use not only the Gaussian scale space but also many other multiscale spaces such as the Perona-Malik scale space, the curvature scale space or the Beltrami scale space. Finally, this multiscale segmentation technique is coupled with a multiscale edge detecting function based on the gradient vector flow model, which is able to extract convex and concave object boundaries independent of the initial condition. We apply our multiscale segmentation model on a synthetic image and a medical image.

Keywords

active contour scale space multiscale segmentation PDE Polyakov action Riemannian manifolds gradient vector flow 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Adalsteinsson, D. and Sethian, J. 1995. ‘A Fast Level Set Method for Propagating Interfaces,’ Journal of Computational Physics, 118, 269–277.zbMATHMathSciNetCrossRefGoogle Scholar
  2. Alvarez, L. Guichard, F. Lions, P.L. and Morel, J.M. 1993. ‘Axioms and Fundamental Equations of Image Processing,’ Archives For Rational Mechanics, 123(3), 199–257.zbMATHMathSciNetCrossRefGoogle Scholar
  3. Aubert, G. and Kornprobst, P. 2001. Mathematical Problems in Image Processing: Partial Differential Equations and the Calculus of Variations, Springer, 147.Google Scholar
  4. Bresson, X. Vandergheynst, P. and Thiran, J.-P. 2005. ‘Multiscale Active Contours,’ in Proceedings of 5th International Conference on Scale Space and PDE methods in Computer Vision, 167–178,Google Scholar
  5. Caselles, V. Kimmel, R. and Sapiro, G. 1997. ‘Geodesic Active Contours,’ International Journal of Computer Vision, 22(1), 61–79.zbMATHCrossRefGoogle Scholar
  6. Cohen, L.D. 1991. ‘On Active Contour Models and Balloons,’ Computer Vision Graphics Image Processing, 53, 211–218.zbMATHGoogle Scholar
  7. Eberly, D. 1994. ‘A Differential Geometric Approach to Anisotropic Diffusion in Geometry-Driven Diffusion in Computer Vision,’ Computational Imaging and Vision, 1, 371–392.Google Scholar
  8. Eberly, D. 1994. ‘Geometric Methods For Analysis Of Ridges In n-Dimensional Images, Ph.D Thesis, University of North Carolina.’Google Scholar
  9. Kreyszig, E. 1991. Differential Geometry, Paperback.Google Scholar
  10. Florack, L. 1993. ‘The Syntactical Structure of Scalar Images, Ph.D Thesis, University of Utrecht.’Google Scholar
  11. Hubel, D.H. and Wiesel, T.N. 1979. ‘Brain Mechanisms of Vision,’ Scientific American Press, 241, 45–53.Google Scholar
  12. Hubel, D.H. 1988. ‘Eye, Brain and Vision,’ Scientific American Press, New York.Google Scholar
  13. Kass, M. Witkin, A. and Terzopoulos, D. 1987. ‘Snakes: Active Contour Models,’ International Journal of Computer Vision, 321–331.Google Scholar
  14. Kichenassamy, S. Kumar, A. Olver, P. Tannenbaum, A. and Yezzi, A.J. 1996. ‘Conformal Curvature Flows: From Phase Transitions to Active Vision,’ in Archive for Rational Mechanics and Analysis, 275–301, 134.zbMATHMathSciNetCrossRefGoogle Scholar
  15. Kimmel, R. Malladi, R. Sochen, N. 2000. ‘Images as Embedded Maps and Minimal Surfaces: Movies, Color, Texture, and Volumetric Medical Images,’ International Journal of Computer Vision, 39(2), 111–129.zbMATHCrossRefGoogle Scholar
  16. Koenderink, J.J. 1984. ‘The Structure of Images,’ Biological Cybernetics, 50, 363–370.zbMATHMathSciNetCrossRefGoogle Scholar
  17. Leroy, B. Herlin, I. and Cohen, L.D. 1996. ‘Multi-Resolution Algorithms for Active Contour Models,’ in Proceedings of the Twelfth International Conference on Analysis and Optimization of Systems, 58–65.Google Scholar
  18. Lindeberg, T. 1994. Scale-Space Theory in Computer Vision, Kluwer Academic Publishers, Netherlands.Google Scholar
  19. Morse, B. 1994. ‘Computation of Object Cores From Grey-Level Images, Ph.D Thesis, University of North Carolina.’Google Scholar
  20. Osher, S. and Sethian, J.A. 1988. ‘Fronts Propagating with Curvature-Dependent Speed: Algorithms Based on Hamilton-Jacobi Formulations,’ Journal of Computational Physics, 79(1), 12–49.zbMATHMathSciNetCrossRefGoogle Scholar
  21. Osher, S. 2003. ‘Level Set Methods’, in Geometric Level Set Methods in Imaging, Vision and Graphics, eds. S. Osher and N. Paragios, Springer-Verlag, NY, 3–20.Google Scholar
  22. Perona, P. and Malik, J. 1990. ‘Scale-Space and Edge Detection Using Anisotropic Diffusion,’ IEEE Transactions on Pattern Analysis and Machine Intelligence, 1252, 629–639.CrossRefGoogle Scholar
  23. Pizer, S.M. Eberly, D. Morse, B.S. and Fritsch, D.S. 1998. ‘Zoom-Invariant Vision of Figural Shape: The Mathematics of Cores,’ International Journal of Computer Vision and Image Understanding, 69, 55–71.CrossRefGoogle Scholar
  24. Polyakov, A.M. 1981. ‘Quantum Geometry of Bosonic Strings,’ Physics Letters B, 103, 207–210.MathSciNetCrossRefGoogle Scholar
  25. Rudin, L.I. Osher, S. and Fatemi, E. 1992. ‘Nonlinear Total Variation Based Noise Removal Algorithms,’ Physica D, 60(1-4), 259–268.zbMATHCrossRefGoogle Scholar
  26. Sapiro, G. and Tannenbaum, A. 1993. ‘Affine Invariant Scale-Space,’ International Journal of Computer Vision, 11(1), 25–44.CrossRefGoogle Scholar
  27. Schnabel, J.A. and Arridge, S.R. 1999. ‘Active Shape Focusing,’ Image and Vision Computing, 17(5-6), 419–428.CrossRefGoogle Scholar
  28. Sethian, J.A. 1999. Level Set Methods and Fast Marching Methods: Evolving Interfaces in Computational Geometry, Fluid Mechanics, Computer Vision and Material Sciences, Cambridge University Press.Google Scholar
  29. Sochen, N. Kimmel, R. and Malladi, R. 1996. ‘A General Framework For Low Level Vision, Technical Report LBNL-39243,’ Physics Department, Berkeley.Google Scholar
  30. Sochen, N. Kimmel R. and Malladi, R. 1998. ‘A General Framework For Low Level Vision,’ IEEE Transactions on Image Processing, 7(3), 310–318.zbMATHMathSciNetCrossRefGoogle Scholar
  31. ter Haar Romeny, B.M. (Editor), 1994. Geometry Driven Diffusion in Computer Vision, Kluwer Academic Publishers, Netherlands.Google Scholar
  32. ter Haar Romeny, B.M. 1997. Front-End Vision and Multiscale Image Analysis: Introduction to Scale-Space Theory, Kluwer Academic Publishers, Netherlands.Google Scholar
  33. Weickert, J. Ishikawa, S. and Imiya, A. 1999. ‘Linear Scale-Space has First been Proposed in Japan,’ Journal of Mathematical Imaging and Vision, 10, 237–252.zbMATHMathSciNetCrossRefGoogle Scholar
  34. Witkin, A.P. 1983. ‘Scale-Space Filtering,’ in International Joint Conference Artificial Intelligence, 1019–1022.Google Scholar
  35. Xu, C. and Prince, J. 1998. ‘Snakes, Shapes and Gradient Vector Flow,’ IEEE Transaction on Image Processing, 7, 359–369.zbMATHMathSciNetCrossRefGoogle Scholar
  36. Zeki, S. 1993. A Vision of the Brain, Blackwell Scientific Publications.Google Scholar

Copyright information

© Springer Science + Business Media, LLC 2006

Authors and Affiliations

  • Xavier Bresson
    • 1
  • Pierre Vandergheynst
    • 1
  • Jean-Philippe Thiran
    • 1
  1. 1.Signal Processing Institute, Swiss Federal Institute of TechnologyLausanneSwitzerland

Personalised recommendations