International Journal of Computer Vision

, Volume 53, Issue 1, pp 45–70 | Cite as

DREAM2S: Deformable Regions Driven by an Eulerian Accurate Minimization Method for Image and Video Segmentation

  • Stéphanie Jehan-Besson
  • Michel Barlaud
  • Gilles Aubert

Abstract

This paper deals with image and video segmentation using active contours. We propose a general form for the energy functional related to region-based active contours. We compute the associated evolution equation using shape derivation tools and accounting for the evolving region-based terms. Then we apply this general framework to compute the evolution equation from functionals that include various statistical measures of homogeneity for the region to be segmented. Experimental results show that the determinant of the covariance matrix appears to be a very relevant tool for segmentation of homogeneous color regions. As an example, it has been successfully applied to face segmentation in real video sequences.

image segmentation region segmentation energy minimization region-based active contours region functionals boundary functionals shape optimization shape gradient partial differential equations face segmen-tation covariance matrix determinant level sets 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Amadieu, O., Debreuve, E., Barlaud, M., and Aubert, G. 1999. Inward and outward curve evolution using level set method. In International Conference on Image Processing. Kobe, Japan.Google Scholar
  2. Amonou, I. and Duhamel, P. 2000. Iterative backward segmentation for hierarchical wavelet image coding. In International Conference on Image Processing. Vancouver, Canada.Google Scholar
  3. Aubert, G., Barlaud, M., Faugeras, O., and Jehan-Besson, S. Image segmentation using active contours: Calculous of variation or shape optimization? To appear in SIAM Applied Mathematics.Google Scholar
  4. Aubert, G. and Kornprobst, P. 2001. Mathematical problems in image processing. Partial differential equations and the calculus of variations, No. 147. Applied Mathematical Sciences, Springer Verlag.Google Scholar
  5. Caselles, V., Catte, F., Coll, T., and Dibos, F. 1993. A geometric model for active contours in image processing. In Numerische Mathematik, vol. 66, pp. 1–33.Google Scholar
  6. Caselles, V., Kimmel, R., and Sapiro, G. 1997. Geodesic active contours. International Journal of Computer Vision, 22(1):61–79.Google Scholar
  7. Chakraborty, A. and Duncan, J. 1999. Game-theoretic integration for image segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence.Google Scholar
  8. Chakraborty, A., Staib, L., and Duncan, J. 1996. Deformable boundary finding in medical images by integrating gradient and region information. IEEE Transactions on Medical Imaging, 15:859–870.Google Scholar
  9. Chan, T. and Vese, L. 2001. Active contours without edges. IEEE Transactions on Image Processing, 10(2):266–277.Google Scholar
  10. Chesnaud, C., Réfrégier, P., and Boulet, V. 1999. Statistical region snake-based segmentation adapted to different physical noise models. IEEE Transactions on Pattern Analysis and Machine Intelligence, 21:1145–1156.Google Scholar
  11. Cohen, L. 1991. On active contour models and balloons. Computer Vision, Graphics and Image Processing: Image Understanding, 53:211–218.Google Scholar
  12. Cohen, L., Bardinet, E., and Ayache, N. 1993. Surface reconstruction using active contour models. In SPIE Conference on Geometric Methods in Computer Vision. San Diego, CA.Google Scholar
  13. Debreuve, E. 2000. Segmentation par contours actifs en imagerie médicale dynamique: Application en cardiologie nucléaire. Ph.D. thesis, University of Nice-Sophia Antipolis, France.Google Scholar
  14. Debreuve, E., Barlaud, M., Aubert, G., and Darcourt, J. 2001. Space time segmentation using level set active contours applied to myocardial gated SPECT. IEEE Transactions on Medical Imaging, 20(7):643–659.Google Scholar
  15. Delfour, M. and Zolésio, J.-P. 2001. Shapes and Geometries, Advances in Design and Control, Siam.Google Scholar
  16. Delingette, H. and Montagnat, J. 2001. Topology and shape constraints on parametric active contours. Computer Vision and Image Understanding, 83(2):140–171.Google Scholar
  17. Goldenberg, R., Kimmel, R., Rivlin, E., and Rudzsky, M. 2001. Fast geodesic active contours. In IEEE Transactions on Image Processing, vol. 10, pp. 1467–1475.Google Scholar
  18. Gomes, J. and Faugeras, O. 2000. Reconciling distance functions and level sets. Journal of Visual Communication and Image Representation, 11:209–223.Google Scholar
  19. Gray, R. and Davidson, L. 2000. An Introduction to Statistical Signal Processing. Version libre.Google Scholar
  20. Gray, R., Young, J., and Aiyer, A. 2001. Minimum discrimination information clustering: Modeling and quantization with gauss mixtures. In International Conference on Image Processing. Thessaloniki, Greece.Google Scholar
  21. Jehan-Besson, S., Barlaud, M., and Aubert, G. 2000. Detection and tracking of moving objects using a new level set based method. In International Conference on Pattern Recognition, Barcelona, Spain, vol. 3, pp. 1112–1117.Google Scholar
  22. Jehan-Besson, S., Barlaud, M., and Aubert, G. 2001a. Regionbased active contours for video object segmentation with camera compensation. In International Conference on Image Processing. Thessaloniki, Greece.Google Scholar
  23. Jehan-Besson, S., Barlaud, M., and Aubert, G. 2001b. Video object segmentation using eulerian region-based active contours. In International Conference on Computer Vision. Vancouver, Canada.Google Scholar
  24. Jehan-Besson, S., Barlaud, M., and Aubert, G. 2002. A 3-Step algorithm using region-based active contours for video objects detection. EURASIP Journal on Applied Signal Processing. Special Issue on Image Analysis for Multimedia Interactive Services, 2002(6):572–581.Google Scholar
  25. Kass, M., Witkin, A., and Terzopoulos, D. 1988. Snakes: Active contour models. International Journal of Computer Vision, 1:321–332.Google Scholar
  26. Malladi, R., Sethian, J., and Vemuri, B. 1995. Shape modeling with front propagation: A level set approach. IEEE Transactions on Pattern Analysis and Machine Intelligence, 17:158–175.Google Scholar
  27. Mansouri, A. and Konrad, J. 1999. Motion segmentation with level sets. In International Conference on Image Processing. Kobe, Japan.Google Scholar
  28. Montagnat, J., Delingette, H., and Ayache, N. 2001. A review of deformable surfaces: Topology, geometry and deformation. Image and Vision Computing, 19(14):1023–1040.Google Scholar
  29. MPEG-7. 1998. MPEG-7 Context and Objectives. Technical report, International Organization for Standardization, ISO/IEC JTC1/SC29/WG11 N2460.Google Scholar
  30. MPEG-7. 2000. Requirements document (V12). Technical report, International Organization for Standardization, ISO/IEC JTC1/SC29/WG11 W3548.Google Scholar
  31. Mumford, D. and Shah, J. 1989. Optimal approximations by piecewise smooth functions and associated variational problems. Communications on Pure and Applied Mathematics, 42:577–684.Google Scholar
  32. Osher, S. and Sethian, J. 1988. Fronts propagating with curvaturedependent speed: Algorithms based on Hamilton-Jacobi Formulation. Journal of Computational Physics, 79:12–49.Google Scholar
  33. Paragios, N. and Deriche, R. 1999a. Geodesic active regions for motion estimation and tracking. In International Conference on Computer Vision. Corfu Greece.Google Scholar
  34. Paragios, N. and Deriche, R. 1999b. Geodesic active regions for motion estimation and tracking. In International Conference on Computer Vision. Corfu Greece.Google Scholar
  35. Paragios, N. and Deriche, R. 2000. Coupled Geodesic Active Regions for Image Segmentation:ALevel Set Approach. In European Conference in Computer Vision. Dublin, Ireland.Google Scholar
  36. Paragios, N. and Deriche, R. 2002a. Geodesic Active Regions: A new Paradigm to deal with frame partition Problems in Computer vision. Journal of Visual Communication and Image Representation, 13:249–268.Google Scholar
  37. Paragios, N. and Deriche, R. 2002b. Geodesic active regions and level set methods for supervised texture segmentation. International Journal of Computer Vision, 46(3):223.Google Scholar
  38. Pateux, S. 2000. Spatial segmentation of color images according to MDL formalism. In International Conference on Color in Graphics and Image Processing. Saint ´ Etienne, France.Google Scholar
  39. Precioso, F. and Barlaud, M. 2001. B-Spline active contours for fast video segmentation. In International Conference on Image Processing. Thessaloniki, Greece.Google Scholar
  40. Ronfard, R. 1994. Region-based strategies for active contour models. International Journal of Computer Vision, 13(2):229–251.Google Scholar
  41. Salembier, P. 1994. Morphological multiscale segmentation for image coding. Signal Processing, 38:359–386.Google Scholar
  42. Samson, C., Blanc-Féraud, L., Aubert, G., and Zerubia, J. 2000. A level set model for image classification. International Journal of Computer Vision, 40(3):187–197. 70 Jehan-Besson, Barlaud and Aubert Schn¨orr, C. 1992. Computation of discontinuous optical flow by domain decomposition and shape optimization. IJCV, 8(2):153–165.Google Scholar
  43. Sethian, J. 1990. Numerical algorithms for propagating interfaces: Hamilton-Jacobi equations and conservation laws. Journal of Differential Geometry, 31:131–161.Google Scholar
  44. Sethian, J. 1996. Level Set Methods. Cambridge Univ. Press.Google Scholar
  45. Siddiqi, K., Lauzière, Y., Tannenbaum, A., and Zucker, S. 1996. Area and length minimizing flows for shape segmentation. IEEE Transactions on Image Processing, 7(3):433–443.Google Scholar
  46. Sokolowski, J. and Zolésio, J.-P. 1992. Introduction to shape optimization. Shape sensitivity analysis. Vol. 16 of Springer Ser. Comput. Math. Springer-Verlag, Berlin.Google Scholar
  47. Weickert, J., Haar Romeny, B., and Viergerer, M.A. 1998. Efficient and reliable scheme for nonlinear diffusion filtering. IEEE Transaction on Image Processing, 7(3):398–410.Google Scholar
  48. Yezzi, A., Tsai, A., and Willsky, A. 1999. A statistical approach to snakes for bimodal and trimodal imagery. In International Conference on Image Processing. Kobe, Japan.Google Scholar
  49. Zhu, S., Lee, T., and Yuille, A. 1995. Region competition: Unifying snakes, region growing, and Bayes/MDL for multiband image segmentation. In International Conference on Computer Vision, pp. 416–423.Google Scholar
  50. Zhu, S. and Yuille, A. 1996a. Region competition: Unifying snakes, region growing, and Bayes/MDL for multiband image segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 18:884–900.Google Scholar
  51. Zhu, S. and Yuille, A. 1996b. Region competition: Unifying snakes, region growing, and Bayes/MDL for multiband image segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 18:884–900.Google Scholar

Copyright information

© Kluwer Academic Publishers 2003

Authors and Affiliations

  • Stéphanie Jehan-Besson
    • 1
  • Michel Barlaud
    • 1
  • Gilles Aubert
    • 2
  1. 1.Laboratoire I3SCNRS-UNSASophia AntipolisFrance
  2. 2.Laboratoire J.A. DieudonnéCNRS-UNSANice Cedex 2France

Personalised recommendations