Segmentation of Vectorial Image Features Using Shape Gradients and Information Measures
In this paper, we propose to focus on the segmentation of vectorial features (e.g. vector fields or color intensity) using region-based active contours. We search for a domain that minimizes a criterion based on homogeneity measures of the vectorial features. We choose to evaluate, within each region to be segmented, the average quantity of information carried out by the vectorial features, namely the joint entropy of vector components. We do not make any assumption on the underlying distribution of joint probability density functions of vector components, and so we evaluate the entropy using non parametric probability density functions. A local shape minimizer is then obtained through the evolution of a deformable domain in the direction of the shape gradient.
The first contribution of this paper lies in the methodological approach used to differentiate such a criterion. This approach is mainly based on shape optimization tools. The second one is the extension of this method to vectorial data. We apply this segmentation method on color images for the segmentation of color homogeneous regions. We then focus on the segmentation of synthetic vector fields and show interesting results where motion vector fields may be separated using both their length and their direction. Then, optical flow is estimated in real video sequences and segmented using the proposed technique. This leads to promising results for the segmentation of moving video objects.
Keywordsimage segmentation active contours image statistics information information theory entropy joint probability shape optimization shape gradient motion segmentation
Unable to display preview. Download preview PDF.
- 6.L. Cohen, E. Bardinet, and N. Ayache, “Surface reconstruction using active contour models,” in SPIE Conf. on Geometric Methods in Comp. Vis. San Diego, 1993.Google Scholar
- 7.T. Cover and J. Thomas, Elements of Information Theory, Wiley-Interscience, 1991.Google Scholar
- 8.D. Cremers and S. Soatto, “Variational space-time motion segmentation,” in IEEE Int. Conf. on Computer Vision, 2003, Vol. 2. pp. 886–892.Google Scholar
- 10.M. Delfour and J. Zolésio, Shape and geometries. Advances in Design and Control, SIAM, 2001.Google Scholar
- 11.S. Geman and D. McLure “Bayesian image analysis: An application to single photon emission tomography,” In: Proc. Statist. Comput. Sect., 1985.Google Scholar
- 13.A. Herbulot, S. Jehan-Besson, M. Barlaud, and G. Aubert, “Shape gradient for image segmentation using information theory,” in International Conference on Acoustics, Speech and Signal Processing. Montreal, 2004.Google Scholar
- 14.A. Herbulot, S. Jehan-Besson, M. Barlaud, and G. Aubert, “Shape gradient for multi-modal image segmentation using mutual information,” In: International Conference on Image Processing. Singapore, 2004.Google Scholar
- 15.S. Jehan-Besson, M. Barlaud, and G. Aubert, “Video object segmentation using eulerian region-based active contours,” in International Conference on Computer Vision. Vancouver, Canada, 2001.Google Scholar
- 16.S. Jehan-Besson, M. Barlaud, and G. Aubert, “A 3-Step algorithm using region-based active contours for video objects detection,” EURASIP Journal on Applied Signal Processing, Special issue on Image Analysis for Multimedia Interactive Services, Vol. 2002, No. 6, pp. 572–581, 2002.Google Scholar
- 19.J. Kim, J. Fisher III, A. Yezzi Jr., M. Cetin, and A. Willsky, “Nonparametric methods for image segmentation using information theory and curve evolution,” in International Conference on Image Processing, 2002Google Scholar
- 20.F. Maes, A. Collignon, D. Vandermeulen, G. Marchal, and P. Suetens, “Multimodality image registration by maximization of mutual information,” IEEE Transactions on Medical Imaging, Vol. 16, No. 2, 1997.Google Scholar
- 25.F. Precioso, M. Barlaud, T. Blu, and M. Unser: to appear, “Robust real-time segmentation of images and videos using a smoothing-spline snake-based algorithm,” IEEE Transactions on Image Processing, 2005.Google Scholar
- 26.F. Ranchin and F. Dibos, “Moving objects segmentation using optical flow estimation,” in Workshop on Mathematics and Image Analysis. Paris, 2004.Google Scholar
- 28.T. Roy, E. Debreuve, M. Barlaud, and G. Aubert, “Segmentation of a vector field: Dominant parameter and shape otimization,” Journal of Mathematical Imaging and Vision (In Press), 2006.Google Scholar
- 29.C. Schnörr, “Segmentation of visual motion by minimizing convex non-quadratic functionals,” in Proc. 12th Int. Conf. Pattern Recognition, Vol. A. Jerusalem, IEEE Computer Society Press, Los Alamitos, 1994, pp. 661–663.Google Scholar
- 31.J. Sokolowski and J. Zolésio, Introduction to Shape Optimization, Vol. 16 of Springer Series in Computational Mathematics. Springer-Verlag, 1992.Google Scholar
- 32.J. Weickert “On discontinuity-preserving optic flow,” in Proc. Computer Vision and Mobile Robotics Workshop, 1998, Santorini, pp. 115–122.Google Scholar
- 34.A. Yezzi, A. Tsai, and A. Willsky, “A statistical approach to snakes for bimodal and trimodal imagery,” in Int. Conference on Image Processing, Kobe Japan, 1999.Google Scholar