Abstract
Matrix-valued data sets arise in a number of applications including diffusion tensor magnetic resonance imaging (DT-MRI) and physical measurements of anisotropic behaviour. Consequently, there arises the need to filter and segment such tensor fields. In order to detect edge-like structures in tensor fields, we first generalise Di Zenzo’s concept of a structure tensor for vector-valued images to tensor-valued data. This structure tensor allows us to extend scalar-valued mean curvature motion and self-snakes to the tensor setting. We present both two-dimensional and three-dimensional formulations, and we prove that these filters maintain positive semidefiniteness if the initial matrix data are positive semidefinite. We give an interpretation of tensorial mean curvature motion as a process for which the corresponding curve evolution of each generalised level line is the gradient descent of its total length. Moreover, we propose a geodesic active contour model for segmenting tensor fields and interpret it as a minimiser of a suitable energy functional with a metric induced by the tensor image. Since tensorial active contours incorporate information from all channels, they give a contour representation that is highly robust under noise. Experiments on three-dimensional DT-MRI data and an indefinite tensor field from fluid dynamics show that the proposed methods inherit the essential properties of their scalar-valued counterparts.
Similar content being viewed by others
References
Alvarez, L., Lions, P.-L., and Morel, J.-M. 1992. Image selective smoothing and edge detection by nonlinear diffusion. II. SIAM Journal on Numerical Analysis, 29:845–866.
Ben-Shahar, O. and Zucker, S.W. 2003. The perceptual organization of texture flow: A contextual inference approach. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25(4):401–417.
Bigün, J., Granlund, G.H., and Wiklund, J. 1991. Multidimensional orientation estimation with applications to texture analysis and optical flow. IEEE Transactions on Pattern Analysis and Machine Intelligence, 13(8):775–790.
Brox, T., Rousson, M., Deriche, R., and Weickert, J. 2003. Unsupervised segmentation incorporating colour, texture, and motion. In Computer Analysis of Images and Patterns, N. Petkov and M.A. Westenberg (Eds.), Vol. 2756 of Lecture Notes in Computer Science. Berlin: Springer, pp.353–360.
Brox, T. and Weickert, J. 2002. Nonlinear matrix diffusion for optic flow estimation. In Pattern Recognition, L. Van Gool (ed.) Vol. 2449 of Lecture Notes in Computer Science. Berlin: Springer, pp. 446–453.
Burgeth, B., Welk, M. Feddern, C., and Weickert J. 2004. Morphological operations on matrix-valued images. In Computer Vision–ECCV 2004, T. Pajdla and J. Matas (Eds.), Part IV, Vol. 3024 of Lecture Notes in Computer Science, Berlin: Springer, pp.155–167.
Campbell, J., Siddiqi, K., Vemuri, B., and Pike, G.B. 2002. A geometric flow for white matter fibre tract reconstruction’. In Proc. 2002 IEEE International Symposium on Biomedical Imaging, Washington, DC, pp. 505–508.
Caselles, V., Catté, F. Coll, T. and Dibos F. 1993. A geometric model for active contours in image processing. Numerische Mathematik, 66:1–31.
Caselles, V., Kimmel, R., and Sapiro, G. 1995. Geodesic active contours. In Proc. Fifth International Conference on Computer Vision, Cambridge, MA, pp. 694–699.
Caselles, V., Sapiro, G., and Chung, D.H. 2000. Vector median filters, inf-sup convolutions, and coupled PDE’s: Theoretical connections. Journal of Mathematical Imaging and Vision, 12(2):109–119.
Chambolle, A. 1994. Partial differential equations and image processing. In Proc. 1994 IEEE International Conference on Image Processing, Vol. 1. Austin, TX, pp. 16–20.
Chung, D.H. and Sapiro, G. 2000. On the level lines and geometry of vector-valued images. IEEE Signal Processing Letters, 7(9):241–243.
Coulon, O., Alexander, D.C., and Arridge, S.A. 2001. A regularization scheme for diffusion tensor magnetic resonance images. In Information Processing in Medical Imaging–IPMI 2001, M.F. Insana and R.M. Leahy (Eds.), Vol. 2082 of Lecture Notes in Computer Science. Berlin: Springer, pp. 92–105.
Cumani, A. 1991. Edge detection in multispectral images. Graphical Models and Image Processing, 53(1):40–51.
Dervieux, A. and Thomasset, F. 1979. A finite element method for the simulation of Rayleigh–Taylor instability. In Approximation Methods forNavier–Stokes Problems, R. Rautman (ed.): Vol. 771 of Lecture Notes in Mathematics. Berlin: Springer, pp. 145–158.
Di Zenzo, S. 1986. A note on the gradient of a multi-image. Computer Vision, Graphics and Image Processing, 33:116–125.
Feddern, C., Weickert, J., and Burgeth, B. 2003. Level-set methods for tensor-valued images. In O. Faugeras and N. Paragios (eds.), Proc. Second IEEE Workshop on Geometric and Level Set Methods in Computer Vision, Nice, France, pp. 65–72.
Gage, M. 1986. On area-preserving evolution equation for plane curves. Contemporary Mathematics, 23:51–62.
Gage, M. and Hamilton, R.S. 1986. The heat equation shrinking convex plane curves. Journal of Differential Geometry, 23:69–96.
Gerig, G., Kübler, O., Kikinis, R., and Jolesz, F.A. 1992. Nonlinear anisotropic filtering of MRI data. IEEE Transactions on Medical Imaging, 11:221–232.
Granlund, G.H. and Knutsson H. 1995. Signal Processing for Computer Vision, Dordrecht: Kluwer.
Grayson, M. 1987. The heat equation shrinks embedded plane curves to round points. Journal of Differential Geometry, 26:285–314.
Guichard, F. and Morel, J.M. 1997. Partial differential equations and image iterative filtering. In The State of the Art in Numerical Analysis, I.S. Duff and G.A. Watson (eds.), No. 63 in IMA Conference Series (New Series). Oxford: Clarendon Press, pp. 525–562.
Hahn, K., Pigarin, S. and Pütz B. 2001. Edge preserving regularization and tracking for diffusion tensor imaging. In Medical Image Computing and Computer-Assisted Intervention—MICCAI 2001, W.J. Niessen and M.A. Viergever (Eds.), Vol. 2208 of Lecture Notes in Computer Science. Berlin: Springer, pp. 195–203.
Huisken, G. 1984. Flow by mean curvature of convex surfaces into spheres. Journal of Differential Geometry, 20:237–266.
Kass, M., Witkin, A., and Terzopoulos, D. 1988. Snakes: Active contour models. International Journal of Computer Vision, 1:321–331.
Kichenassamy, S., Kumar, A., Olver, P., Tannenbaum, A., and Yezzi, A. 1995. Gradient flows and geometric active contour models. In Proc. Fifth International Conference on Computer Vision, Cambridge, MA, pp. 810–815.
Kimia, B.B. and Siddiqi, K. 1996. Geometric heat equation and non-linear diffusion of shapes and images. Computer Vision and Image Understanding, 64:305–322.
Kimmel, R. 2003. Numerical Geometry of Images: Theory, Algorithms, and Applications, New York: Springer.
Kimmel, R. and Sochen, N. 2002. Orientation diffusion or how to comb a porcupine. Journal of Visual Communication and Image Representation, 13:238–248.
Kramer, H.P. and Bruckner, J.B. 1975. Iterations of a non-linear transformation for enhancement of digital images. Pattern Recognition, 7:53–58.
Krivá, Z. and Mikula, K. 2000. An adaptive finite volume method in processing of color images. In Proc. Algoritmy 2000 Conference on Scientific Computing, Podbanské, Slovakia, pp. 174–187.
Malladi, R., Sethian, J.A., and Vemuri, B.C. 1993. A topology independent shape modeling scheme. In Geometric Methods in Computer Vision, B. Vemuri (ed.), Vol. 2031 of Proceedings of SPIE. Bellingham: SPIE Press, pp. 246–258.
Medioni, G., Lee, M., and Tang, C. 2000. A Computational Framework for Segmentation and Grouping, Amsterdam:Elsevier.
Osher, S. and Fedkiw, R.P. 2002. Level Set Methods and Dynamic Implicit Surfaces, Vol. 153 of Applied Mathematical Sciences, New York: Springer.
Osher, S. and Paragios N.(Eds.), 2003. Geometric Level Set Methods in Imaging, Vision and Graphics, New York: Springer.
Osher, S. and Rudin, L.I. 1990. Feature-oriented image enhancement using shock filters. SIAM Journal on Numerical Analysis, 27:919–940.
Osher, S. and Sethian, J.A. 1988. Fronts propagating with curvature-dependent speed: Algorithms based on Hamilton–Jacobi formulations. Journal of Computational Physics, 79:12–49.
Parker, G.J.M., Schnabel, J.A., Symms, M.R., Werring, D.J., and Barker, G.J. 2000. Nonlinear smoothing for reduction of systematic and random errors in diffusion tensor imaging. Journal of Magnetic Resonance Imaging, 11:702–710.
Perona, P. and Malik, J. 1990. Scale space and edge detection using anisotropic diffusion. IEEE Transactions on Pattern Analysis and Machine Intelligence, 12:629–639.
Pierpaoli, C., Jezzard, P., Basser, P.J., Barnett, A., and Di Chiro, G. 1996. Diffusion tensor MR imaging of the human brain. Radiology, 201(3):637–648.
Poupon, C., Mangin, J., Frouin, V., Régis, J., Poupon, F., Pachot-Clouard, M., Le Bihan, D., and Bloch, I. 1998. Regularization of MR diffusion tensor maps for tracking brain white matter bundles. In Medical Image Computing and Computer-Assisted Intervention – MICCAI 1998, W.M. Wells, A. Colchester, and S. Delp (Eds.), Vol. 1496 of Lecture Notes in Computer Science, Berlin: Springer, pp. 489–498.
Preußer, T. and Rumpf, M. 2002. A level set method for anisotropic geometric diffusion in 3D image processing. SIAM Journal on Applied Mathematics, 62(5):1772–1793.
Rao, A.R. and Schunck, B.G. 1991. Computing oriented texture fields. CVGIP: Graphical Models and Image Processing, 53:157–185.
Sapiro, G. 1996. Vector (self) snakes: A geometric framework for color, texture and multiscale image segmentation. In Proc. 1996 IEEE International Conference on Image Processing, Vol. 1. Lausanne, Switzerland, pp. 817–820.
Sapiro, G. 2001. Geometric Partial Differential Equations and Image Analysis. Cambridge, UK: Cambridge University Press.
Sapiro, G. and Ringach, D.L. 1996. Anisotropic diffusion of multivalued images with applications to color filtering. IEEE Transactions on Image Processing, 5(11):1582–1586.
Sapiro, G. and Tannenbaum, A. 1995. Area and length preserving geometric invariant scale-spaces. IEEE Transactions on Pattern Analysis and Machine Intelligence, 17:67–72.
Schwarz, H.R. 1989, Numerical Analysis: A Comprehensive Introduction, New York: Wiley.
Sethian, J.A. 1999. Level Set Methods and Fast Marching Methods, Cambridge, UK: Cambridge University Press, second edition.
Tschumperlé, D. and Deriche, R. 2002. Orthonormal vector sets regularization with PDE’s and applications. International Journal of Computer Vision, 50(3):237–252.
Tschumperlé, D. and Deriche, R. 2003. Vector-valued image regularization with PDE’s: a common framework for different applications. In Proc. 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Vol. 1. Madison, WI, pp. 651–656.
Vemuri, B., Chen, Y., Rao, M., McGraw, T., Wang, Z., and Mareci, T. 2001. Fiber tract mapping from diffusion tensor MRI. In Proc. First IEEE Workshop on Variational and Level Set Methods in Computer Vision, Vancouver, Canada, pp. 73–80.
Wang, Z. and Vemuri, B. 2004. An affine invariant tensor dissimilarity measure and its applications to tensor-valued image segmentation. In Proc. 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Washington, DC.
Weickert, J. 1998. Anisotropic Diffusion in Image Processing, Stuttgart: Teubner.
Weickert, J. 1999. Coherence-enhancing diffusion of colour images. Image and Vision Computing, 17(3–4):199–210.
Weickert, J. and Brox, T. 2002. Diffusion and regularization of vector- and matrix-valued images. In Inverse Problems, Image Analysis, and Medical Imaging, M.Z. Nashed and O. Scherzer (eds.), Vol. 313 of Contemporary Mathematics, Providence: AMS, pp. 251–268.
Welk, M., Feddern, C., Burgeth, B., and Weickert, J. 2003. Median filtering of tensor-valued images. In Pattern Recognition, B. Michaelis and G. Krell (Eds.), Vol. 2781 of Lecture Notes in Computer Science, Berlin, pp. 17–24.
Westin, C., Maier, S.E. Khidhir, B., Everett, P., Jolesz, F.A., and Kikinis, R. 1999. Image processing for diffusion tensor magnetic resonance imaging. In Medical Image Computing and Computer-Assisted Intervention – MICCAI 1999, C. Taylor and A. Colchester (Eds.), Vol. 1679 of Lecture Notes in Computer Science,Berlin: Springer, pp. 441–452.
Whitaker, R.T. and Xue, X. 2001. Variable-conductance, level-set curvature for image denoising.In Proc. 2001 IEEE International Conference on Image Processing, Thessaloniki, Greece, pp. 142–145.
Zhukov, L., Munseth, K., Breen, D., Whitaker, R., and Barr, A.H. 2003. Level set modeling and segmentation of DT-MRI brain data. Journal of Electronic Imaging, 12(1):125–133.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Feddern, C., Weickert, J., Burgeth, B. et al. Curvature-Driven PDE Methods for Matrix-Valued Images. Int J Comput Vision 69, 93–107 (2006). https://doi.org/10.1007/s11263-006-6854-8
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11263-006-6854-8