Skip to main content
Log in

Curvature-Driven PDE Methods for Matrix-Valued Images

  • Published:
International Journal of Computer Vision Aims and scope Submit manuscript

Abstract

Matrix-valued data sets arise in a number of applications including diffusion tensor magnetic resonance imaging (DT-MRI) and physical measurements of anisotropic behaviour. Consequently, there arises the need to filter and segment such tensor fields. In order to detect edge-like structures in tensor fields, we first generalise Di Zenzo’s concept of a structure tensor for vector-valued images to tensor-valued data. This structure tensor allows us to extend scalar-valued mean curvature motion and self-snakes to the tensor setting. We present both two-dimensional and three-dimensional formulations, and we prove that these filters maintain positive semidefiniteness if the initial matrix data are positive semidefinite. We give an interpretation of tensorial mean curvature motion as a process for which the corresponding curve evolution of each generalised level line is the gradient descent of its total length. Moreover, we propose a geodesic active contour model for segmenting tensor fields and interpret it as a minimiser of a suitable energy functional with a metric induced by the tensor image. Since tensorial active contours incorporate information from all channels, they give a contour representation that is highly robust under noise. Experiments on three-dimensional DT-MRI data and an indefinite tensor field from fluid dynamics show that the proposed methods inherit the essential properties of their scalar-valued counterparts.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Alvarez, L., Lions, P.-L., and Morel, J.-M. 1992. Image selective smoothing and edge detection by nonlinear diffusion. II. SIAM Journal on Numerical Analysis, 29:845–866.

    Article  MathSciNet  Google Scholar 

  • Ben-Shahar, O. and Zucker, S.W. 2003. The perceptual organization of texture flow: A contextual inference approach. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25(4):401–417.

    Article  Google Scholar 

  • Bigün, J., Granlund, G.H., and Wiklund, J. 1991. Multidimensional orientation estimation with applications to texture analysis and optical flow. IEEE Transactions on Pattern Analysis and Machine Intelligence, 13(8):775–790.

    Article  Google Scholar 

  • Brox, T., Rousson, M., Deriche, R., and Weickert, J. 2003. Unsupervised segmentation incorporating colour, texture, and motion. In Computer Analysis of Images and Patterns, N. Petkov and M.A. Westenberg (Eds.), Vol. 2756 of Lecture Notes in Computer Science. Berlin: Springer, pp.353–360.

    Google Scholar 

  • Brox, T. and Weickert, J. 2002. Nonlinear matrix diffusion for optic flow estimation. In Pattern Recognition, L. Van Gool (ed.) Vol. 2449 of Lecture Notes in Computer Science. Berlin: Springer, pp. 446–453.

    Google Scholar 

  • Burgeth, B., Welk, M. Feddern, C., and Weickert J. 2004. Morphological operations on matrix-valued images. In Computer Vision–ECCV 2004, T. Pajdla and J. Matas (Eds.), Part IV, Vol. 3024 of Lecture Notes in Computer Science, Berlin: Springer, pp.155–167.

    Google Scholar 

  • Campbell, J., Siddiqi, K., Vemuri, B., and Pike, G.B. 2002. A geometric flow for white matter fibre tract reconstruction’. In Proc. 2002 IEEE International Symposium on Biomedical Imaging, Washington, DC, pp. 505–508.

  • Caselles, V., Catté, F. Coll, T. and Dibos F. 1993. A geometric model for active contours in image processing. Numerische Mathematik, 66:1–31.

    Article  MathSciNet  Google Scholar 

  • Caselles, V., Kimmel, R., and Sapiro, G. 1995. Geodesic active contours. In Proc. Fifth International Conference on Computer Vision, Cambridge, MA, pp. 694–699.

  • Caselles, V., Sapiro, G., and Chung, D.H. 2000. Vector median filters, inf-sup convolutions, and coupled PDE’s: Theoretical connections. Journal of Mathematical Imaging and Vision, 12(2):109–119.

    Article  MathSciNet  Google Scholar 

  • Chambolle, A. 1994. Partial differential equations and image processing. In Proc. 1994 IEEE International Conference on Image Processing, Vol. 1. Austin, TX, pp. 16–20.

  • Chung, D.H. and Sapiro, G. 2000. On the level lines and geometry of vector-valued images. IEEE Signal Processing Letters, 7(9):241–243.

    Article  Google Scholar 

  • Coulon, O., Alexander, D.C., and Arridge, S.A. 2001. A regularization scheme for diffusion tensor magnetic resonance images. In Information Processing in Medical Imaging–IPMI 2001, M.F. Insana and R.M. Leahy (Eds.), Vol. 2082 of Lecture Notes in Computer Science. Berlin: Springer, pp. 92–105.

    Google Scholar 

  • Cumani, A. 1991. Edge detection in multispectral images. Graphical Models and Image Processing, 53(1):40–51.

    Article  MATH  Google Scholar 

  • Dervieux, A. and Thomasset, F. 1979. A finite element method for the simulation of Rayleigh–Taylor instability. In Approximation Methods forNavier–Stokes Problems, R. Rautman (ed.): Vol. 771 of Lecture Notes in Mathematics. Berlin: Springer, pp. 145–158.

    Google Scholar 

  • Di Zenzo, S. 1986. A note on the gradient of a multi-image. Computer Vision, Graphics and Image Processing, 33:116–125.

    Article  MATH  Google Scholar 

  • Feddern, C., Weickert, J., and Burgeth, B. 2003. Level-set methods for tensor-valued images. In O. Faugeras and N. Paragios (eds.), Proc. Second IEEE Workshop on Geometric and Level Set Methods in Computer Vision, Nice, France, pp. 65–72.

  • Gage, M. 1986. On area-preserving evolution equation for plane curves. Contemporary Mathematics, 23:51–62.

    Google Scholar 

  • Gage, M. and Hamilton, R.S. 1986. The heat equation shrinking convex plane curves. Journal of Differential Geometry, 23:69–96.

    MathSciNet  Google Scholar 

  • Gerig, G., Kübler, O., Kikinis, R., and Jolesz, F.A. 1992. Nonlinear anisotropic filtering of MRI data. IEEE Transactions on Medical Imaging, 11:221–232.

    Article  Google Scholar 

  • Granlund, G.H. and Knutsson H. 1995. Signal Processing for Computer Vision, Dordrecht: Kluwer.

    Google Scholar 

  • Grayson, M. 1987. The heat equation shrinks embedded plane curves to round points. Journal of Differential Geometry, 26:285–314.

    MATH  MathSciNet  Google Scholar 

  • Guichard, F. and Morel, J.M. 1997. Partial differential equations and image iterative filtering. In The State of the Art in Numerical Analysis, I.S. Duff and G.A. Watson (eds.), No. 63 in IMA Conference Series (New Series). Oxford: Clarendon Press, pp. 525–562.

    Google Scholar 

  • Hahn, K., Pigarin, S. and Pütz B. 2001. Edge preserving regularization and tracking for diffusion tensor imaging. In Medical Image Computing and Computer-Assisted Intervention—MICCAI 2001, W.J. Niessen and M.A. Viergever (Eds.), Vol. 2208 of Lecture Notes in Computer Science. Berlin: Springer, pp. 195–203.

    Google Scholar 

  • Huisken, G. 1984. Flow by mean curvature of convex surfaces into spheres. Journal of Differential Geometry, 20:237–266.

    MATH  MathSciNet  Google Scholar 

  • Kass, M., Witkin, A., and Terzopoulos, D. 1988. Snakes: Active contour models. International Journal of Computer Vision, 1:321–331.

    Article  Google Scholar 

  • Kichenassamy, S., Kumar, A., Olver, P., Tannenbaum, A., and Yezzi, A. 1995. Gradient flows and geometric active contour models. In Proc. Fifth International Conference on Computer Vision, Cambridge, MA, pp. 810–815.

  • Kimia, B.B. and Siddiqi, K. 1996. Geometric heat equation and non-linear diffusion of shapes and images. Computer Vision and Image Understanding, 64:305–322.

    Article  Google Scholar 

  • Kimmel, R. 2003. Numerical Geometry of Images: Theory, Algorithms, and Applications, New York: Springer.

    Google Scholar 

  • Kimmel, R. and Sochen, N. 2002. Orientation diffusion or how to comb a porcupine. Journal of Visual Communication and Image Representation, 13:238–248.

    Article  Google Scholar 

  • Kramer, H.P. and Bruckner, J.B. 1975. Iterations of a non-linear transformation for enhancement of digital images. Pattern Recognition, 7:53–58.

    Article  MathSciNet  Google Scholar 

  • Krivá, Z. and Mikula, K. 2000. An adaptive finite volume method in processing of color images. In Proc. Algoritmy 2000 Conference on Scientific Computing, Podbanské, Slovakia, pp. 174–187.

  • Malladi, R., Sethian, J.A., and Vemuri, B.C. 1993. A topology independent shape modeling scheme. In Geometric Methods in Computer Vision, B. Vemuri (ed.), Vol. 2031 of Proceedings of SPIE. Bellingham: SPIE Press, pp. 246–258.

    Google Scholar 

  • Medioni, G., Lee, M., and Tang, C. 2000. A Computational Framework for Segmentation and Grouping, Amsterdam:Elsevier.

    Google Scholar 

  • Osher, S. and Fedkiw, R.P. 2002. Level Set Methods and Dynamic Implicit Surfaces, Vol. 153 of Applied Mathematical Sciences, New York: Springer.

    Google Scholar 

  • Osher, S. and Paragios N.(Eds.), 2003. Geometric Level Set Methods in Imaging, Vision and Graphics, New York: Springer.

    Google Scholar 

  • Osher, S. and Rudin, L.I. 1990. Feature-oriented image enhancement using shock filters. SIAM Journal on Numerical Analysis, 27:919–940.

    Article  Google Scholar 

  • Osher, S. and Sethian, J.A. 1988. Fronts propagating with curvature-dependent speed: Algorithms based on Hamilton–Jacobi formulations. Journal of Computational Physics, 79:12–49.

    Article  MathSciNet  Google Scholar 

  • Parker, G.J.M., Schnabel, J.A., Symms, M.R., Werring, D.J., and Barker, G.J. 2000. Nonlinear smoothing for reduction of systematic and random errors in diffusion tensor imaging. Journal of Magnetic Resonance Imaging, 11:702–710.

    Article  Google Scholar 

  • Perona, P. and Malik, J. 1990. Scale space and edge detection using anisotropic diffusion. IEEE Transactions on Pattern Analysis and Machine Intelligence, 12:629–639.

    Article  Google Scholar 

  • Pierpaoli, C., Jezzard, P., Basser, P.J., Barnett, A., and Di Chiro, G. 1996. Diffusion tensor MR imaging of the human brain. Radiology, 201(3):637–648.

    Google Scholar 

  • Poupon, C., Mangin, J., Frouin, V., Régis, J., Poupon, F., Pachot-Clouard, M., Le Bihan, D., and Bloch, I. 1998. Regularization of MR diffusion tensor maps for tracking brain white matter bundles. In Medical Image Computing and Computer-Assisted Intervention – MICCAI 1998, W.M. Wells, A. Colchester, and S. Delp (Eds.), Vol. 1496 of Lecture Notes in Computer Science, Berlin: Springer, pp. 489–498.

    Google Scholar 

  • Preußer, T. and Rumpf, M. 2002. A level set method for anisotropic geometric diffusion in 3D image processing. SIAM Journal on Applied Mathematics, 62(5):1772–1793.

    Article  MathSciNet  Google Scholar 

  • Rao, A.R. and Schunck, B.G. 1991. Computing oriented texture fields. CVGIP: Graphical Models and Image Processing, 53:157–185.

    Article  Google Scholar 

  • Sapiro, G. 1996. Vector (self) snakes: A geometric framework for color, texture and multiscale image segmentation. In Proc. 1996 IEEE International Conference on Image Processing, Vol. 1. Lausanne, Switzerland, pp. 817–820.

  • Sapiro, G. 2001. Geometric Partial Differential Equations and Image Analysis. Cambridge, UK: Cambridge University Press.

    Google Scholar 

  • Sapiro, G. and Ringach, D.L. 1996. Anisotropic diffusion of multivalued images with applications to color filtering. IEEE Transactions on Image Processing, 5(11):1582–1586.

    Article  Google Scholar 

  • Sapiro, G. and Tannenbaum, A. 1995. Area and length preserving geometric invariant scale-spaces. IEEE Transactions on Pattern Analysis and Machine Intelligence, 17:67–72.

    Article  Google Scholar 

  • Schwarz, H.R. 1989, Numerical Analysis: A Comprehensive Introduction, New York: Wiley.

    Google Scholar 

  • Sethian, J.A. 1999. Level Set Methods and Fast Marching Methods, Cambridge, UK: Cambridge University Press, second edition.

    Google Scholar 

  • Tschumperlé, D. and Deriche, R. 2002. Orthonormal vector sets regularization with PDE’s and applications. International Journal of Computer Vision, 50(3):237–252.

    Article  Google Scholar 

  • Tschumperlé, D. and Deriche, R. 2003. Vector-valued image regularization with PDE’s: a common framework for different applications. In Proc. 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Vol. 1. Madison, WI, pp. 651–656.

  • Vemuri, B., Chen, Y., Rao, M., McGraw, T., Wang, Z., and Mareci, T. 2001. Fiber tract mapping from diffusion tensor MRI. In Proc. First IEEE Workshop on Variational and Level Set Methods in Computer Vision, Vancouver, Canada, pp. 73–80.

  • Wang, Z. and Vemuri, B. 2004. An affine invariant tensor dissimilarity measure and its applications to tensor-valued image segmentation. In Proc. 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Washington, DC.

  • Weickert, J. 1998. Anisotropic Diffusion in Image Processing, Stuttgart: Teubner.

    Google Scholar 

  • Weickert, J. 1999. Coherence-enhancing diffusion of colour images. Image and Vision Computing, 17(3–4):199–210.

    Google Scholar 

  • Weickert, J. and Brox, T. 2002. Diffusion and regularization of vector- and matrix-valued images. In Inverse Problems, Image Analysis, and Medical Imaging, M.Z. Nashed and O. Scherzer (eds.), Vol. 313 of Contemporary Mathematics, Providence: AMS, pp. 251–268.

  • Welk, M., Feddern, C., Burgeth, B., and Weickert, J. 2003. Median filtering of tensor-valued images. In Pattern Recognition, B. Michaelis and G. Krell (Eds.), Vol. 2781 of Lecture Notes in Computer Science, Berlin, pp. 17–24.

  • Westin, C., Maier, S.E. Khidhir, B., Everett, P., Jolesz, F.A., and Kikinis, R. 1999. Image processing for diffusion tensor magnetic resonance imaging. In Medical Image Computing and Computer-Assisted Intervention – MICCAI 1999, C. Taylor and A. Colchester (Eds.), Vol. 1679 of Lecture Notes in Computer Science,Berlin: Springer, pp. 441–452.

    Google Scholar 

  • Whitaker, R.T. and Xue, X. 2001. Variable-conductance, level-set curvature for image denoising.In Proc. 2001 IEEE International Conference on Image Processing, Thessaloniki, Greece, pp. 142–145.

  • Zhukov, L., Munseth, K., Breen, D., Whitaker, R., and Barr, A.H. 2003. Level set modeling and segmentation of DT-MRI brain data. Journal of Electronic Imaging, 12(1):125–133.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Joachim Weickert.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Feddern, C., Weickert, J., Burgeth, B. et al. Curvature-Driven PDE Methods for Matrix-Valued Images. Int J Comput Vision 69, 93–107 (2006). https://doi.org/10.1007/s11263-006-6854-8

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11263-006-6854-8

Keywords

Navigation