Introducing Maximal Anisotropy into Second Order Coupling Models

  • David Hafner
  • Christopher Schroers
  • Joachim Weickert
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9358)


On the one hand, anisotropic diffusion is a well-established concept that has improved numerous computer vision approaches by permitting direction-dependent smoothing. On the other hand, recent applications have uncovered the importance of second order regularisation. The goal of this work is to combine the benefits of both worlds. To this end, we propose a second order regulariser that allows to penalise both jumps and kinks in a direction-dependent way. We start with an isotropic coupling model, and systematically introduce anisotropic concepts from first order approaches. We demonstrate the benefits of our model by experiments, and apply it to improve an existing focus fusion method.



Our research has been partially funded by the Deutsche Forschungsgemeinschaft (DFG) through a Gottfried Wilhelm Leibniz Prize for Joachim Weickert. This is gratefully acknowledged.


  1. 1.
    Agarwala, A., Dontcheva, M., Agrawala, M., Drucker, S., Colburn, A., Curless, B., Salesin, D., Cohen, M.: Interactive digital photomontage. ACM Trans. Graph. 23(3), 294–302 (2004)CrossRefGoogle Scholar
  2. 2.
    Aguet, F., Van De Ville, D., Unser, M.: Model-based 2.5-D deconvolution for extended depth of field in brightfield microscopy. IEEE Trans. Image Process. 17(7), 1144–1153 (2008)MathSciNetCrossRefGoogle Scholar
  3. 3.
    Boshtayeva, M., Hafner, D., Weickert, J.: A focus fusion framework with anisotropic depth map smoothing. Pattern Recogn. 48(11), 3310–3323 (2015)Google Scholar
  4. 4.
    Bredies, K., Kunisch, K., Pock, T.: Total generalized variation. SIAM J. Imaging Sci. 3(3), 492–526 (2010)MathSciNetCrossRefzbMATHGoogle Scholar
  5. 5.
    Chambolle, A., Lions, P.L.: Image recovery via total variation minimization and related problems. Numerische Mathematik 76(2), 167–188 (1997)MathSciNetCrossRefzbMATHGoogle Scholar
  6. 6.
    Chan, T.F., Marquina, A., Mulet, P.: High-order total variation-based image restoration. SIAM J. Sci. Comput. 22(2), 503–516 (2000)MathSciNetCrossRefzbMATHGoogle Scholar
  7. 7.
    Charbonnier, P., Blanc-Féraud, L., Aubert, G., Barlaud, M.: Two deterministic half-quadratic regularization algorithms for computed imaging. In: Proceedings of IEEE International Conference on Image Processing, Austin, TX, vol. 2, pp. 168–172, November 1994Google Scholar
  8. 8.
    Didas, S., Weickert, J., Burgeth, B.: Properties of higher order nonlinear diffusion filtering. J. Math. Imaging Vis. 35(3), 208–226 (2009)MathSciNetCrossRefzbMATHGoogle Scholar
  9. 9.
    Ferstl, D., Reinbacher, C., Ranftl, R., Rüther, M., Bischof, H.: Image guided depth upsampling using anisotropic total generalized variation. In: Proceedings of International Conference on Computer Vision, Sydney, Australia, pp. 993–1000, December 2013Google Scholar
  10. 10.
    Forster, B., Van De Ville, D., Berent, J., Sage, D., Unser, M.: Complex wavelets for extended depth-of-field: a new method for the fusion of multichannel microscopy images. Microsc. Res. Tech. 65(1–2), 33–42 (2004)CrossRefGoogle Scholar
  11. 11.
    Förstner, W., Gülch, E.: A fast operator for detection and precise location of distinct points, corners and centres of circular features. In: Proceedings of ISPRS Intercommission Conference on Fast Processing of Photogrammetric Data, Interlaken, Switzerland, pp. 281–305, June 1987Google Scholar
  12. 12.
    Hafner, D., Demetz, O., Weickert, J.: Simultaneous HDR and optic flow computation. In: Proceedings of International Conference on Pattern Recognition, Stockholm, Sweden, pp. 2065–2070, August 2014Google Scholar
  13. 13.
    Hewer, A., Weickert, J., Scheffer, T., Seibert, H., Diebels, S.: Lagrangian strain tensor computation with higher order variational models. In: Burghardt, T., Damen, D., Mayol-Cuevas, W., Mirmehdi, M. (eds.) Proceedings of British Machine Vision Conference. BMVA Press, Bristol, September 2013Google Scholar
  14. 14.
    Horn, B.K.P.: Focusing. Tech. Rep. Memo No. 160, MIT Artificial Intelligence Laboratory, Cambridge, MA, May 1968Google Scholar
  15. 15.
    Horn, B.K.P.: Height and gradient from shading. Int. J. Comput. Vis. 5(1), 37–75 (1990)CrossRefGoogle Scholar
  16. 16.
    Lenzen, F., Becker, F., Lellmann, J.: Adaptive second-order total variation: an approach aware of slope discontinuities. In: Kuijper, A., Bredies, K., Pock, T., Bischof, H. (eds.) SSVM 2013. LNCS, vol. 7893, pp. 61–73. Springer, Heidelberg (2013) CrossRefGoogle Scholar
  17. 17.
    Li, H., Manjunath, B., Mitra, S.: Multisensor image fusion using the wavelet transform. Graph. Models Image Process. 57(3), 235–245 (1995)CrossRefGoogle Scholar
  18. 18.
    Lysaker, M., Lundervold, A., Tai, X.C.: Noise removal using fourth-order partial differential equation with applications to medical magnetic resonance images in space and time. IEEE Trans. Image Process. 12(12), 1579–1590 (2003)CrossRefzbMATHGoogle Scholar
  19. 19.
    Nagel, H.H., Enkelmann, W.: An investigation of smoothness constraints for the estimation of displacement vector fields from image sequences. IEEE Trans. Pattern Anal. Mach. Intell. 8(5), 565–593 (1986)CrossRefGoogle Scholar
  20. 20.
    Nayar, S.K., Nakagawa, Y.: Shape from focus. IEEE Trans. Pattern Anal. Mach. Intell. 16(8), 824–831 (1994)CrossRefGoogle Scholar
  21. 21.
    Nir, T., Bruckstein, A.M., Kimmel, R.: Over-parameterized variational optical flow. Int. J. Comput. Vis. 76(2), 205–216 (2008)CrossRefGoogle Scholar
  22. 22.
    Ogden, J., Adelson, E., Bergen, J., Burt, P.: Pyramid-based computer graphics. RCA Eng. 30(5), 4–15 (1985)Google Scholar
  23. 23.
    Persch, N., Schroers, C., Setzer, S., Weickert, J.: Introducing more physics into variational depth–from–defocus. In: Jiang, X., Hornegger, J., Koch, R. (eds.) GCPR 2014. LNCS, vol. 8753, pp. 15–27. Springer, Heidelberg (2014) Google Scholar
  24. 24.
    Peter, P., Weickert, J., Munk, A., Krivobokova, T., Li, H.: Justifying tensor-driven diffusion from structure-adaptive statistics of natural images. In: Tai, X.-C., Bae, E., Chan, T.F., Lysaker, M. (eds.) EMMCVPR 2015. LNCS, vol. 8932, pp. 263–277. Springer, Heidelberg (2015) Google Scholar
  25. 25.
    Petrovic, V., Xydeas, C.: Gradient-based multiresolution image fusion. IEEE Trans. Image Process. 13(2), 228–237 (2004)CrossRefzbMATHGoogle Scholar
  26. 26.
    Ranftl, R., Bredies, K., Pock, T.: Non-local total generalized variation for optical flow estimation. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014, Part I. LNCS, vol. 8689, pp. 439–454. Springer, Heidelberg (2014) Google Scholar
  27. 27.
    Ranftl, R., Gehrig, S., Pock, T., Bischof, H.: Pushing the limits of stereo using variational stereo estimation. In: Proceedings of IEEE Intelligent Vehicles Symposium, Alcalá de Henares, Spain, pp. 401–407, June 2012Google Scholar
  28. 28.
    Scherzer, O.: Denoising with higher order derivatives of bounded variation and an application to parameter estimation. Computing 60(1), 1–27 (1998)MathSciNetCrossRefzbMATHGoogle Scholar
  29. 29.
    Schroers, C., Zimmer, H., Valgaerts, L., Bruhn, A., Demetz, O., Weickert, J.: Anisotropic range image integration. In: Pinz, A., Pock, T., Bischof, H., Leberl, F. (eds.) DAGM and OAGM 2012. LNCS, vol. 7476, pp. 73–82. Springer, Heidelberg (2012) CrossRefGoogle Scholar
  30. 30.
    Trobin, W., Pock, T., Cremers, D., Bischof, H.: An unbiased second-order prior for high-accuracy motion estimation. In: Rigoll, G. (ed.) DAGM 2008. LNCS, vol. 5096, pp. 396–405. Springer, Heidelberg (2008) CrossRefGoogle Scholar
  31. 31.
    Weickert, J.: Anisotropic Diffusion in Image Processing. Teubner, Stuttgart (1998)zbMATHGoogle Scholar
  32. 32.
    Weickert, J., Grewenig, S., Schroers, C., Bruhn, A.: Cyclic schemes for PDE-based image analysis. Tech. Rep. 327 (revised), Department of Mathematics, Saarland University, Saarbrücken, German, April 2015Google Scholar
  33. 33.
    Weickert, J., Welk, M., Wickert, M.: \(L^2\)-stable nonstandard finite differences for anisotropic diffusion. In: Kuijper, A., Bredies, K., Pock, T., Bischof, H. (eds.) SSVM 2013. LNCS, vol. 7893, pp. 380–391. Springer, Heidelberg (2013) CrossRefGoogle Scholar
  34. 34.
    Zimmer, H., Bruhn, A., Weickert, J.: Optic flow in harmony. Int. J. Compu. Vis. 93(3), 368–388 (2011)MathSciNetCrossRefzbMATHGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Open Access This chapter is distributed under the terms of the Creative Commons Attribution Noncommercial License, which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author(s) and source are credited.

Authors and Affiliations

  • David Hafner
    • 1
  • Christopher Schroers
    • 1
  • Joachim Weickert
    • 1
  1. 1.Mathematical Image Analysis Group, Faculty of Mathematics and Computer ScienceSaarland UniversitySaarbrückenGermany

Personalised recommendations