Journal of Mathematical Imaging and Vision

, Volume 57, Issue 3, pp 293–323 | Cite as

Mapping-Based Image Diffusion

  • Freddie ÅströmEmail author
  • Michael Felsberg
  • George Baravdish


In this work, we introduce a novel tensor-based functional for targeted image enhancement and denoising. Via explicit regularization, our formulation incorporates application-dependent and contextual information using first principles. Few works in literature treat variational models that describe both application-dependent information and contextual knowledge of the denoising problem. We prove the existence of a minimizer and present results on tensor symmetry constraints, convexity, and geometric interpretation of the proposed functional. We show that our framework excels in applications where nonlinear functions are present such as in gamma correction and targeted value range filtering. We also study general denoising performance where we show comparable results to dedicated PDE-based state-of-the-art methods.


Image enhancement Denoising PDE Diffusion Gradient energy tensor Structure tensor 



We thank the reviewers for their helpful comments and suggestions which have improved this work. This research has received funding from the Swedish Foundation for Strategic Research through the grant VPS and from Swedish Research Council through grants for the projects energy models for computational cameras \((\hbox {EMC}^2)\) and Visualization adaptive Iterative Denoising of Images (VIDI), all within the Linnaeus environment CADICS and the excellence network ELLIIT. Support by the German Science Foundation and the Research Training Group (GRK 1653) is gratefully acknowledged by the first author.


  1. 1.
    Åström, F., Baravdish, G., Felsberg, M.: On tensor-based PDEs and their corresponding variational formulations with application to color image denoising. In: ECCV12, vol. 7574, pp. 215–228. LNCS, Springer, Berlin (2012)Google Scholar
  2. 2.
    Åström, F., Baravdish, G., Felsberg, M.: A tensor variational formulation of gradient energy total variation. In: Tai, X.C., Bae, E., Chan, T., Lysaker, M. (eds.) Energy Minimization Methods in Computer Vision and Pattern Recognition (EMMCVPR), LNCS, vol. 8932, pp. 307–320. Springer (2015)Google Scholar
  3. 3.
    Åström, F., Felsberg, M.: On the choice of tensor estimation for corner detection, optical flow and denoising. In: Jawahar, C., Shan S. (eds.) Computer Vision—ACCV 2014 Workshops, LNCS, vol. 9009, pp. 16–30. Springer (2015)Google Scholar
  4. 4.
    Åström, F., Felsberg, M., Baravdish, G., Lundström, C.: Targeted iterative filtering. In: SSVM2013. pp. 1–11. Springer, Berlin (2013)Google Scholar
  5. 5.
    Åström, F., Zografos, V., Felsberg, M.: Density driven diffusion. In: SCIA, pp. 17–20 (2013)Google Scholar
  6. 6.
    Aubert, G., Kornprobst, P.: Mathematical Problems in Image Processing: Partial Differential Equations and the Calculus of Variations. Applied Mathematical Sciences, vol. 147, 2nd edn. Springer, Berlin (2006)zbMATHGoogle Scholar
  7. 7.
    Ballester, C., Bertalmío, M., Caselles, V., Sapiro, G., Verdera, J.: Filling-in by joint interpolation of vector fields and gray levels. IEEE Trans. Image Process. 10(8), 1200–1211 (2001)MathSciNetCrossRefzbMATHGoogle Scholar
  8. 8.
    Baravdish, G., Svensson, O., Åström, F.: On backward \(p(x)\)-parabolic equations for image enhancement. Numer. Funct. Anal. Optim. 36(2), 147–168 (2015)MathSciNetCrossRefzbMATHGoogle Scholar
  9. 9.
    den Bergh, M.V., Boix, X., Roig, G., de Capitani, B., Gool, L.V.: SEEDS: superpixels extracted via energy-driven sampling. In: Fitzgibbon, A.W., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV12, LNCS, vol. 7578, pp. 13–26. Springer (2012)Google Scholar
  10. 10.
    Bigün, J., Granlund, G.H.: Optimal orientation detection of linear symmetry. In: Proceedings of the IEEE First ICCV, pp. 433–438. Great Britain, London (1987)Google Scholar
  11. 11.
    Black, M.J., Rangarajan, A.: On the unification of line processes, outlier rejection, and robust statistics with applications in early vision. IJCV 19(1), 57–91 (1996)CrossRefGoogle Scholar
  12. 12.
    Blomgren, P., Chan, T.F., Mulet, P., Wong, C.: Total variation image restoration: numerical methods and extensions. In: Proceedings of IEEE ICIP, pp. 384–387 (1997)Google Scholar
  13. 13.
    Bollt, E.M., Chartrand, R., Esedoğlu, S., Schultz, P., Vixie, K.R.: Graduated adaptive image denoising: local compromise between total variation and isotropic diffusion. Adv. Comput. Math. 31(1), 61–85 (2008)MathSciNetzbMATHGoogle Scholar
  14. 14.
    Bovik, A.C., Maragos, P.: Conditions for positivity of an energy operator. Signal Process. IEEE Trans. 42(2), 469–471 (1994)CrossRefGoogle Scholar
  15. 15.
    Boyd, S., Vandenberghe, L.: Convex Optimization. Cambridge University Press, New York (2004)CrossRefzbMATHGoogle Scholar
  16. 16.
    Bredies, K., Kunisch, K., Pock, T.: Total generalized variation. SIAM J. Image Sci. 3(3), 492–526 (2009)MathSciNetCrossRefzbMATHGoogle Scholar
  17. 17.
    Bruhn, A., Weickert, J., Feddern, C., Kohlberger, T., Schnörr, C.: Variational optical flow computation in real time. Image Process. IEEE Trans. 14(5), 608–615 (2005)Google Scholar
  18. 18.
    Buades, A., Coll, B., Morel, J.M.: A non-local algorithm for image denoising. In: CVPR, vol. 2, pp. 60–65 (2005)Google Scholar
  19. 19.
    Chan, T., Esedoğlu, S., Park, F., Yip, A.: Total variation image restoration: overview and recent developments. In: Paragios, N., Chen, Y., Faugeras, O. (eds.) Handbook of Mathematical Models in Computer Vision, chap. 2, pp. 17–31. Springer (2006)Google Scholar
  20. 20.
    Chan, T.F., Golub, G.H., Mulet, P.: A nonlinear primal-dual method for total variation-based image restoration. SIAM J. Sci. Comput. 20(6), 1964–1977 (1999)MathSciNetCrossRefzbMATHGoogle Scholar
  21. 21.
    Chan, T.F., Kang, S.H., Kang Shen, J.: Euler’s elastica and curvature based inpaintings. SIAM J. Appl. Math. 63, 564–592 (2002)MathSciNetzbMATHGoogle Scholar
  22. 22.
    Chan, T.F., Wong, C.K.: Total variation blind deconvolution. IEEE Trans. Image Process. 7(3), 370–375 (1998)CrossRefGoogle Scholar
  23. 23.
    Chen, Y., Levine, S., Rao, M.: Variable exponent, linear growth functionals in image processing. SIAM J. Appl. Math. 66, 1383–1406 (2004)CrossRefzbMATHGoogle Scholar
  24. 24.
    Dabov, K., Foi, A., Katkovnik, V., Egiazarian, K.O.: Image denoising by sparse 3-D transform-domain collaborative filtering. IEEE Trans. Image Process. 16(8), 2080–2095 (2007)MathSciNetCrossRefGoogle Scholar
  25. 25.
    DiBenedetto, E.: Degenerate Parabolic Equations. Springer, New York (1993)CrossRefzbMATHGoogle Scholar
  26. 26.
    Felsberg, M.: Autocorrelation-driven diffusion filtering. Image Process. IEEE Trans. 20(7), 1797–1806 (2011)MathSciNetCrossRefGoogle Scholar
  27. 27.
    Felsberg, M., Granlund, G.: POI detection using channel clustering and the 2D energy tensor. In: Pattern recognition: 26th DAGM symposium. Volume 3175 of LNCS, pp. 103–110 (2004)Google Scholar
  28. 28.
    Felsberg, M., Köthe, U.: GET: the connection between monogenic scale-space and Gaussian derivatives. In: Kimmel, R., Sochen, N., Weickert, J. (eds.) Scale Space and PDE Methods in Computer Vision, LNCS, vol. 3459, pp. 192–203. LNCS (2005)Google Scholar
  29. 29.
    Förstner, W., Gülch, E.: A fast operator for detection and precise location of distinct points, corners and centres of circular features. In: ISPRS Intercommission, Workshop, Interlaken, pp. 149–155. (1987)Google Scholar
  30. 30.
    Gårding, J., Lindeberg, T.: Direct computation of shape cues using scale-adapted spatial derivative operators. IJCV 17(2), 163–191 (1996)CrossRefGoogle Scholar
  31. 31.
    Gilbarg, D., Trudinger, N.: Elliptic Partial Differential Equations of Second Order. Classics in Mathematics. Springer, Berlin (2001)zbMATHGoogle Scholar
  32. 32.
    Granlund, G.H., Knutsson, H.: Signal Processing for Computer Vision. Kluwer, Alphen aan den Rijn (1995)CrossRefGoogle Scholar
  33. 33.
    Grasmair, M., Lenzen, F.: Anisotropic total variation filtering. Appl. Math. Optim. 62(3), 323–339 (2010)MathSciNetCrossRefzbMATHGoogle Scholar
  34. 34.
    Horn, B.K.P., Schunck, B.G.: Determining optical flow. Artif. Intell. 17, 185–203 (1981)CrossRefGoogle Scholar
  35. 35.
    Horn, R.A., Johnson, C.R. (eds.): Matrix Analysis. Cambridge University Press, New York (1986)Google Scholar
  36. 36.
    Huguet, F., Devernay, F.: A variational method for scene flow estimation from stereo sequences. In: IEEE 11th International Conference on Computer Vision, 2007. ICCV 2007, pp. 1–7 (2007)Google Scholar
  37. 37.
    Kaiser, J.F.: On a simple algorithm to calculate the ‘energy’ of a signal. In: 1990 International Conference on Acoustics, Speech, and Signal Processing, 1990. ICASSP-90, vol. 1, pp. 381–384 (1990)Google Scholar
  38. 38.
    Kass, M., Witkin, A., Terzopoulos, D.: Snakes: active contour models. Int. J. Comput. Vis. 1(4), 321–331 (1988)CrossRefzbMATHGoogle Scholar
  39. 39.
    Koenderink, J.J.: The structure of images. Biol. Cybern. 370(50), 363–370 (1984)MathSciNetCrossRefzbMATHGoogle Scholar
  40. 40.
    Krajsek, K., Scharr, H.: Diffusion filtering without parameter tuning : models and inference tools. In: CVPR2010, pp. 2536–2543. San Francisco (2010)Google Scholar
  41. 41.
    Kuijper, A.: Geometrical PDEs based on second-order derivatives of gauge coordinates in image processing. Image Vis. Comput. 27(8), 1023–1034 (2009)CrossRefGoogle Scholar
  42. 42.
    Ladyženskaja, O.A., Solonnikov, V.A., Ural’ceva, N.N.: Linear and quasilinear equations of parabolic type. Translated from the Russian by S. Smith. Translations of Mathematical Monographs, Vol. 23. American Mathematical Society, Providence, RI (1968)Google Scholar
  43. 43.
    Lefkimmiatis, S., Roussos, A., Unser, M., Maragos, P.: Convex generalizations of total variation based on the structure tensor with applications to inverse problems. In: Kuijper, A., Bredies, K., Pock, T., Bischof H. (eds.) SSVM, pp. 48–60 (2013)Google Scholar
  44. 44.
    Levin, A., Nadler, B., Durand, F., Freeman, W.T.: ECCV 2012, chap. Patch Complexity, Finite Pixel Correlations and Optimal Denoising, pp. 73–86. Springer, Berlin (2012)Google Scholar
  45. 45.
    Lindeberg, T.: Scale-Space Theory in Computer Vision. Kluwer international series in engineering and computer science: Robotics: vision, manipulation and sensors. Springer (1993)Google Scholar
  46. 46.
    Nordberg, K.: Signal representation and processing using operator groups. Ph.D. thesis, Linköping University, Sweden (1995)Google Scholar
  47. 47.
    Oliveira, J.P., Bioucas-Dias, J.M., Figueiredo, M.A.: Adaptive total variation image deblurring: a majorizationminimization approach. Signal Process. 89(9), 1683–1693 (2009)CrossRefzbMATHGoogle Scholar
  48. 48.
    Perona, P., Malik, J.: Scale-space and edge detection using anisotropic diffusion. IEEE Trans. PAMI 12(7), 629–639 (1990)CrossRefGoogle Scholar
  49. 49.
    Roussos, A., Maragos, P.: Tensor-based image diffusions derived from generalizations of the total variation and beltrami functionals. In: ICIP, pp. 4141–4144 (2010)Google Scholar
  50. 50.
    Rudin, L., Osher, S., Fatemi, E.: Nonlinear total variation based noise removal algorithms. Phys. D 60(1–4), 259–268 (1992)MathSciNetCrossRefzbMATHGoogle Scholar
  51. 51.
    Scherzer, O., Weickert, J.: Relations between regularization and diffusion filtering. J. Math. Imaging Vis. 12(1), 43–63 (2000)MathSciNetCrossRefzbMATHGoogle Scholar
  52. 52.
    Schmidt, U., Gao, Q., Roth, S.: A generative perspective on mrfs in low-level vision. In: 2010 IEEE conference on computer vision and pattern recognition (CVPR), pp. 1751–1758 (2010)Google Scholar
  53. 53.
    Sharma, G., Bala, R.: Digital Color Imaging Handbook. Electrical Engineering & Applied Signal Processing Series. Taylor & Francis, Abingdon (2014)Google Scholar
  54. 54.
    Torralba, A., Oliva, A.: Statistics of natural image categories. Network: Computation in Neural Systems, pp. 391–412 (2003)Google Scholar
  55. 55.
    Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13(4), 600–612 (2004)CrossRefGoogle Scholar
  56. 56.
    Weickert, J.: Anisotropic Diffusion in Image Processing. Teubner-Verlag, Stuttgart (1998)zbMATHGoogle Scholar
  57. 57.
    Weickert, J.: Nonlinear diffusion filtering. In: Jähne, B., Haussecker, H., Beissler, P. (eds.) Signal Processing and Pattern Recognition. Handbook of Computer Vision and Applications, chap. 15, pp. 423—451. Academic Press (1999)Google Scholar

Copyright information

© Springer Science+Business Media New York 2016

Authors and Affiliations

  • Freddie Åström
    • 1
    Email author
  • Michael Felsberg
    • 2
  • George Baravdish
    • 3
  1. 1.Heidelberg Collaboratory for Image Processing (HCI)Heidelberg UniversityHeidelbergGermany
  2. 2.Department of Electrical EngineeringLinköping UniversityLinköpingSweden
  3. 3.Department of Science and TechnologyLinköping UniversityLinköpingSweden

Personalised recommendations