Non-local Regularization of Inverse Problems

  • Gabriel Peyré
  • Sébastien Bougleux
  • Laurent Cohen
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5304)


This article proposes a new framework to regularize linear inverse problems using the total variation on non-local graphs. This non-local graph allows to adapt the penalization to the geometry of the underlying function to recover. A fast algorithm computes iteratively both the solution of the regularization process and the non-local graph adapted to this solution. We show numerical applications of this method to the resolution of image processing inverse problems such as inpainting, super-resolution and compressive sampling.


Inverse Problem Compressive Sampling Graph Regularization Image Inpainting Proximity Operator 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Mallat, S.: A Wavelet Tour of Signal Processing. Academic Press, San Diego (1998)zbMATHGoogle Scholar
  2. 2.
    Yaroslavsky, L.P.: Digital Picture Processing – an Introduction. Springer, Heidelberg (1985)CrossRefGoogle Scholar
  3. 3.
    Tomasi, C., Manduchi, R.: Bilateral filtering for gray and color images. In: Int. Conf. on Computer Vision, pp. 839–846. IEEE Computer Society, Los Alamitos (1998)Google Scholar
  4. 4.
    Smith, S.M., Brady, J.M.: SUSAN - a new approach to low level image processing. International Journal of Computer Vision 23, 45–78 (1997)CrossRefGoogle Scholar
  5. 5.
    Spira, A., Kimmel, R., Sochen, N.: A short time beltrami kernel for smoothing images and manifolds. IEEE Trans. Image Processing 16, 1628–1636 (2007)MathSciNetCrossRefGoogle Scholar
  6. 6.
    Buades, A., Coll, B., Morel, J.M.: On image denoising methods. SIAM Multiscale Modeling and Simulation 4, 490–530 (2005)CrossRefzbMATHGoogle Scholar
  7. 7.
    Efros, A.A., Leung, T.K.: Texture synthesis by non-parametric sampling. In: Int. Conf. on Computer Vision, pp. 1033–1038. IEEE Computer Society, Los Alamitos (1999)Google Scholar
  8. 8.
    Wei, L.Y., Levoy, M.: Fast texture synthesis using tree-structured vector quantization. In: SIGGRAPH 2000, pp. 479–488 (2000)Google Scholar
  9. 9.
    Le Pennec, E., Mallat, S.: Bandelet Image Approximation and Compression. SIAM Multiscale Modeling and Simulation 4, 992–1039 (2005)MathSciNetCrossRefzbMATHGoogle Scholar
  10. 10.
    Mallat, S.: Geometrical grouplets. Applied and Computational Harmonic Analysis (to appear, 2008)Google Scholar
  11. 11.
    Peyré, G.: Texture processing with grouplets. Preprint Ceremade (2008)Google Scholar
  12. 12.
    Coifman, R.R., Lafon, S., Lee, A.B., Maggioni, M., Nadler, B., Warner, F., Zucker, S.W.: Geometric diffusions as a tool for harmonic analysis and structure definition of data: Diffusion maps. Proc. of the Nat. Ac. of Science 102, 7426–7431 (2005)CrossRefGoogle Scholar
  13. 13.
    Szlam, A., Maggioni, M., Coifman, R.R.: A general framework for adaptive regularization based on diffusion processes on graphs. Journ. Mach. Learn. Res. (to appear 2007)Google Scholar
  14. 14.
    Gilboa, G., Osher, S.: Nonlocal linear image regularization and supervised segmentation. SIAM Multiscale Modeling and Simulation 6, 595–630 (2007)MathSciNetCrossRefzbMATHGoogle Scholar
  15. 15.
    Gilboa, G., Darbon, J., Osher, S., Chan, T.: Nonlocal convex functionals for image regularization. UCLA CAM Report 06-57 (2006)Google Scholar
  16. 16.
    Zhou, D., Scholkopf, B.: Regularization on discrete spaces. In: German Pattern Recognition Symposium, pp. 361–368 (2005)Google Scholar
  17. 17.
    Elmoataz, A., Lezoray, O., Bougleux, S.: Nonlocal discrete regularization on weighted graphs: a framework for image and manifold processing. IEEE Tr. on Image Processing 17(7), 1047–1060 (2008)MathSciNetCrossRefzbMATHGoogle Scholar
  18. 18.
    Peyré, G.: Image processing with non-local spectral bases. SIAM Multiscale Modeling and Simulation (to appear, 2008)Google Scholar
  19. 19.
    Kindermann, S., Osher, S., Jones, P.W.: Deblurring and denoising of images by nonlocal functionals. SIAM Mult. Model. and Simul. 4, 1091–1115 (2005)MathSciNetCrossRefzbMATHGoogle Scholar
  20. 20.
    Buades, A., Coll, B., Morel, J.M.: Image enhancement by non-local reverse heat equation. Preprint CMLA 2006-22 (2006)Google Scholar
  21. 21.
    Buades, A., Coll, B., Morel, J.M., Sbert, C.: Non local demosaicing. Preprint 2007-15 (2007)Google Scholar
  22. 22.
    Gilboa, G., Osher, S.: Nonlocal operators with applications to image processing. UCLA CAM Report 07-23 (2007)Google Scholar
  23. 23.
    Datsenko, D., Elad, M.: Example-based single image super-resolution: A global map approach with outlier rejection. Journal of Mult. System and Sig. Proc. 18, 103–121 (2007)MathSciNetCrossRefzbMATHGoogle Scholar
  24. 24.
    Freeman, W.T., Jones, T.R., Pasztor, E.C.: Example-based super-resolution. IEEE Computer Graphics and Applications 22, 56–65 (2002)CrossRefGoogle Scholar
  25. 25.
    Ebrahimi, M., Vrscay, E.: Solving the inverse problem of image zooming using ’self examples’. In: Kamel, M., Campilho, A. (eds.) ICIAR 2007. LNCS, vol. 4633, pp. 117–130. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  26. 26.
    Rudin, L.I., Osher, S., Fatemi, E.: Nonlinear total variation based noise removal algorithms. Phys. D 60, 259–268 (1992)MathSciNetCrossRefzbMATHGoogle Scholar
  27. 27.
    Malgouyres, F., Guichard, F.: Edge direction preserving image zooming: A mathematical and numerical analysis. SIAM Journal on Numer. An. 39, 1–37 (2001)MathSciNetCrossRefzbMATHGoogle Scholar
  28. 28.
    Donoho, D., Johnstone, I.: Ideal spatial adaptation via wavelet shrinkage. Biometrika 81, 425–455 (1994)MathSciNetCrossRefzbMATHGoogle Scholar
  29. 29.
    Daubechies, I., Defrise, M., Mol, C.D.: An iterative thresholding algorithm for linear inverse problems with a sparsity constraint. Comm. Pure Appl. Math. 57, 1413–1541 (2004)MathSciNetCrossRefzbMATHGoogle Scholar
  30. 30.
    Elad, M., Starck, J.L., Donoho, D., Querre, P.: Simultaneous cartoon and texture image inpainting using morphological component analysis (MCA). Journal on Applied and Computational Harmonic Analysis 19, 340–358 (2005)MathSciNetCrossRefzbMATHGoogle Scholar
  31. 31.
    Fadili, M., Starck, J.L., Murtagh, F.: Inpainting and zooming using sparse representations. The Computer Journal (to appear) (2006)Google Scholar
  32. 32.
    Chung, F.R.K.: Spectral graph theory. In: Regional Conference Series in Mathematics, American Mathematical Society, vol. 92, pp. 1–212 (1997)Google Scholar
  33. 33.
    Combettes, P.L., Wajs, V.R.: Signal recovery by proximal forward-backward splitting. Multiscale Modeling & Simulation 4, 1168–1200 (2005)MathSciNetCrossRefzbMATHGoogle Scholar
  34. 34.
    Fadili, M., Starck, J.L.: Monotone operator splitting and fast solutions to inverse problems with sparse representations (preprint, 2008)Google Scholar
  35. 35.
    Chambolle, A.: An algorithm for total variation minimization and applications. Journal of Mathematical Imaging and Vision 20, 89–97 (2004)MathSciNetCrossRefzbMATHGoogle Scholar
  36. 36.
    Masnou, S.: Disocclusion: a variational approach using level lines. IEEE Trans. Image Processing 11, 68–76 (2002)MathSciNetCrossRefGoogle Scholar
  37. 37.
    Ballester, C., Bertalmìo, M., Caselles, V., Sapiro, G., Verdera, J.: Filling-in by joint interpolation of vector fields and gray levels. IEEE Trans. Image Processing 10, 1200–1211 (2001)MathSciNetCrossRefzbMATHGoogle Scholar
  38. 38.
    Bertalmìo, M., Sapiro, G., Caselles, V., Ballester, C.: Image inpainting. In: Siggraph 2000, pp. 417–424 (2000)Google Scholar
  39. 39.
    Tschumperlé, D., Deriche, R.: Vector-valued image regularization with PDEs: Acommon framework for different applications. IEEE Trans. Pattern Anal. Mach. Intell 27, 506–517 (2005)CrossRefGoogle Scholar
  40. 40.
    Criminisi, A., Pérez, P., Toyama, K.: Region filling and object removal by exemplar-based image inpainting. IEEE Trans. on Image Processing 13, 1200–1212 (2004)CrossRefGoogle Scholar
  41. 41.
    Park, S.C., Park, M.K., Kang, M.G.: Super-resolution image reconstruction: a technical overview. IEEE Signal Processing Magazine 20, 21–36 (2003)CrossRefGoogle Scholar
  42. 42.
    Farsiu, S., Robinson, D., Elad, M., Milanfar, P.: Advances and challenges in super-resolution. Int. Journal of Imaging Sys. and Tech. 14, 47–57 (2004)CrossRefGoogle Scholar
  43. 43.
    Candès, E., Tao, T.: Near-optimal signal recovery from random projections: Universal encoding strategies? IEEE Trans. Information Theory 52, 5406–5425 (2006)MathSciNetCrossRefzbMATHGoogle Scholar
  44. 44.
    Donoho, D.: Compressed sensing. IEEE Trans. Information Theory 52, 1289–1306 (2006)MathSciNetCrossRefzbMATHGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Gabriel Peyré
    • 1
  • Sébastien Bougleux
    • 1
  • Laurent Cohen
    • 1
  1. 1.Université Paris-Dauphine, CEREMADEParis Cedex 16France

Personalised recommendations