Abstract
We exploit the recurrence of structures at different locations, orientations and scales in an image to perform denoising. While previous methods based on “nonlocal filtering” identify corresponding patches only up to translations, we consider more general similarity transformations. Due to the additional computational burden, we break the problem down into two steps: First, we extract similarity invariant descriptors at each pixel location; second, we search for similar patches by matching descriptors. The descriptors used are inspired by scale-invariant feature transform (SIFT), whereas the similarity search is solved via the minimization of a cost function adapted from local denoising methods. Our method compares favorably with existing denoising algorithms as tested on several datasets.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Mumford, D., Shah, J.: Optimal approximation by piecewise smooth optimal approximation by piecewise smooth functions and associated variational problems. Commun. Pure Appl. Math. 42, 577–685 (1989)
Yin, W., Goldfarb, D., Osher, S.J.: Image cartoon-texture decomposition and feature selection using the total variation regularized l1 functional. In: Paragios, N., Faugeras, O., Chan, T., Schnörr, C. (eds.) VLSM 2005. LNCS, vol. 3752, pp. 73–84. Springer, Heidelberg (2005)
Wang, J.Y.A., Adelson, E.H.: Representing moving images with layers. IEEE Transactions on Image Processing Special Issue: Image Sequence Compression 3(5), 625–638 (1994)
Lindeberg, T.: Scale-space theory: A basic tool for analysing sturctures at different scale. Journal of Applied Statistics 21(2), 224–270 (1994)
Freeman, W.T., Jones, T.R., Pasztor, E.C.: Example-based super-resolution. In: IEEE Computer Graphics and Applications (2002)
Wei, L.Y., Levoy, M.: Fast texture synthesis using tree-structured vector quantization. In: Proc. of conf. on Computer Graphics and interactive techniques, pp. 479–488 (2000)
Buades, A., Coll, B., Morel, J.M.: On image denoising methods. SIAM Multiscale Modeling and Simulation 4(2), 490–530 (2005)
Lowe, D.G.: Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision 60(2), 91–110 (2004)
Perona, P., Malik, J.: Scale space and edge detection using anisotropic diffusion. IEEE Trans. Pattern Anal. Math. Intell. 12, 629–639 (1990)
Rudin, L., Osher, S., Fatemi, E.: Nonlinear total variation based noise removal algorithms. Physica D 60, 259–268 (1992)
Chambolle, A.: An algorithm for total variation minimization and applications. Journal of Mathematical Imaging Vision 20, 89–97 (2004)
Portilla, J., Strela, V., Wainwright, M.J., Simoncelli, E.P.: Image denoising using scale mixtures of gaussians in the wavelet domain. IEEE Trans. Image Process. 12, 1338–1351 (2003)
Mignotte, M.: Image denoising by averaging of piecewise constant simulations of image partitions. IEEE Trans. Image Processing 16, 523–533 (2007)
Tomasi, C., Manduchi, R.: Bilateral filtering for gray and color images. In: Proc. International Conference Computer Vision, pp. 839–846 (1998)
Awate, S.P., Whitaker, R.T.: Unsupervised, information-theoretic, adaptive image filtering for image restoration. IEEE Trans. Pattern Anal. Mach. Intell. 28(3), 364–376 (2006)
Yaroslavsky, L.P.: Digital Picture Processing, an Introduction. Springer, Berlin (1985)
Efros, A.A., Leung, T.K.: Texture synthesis by non-parameteric sampling. In: ICCV, vol. 2, pp. 1033–1038 (1999)
Criminisi, A., Perez, P., Toyama, K.: Region filling and object removal by exemplar-based inpainting. IEEE Transactions on Image Processing, 1200–1212 (2004)
Brox, T., Cremers, D.: Iterated nonlocal means for texture restoration. In: Sgallari, F., Murli, A., Paragios, N. (eds.) SSVM 2007. LNCS, vol. 4485, pp. 13–24. Springer, Heidelberg (2007)
Mahmoudi, M., Sapiro, G.: Fast image and video denoising via nonlocal means of similiar neighborhoods. IEEE Signal Processing Letter 12, 839–842 (2005)
Kervrann, C., Boulanger, J.: Optimal spatial adaptatio for patch-based image denoising. IEEE Trans. Image Processing 15, 2866–2878 (2006)
Gilboa, G., Osher, S.: Nonlocal operators with applications to image processing. Technical report, UCLA CAM report 07-23 (2007)
Kindermann, S., Osher, S., Jones, P.: Deblurring and denoising of images by nonlocal functionals. SIAM Multiscale Modeling and Simulation 4(4), 1091–1115 (2005)
Zhou, D., Scholkopf, B.: A regularization framework for learning from graph data. In: ICML Workshop on Stat. Relational Learning and Its Connections to Other Fields (2004)
Chatterjee, P., Milanfar, P.: A generalization of non-local means via kernel regression. In: Proc. of SPIE Conf. on Computational Imaging (2008)
Schmid, C., Mohr, R.: Local greyvalue invariants for image retrieval. Pattern Analysis and Machine Intelligence (1997)
Tuytelaars, T., Gool, L.V.: Wide baseline stereo based on local, affinely invariant regions. In: British Machine vision conference, pp. 412–422 (2000)
Matas, J., Chum, O., Urban, M., Pajdla, T.: Robusts wide baseline stereo from maximally stable extremal regions. In: British Machine vision conference, pp. 384–393 (2002)
Vedaldi, A., Soatto, S.: Local features, all grown up. In: Proceedings of the IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), pp. 1753–1760 (2006)
Gilboa, G., Osher, S.: Nonlocal linear image regularization and supervised segmentation. SIAM Multiscale Modeling and Simulation 6(2), 595–630 (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Lou, Y., Favaro, P., Soatto, S., Bertozzi, A. (2009). Nonlocal Similarity Image Filtering. In: Foggia, P., Sansone, C., Vento, M. (eds) Image Analysis and Processing – ICIAP 2009. ICIAP 2009. Lecture Notes in Computer Science, vol 5716. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-04146-4_9
Download citation
DOI: https://doi.org/10.1007/978-3-642-04146-4_9
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-04145-7
Online ISBN: 978-3-642-04146-4
eBook Packages: Computer ScienceComputer Science (R0)