Abstract
We introduce an exact reformulation of a broad class of neighborhood filters, among which the bilateral filters, in terms of two functional rearrangements: the decreasing and the relative rearrangements. Independently of the image spatial dimension (one-dimensional signal, image, volume of images, etc.), we reformulate these filters as integral operators defined in a one-dimensional space corresponding to the level sets measures. We prove the equivalence between the usual pixel-based version and the rearranged version of the filter. When restricted to the discrete setting, our reformulation of bilateral filters extends previous results for the so-called fast bilateral filtering. We, in addition, prove that the solution of the discrete setting, understood as constant-wise interpolators, converges to the solution of the continuous setting. Finally, we numerically illustrate computational aspects concerning quality approximation and execution time provided by the rearranged formulation.
Similar content being viewed by others
Notes
C++ code downloaded from http://www.cs.cityu.edu.hk/~qiyang
C++ code downloaded from http://graphics.stanford.edu/papers/permutohedral
References
Adams, A., Gelfand, N., Dolson, J., Levoy, M.: Gaussian kd-trees for fast high-dimensional filtering. ACM Trans. Graph. 28, 21:1–21:12 (2009)
Adams, A., Baek, J., Davis, M.A.: Fast high-dimensional filtering using the permutohedral lattice. Comput. Graph. Forum 29(2), 753–762 (2010)
Álvarez, L., Lions, P.L., Morel, J.M.: Image selective smoothing and edge detection by nonlinear diffusion, II. SIAM J. Numer. Anal. 29, 845–866 (1992)
Alvarez, L., Mazorra, L.: Signal and image restoration using shock filters and anisotropic diffusion. SIAM J. Numer. Anal. 31(2), 590–605 (1994)
Alvino, A., Trombetti, G.: Sulle migliori costanti di maggiorazione per una classe di equationi ellittiche degeneri. Ricerche Mat 27, 413–428 (1978)
Alvino, A., Díaz, J.I., Lions, P.L., Trombetti, G.: Elliptic equations and steiner symmetrization. Commun. Pure Appl. Math. XLIX, 217–236 (1996)
Bandle, C.: Isoperimetric Inequalities and Applications. Pitman, Boston (1980)
Barash, D.: Fundamental relationship between bilateral filtering, adaptive smoothing, and the nonlinear diffusion equation. IEEE T. Pattern Anal. 24(6), 844–847 (2002)
Barash, D., Comaniciu, D.: A common framework for nonlinear diffusion, adaptive smoothing, bilateral filtering and mean shift. Image Vision Comput. 22(1), 73–81 (2004)
Buades, A., Coll, B., Morel, J.M.: A review of image denoising algorithms, with a new one. Multiscale Model Simul. 4(2), 490–530 (2005)
Buades, A., Coll, B., Morel, J.M.: Neighborhood filters and PDE’s. Numer. Math 105(1), 1–34 (2006)
Buades, A., Coll, B., Morel, J.M.: Image denoising methods. A new nonlocal principle. SIAM Rev. 52(1), 113–147 (2010)
Chaudhury, K.N., Sage, D., Unser, M.: Fast O(1) bilateral filtering using trigonometric range kernels. TIP 20(12), 3376 (2011)
Díaz, J.I., Nagai, T.: Symmetrization in a parabolic-elliptic system related to chemotaxis. Adv. Math. Sci. Appl. 5, 659–680 (1995)
Díaz, J.I., Rakotoson, J.M.: On a nonlocal stationary free boundary problem arising in the confinement of a plasma in a Stellarator geometry. Arch. Ration. Mech. Anal. 134(1), 53–95 (1996)
Díaz, J.I., Padial, J.F., Rakotoson, J.M.: Mathematical treatement of the magnetic confinement in a current carrying Stellerator. Nonlinear Anal. TMA 34, 857–887 (1998)
Durand, F., Dorsey, J.: Fast bilateral filtering for the display of high-dynamic-range images. ACM Siggraph 21, 257–266 (2002)
Eisemann, E., Durand, F.: Flash photography enhancement via intrinsic relighting. Siggraph 23(3), 673–678 (2004)
Elad, M.: On the origin of the bilateral filter and ways to improve it. IEEE Trans. Image Process. 11(10), 1141–1151 (2002)
Fiorenza, A., Rakotoson, J.M.: Relative rearrangement and Lebesgue spaces \(L^p(\cdot )\) with variable exponent. J. Math. Pures Appl. 88(6), 506–521 (2007)
Fiorenza, A., Rakotoson, J.M.: Relative rearrangement method for estimating dual norms. Indiana Univ. Math. J. 58(3), 1127–1150 (2009)
Galiano, G., Velasco, J.: On a non-local spectrogram for denoising one-dimensional signals. Appl. Math. Comput. 244, 859–869 (2014)
Galiano, G., Velasco, J.: Neighborhood filters and the decreasing rearrangement. J. Math. Imaging Vision 51(2), 279–295 (2015)
Gilboa, G., Osher, S.: Nonlocal operators with applications to image processing. Multiscale Model Simul 7(3), 1005–1028 (2008)
Hardy, G.H., Littlewood, J.E., Polya, G.: Inequalities. Cambridge University Press, Cambridge (1964)
Kass, M., Solomon, J.: Smoothed local histogram filters. ACM TOG 29(4), 100:1–100:10 (2010)
Lieb, E.H., Loss, M.: Analysis, vol. 4. American Mathematical Society, Providence (2001)
Milanfar, P.: A tour of modern image filtering: new insights and methods, both practical and theoretical. IEEE Signal Process Mag. 30, 106–128 (2012)
Mossino, J., Temam, R.: Directional derivative of the increasing rearrangement mapping and application to a queer differential equation in plasma physics. Duke Math. J. 48(3), 475–495 (1981)
Mossino, J.: Inégalités Isopérmétriques et applications en physique. Hermann, Paris (1984)
Mossino, J., Rakotoson, J.M.: Isoperimetric inequalities in parabolic equations. Ann. Sc. Norm. Super. Pisa. Sci. IV 13(1), 51–73 (1986)
Paris, S., Durand, F.: A fast approximation of the bilateral filter using a signal processing approach. ECCV. Springer, Berlin (2006)
Perona, P., Malik, J.: Scale-space and edge detection using anisotropic diffusion. IEEE Trans. Pattern Anal. 12(7), 629–639 (1990)
Peyré, G.: Image processing with nonlocal spectral bases. Multiscale Model Simulat. 7(2), 703–730 (2008)
Petschnigg, G., Agrawala, M., Hoppe, H., Szeliski, R., Cohen, M., Toyama, K.: Digital photography with flash and no-flash image pairs. ACM Siggraph 23(3), 664–672 (2004)
Pólya, G., Szegö, G.: Isoperimetric Inequalities in Mathematical Physics. Princenton University Press, Princeton (1951)
Porikli, F.: Constant time O(1) bilateral filtering. In: CVPR (2008)
Rakotoson, J.M.: Réarrangement Relatif: Un instrument d’estimations dans les problèmes aux limites, vol. 64. Springer, Berlin (2008)
Rakotoson, J.M.: Lipschitz properties in variable exponent problems via relative rearrangement. Chin. Ann. Math. 31B(6), 991–1006 (2010)
Rakotoson, J.M.: New Hardy inequalities and behaviour of linear elliptic equations. J. Funct. Anal. 263(9), 2893–2920 (2008)
Ram, I., Elad, M., Cohen, I.: Image processing using smooth ordering of its patches. IEEE Trans. Image Process. 22(7), 2764–2774 (2013)
Rudin, L.I., Osher, S., Fatemi, E.: Nonlinear total variation based noise removal algorithms. Physica D 60(1), 259–268 (1992)
Singer, A., Shkolnisky, Y., Nadler, B.: Diffusion interpretation of nonlocal neighborhood filters for signal denoising. SIAM J. Imaging Sci. 2(1), 118–139 (2009)
Smith, S.M., Brady, J.M.: Susan. A new approach to low level image processing. Int. J. Comput. Vision 23(1), 45–78 (1997)
Talenti, G.: Best constant in Sobolev inequality. Ann. Mat. Pura Appl. (4)110, 353–372 (1976)
Tomasi, C., Manduchi, R.: Bilateral filtering for gray and color images. In: Sixth International Conference on Computer Vision, pp 839–846 (1998)
Vázquez, J.L.: Symétrization pour \(u_{t}=\varDelta \phi (u)\) et applications. C. R. Acad. Paris 295, 71–74 (1982)
Weiss, B.: Fast median and bilateral filtering. ACM Siggraph 25, 519–526 (2006)
Yang, Q., Tan, K.H., Ahuja, N.: Real-time O(1) bilateral filtering. In: CVPR (2009)
Yang, Q., Ahuja, N., Tan, K.H.: Constant time median and bilateral filtering. Int. J. Comput. Vis. 9, 41 (2014). doi:10.1007/s11263-014-0764-y
Yaroslavsky, L.P.: Digital Picture Processing. An Introduction. Springer, Berlin (1985)
Yaroslavsky, L.P., Eden, M.: Fundamentals of Digital Optics. Birkhäuser, Boston (2003)
Acknowledgments
The authors are partially supported by the Spanish DGI Project MTM2013-43671-P. The authors thank to the anonymous reviewers for their interesting comments and suggestions, that highly contributed to the improvement of our work.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Galiano, G., Velasco, J. On a Fast Bilateral Filtering Formulation Using Functional Rearrangements. J Math Imaging Vis 53, 346–363 (2015). https://doi.org/10.1007/s10851-015-0583-y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10851-015-0583-y