Abstract
The Moreau envelope, also known as Moreau–Yosida regularization, and the associated proximal mapping have been widely used in Hilbert and Banach spaces. They have been objects of great interest for optimizers since their conception more than half a century ago. They were generalized by the notion of the D-Moreau envelope and D-proximal mapping by replacing the usual square of the Euclidean distance with the conception of Bregman distance for a convex function. Recently, the D-Moreau envelope has been developed in a very general setting. In this article, we present a regularizing and smoothing technique for convex functions defined in Banach spaces. We also investigate several properties of the D-Moreau envelope function and its related D-proximal mapping in Banach spaces. For technical reasons, we restrict our attention to the Lipschitz continuity property of the D-proximal mapping and differentiability properties of the D-Moreau envelope function. In particular, we prove the Fréchet differentiability property of the envelope and the Lipschitz continuity property of its derivative.
Similar content being viewed by others
References
Fukushima, M., Qi, L.: A globally and superlinearly convergent algorithm for nonsmooth convex minimization. SIAM J. Optim. 6, 1106–1120 (1996)
Rockefeller, R.T.: Monotone operators and proximal point algorithm. SIAM J. Control Optim. 14, 877–898 (1976)
Attouch, H.: Variational Convergence for Functions and Operators. Pitman Advanced Publishing Program, Boston (1984)
Moreau, J.J.: Proximité et dualité dans un espace hilbertien. Bull. Soc. Math. France 93, 273–299 (1965)
Bauschke, H.H., Combettes, P.L.: Convex Analysis and Monotone Operator Theory in Hilbert Spaces. Springer, New York (2011)
Burger, M., Sawatzky, A., Steidl, G.: First order algorithms in variational image processing. In: Splitting Methods in Communication, Imaging, Science, and Engineering, pp. 345–407. Springer, Cham (2016)
Parikh, N., Boyd, S.: Proximal algorithms. Found. Trends Optim. 1, 127–239 (2014)
Censor, Y., Lent, A.: An iterative row-action method for interval convex programming. J. Optim. Theory Appl. 34, 321–353 (1981)
Bregman, L.M.: The relaxation method of finding the common point of convex sets and its application to the solution of problems in convex programming. USSR Comput. Math. Math. Phys. 7, 200–217 (1967)
Kan, C., Song, W.: The Moreau envelope function and proximal mapping in the sense of the Bregman distance. Nonlinear Anal. Theory Methods Appl. 75, 1385–1399 (2012)
Chen, Y.Y., Kan, C., Song, W.: The Moreau envelope function and proximal mapping with respect to the Bregman distances in Banach spaces. Vietnam J. Math. 40, 181–99 (2012)
Bauschke, H.H., Dao, M.N., Lindstrom, S.B.: Regularizing with Bregman–Moreau envelopes. SIAM J. Optim. 28, 3208–3228 (2018)
Burachik, R.S., Iusem, A.N.: A generalized proximal point algorithm for the variational inequality problem in a Hilbert space. SIAM J. Optim. 8, 197–216 (1998)
Clarke, F.H.: Optimization and Nonsmooth Analysis. Wiley, New York (1983)
Peypouquet, J.: Convex Optimization in Normed Spaces: Theory, Methods and Examples. Springer, Berlin (2015)
Takahashi, W.: Nonlinear Functional Analysis. Fixed Point Theory and Its Applications. Yokohama Publishers, Yokohama (2000)
Zalinescu, C.: Convex Analysis in General Vector Spaces. World Scientific, River Edge (2002)
Bauschke, H.H., Borwein, J.M., Combettes, P.L.: Bregman monotone optimization algorithms. SIAM J. Control Optim. 42, 596–636 (2003)
Butnariu, D., Iusem, A.N.: Totally Convex Functions for Fixed Points Computation and Infinite Dimensional Optimization, vol. 40. Springer, Berlin (2012)
Butnariu, D., Resmerita, E.: Bregman distances, totally convex functions, and a method for solving operator equations in Banach spaces. Abstr. Appl. Anal. 2006, 1–39 (2006)
Resmerita, E.: On total convexity, Bregman projections and stability in Banach spaces. J. Convex Anal. 11, 1–16 (2004)
Acknowledgements
All the authors express their thanks to the referees for their helpful remarks and comments about this subject.
Author information
Authors and Affiliations
Corresponding author
Additional information
Communicated by Nicolas Hadjisavvas.
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Soueycatt, M., Mohammad, Y. & Hamwi, Y. Regularization in Banach Spaces with Respect to the Bregman Distance. J Optim Theory Appl 185, 327–342 (2020). https://doi.org/10.1007/s10957-020-01655-4
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10957-020-01655-4