Abstract
In this paper, the forward–backward splitting method for the minimization of the sum of two functions have been extended to Banach spaces. The regularization term of the forward–backward splitting method is constructed by the norm with p-power. We prove the functional values of the sequences generated by this method converge with an asymptotic rate \(n^{1-p}\) to the optimal value of the problem and establish the linear convergence under an error bound assumption.
Similar content being viewed by others
References
Attouch, H., Czarnecki, M.O., Peypouquet, J.: Coupling forward–backward with penalty schemes and parallel splitting for constrained variational inequalities. SIAM J. Optim. 21(4), 1251–1274 (2011)
Attouch, H., Cabot, A., Chbani, Z., Riahi, H.: Inertial forward–backward algorithms with perturbations: application to Tikhonov regularization. J. Optim. Theory Appl. 179, 1–36 (2018)
Beauzamy, B.: Introduction to Banach Spaces and Their Geometry, 2nd edn, p. 25. North-Holland, Amsterdam (1985)
Bonnans, J.F., Shapiro, A.: Perturbation Analysis of Optimization Problems. Springer, New York (2000)
Bredies, K.: A forward–backward splitting algorithm for the minimization of nonsmooth convex functionals in Banach space. Inverse Problems 25, 015005 (2009)
Cioranescu, I.: Geometry of Banach Spaces, Duality Mappings and Nonlinear Problems, vol. 62 of Mathematics and Its Applications. Kluwer Academic Publishers, Dordrecht (1990)
Combettes, P.L.: Inconsistent signal feasibility problems: least-squares solutions in a product space. IEEE Trans. Signal Process. 42, 2955–2966 (1994)
Combettes, P.L., Dũng, D., Vũ, B.C.: Dualization of signal recovery problems. Set-Valued Anal. 18, 373–404 (2010)
Combettes, P.L., Wajs, V.R.: Signal recovery by proximal forward–backward splitting. Multiscale Model. Simul. 4, 1168–1200 (2005)
Guan, W.B., Song, W.: The generalized forward–backward splitting method for the minimization of the sum of two functions in Banach spaces. Numer. Func. Anal. Opt. 36, 867–886 (2015)
Lions, P.L., Mercier, B.: Splitting algorithms for the sum of two nonlinear operators. SIAM J. Numer. Anal. 16, 964–979 (1979)
Nguyen, Q.V.: Forward–backward splitting with Bregman distances. Vietnam J. Math. 45, 519–539 (2017)
Stella, L., Themelis, A., Patrinos, P.: Forward–backward quasi-Newton methods for nonsmooth optimization poblems. Comput. Optim. Appl. 67, 443–487 (2017)
Takahashi, W.: Convex Analysis and Approximation of Fixed Points, vol. 2 of Mathematical Analysis Series. Yokohama Publishers, Yokohama (2000)
Zalinescu, C.: On uniformly convex functions. J. Math. Anal. Appl. 95, 344–374 (1983)
Zhang, H.B., Jiang, J.J., Luo, ZhQ: On the linear convergence of a proximal gradient method for a class of nonsmooth convex minimization poblems. J. Oper. Res. China 1, 163–186 (2013)
Acknowledgements
The work was supported by PHD research startup foundation of Harbin Normal University (No. XKB201804) and the National Natural Sciences Grant (No. 11871182).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Guan, WB., Song, W. The forward–backward splitting method and its convergence rate for the minimization of the sum of two functions in Banach spaces. Optim Lett 15, 1735–1758 (2021). https://doi.org/10.1007/s11590-020-01544-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11590-020-01544-9