Abstract
In this paper, we consider the regularization method for exact as well as for inexact proximal point algorithms for finding the singularities of maximal monotone set-valued vector fields. We prove that the sequences generated by these algorithms converge to an element of the set of singularities of a maximal monotone set-valued vector field. A numerical example is provided to illustrate the inexact proximal point algorithm with regularization. Applications of our results to minimization problems and saddle point problems are given in the setting of Hadamard manifolds.
Similar content being viewed by others
References
Bačák, M., Reich, S.: The asymptotic behavior of a class of nonlinear semigroups in Hadamard spaces. J. Fixed Point Theory Appl. 16, 189–202 (2014)
Bauschke, H.H., Combettes, P.L.: A weak-to-strong convergence principle for Fejér-monotone methods in Hilbert spaces. Math. Oper. Res. 26, 248–264 (2001)
Bauschke, H.H., Matoušková, E., Reich, S.: Projection and proximal point methods, convergence results and counterexamples. Nonlinear Anal. 56, 715–736 (2004)
Bridson, M., Haefliger, A.: Metric Spaces of Non-positive Curvature. Springer, Berlin, Heidelberg, New York (1999)
Bruck, R.E.: A strongly convergent iterative solution of \(0 \in U(x)\) for a maximal monotone operator in Hilbert space. J. Math. Anal. Appl. 48, 114–126 (1974)
Bruck, R.E., Reich, S.: Nonexpansive projections and resolvents of accretive operators in Banach spaces. Houston J. Math. 3, 459–470 (1977)
Bruck, R.E., Reich, S.: A general convergence principle in nonlinear functional analysis. Nonlinear Anal. 4, 939–950 (1980)
da Cruz Neto, J.X., Ferreira, O.P., Lucambio Pérez, L.R., Németh, S.Z.: Convex- and monotone-transformable mathematical programming problems and a proximal-like point method. J. Global Optim., 35, 53–69 (2006)
da Cruz Neto, J.X., Ferreira, O.P., Lucambio Pérez, L.R.: Monotone point-to-set vector fields. Balk. J. Geometry Appl 5(1), 69–79 (2000)
Ferreira, O.P., Oliveira, P.R.: Proximal point algorithm on Riemannian manifolds. Optimization 51, 257–270 (2002)
Güler, O.: On The convergence of the proximal point algorithm for convex minimization. SIAM J. Control Optim. 29, 403–419 (1991)
Han, D.R., He, B.S.: A new accuracy criterion for approximate proximal point algorithms. J. Math. Anal. Appl. 263, 343–354 (2001)
Kamimura, S., Takahashi, W.: Approximating solutions of maximal monotone operators in Hilbert spaces. J. Approx. Theory 106, 226–240 (2000)
Kamimura, S., Takahashi, W.: Strong convergence of a proximal-type algorithm in a Banach space. SIAM J. Optim. 13(3), 938–945 (2003)
Lehdili, N., Moudafi, A.: Combining the proximal algorithm and Tikhonov regularization. Optimization 37, 239–252 (1996)
Li, C., López, G., Martín-Márquez, V.: Monotone vector fields and the proximal point algorithm on Hadamard manifolds. J. Lond. Math. Soc. 79, 663–683 (2009)
Li, C., López, G., Martín-Márquez, V.: Iterative algorithms for nonexpansive mappings on Hadamard manifolds. Taiwan. J. Math. 14(2), 541–559 (2010)
Li, C., López, G., Martín-Márquez, V.: Resolvents of set-valued monotone vector fields in Hadamard manifolds. Set Val. Anal. 19, 361–383 (2011)
Nevanlinna, O., Reich, S.: Strong convergence of contraction semigroups and of iterative methods for accretive operators in Banach spaces. Israel J. Math. 32, 44–58 (1979)
Reich, S.: Extension problems for accretive sets in Banach spaces. J. Funct. Anal. 26, 378–395 (1977)
Reich, S., Salinas, Z.: Weak convergence of infinite products of operators in Hadamard spaces. Rend. Circ. Mat. Palermo 65, 55–71 (2016)
Rockafellar, R.T.: Monotone operators and the proximal point algorithm. SIAM J. Control Optim. 14, 877–898 (1976)
Rudin, W.: Real and Complex Analysis, 3rd edn. McGraw-Hill, New York (1987)
Sahu, D.R., Ansari, Q.H., Yao, J.C.: The Prox–Tikhonov-like forward-backward method and applications. Taiwan. J. Math. 19, 481–503 (2015)
Sakai, T.: Riemannian geometry, translations of mathematical monographs. American Mathematical Society, Providence, RI (1996)
Solodov, M.V., Svaiter, B.F.: Forcing strong convergence of proximal point iterations in a Hilbert space. Math. Program., Ser. A, 87, 189–202 (2000)
Song, Y., Yang, C.: A note on a paper “A regularization method for the proximal point algorithm”. J. Global Optim. 43, 171–174 (2009)
Tang, G.J., Huang, N.J.: An inexact proximal point algorithm for maximal monotone vector fields on Hadamard manifolds. Oper. Res. Lett. 41, 586–591 (2013)
Udriste, C.: Convex Functions and Optimization Methods on Riemannian Manifolds. Kluwer Academic Publishers, Dordrecht, Boston, London (1994)
Walter, R.: On the metric projections onto convex sets in Riemannian spaces, pp. 91–98. Arch. Math, XXV (1974)
Wang, F.: A note on the regularized proximal point algorithm. J. Global Optim. 50, 531–535 (2011)
Wang, J., Li, C., López, G., Yao, J.C.: Convergence analysis of inexact proximal point algorithms on Hadamard manifolds. J. Global Optim. 61(3), 553–573 (2015)
Xu, H.K.: A regularization method for the proximal point algorithm. J. Global Optim. 36, 115–125 (2006)
Acknowledgements
The authors are grateful to the reviewers for their valuable suggestions and corrections that improved the first draft of this paper. In this research, the first author was supported by a research Grant of DST-SERB No. EMR/2016/005124, and the last author was supported by a research Grant No. MOST 105-2115-M-039-002-MY3.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Ansari, Q.H., Babu, F. & Yao, JC. Regularization of proximal point algorithms in Hadamard manifolds. J. Fixed Point Theory Appl. 21, 25 (2019). https://doi.org/10.1007/s11784-019-0658-2
Published:
DOI: https://doi.org/10.1007/s11784-019-0658-2
Keywords
- Inclusion problems
- regularization method
- proximal point algorithms
- maximal monotone vector fields
- minimization problems
- saddle point problems
- Hadamard manifolds