Skip to main content
SpringerLink
Log in

Moduli of regularity and rates of convergence for Fejér monotone sequences

  • Published:
Israel Journal of Mathematics Aims and scope Submit manuscript

Abstract

In this paper we introduce the concept of modulus of regularity as a tool to analyze the speed of convergence, including the linear convergence and finite termination, for classes of Fejér monotone sequences which appear in fixed point theory, monotone operator theory, and convex optimization. This concept allows for a unified approach to several notions such as weak sharp minima, error bounds, metric subregularity, Holder regularity, etc., as well as to obtain rates of convergence for Picard iterates, the Mann algorithm, the proximal point algorithm and the cyclic projection method. As a byproduct we obtain a quantitative version of the well-known fact that for a convex lower semi-continuous function the set of minimizers coincides with the set of zeros of its subdifferential and the set of fixed points of its resolvent.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. R. M. Anderson, ‘Almost’ implies ‘Near’, Transactions of the American Mathematical Society 296 (1986), 229–237.

    MathSciNet  MATH  Google Scholar 

  2. D. Ariza-Ruiz, E. M. Briseid, A. Jiménez-Melado and G. López-Acedo, Rate of convergence under weak contractiveness conditions, Fixed Point Theory 14 (2013), 11–27.

    MathSciNet  MATH  Google Scholar 

  3. D. Ariza, L. Leuştean and G. López-Acedo, Firmly nonexpansive mappings in classes of geodesic spaces, Transactions of the American Mathematical Society 366 (2014), 4299–4322.

    Article  MathSciNet  MATH  Google Scholar 

  4. D. Ariza-Ruiz, G. López-Acedo and A. Nicolae, The asymptotic behavior of the composition of firmly nonexpansive mappings, Journal of Optimization Theory and Applications 167 (2015), 409–429.

    Article  MathSciNet  MATH  Google Scholar 

  5. M. Bačák, Computing medians and means in Hadamard spaces, SIAM Journal on Optimization 24 (2014), 1542–1566.

    Article  MathSciNet  MATH  Google Scholar 

  6. J. B. Baillon and G. Haddad, Quelques propriétés des operateurs angle-bornes et ncycliquement monotones, Israel Journal of Mathematics 26 (1977), 137–150.

    Article  MathSciNet  MATH  Google Scholar 

  7. S. Banert, Backward-backward splitting in Hadamard spaces, Journal of Mathematical Analysis and Applications 414 (2014), 656–665.

    Article  MathSciNet  MATH  Google Scholar 

  8. H. H. Bauschke and J. M. Borwein, On the convergence of von Neumann’s alternating projection algorithm for two sets, Set-Valued Analysis 1 (1993), 185–212.

    Article  MathSciNet  MATH  Google Scholar 

  9. H. H. Bauschke and J. M. Borwein, On projection algorithms for solving convex feasibility problems, SIAM Review 38 (1996), 367–426.

    Article  MathSciNet  MATH  Google Scholar 

  10. H. H. Bauschke and J. M. Borwein, Dykstra’s alternating projection algorithm for two sets, Journal of Approximation Theory 79 (1994), 418–443.

    Article  MathSciNet  MATH  Google Scholar 

  11. H. H. Bauschke and P. L. Combettes, Convex Analysis and Monotone Operator Theory in Hilbert Spaces, CMS Books in Mathematics, Springer, Cham, 2017.

    Google Scholar 

  12. J. Ben-Artzi, A. C. Hansen, O. Nevanlinna and M. Seidel, New barriers in complexity theory: on the solvability complexity index and the towers of algorithms, Comptes Rendus Mathéamtique. Académie des Sciences. Paris 353 (2015), 931–936.

    Google Scholar 

  13. I. D. Berg and I. G. Nikolaev, Quasilinearization and curvature of Aleksandrov spaces, Geometriae Dedicata 133 (2008), 195–218.

    Article  MathSciNet  MATH  Google Scholar 

  14. I. D. Berg and I. G. Nikolaev, Characterization of Aleksandrov spaces of curvature bounded above by means of the metric Cauchy—Schwarz inequality, Michigan Mathematical Journal 67 (2018), 289–332.

    Article  MathSciNet  MATH  Google Scholar 

  15. J. Bolte, T. P. Nguyen, J. Peypouquet and B. W. Suter, From error bounds to the complexity of first-order descent methods for convex functions, Mathematical Programming 165 (2017), 471–507.

    Article  MathSciNet  MATH  Google Scholar 

  16. J. M. Borwein, G. Li and L. J. Yao, Analysis of the convergence rate for the cyclic projection algorithm applied to basic semi-algebraic convex sets, SIAM Journal on Optimization 24 (2014), 498–527.

    Article  MathSciNet  MATH  Google Scholar 

  17. J. M. Borwein, G. Li and M. K. Tam, Convergence rate analysis for averaged fixed point iterations in common fixed point problems, SIAM Journal on Optimization 27 (2017), 1–33.

    Article  MathSciNet  MATH  Google Scholar 

  18. M. R. Bridson and A. Haefliger, Metric Spaces of Non-positive Curvature, Grundlehren der Mathematischen Wissenschaften, Vol. 319, Springer, Berlin, 1999.

  19. E. M. Briseid, Logical aspects of rates of convergence in metric spaces, Journal of Symbolic Logic 74 (2009), 1401–1428.

    Article  MathSciNet  MATH  Google Scholar 

  20. J. V. Burke and S. Deng, Weak sharp minima revisited. I. Basic theory, Control and Cybernetics 31 (2002), 439–469.

    MathSciNet  MATH  Google Scholar 

  21. J. V. Burke and M. C. Ferris, Weak sharp minima in mathematical programming, SIAM Journal on Control and Optimization 31 (1993), 1340–1359.

    Article  MathSciNet  MATH  Google Scholar 

  22. A. Ciegielski, S. Reich and R. Zalas, Regular sequences of quasi-nonexpansive operators and their applications, SIAM Journal on Optimization 28 (2018), 1508–1532.

    Article  MathSciNet  MATH  Google Scholar 

  23. G. Crombez, Image recovery by convex combinations of projections, Journal of Mathematical Analysis and Applications 155 (1991), 413–419.

    Article  MathSciNet  MATH  Google Scholar 

  24. G. Crombez, Parallel methods in image recovery by projections onto convex sets, Czechoslovak Mathematical Journal 42 (1992), 445–450.

    MathSciNet  MATH  Google Scholar 

  25. A. L. Dontchev and R. T. Rockafellar, Implicit Functions and Solution Mappings. A View from Variational Analysis, Springer Monographs in Mathematics, Springer, Dordrecht, 2009.

    Google Scholar 

  26. M. C. Ferris, Finite termination of the proximal point algorithm, Mathematical Programming 50 (1991), 359–366.

    Article  MathSciNet  MATH  Google Scholar 

  27. K. Goebel and S. Reich, Uniform Convexity, Hyperbolic Geometry, and Nonexpansive Mappings, Monographs and Textbooks in Pure and Applied Mathematics, Vol. 83, Marcel Dekker, New York, 1984.

  28. A. Grzegorczyk, On the definitions of computable real continuous functions, Fundamenta Mathematica 44 (1957), 61–71.

    Article  MathSciNet  MATH  Google Scholar 

  29. L. G. Gurin, B. T. Polyak and E. V. Raik, The method of projections for finding the common point of convex sets, Žurnal Vyčislitel’noui Matematiki i Matematičeskoĭ Fiziki 7 (1967), 1211–1228; English translation: USSR Computational Mathematics and Mathematical Physics 7 (1967), 1–24.

    Google Scholar 

  30. J. Jost, Convex functionals and generalized harmonic maps into spaces of non positive curvature, Commentarii Mathematici Helvetici 70 (1995), 659–673.

    Article  MathSciNet  MATH  Google Scholar 

  31. M. A. A. Khan and U. Kohlenbach, Quantitative image recovery theorems, Nonlinear Analysis 106 (2014), 138–150.

    Article  MathSciNet  MATH  Google Scholar 

  32. U. Kohlenbach, Effective moduli from ineffective uniqueness proofs. An unwinding of de La Vallée Poussin’s proof for Chebycheff approximation, Annals of Pure and Applied Logic 64 (1993), 27–94.

    Article  MathSciNet  MATH  Google Scholar 

  33. U. Kohlenbach, New effective moduli of uniqueness and uniform a-priori estimates for constants of strong unicity by logical analysis of known proofs in best approximation theory, Numerical Functional Analysis and Optimization 14 (1993), 581–606.

    Article  MathSciNet  MATH  Google Scholar 

  34. U. Kohlenbach, Applied Proof Theory: Proof Interpretations and their Use in Mathematics, Springer Monographs in Mathematics, Springer, Berlin-Heidelberg, 2008.

    Google Scholar 

  35. U. Kohlenbach, On the quantitative asymptotic behavior of strongly nonexpansive mappings in Banach and geodesic spaces, Israel Journal of Mathematics 216 (2016), 215–246.

    Article  MathSciNet  MATH  Google Scholar 

  36. U. Kohlenbach, On the reverse mathematics and Weihrauch complexity of moduli of regularity and uniqueness, Computability, to appear.

  37. U. Kohlenbach and A. Koutsoukou-Argyraki, Rates of convergence and metastability for abstract Cauchy problems generated by accretive operators, Journal of Mathematical Analysis and Applications 423 (2015), 1089–1112.

    Article  MathSciNet  MATH  Google Scholar 

  38. U. Kohlenbach, L. Leuştean and A. Nicolae, Quantitative results on Fejér monotone sequences, Communications in Contemporary Mathematics 20 (2018), paper no. 1750015.

  39. U. Kohlenbach and P. Oliva, Proof mining in L 1 -approximation, Annals of Pure and Applied Logic 121 (2003), 1–38.

    Article  MathSciNet  MATH  Google Scholar 

  40. E. Kopeckaá and S. Reich, A note on alternating projections in Hilbert space, Fixed Point Theory and Applications 12 (2012), 41–47.

    Article  MathSciNet  Google Scholar 

  41. L. Leuştean, A quadratic rate of asymptotic regularity for CAT(0)-spaces, Journal of Mathematical Analysis and Applications 325 (2007), 386–399.

    Article  MathSciNet  MATH  Google Scholar 

  42. D. Leventhal, Metric subregularity and the proximal point method, Journal of Mathematical Analysis and Applications 360 (2009), 681–688.

    Article  MathSciNet  MATH  Google Scholar 

  43. C. Li, B. S. Mordukhovich, J. H. Wang and J. C. Yao, Weak sharp minima on Riemannian manifolds, SIAM Journal on Optimization 21 (2011), 1523–1560.

    Article  MathSciNet  MATH  Google Scholar 

  44. G. Li, B. S. Mordukhovich, T. T. A. Nghia and T. S. Pham, Error bounds for parametric polynomial systems with applications to higher order stability systems and convergence rates, Mathematical Programming 168 (2018), 313–346.

    Article  MathSciNet  MATH  Google Scholar 

  45. J. Liang, M. J. Fadili and G. Peyré, Local linear convergence of Forward-Backward under partial smoothness, in Advances in Neural Information Processing Systems. Vol. 27, Curran Associates, Red Hook, NY, 2014, pp. 1970–1978.

    Google Scholar 

  46. J. Liang, J. Fadili and G. Peyré, Convergence rates with inexact non-expansive operators, Mathematical Programming 159 (2016), 403–434.

    Article  MathSciNet  MATH  Google Scholar 

  47. E. Neumann, Computational problems in metric fixed point theory and their Weihrauch degrees, Logical Methods in Computer Science 11 (2015), paper no. 1621.

  48. O. Nevanlinna and S. Reich, Strong convergence of contraction semigroups and of iterative methods for accretive operators in Banach spaces, Israel Journal of Mathematics 32 (1979), 44–58.

    Article  MathSciNet  MATH  Google Scholar 

  49. A. Nicolae, Asymptotic behavior of averaged and firmly nonexpansive mappings in geodesic spaces, Nonlinear Analysis 87 (2013), 102–115.

    Article  MathSciNet  MATH  Google Scholar 

  50. S.-I. Ohta, Convexities of metric spaces, Geometriae Dedicata 125 (2007), 225–250.

    Article  MathSciNet  MATH  Google Scholar 

  51. C. L. Outlaw, Mean value iteration of nonexpansive mappings in a Banach space, Pacific Journal of Mathematics 30 (1969) 747–750.

    Article  MathSciNet  MATH  Google Scholar 

  52. A. Petruşel and I. A. Rus, Graphic contraction principle and applications, submitted.

  53. M. B. Pour-El and J. I. Richards, Computability in Analysis and Physics, Perspectives in Mathematical Logic, Springer, Berlin-Heidelberg, 1989.

    Google Scholar 

  54. S. Reich, A limit theorem for projections, Linear and Multilinear Algebra 13 (1983), 281–290.

    Article  MathSciNet  MATH  Google Scholar 

  55. R. T. Rockafellar, Monotone operators the proximal point algorithm, SIAM Journal on Control and Optimization 14 (1976), 877–898.

    Article  MathSciNet  MATH  Google Scholar 

  56. H. F. Senter and W. G. Dotson, Jr., Approximating fixed points of nonexpansive mappings, Proceedings of the American Mathematical Society 44 (1974), 375–380.

    Article  MathSciNet  MATH  Google Scholar 

  57. E. Specker, Nicht konstruktiv beweisbare Sätze der Analysis, Journal of Symbolic Logic 14 (1949), 145–158.

    Article  MathSciNet  MATH  Google Scholar 

  58. K. Weihrauch, Computable Analysis, Texts in Theoretical Computer Science, Springer, Berlin, 2000.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Mathematics, Technische Universität Darmstadt, Schlossgartenstraße 7, 64289, Darmstadt, Germany

    Ulrich Kohlenbach

  2. Department of Mathematical Analysis - IMUS, University of Seville, Sevilla, Spain

    Genaro López-Acedo & Adriana Nicolae

  3. Department of Mathematics, Babeş-Bolyai University, Kogălniceanu 1, 400084, Cluj-Napoca, Romania

    Adriana Nicolae

Authors
  1. Ulrich Kohlenbach
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Genaro López-Acedo
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Adriana Nicolae
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ulrich Kohlenbach.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kohlenbach, U., López-Acedo, G. & Nicolae, A. Moduli of regularity and rates of convergence for Fejér monotone sequences. Isr. J. Math. 232, 261–297 (2019). https://doi.org/10.1007/s11856-019-1870-x

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11856-019-1870-x

Search

Navigation