Advertisement

Journal of Optimization Theory and Applications

, Volume 158, Issue 2, pp 343–362 | Cite as

Strong Convergence in Hilbert Spaces via Γ-Duality

  • M. Marques Alves
  • J. G. Melo
Article

Abstract

We analyze a primal-dual pair of problems generated via a duality theory introduced by Svaiter. We propose a general algorithm and study its convergence properties. The focus is a general primal-dual principle for strong convergence of some classes of algorithms. In particular, we give a different viewpoint for the weak-to-strong principle of Bauschke and Combettes and unify many results concerning weak and strong convergence of subgradient type methods.

Keywords

Γ-Duality Hilbert spaces Convex feasibility Strong convergence Subgradient method 

Notes

Acknowledgements

This work was completed while the first author was visiting the Institute of Mathematics and Statistics at the University of Goias, whose warm hospitality is gratefully acknowledged. The authors thank Dr. Benar Fux Svaiter for bringing this problem to our attention, for sending us a copy of [11] and [12] as well as for the criticism concerning the first version of this manuscript. The authors also thank the two anonymous referees and the editor for their valuable comments.

M. Marques Alves is partially supported by CNPq grants 305414/2011-9 and 479729/2011-5 and PRONEX-Optimization. J.G. Melo is Partially supported by Procad/NF and by PRONEX-Optimization.

References

  1. 1.
    Ekeland, I., Temam, R.: Convex Analysis and Variational Problems. North-Holland, Amsterdam (1976) zbMATHGoogle Scholar
  2. 2.
    Bauschke, H.H., Combettes, P.L.: Convex Analysis and Monotone Operator Theory in Hilbert Spaces. Springer, New York (2011) zbMATHCrossRefGoogle Scholar
  3. 3.
    Brezis, H.: Functional Analysis, Sobolev Spaces and Partial Differential Equations. Springer, New York (2011) zbMATHGoogle Scholar
  4. 4.
    Vinter, R.: Optimal Control. Modern Birkhäuser Classics, Secaucus (2000) zbMATHGoogle Scholar
  5. 5.
    Engl, H.W., Hanke, M., Neubauer, A.: Regularization of Inverse Problems. Kluwer Academic, Dordrecht (1996) zbMATHCrossRefGoogle Scholar
  6. 6.
    Rockafellar, R.T.: Monotone operators and the proximal point algorithm. SIAM J. Control Optim. 14, 877–898 (1976) MathSciNetzbMATHCrossRefGoogle Scholar
  7. 7.
    Güler, O.: On the convergence of the proximal point algorithm for convex minimization. SIAM J. Control Optim. 29, 403–419 (1991) MathSciNetzbMATHCrossRefGoogle Scholar
  8. 8.
    Solodov, M.V., Svaiter, B.F.: Forcing strong convergence of proximal point iterations in a Hilbert space. Math. Program. 87, 189–202 (2000) MathSciNetzbMATHGoogle Scholar
  9. 9.
    Bauschke, H.H., Combettes, P.L.: A weak-to-strong convergence principle for Fejér-monotone methods in Hilbert spaces. Math. Oper. Res. 26, 248–264 (2001) MathSciNetzbMATHCrossRefGoogle Scholar
  10. 10.
    Dantzig, G.B.: Linear Programming and Extensions. Princeton University Press, New Jersey (1963) zbMATHGoogle Scholar
  11. 11.
    Svaiter, B.F.: Uma nova abordagem para dualidade em programação não linear e aplicações. Ph.D. Thesis, IMPA (1994) Google Scholar
  12. 12.
    Svaiter, B.F.: A new duality theory for mathematical programming. Optimization 60, 1209–1231 (2011) MathSciNetzbMATHCrossRefGoogle Scholar
  13. 13.
    Bello Cruz, J.Y., Iusem, A.N.: A strongly convergent method for nonsmooth convex minimization in Hilbert spaces. Numer. Funct. Anal. Optim. 32, 1009–1018 (2011) MathSciNetzbMATHCrossRefGoogle Scholar
  14. 14.
    Fan, Ky.: On systems of linear inequalities. Linear inequalities and related systems. In: Annals of Math. Studies, vol. 38, pp. 99–156. Princeton University Press, New Jersey (1956) Google Scholar

Copyright information

© Springer Science+Business Media New York 2013

Authors and Affiliations

  1. 1.Departamento de MatemáticaUniversidade Federal de Santa CatarinaFlorianópolisBrazil
  2. 2.Instituto de Matemática e EstatísticaUniversidade Federal de GoiásGoiâniaBrazil

Personalised recommendations