Advertisement

Self-adaptive gradient projection algorithms for variational inequalities involving non-Lipschitz continuous operators

  • Pham Ky Anh
  • Nguyen The Vinh
Original Paper
  • 39 Downloads

Abstract

In this paper, we introduce a self-adaptive inertial gradient projection algorithm for solving monotone or strongly pseudomonotone variational inequalities in real Hilbert spaces. The algorithm is designed such that the stepsizes are dynamically chosen and its convergence is guaranteed without the Lipschitz continuity and the paramonotonicity of the underlying operator. We will show that the proposed algorithm yields strong convergence without being combined with the hybrid/viscosity or linesearch methods. Our results improve and develop previously discussed gradient projection-type algorithms by Khanh and Vuong (J. Global Optim. 58, 341–350 2014).

Keywords

Variational inequality Monotone operator Gradient projection algorithm Extragradient algorithm Subgradient extragradient algorithm Projected reflected gradient method Inertial-type algorithm 

Mathematics Subject Classification (2010)

47J20 90C25 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Notes

Acknowledgements

The authors would like to thanks the editor and the referee for valuable remarks and helpful suggestions which improved the quality of the paper.

Funding information

The second named author is funded by Vietnam National Foundation for Science and Technology Development (NAFOSTED) under Grant No. 101.01-2017.08. His research is also partially supported by the Vietnam Institute for Advanced Study in Mathematics and by UTC under Grant T2019-CB-014.

References

  1. 1.
    Alber, Ya.I., Iusem, A.N., Solodov, M.V.: On the projected subgradient method for nonsmooth convex optimization in a Hilbert space. Math. Program. 81, 23–35 (1998)MathSciNetzbMATHGoogle Scholar
  2. 2.
    Alvarez, F., Attouch, H.: An inertial proximal method for maximal monotone operators via discretization of a nonlinear oscillator with damping. Set-Valued Anal. 9, 3–11 (2001)MathSciNetCrossRefzbMATHGoogle Scholar
  3. 3.
    Ansari, Q.H., Lalitha, C.S., Mehta, M.: Generalized convexity, nonsmooth variational inequalities, and nonsmooth optimization. CRC Press, Boca Raton (2014)zbMATHGoogle Scholar
  4. 4.
    Attouch, H., Goudon, X., Redont, P.: The heavy ball with friction I. The continuous dynamical system. Commun. Contemp. Math. 2, 1–34 (2000)MathSciNetzbMATHGoogle Scholar
  5. 5.
    Attouch, H., Czarnecki, M.O.: Asymptotic control and stabilization of nonlinear oscillators with non-isolated equilibria. J. Differential Equations 179, 278–310 (2002)MathSciNetCrossRefzbMATHGoogle Scholar
  6. 6.
    Auslender, A., Teboulle, M.: Projected subgradient methods with non-Euclidean distances for non-differentiable convex minimization and variational inequalities. Math. Program., Ser. B 120, 27–48 (2009)MathSciNetCrossRefzbMATHGoogle Scholar
  7. 7.
    Censor, Y., Gibali, A., Reich, S.: The subgradient extragradient method for solving variational inequalities in Hilbert space. J. Optim. Theory Appl. 148, 318–335 (2011)MathSciNetCrossRefzbMATHGoogle Scholar
  8. 8.
    Censor, Y., Iusem, A.N., Zenios, S.: An interior point method with Bregman functions for the variational inequality problem with paramonotone operators. Math. Program. 81, 373–400 (1998)MathSciNetzbMATHGoogle Scholar
  9. 9.
    Combettes, P.L.: Quasi-Fejérian analysis of some optimization algorithms. In: Butnariu, D., Censor, Y., Reich, S. (eds.) Inherently Parallel Algorithms for Feasibility and Optimization, pp 115–152. Elsevier, New York (2001)Google Scholar
  10. 10.
    Bello Cruz, J.Y., Iusem, A.N.: Convergence of direct methods for paramonotone variational inequalities. Comput. Optim. Appl. 46, 247–263 (2010)MathSciNetCrossRefzbMATHGoogle Scholar
  11. 11.
    Bello Cruz, J.Y., Iusem, A.N.: An explicit algorithm for monotone variational inequalities. Optimization 61, 855–871 (2012)MathSciNetCrossRefzbMATHGoogle Scholar
  12. 12.
    Bello Cruz, J.Y., Iusem, A.N.: Full convergence of an approximate projection method for nonsmooth variational inequalities. Math. Comput. Simul. 114, 2–13 (2015)MathSciNetCrossRefGoogle Scholar
  13. 13.
    Burachik, R.S., Lopes, J.O., Svaiter, B.F.: An outer approximation method for the variational inequality problem. SIAM J. Control Optim. 43, 2071–2088 (2005)MathSciNetCrossRefzbMATHGoogle Scholar
  14. 14.
    Vector Variational Inequalities and Vector Equilibria: Mathematical Theories Nonconvex Optimization and Its Applications. In: Giannessi, F. (ed.) , vol. 38. Kluwer, Dordrecht (2000)Google Scholar
  15. 15.
    Gibali, A.: Algorithm for solving the set-valued variational inequality problem in Euclidean space. Pacific J. Optim. 9, 61–75 (2013)MathSciNetzbMATHGoogle Scholar
  16. 16.
    Hai, T.N., Vinh, N.T.: Two new splitting algorithms for equilibrium problems. Revista de la Real Academia de Ciencias Exactas, Físicas y Naturales. Serie A Matemáticas 111, 1051–1069 (2017)MathSciNetCrossRefzbMATHGoogle Scholar
  17. 17.
    Hartman, G.J., Stampacchia, G.: On some nonlinear elliptic differential equations. Acta Math. 115, 271–310 (1966)MathSciNetCrossRefzbMATHGoogle Scholar
  18. 18.
    Iusem, A.N., Svaiter, B.F.: A variant of Korpelevich’s method for variational inequalities with a new search strategy. Optimization 42, 309–321 (1997)MathSciNetCrossRefzbMATHGoogle Scholar
  19. 19.
    Kaczor, W.J., Nowak, M.T.: Problems in Mathematical Analysis I: Real Numbers, Sequences and Series Student Mathematical Library, vol. 4. American Mathematical Society, Providence (2000)CrossRefGoogle Scholar
  20. 20.
    Khanh, P.D., Vuong, P.T.: Modified projection method for strongly pseudomonotone variational inequalities. J. Global Optim. 58, 341–350 (2014)MathSciNetCrossRefzbMATHGoogle Scholar
  21. 21.
    Khobotov, E.N.: A modification of the extragradient method for solving variational inequalities and some optimization problems. (Russian) Zh. Vychisl. Mat. i Mat. Fiz. 27, 1462–1473 (1987)MathSciNetGoogle Scholar
  22. 22.
    Kinderlehrer, D., Stampacchia, G.: An Introduction to Variational Inequalities and Their Applications. Academic Press, New York (1980)zbMATHGoogle Scholar
  23. 23.
    Konnov, I.V.: Equilibrium Models and Variational Inequalities. Elsevier, Amsterdam (2007)zbMATHGoogle Scholar
  24. 24.
    Korpelevich, G.M.: An extragradient method for finding saddle points and for other problems. Ekonom. i Mat. Metody 12, 747–756 (1976)MathSciNetzbMATHGoogle Scholar
  25. 25.
    Maingé, P.E.: Convergence theorems for inertial KM-type algorithms. J. Comput. Appl. Math. 219, 223–236 (2008)MathSciNetCrossRefzbMATHGoogle Scholar
  26. 26.
    Maingé, P.: Numerical approach to monotone variational inequalities by a one-step projected reflected gradient method with line-search procedure. Comput. Math. Appl. 72, 720–728 (2016)MathSciNetCrossRefzbMATHGoogle Scholar
  27. 27.
    Maingé, P., Gobinddass, M.L.: Convergence of one-step projected gradient methods for variational inequalities. J. Optim. Theory Appl. 171, 146–168 (2016)MathSciNetCrossRefzbMATHGoogle Scholar
  28. 28.
    Malitsky, Y.: Projected reflected gradient methods for monotone variational inequalities. SIAM J. Optim. 25, 502–520 (2015)MathSciNetCrossRefzbMATHGoogle Scholar
  29. 29.
    Malitsky, Y.V., Semenov, V.V.: An extragradient algorithm for monotone variational inequalities. Cybern. Syst. Anal. 50, 271–277 (2014)MathSciNetCrossRefzbMATHGoogle Scholar
  30. 30.
    Minty, G.J.: Monotone (nonlinear) operators in Hilbert space. Duke Math. J. 29, 341–346 (1962)MathSciNetCrossRefzbMATHGoogle Scholar
  31. 31.
    Moudafi, A., Oliny, M.: Convergence of a splitting inertial proximal method for monotone operators. J. Comput. Appl. Math. 155, 447–454 (2003)MathSciNetCrossRefzbMATHGoogle Scholar
  32. 32.
    Popov, L.: A modification of the Arrow-Hurwicz method for search for saddle points. Math. Notes 28, 845–848 (1980)CrossRefzbMATHGoogle Scholar
  33. 33.
    Solodov, M.V., Svaiter, B.F.: A new projection method for variational inequality problems. SIAM J. Control Optim. 37, 765–776 (1999)MathSciNetCrossRefzbMATHGoogle Scholar
  34. 34.
    Tinti, F.: Numerical Solution for Pseudomonotone Variational Inequality Problems by Extragradient Methods. (English summary) Variational Analysis and Applications, 1101–1128, Nonconvex Optim Appl., 79. Springer, New York (2005)Google Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2018

Authors and Affiliations

  1. 1.College of ScienceVietnam National UniversityThanh XuanVietnam
  2. 2.Department of MathematicsUniversity of Transport and CommunicationsHanoiVietnam

Personalised recommendations