Abstract
In this book we study behavior of algorithms for constrained convex minimization problems in a Hilbert space. Our goal is to obtain a good approximate solution of the problem in the presence of computational errors. We show that the algorithm generates a good approximate solution, if the sequence of computational errors is bounded from above by a constant. In this section we discuss several algorithms which are studied in the book.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Alber YI (1971) On minimization of smooth functional by gradient methods. USSR Comput Math Math Phys 11:752–758
Alber YI, Iusem AN, Solodov MV (1998) On the projected subgradient method for nonsmooth convex optimization in a Hilbert space. Math Program 81:23–35
Ansari QH, Yao JC (1999) A fixed point theorem and its applications to a system of variational inequalities. Bull Aust Math Soc 59:433–442
Attouch H, Bolte J (2009) On the convergence of the proximal algorithm for nonsmooth functions involving analytic features. Math Program Ser B 116:5–16
Barty K, Roy J-S, Strugarek C (2007) Hilbert-valued perturbed subgradient algorithms. Math Oper Res 32:551–562
Bauschke HH, Borwein JM, Combettes PL (2003) Bregman monotone optimization algorithms. SIAM J Control Optim 42:596–636
Bauschke HH, Goebel R, Lucet Y, Wang X (2008) The proximal average: basic theory. SIAM J Optim 19:766–785
Beck A, Teboulle M (2003) Mirror descent and nonlinear projected subgradient methods for convex optimization. Oper Res Lett 31:167–175
Burachik RS, Iusem AN (1998) A generalized proximal point algorithm for the variational inequality problem in a Hilbert space. SIAM J Optim 8:197–216
Burachik RS, Grana Drummond LM, Iusem AN, Svaiter BF (1995) Full convergence of the steepest descent method with inexact line searches. Optimization 32:137–146
Burachik RS, Lopes JO, Da Silva GJP (2009) An inexact interior point proximal method for the variational inequality problem. Comput Appl Math 28:15–36
Butnariu D, Kassay G (2008) A proximal-projection method for finding zeros of set-valued operators. SIAM J Control Optim 47:2096–2136
Censor Y, Zenios SA (1992) The proximal minimization algorithm with D-functions. J. Optim. Theory Appl. 73:451–464
Censor Y, Gibali A, Reich S (2011) The subgradient extragradient method for solving variational inequalities in Hilbert space. J Optim Theory Appl 148:318–335
Censor Y, Gibali A, Reich S, Sabach S (2012) Common solutions to variational inequalities. Set-Valued Var Anal 20:229–247
Demyanov VF, Vasilyev LV (1985) Nondifferentiable optimization. Optimization Software, New York
Ermoliev YM (1966) Methods for solving nonlinear extremal problems. Cybernetics 2:1–17
Facchinei F, Pang J-S (2003) Finite-dimensional variational inequalities and complementarity problems, volume I and volume II. Springer, New York
Guler O (1991) On the convergence of the proximal point algorithm for convex minimization. SIAM J Control Optim 29:403–419
Gwinner J, Raciti F (2009) On monotone variational inequalities with random data. J Math Inequal 3:443–453
Hager WW, Zhang H (2007) Asymptotic convergence analysis of a new class of proximal point methods. SIAM J Control Optim 46:1683–1704
Iiduka H, Takahashi W, Toyoda M (2004) Approximation of solutions of variational inequalities for monotone mappings. Pan Am Math J 14:49–61
Kaplan A, Tichatschke R (2007) Bregman-like functions and proximal methods for variational problems with nonlinear constraints. Optimization 56:253–265
Kassay G (1985) The proximal points algorithm for reflexive Banach spaces. Stud Univ Babes-Bolyai Math 30:9–17
Kiwiel KC (1996) Restricted step and Levenberg–Marquardt techniques in proximal bundle methods for nonconvex nondifferentiable optimization. SIAM J Optim 6:227–249
Konnov IV (1997) On systems of variational inequalities. Russ Math (Iz VUZ) 41:79–88
Konnov IV (2009) A descent method with inexact linear search for mixed variational inequalities. Russ Math (Iz VUZ) 53:29–35
Korpelevich GM (1976) The extragradient method for finding saddle points and other problems. Ekon Matem Metody 12:747–756
Lemaire B (1989) The proximal algorithm. In: Penot JP (ed) International series of numerical mathematics, vol 87. Birkhauser-Verlag, Basel, pp 73–87
Mainge P-E (2008) Strong convergence of projected subgradient methods for nonsmooth and nonstrictly convex minimization. Set-Valued Anal 16:899–912
Martinet B (1978) Pertubation des methodes d’optimisation: application. RAIRO Anal Numer 12:153–171
Mordukhovich BS (2006) Variational analysis and generalized differentiation, I: I: basic theory. Springer, Berlin
Moreau JJ (1965) Proximite et dualite dans un espace Hilbertien. Bull Soc Math Fr 93:273–299
Nedic A, Ozdaglar A (2009) Subgradient methods for saddle-point problems. J Optim Theory Appl 142:205–228
Nemirovski A, Yudin D (1983) Problem complexity and method efficiency in optimization. Wiley, New York
Nesterov Yu (2004) Introductory lectures on convex optimization. Kluwer, Boston
Pang J-S (1985) Asymmetric variational inequality problems over product sets: applications and iterative methods. Math Program 31:206–219
Polyak BT (1967) A general method of solving extremum problems. Dokl Akad Nauk 8:593–597
Polyak BT (1987) Introduction to optimization. Optimization Software, New York
Rockafellar RT (1976) Augmented Lagrangians and applications of the proximal point algorithm in convex programming. Math Oper Res 1:97–116
Rockafellar RT (1976) Monotone operators and the proximal point algorithm. SIAM J Control Optim 14:877–898
Shor NZ (1985) Minimization methods for non-differentiable functions. Springer, Berlin
Solodov MV, Svaiter BF (2000) Error bounds for proximal point subproblems and associated inexact proximal point algorithms. Math Program 88:371–389
Solodov MV, Svaiter BF (2001) A unified framework for some inexact proximal point algorithms. Numer Funct Anal Optim 22:1013–1035
Solodov MV, Zavriev SK (1998) Error stability properties of generalized gradient-type algorithms. J Optim Theory Appl 98:663–680
Su M, Xu H-K (2010) Remarks on the gradient-projection algorithm. J Nonlinear Anal Optim 1:35–43
Xu H-K (2006) A regularization method for the proximal point algorithm. J Global Optim 36:115–125
Xu H-K (2011) Averaged mappings and the gradient-projection algorithm. J Optim Theory Appl 150:360–378
Yamashita N, Kanzow C, Morimoto T, Fukushima M (2001) An infeasible interior proximal method for convex programming problems with linear constraints. J Nonlinear Convex Anal 2:139–156
Zeng LC, Yao JC (2006) Strong convergence theorem by an extragradient method for fixed point problems and variational inequality problems. Taiwan J Math 10:1293–1303
Author information
Authors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this chapter
Cite this chapter
Zaslavski, A.J. (2016). Introduction. In: Numerical Optimization with Computational Errors. Springer Optimization and Its Applications, vol 108. Springer, Cham. https://doi.org/10.1007/978-3-319-30921-7_1
Download citation
DOI: https://doi.org/10.1007/978-3-319-30921-7_1
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-30920-0
Online ISBN: 978-3-319-30921-7
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)