Abstract
A parametric nonlinear programming problem in a metric space with an operator equality constraint in a Hilbert space is studied assuming that its lower semicontinuous value function at a chosen individual parameter value has certain subdifferentiability properties in the sense of nonlinear (nonsmooth) analysis. Such subdifferentiability can be understood as the existence of a proximal subgradient or a Fréchet subdifferential. In other words, an individual problem has a corresponding generalized Kuhn-Tucker vector. Under this assumption, a stable sequential Kuhn-Tucker theorem in nondifferential iterative form is proved and discussed in terms of minimizing sequences on the basis of the dual regularization method. This theorem provides necessary and sufficient conditions for the stable construction of a minimizing approximate solution in the sense of Warga in the considered problem, whose initial data can be approximately specified. A substantial difference of the proved theorem from its classical same-named analogue is that the former takes into account the possible instability of the problem in the case of perturbed initial data and, as a consequence, allows for the inherited instability of classical optimality conditions. This theorem can be treated as a regularized generalization of the classical Uzawa algorithm to nonlinear programming problems. Finally, the theorem is applied to the “simplest” nonlinear optimal control problem, namely, to a time-optimal control problem.
Similar content being viewed by others
References
V. M. Alekseev, V. M. Tikhomirov, and S. V. Fomin, Optimal Control (Nauka, Moscow, 1979) [in Russian].
F. P. Vasil’ev, Optimization Methods (MTsNMO, Moscow, 2011) [in Russian].
M. I. Sumin, “Stable sequential convex programming in a Hilbert space and its application for solving unstable problems,” Comput. Math. Math. Phys. 54 (1), 22–44 (2014).
M. I. Sumin, “Regularized parametric Kuhn–Tucker theorem in a Hilbert space,” Comput. Math. Math. Phys. 51 (9), 1489–1509 (2011).
J.-P. Aubin and I. Ekeland, Applied Nonlinear Analysis (Wiley, New York, 1984; Mir, Moscow, 1988).
J.-P. Aubin, L’analyse non linéaire et ses motivations economiques (Masson, Paris, 1984; Mir, Moscow, 1988).
M. I. Sumin, “On the stable sequential Kuhn-Tucker theorem and its applications,” Appl. Math. A (Special issue “Optimization”) 3, 1334–1350 (2012).
M. I. Sumin, “Stable sequential Lagrange principle in convex programming and its application to solving unstable problems,” Trudy Inst. Mat. Mekh. Ural. Otd. Ross. Akad. Nauk 19, (4), 231–240 (2013).
A. N. Tikhonov and V. Ya. Arsenin, Solutions of Ill-Posed Problems (Halsted, New York, 1977; Nauka, Moscow, 1986).
M. I. Sumin, “Duality-Based Regularization in a Linear Convex Mathematical Programming Problem,” Comput. Math. Math. Phys. 47 (4), 579–600 (2007).
M. I. Sumin, Ill-Posed Problems and Solution Methods (Nizhegorod. Gos. Univ., Nizhni Novgorod, 2009) [in Russian].
K. Arrow, L. Hurwicz, and H. Uzawa, Studies in Nonlinear Programming (Stanford Univ. Press, Stanford, 1958; Inostrannaya Literatura, Moscow, 1962).
M. Minoux, Mathematical Programming: Theory and Algorithms (Wiley, New York, 1986; Nauka, Moscow, 1990).
M. I. Sumin, “Regularized dual method for nonlinear mathematical programming,” Comput. Math. Math. Phys. 47 (5), 760–779 (2007).
M. I. Sumin, “Parametric dual regularization in nonlinear mathematical programming,” in Advances in Mathematics Research (Nova Science, New York, 2010), Vol. 11, Ch. 5, pp. 103–134.
A. V. Kanatov and M. I. Sumin, “Sequential stable Kuhn–Tucker theorem in nonlinear programming,” Comput. Math. Math. Phys. 53 (8), 1078–1098 (2013).
J. M. Borwein and H. M. Strojwas, “Proximal analysis and boundaries of closed sets in Banach space, Part I: Theory,” Can. J. Math. 38 (2), 431–452 (1986); “Part II: Applications,” Can. J. Math. 39 (2), 428–472 (1987).
F. Clarke, Optimization and Nonsmooth Analysis (Wiley, New York, 1983; Nauka, Moscow, 1988).
P. D. Loewen, Optimal Control via Nonsmooth Analysis (Am. Math. Soc., Providence, RI, 1993).
F. H. Clarke, Yu. S. Ledyaev, R. J. Stern, and P. R. Wolenski, Nonsmooth Analysis and Control Theory (Springer-Verlag, New York, 1998).
B. S. Mordukhovich, Variational Analysis and Generalized Differentiation, Vol. 1: Basic Theory, Vol. 2: Applications (Springer, Berlin, 2006).
J. Warga, Optimal Control of Differential and Functional Equations (Academic, New York, 1972; Nauka, Moscow, 1977).
M. R. Hestenes, “Multiplier and gradient methods,” J. Optim. Theory Appl. 4, 303–320 (1969).
M. J. D. Powell, “A method for nonlinear constraints in minimization problems,” Optimization, Ed. by R. Fletcher (Academic, New York, 1969), pp. 293–298.
D. P. Bertsekas, Constrained Optimization and Lagrange Multiplier Methods (Academic, New York, 1982; Radio I Svyaz’, Moscow, 1987).
M. I. Sumin, “Suboptimal control of distributed-parameter systems: Minimizing sequences and the value function,” Comput. Math. Math. Phys. 37 (1), 21–39 (1997).
E. G. Gol’shtein and N. V. Tret’yakov, Augmented Lagrangians: Theory and Optimization Methods (Nauka, Moscow, 1989) [in Russian].
A. V. Arutyunov, Extremum Conditions: Abnormal and Degenerate Problems (Faktorial, Moscow, 1997) [in Russian].
A. A. Milyutin, A. V. Dmitruk, and N. P. Osmolovskii, Maximum Principle in Optimal Control (Mosk. Gos. Univ., Moscow, 2004) [in Russian].
Author information
Authors and Affiliations
Corresponding author
Additional information
Original Russian Text © M.I. Sumin, 2015, published in Zhurnal Vychislitel’noi Matematiki i Matematicheskoi Fiziki, 2015, Vol. 55, No. 6, pp. 947–977.
Rights and permissions
About this article
Cite this article
Sumin, M.I. Stable sequential Kuhn-Tucker theorem in iterative form or a regularized Uzawa algorithm in a regular nonlinear programming problem. Comput. Math. and Math. Phys. 55, 935–961 (2015). https://doi.org/10.1134/S0965542515060111
Received:
Published:
Issue Date:
DOI: https://doi.org/10.1134/S0965542515060111