Skip to main content
Log in

Stable sequential Kuhn-Tucker theorem in iterative form or a regularized Uzawa algorithm in a regular nonlinear programming problem

  • Published:
Computational Mathematics and Mathematical Physics Aims and scope Submit manuscript

Abstract

A parametric nonlinear programming problem in a metric space with an operator equality constraint in a Hilbert space is studied assuming that its lower semicontinuous value function at a chosen individual parameter value has certain subdifferentiability properties in the sense of nonlinear (nonsmooth) analysis. Such subdifferentiability can be understood as the existence of a proximal subgradient or a Fréchet subdifferential. In other words, an individual problem has a corresponding generalized Kuhn-Tucker vector. Under this assumption, a stable sequential Kuhn-Tucker theorem in nondifferential iterative form is proved and discussed in terms of minimizing sequences on the basis of the dual regularization method. This theorem provides necessary and sufficient conditions for the stable construction of a minimizing approximate solution in the sense of Warga in the considered problem, whose initial data can be approximately specified. A substantial difference of the proved theorem from its classical same-named analogue is that the former takes into account the possible instability of the problem in the case of perturbed initial data and, as a consequence, allows for the inherited instability of classical optimality conditions. This theorem can be treated as a regularized generalization of the classical Uzawa algorithm to nonlinear programming problems. Finally, the theorem is applied to the “simplest” nonlinear optimal control problem, namely, to a time-optimal control problem.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. V. M. Alekseev, V. M. Tikhomirov, and S. V. Fomin, Optimal Control (Nauka, Moscow, 1979) [in Russian].

  2. F. P. Vasil’ev, Optimization Methods (MTsNMO, Moscow, 2011) [in Russian].

  3. M. I. Sumin, “Stable sequential convex programming in a Hilbert space and its application for solving unstable problems,” Comput. Math. Math. Phys. 54 (1), 22–44 (2014).

    Article  MathSciNet  Google Scholar 

  4. M. I. Sumin, “Regularized parametric Kuhn–Tucker theorem in a Hilbert space,” Comput. Math. Math. Phys. 51 (9), 1489–1509 (2011).

    Article  MathSciNet  Google Scholar 

  5. J.-P. Aubin and I. Ekeland, Applied Nonlinear Analysis (Wiley, New York, 1984; Mir, Moscow, 1988).

  6. J.-P. Aubin, L’analyse non linéaire et ses motivations economiques (Masson, Paris, 1984; Mir, Moscow, 1988).

  7. M. I. Sumin, “On the stable sequential Kuhn-Tucker theorem and its applications,” Appl. Math. A (Special issue “Optimization”) 3, 1334–1350 (2012).

    Google Scholar 

  8. M. I. Sumin, “Stable sequential Lagrange principle in convex programming and its application to solving unstable problems,” Trudy Inst. Mat. Mekh. Ural. Otd. Ross. Akad. Nauk 19, (4), 231–240 (2013).

    Google Scholar 

  9. A. N. Tikhonov and V. Ya. Arsenin, Solutions of Ill-Posed Problems (Halsted, New York, 1977; Nauka, Moscow, 1986).

  10. M. I. Sumin, “Duality-Based Regularization in a Linear Convex Mathematical Programming Problem,” Comput. Math. Math. Phys. 47 (4), 579–600 (2007).

    Article  MathSciNet  Google Scholar 

  11. M. I. Sumin, Ill-Posed Problems and Solution Methods (Nizhegorod. Gos. Univ., Nizhni Novgorod, 2009) [in Russian].

  12. K. Arrow, L. Hurwicz, and H. Uzawa, Studies in Nonlinear Programming (Stanford Univ. Press, Stanford, 1958; Inostrannaya Literatura, Moscow, 1962).

  13. M. Minoux, Mathematical Programming: Theory and Algorithms (Wiley, New York, 1986; Nauka, Moscow, 1990).

  14. M. I. Sumin, “Regularized dual method for nonlinear mathematical programming,” Comput. Math. Math. Phys. 47 (5), 760–779 (2007).

    Article  MathSciNet  Google Scholar 

  15. M. I. Sumin, “Parametric dual regularization in nonlinear mathematical programming,” in Advances in Mathematics Research (Nova Science, New York, 2010), Vol. 11, Ch. 5, pp. 103–134.

  16. A. V. Kanatov and M. I. Sumin, “Sequential stable Kuhn–Tucker theorem in nonlinear programming,” Comput. Math. Math. Phys. 53 (8), 1078–1098 (2013).

    Article  MathSciNet  Google Scholar 

  17. J. M. Borwein and H. M. Strojwas, “Proximal analysis and boundaries of closed sets in Banach space, Part I: Theory,” Can. J. Math. 38 (2), 431–452 (1986); “Part II: Applications,” Can. J. Math. 39 (2), 428–472 (1987).

    Article  MATH  MathSciNet  Google Scholar 

  18. F. Clarke, Optimization and Nonsmooth Analysis (Wiley, New York, 1983; Nauka, Moscow, 1988).

  19. P. D. Loewen, Optimal Control via Nonsmooth Analysis (Am. Math. Soc., Providence, RI, 1993).

  20. F. H. Clarke, Yu. S. Ledyaev, R. J. Stern, and P. R. Wolenski, Nonsmooth Analysis and Control Theory (Springer-Verlag, New York, 1998).

  21. B. S. Mordukhovich, Variational Analysis and Generalized Differentiation, Vol. 1: Basic Theory, Vol. 2: Applications (Springer, Berlin, 2006).

  22. J. Warga, Optimal Control of Differential and Functional Equations (Academic, New York, 1972; Nauka, Moscow, 1977).

  23. M. R. Hestenes, “Multiplier and gradient methods,” J. Optim. Theory Appl. 4, 303–320 (1969).

    Article  MATH  MathSciNet  Google Scholar 

  24. M. J. D. Powell, “A method for nonlinear constraints in minimization problems,” Optimization, Ed. by R. Fletcher (Academic, New York, 1969), pp. 293–298.

  25. D. P. Bertsekas, Constrained Optimization and Lagrange Multiplier Methods (Academic, New York, 1982; Radio I Svyaz’, Moscow, 1987).

  26. M. I. Sumin, “Suboptimal control of distributed-parameter systems: Minimizing sequences and the value function,” Comput. Math. Math. Phys. 37 (1), 21–39 (1997).

    MathSciNet  Google Scholar 

  27. E. G. Gol’shtein and N. V. Tret’yakov, Augmented Lagrangians: Theory and Optimization Methods (Nauka, Moscow, 1989) [in Russian].

  28. A. V. Arutyunov, Extremum Conditions: Abnormal and Degenerate Problems (Faktorial, Moscow, 1997) [in Russian].

  29. A. A. Milyutin, A. V. Dmitruk, and N. P. Osmolovskii, Maximum Principle in Optimal Control (Mosk. Gos. Univ., Moscow, 2004) [in Russian].

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to M. I. Sumin.

Additional information

Original Russian Text © M.I. Sumin, 2015, published in Zhurnal Vychislitel’noi Matematiki i Matematicheskoi Fiziki, 2015, Vol. 55, No. 6, pp. 947–977.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sumin, M.I. Stable sequential Kuhn-Tucker theorem in iterative form or a regularized Uzawa algorithm in a regular nonlinear programming problem. Comput. Math. and Math. Phys. 55, 935–961 (2015). https://doi.org/10.1134/S0965542515060111

Download citation

  • Received:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1134/S0965542515060111

Keywords

Navigation