Abstract
Motivated by our recent works on optimality conditions in discrete optimal control problems under a nonconvex cost function, in this paper, we study second-order necessary and sufficient optimality conditions for a discrete optimal control problem with a nonconvex cost function and state-control constraints. By establishing an abstract result on second-order optimality conditions for a mathematical programming problem, we derive second-order necessary and sufficient optimality conditions for a discrete optimal control problem. Using a common critical cone for both the second-order necessary and sufficient optimality conditions, we obtain “no-gap” between second-order optimality conditions.
Similar content being viewed by others
References
Ben-Tal, A.: Second order and related extremality conditions in nonlinear programming. J. Optim. Theory Appl. 31, 143–165 (1980)
Bonnans, J.F., Cominetti, R., Shapiro, A.: Second order optimality conditions based on parabolic second order tangent sets. SIAM J. Optim. 9, 466–492 (1999)
Cominetti, R.: Metric regularity, tangent sets, and second-order optimality conditions. Appl. Math. Optim. 21, 265–287 (1990)
Ioffe, A.D.: Necessary and sufficient conditions for a local minimum. 3: Second order conditions and augmented duality. SIAM J. Control Optim. 17, 266–288 (1979)
Kawasaki, H.: An envelope-like effect on infinitely many inequality constraints on second-order necessary conditions for minimization problems. Math. Program. 41, 73–96 (1988)
Páles, Z., Zeidan, V.: Nonsmooth optimum problems with constraints. SIAM J. Control Optim. 32, 1476–1502 (1994)
Penot, J.-P.: Optimality conditions in mathematical programming and composite optimization. Math. Program. 67, 225–245 (1994)
Penot, J.-P.: Second-order conditions for optimization problems with constraints. SIAM J. Control Optim. 37, 303–318 (1998)
Son, N.H., Kien, B.T., Rösch, A.: Second-order optimality conditions for boundary control problems with mixed pointwise constraints. SIAM J. Optim. 26, 1912–1943 (2016)
Avakov, E.R., Arutyunov, A.V., Izmailov, A.F.: Necessary conditions for an extremum in a mathematical programming problem. Proc. Steklov Inst. Math. 256, 2–25 (2007)
Hilscher, R., Zeidan, V.: Second-order sufficiency criteria for a discrete optimal control problem. J. Abstr. Differ. Equ. Appl. 8, 573–602 (2002)
Hilscher, R., Zeidan, V.: Discrete optimal control: second-order optimality conditions. J. Abstr. Differ. Equ. Appl. 8, 875–896 (2002)
Ioffe, A.D., Tihomirov, V.M.: Theory of Extremal Problems. North-Holland Publishing Company, North-Holland (1979)
Marinkovíc, B.: Optimality conditions in discrete optimal control problems. J. Optim. Methods Softw. 22, 959–969 (2007)
Marinkovíc, B.: Optimality conditions for discrete optimal control problems with equality and inequality type constraints. Positivity 12, 535–545 (2008)
Marinkovíc, B.: Second-order optimality conditions in a discrete optimal control problem. Optimization 57, 539–548 (2008)
Arutyunov, A.V., Marinkovích, B.: Necessary optimality conditions for discrete optimal control problems. Mosc. Univ. Comput. Math. Cybern. 1, 38–44 (2005)
Toan, N.T., Ansari, Q.H., Yao, J.-C.: Second-order necessary optimality conditions for a discrete optimal control problem. J. Optim. Theory Appl. 165, 812–836 (2015)
Toan, N.T., Thuy, L.Q.: Second-order necessary optimality conditions for a discrete optimal control problem with mixed constraints. J. Global Optim. 64, 533–562 (2016)
Bertsekas, D.P.: Dynamic Programming and Optimal Control, vol. I. Springer, Berlin (2005)
Gabasov, R., Mordukhovich, B.S., Kirillova, F.M.: The discrete maximum principle. Dokl. Akad. Nauk SSSR 213, 19–22 (1973). (Russian; English transl. in Soviet Math. Dokl. 14, 1624-1627, 1973)
Larson, R.E., Casti, J.: Principles of Dynamic Programming, vol. I. Marcel Dekker, New York (1982)
Larson, R.E., Casti, J.: Principles of Dynamic Programming, vol. II. Marcel Dekker, New York (1982)
Lian, Z., Liu, L., Neuts, M.F.: A discrete-time model for common lifetime inventory systems. Math. Oper. Res. 30, 718–732 (2005)
Lyshevski, S.E.: Control System Theory with Engineering Applications, Control Engineering. Birkhäuser, Boston (2001)
Malozemov, V.N., Omelchenko, A.V.: On a discrete optimal control problem with an explicit solution. J. Ind. Manag. Optim. 2, 55–62 (2006)
Mordukhovich, B.S.: Difference approximations of optimal control system. Prikladaya Mat. Mekhanika 42, 431–440 (1978). (in Russian; English transl. in J. Appl. Math. Mech. 42, 452–461, 1978)
Toan, N.T., Kien, B.T.: Continuity properties of the solution map to a parametric discrete optimal control problem. J. Nonlinear Convex Anal. 12, 635–650 (2011)
Toan, N.T., Yao, J.-C.: Mordukhovich subgradients of the value function to a parametric discrete optimal control problem. J. Global Optim. 58, 595–612 (2014)
Pindyck, R.S.: An application of the linear quadratic tracking problem to economic stabilization policy. IEEE Trans. Automat. Control 17, 287–300 (1972)
Tu, P.N.V.: Introductory Optimization Dynamics. Springer, Berlin (1991)
Henrion, R., Mordukhovich, B.S., Nam, N.M.: Second-order analysis of polyhedral systems in finite dimensions with applications to robust stability of variational inequalities. SIAM J. Optim. 20, 2199–2227 (2010)
Kien, B.T., Nhu, V.H.: Second-order necessary optimality conditions for a class of semilinear elliptic optimal control problems with mixed pointwise constraints. SIAM J. Control Optim. 52, 1166–1202 (2014)
Mangasarian, O.L., Shiau, T.-H.: Lipschitz continuity of solutions of linear inequalities, programs and complementarity problems. SIAM J. Control Optim. 25, 583–595 (1987)
Mordukhovich, B.S.: Variational Analysis and Generalized Differentiation I. Basis Theory. Springer, Berlin (2006)
Mordukhovich, B.S.: Variational Analysis and Generalized Differentiation II. Applications. Springer, Berlin (2006)
Rockafellar, R.T., Wets, R.J.-B.: Variational Analysis. Springer, Berlin (1998)
Aubin, J.-P., Frankowska, H.: Set-Valued Analysis. Birkhäuser, Boston (1990)
Acknowledgements
This research is funded by Vietnam National Foundation for Science and Technology Development (NAFOSTED) under grant number 101.01-2015.04 and by the Vietnam Institute for Advanced Study in Mathematics (VIASM).
Author information
Authors and Affiliations
Corresponding author
Additional information
Communicated by Boris S. Mordukhovich.
Rights and permissions
About this article
Cite this article
Thuy, L.Q., Thanh, B.T. & Toan, N.T. On the No-Gap Second-Order Optimality Conditions for a Discrete Optimal Control Problem with Mixed Constraints. J Optim Theory Appl 173, 421–442 (2017). https://doi.org/10.1007/s10957-017-1094-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10957-017-1094-3
Keywords
- Second-order necessary optimality condition
- Second-order sufficient optimality condition
- No-gap second-order optimality condition
- Discrete optimal control problem
- Mixed constraint