Skip to main content
Log in

On the No-Gap Second-Order Optimality Conditions for a Discrete Optimal Control Problem with Mixed Constraints

  • Published:
Journal of Optimization Theory and Applications Aims and scope Submit manuscript

Abstract

Motivated by our recent works on optimality conditions in discrete optimal control problems under a nonconvex cost function, in this paper, we study second-order necessary and sufficient optimality conditions for a discrete optimal control problem with a nonconvex cost function and state-control constraints. By establishing an abstract result on second-order optimality conditions for a mathematical programming problem, we derive second-order necessary and sufficient optimality conditions for a discrete optimal control problem. Using a common critical cone for both the second-order necessary and sufficient optimality conditions, we obtain “no-gap” between second-order optimality conditions.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Ben-Tal, A.: Second order and related extremality conditions in nonlinear programming. J. Optim. Theory Appl. 31, 143–165 (1980)

    Article  MathSciNet  MATH  Google Scholar 

  2. Bonnans, J.F., Cominetti, R., Shapiro, A.: Second order optimality conditions based on parabolic second order tangent sets. SIAM J. Optim. 9, 466–492 (1999)

    Article  MathSciNet  MATH  Google Scholar 

  3. Cominetti, R.: Metric regularity, tangent sets, and second-order optimality conditions. Appl. Math. Optim. 21, 265–287 (1990)

    Article  MathSciNet  MATH  Google Scholar 

  4. Ioffe, A.D.: Necessary and sufficient conditions for a local minimum. 3: Second order conditions and augmented duality. SIAM J. Control Optim. 17, 266–288 (1979)

    Article  MathSciNet  MATH  Google Scholar 

  5. Kawasaki, H.: An envelope-like effect on infinitely many inequality constraints on second-order necessary conditions for minimization problems. Math. Program. 41, 73–96 (1988)

    Article  MathSciNet  MATH  Google Scholar 

  6. Páles, Z., Zeidan, V.: Nonsmooth optimum problems with constraints. SIAM J. Control Optim. 32, 1476–1502 (1994)

    Article  MathSciNet  MATH  Google Scholar 

  7. Penot, J.-P.: Optimality conditions in mathematical programming and composite optimization. Math. Program. 67, 225–245 (1994)

    Article  MathSciNet  MATH  Google Scholar 

  8. Penot, J.-P.: Second-order conditions for optimization problems with constraints. SIAM J. Control Optim. 37, 303–318 (1998)

    Article  MathSciNet  MATH  Google Scholar 

  9. Son, N.H., Kien, B.T., Rösch, A.: Second-order optimality conditions for boundary control problems with mixed pointwise constraints. SIAM J. Optim. 26, 1912–1943 (2016)

    Article  MathSciNet  MATH  Google Scholar 

  10. Avakov, E.R., Arutyunov, A.V., Izmailov, A.F.: Necessary conditions for an extremum in a mathematical programming problem. Proc. Steklov Inst. Math. 256, 2–25 (2007)

    Article  MathSciNet  MATH  Google Scholar 

  11. Hilscher, R., Zeidan, V.: Second-order sufficiency criteria for a discrete optimal control problem. J. Abstr. Differ. Equ. Appl. 8, 573–602 (2002)

    Article  MathSciNet  MATH  Google Scholar 

  12. Hilscher, R., Zeidan, V.: Discrete optimal control: second-order optimality conditions. J. Abstr. Differ. Equ. Appl. 8, 875–896 (2002)

    Article  MathSciNet  MATH  Google Scholar 

  13. Ioffe, A.D., Tihomirov, V.M.: Theory of Extremal Problems. North-Holland Publishing Company, North-Holland (1979)

    MATH  Google Scholar 

  14. Marinkovíc, B.: Optimality conditions in discrete optimal control problems. J. Optim. Methods Softw. 22, 959–969 (2007)

    Article  MathSciNet  MATH  Google Scholar 

  15. Marinkovíc, B.: Optimality conditions for discrete optimal control problems with equality and inequality type constraints. Positivity 12, 535–545 (2008)

    Article  MathSciNet  MATH  Google Scholar 

  16. Marinkovíc, B.: Second-order optimality conditions in a discrete optimal control problem. Optimization 57, 539–548 (2008)

    Article  MathSciNet  MATH  Google Scholar 

  17. Arutyunov, A.V., Marinkovích, B.: Necessary optimality conditions for discrete optimal control problems. Mosc. Univ. Comput. Math. Cybern. 1, 38–44 (2005)

    MathSciNet  MATH  Google Scholar 

  18. Toan, N.T., Ansari, Q.H., Yao, J.-C.: Second-order necessary optimality conditions for a discrete optimal control problem. J. Optim. Theory Appl. 165, 812–836 (2015)

    Article  MathSciNet  MATH  Google Scholar 

  19. Toan, N.T., Thuy, L.Q.: Second-order necessary optimality conditions for a discrete optimal control problem with mixed constraints. J. Global Optim. 64, 533–562 (2016)

    Article  MathSciNet  MATH  Google Scholar 

  20. Bertsekas, D.P.: Dynamic Programming and Optimal Control, vol. I. Springer, Berlin (2005)

    MATH  Google Scholar 

  21. Gabasov, R., Mordukhovich, B.S., Kirillova, F.M.: The discrete maximum principle. Dokl. Akad. Nauk SSSR 213, 19–22 (1973). (Russian; English transl. in Soviet Math. Dokl. 14, 1624-1627, 1973)

    MathSciNet  MATH  Google Scholar 

  22. Larson, R.E., Casti, J.: Principles of Dynamic Programming, vol. I. Marcel Dekker, New York (1982)

    MATH  Google Scholar 

  23. Larson, R.E., Casti, J.: Principles of Dynamic Programming, vol. II. Marcel Dekker, New York (1982)

    MATH  Google Scholar 

  24. Lian, Z., Liu, L., Neuts, M.F.: A discrete-time model for common lifetime inventory systems. Math. Oper. Res. 30, 718–732 (2005)

    Article  MathSciNet  MATH  Google Scholar 

  25. Lyshevski, S.E.: Control System Theory with Engineering Applications, Control Engineering. Birkhäuser, Boston (2001)

    Book  MATH  Google Scholar 

  26. Malozemov, V.N., Omelchenko, A.V.: On a discrete optimal control problem with an explicit solution. J. Ind. Manag. Optim. 2, 55–62 (2006)

    Article  MathSciNet  MATH  Google Scholar 

  27. Mordukhovich, B.S.: Difference approximations of optimal control system. Prikladaya Mat. Mekhanika 42, 431–440 (1978). (in Russian; English transl. in J. Appl. Math. Mech. 42, 452–461, 1978)

    MathSciNet  Google Scholar 

  28. Toan, N.T., Kien, B.T.: Continuity properties of the solution map to a parametric discrete optimal control problem. J. Nonlinear Convex Anal. 12, 635–650 (2011)

    MathSciNet  MATH  Google Scholar 

  29. Toan, N.T., Yao, J.-C.: Mordukhovich subgradients of the value function to a parametric discrete optimal control problem. J. Global Optim. 58, 595–612 (2014)

    Article  MathSciNet  MATH  Google Scholar 

  30. Pindyck, R.S.: An application of the linear quadratic tracking problem to economic stabilization policy. IEEE Trans. Automat. Control 17, 287–300 (1972)

    Article  MathSciNet  Google Scholar 

  31. Tu, P.N.V.: Introductory Optimization Dynamics. Springer, Berlin (1991)

    MATH  Google Scholar 

  32. Henrion, R., Mordukhovich, B.S., Nam, N.M.: Second-order analysis of polyhedral systems in finite dimensions with applications to robust stability of variational inequalities. SIAM J. Optim. 20, 2199–2227 (2010)

    Article  MathSciNet  MATH  Google Scholar 

  33. Kien, B.T., Nhu, V.H.: Second-order necessary optimality conditions for a class of semilinear elliptic optimal control problems with mixed pointwise constraints. SIAM J. Control Optim. 52, 1166–1202 (2014)

    Article  MathSciNet  MATH  Google Scholar 

  34. Mangasarian, O.L., Shiau, T.-H.: Lipschitz continuity of solutions of linear inequalities, programs and complementarity problems. SIAM J. Control Optim. 25, 583–595 (1987)

    Article  MathSciNet  MATH  Google Scholar 

  35. Mordukhovich, B.S.: Variational Analysis and Generalized Differentiation I. Basis Theory. Springer, Berlin (2006)

  36. Mordukhovich, B.S.: Variational Analysis and Generalized Differentiation II. Applications. Springer, Berlin (2006)

    Google Scholar 

  37. Rockafellar, R.T., Wets, R.J.-B.: Variational Analysis. Springer, Berlin (1998)

    Book  MATH  Google Scholar 

  38. Aubin, J.-P., Frankowska, H.: Set-Valued Analysis. Birkhäuser, Boston (1990)

    MATH  Google Scholar 

Download references

Acknowledgements

This research is funded by Vietnam National Foundation for Science and Technology Development (NAFOSTED) under grant number 101.01-2015.04 and by the Vietnam Institute for Advanced Study in Mathematics (VIASM).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Nguyen Thi Toan.

Additional information

Communicated by Boris S. Mordukhovich.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Thuy, L.Q., Thanh, B.T. & Toan, N.T. On the No-Gap Second-Order Optimality Conditions for a Discrete Optimal Control Problem with Mixed Constraints. J Optim Theory Appl 173, 421–442 (2017). https://doi.org/10.1007/s10957-017-1094-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10957-017-1094-3

Keywords

Mathematics Subject Classification

Navigation