Set-Valued and Variational Analysis

, Volume 26, Issue 4, pp 843–866 | Cite as

An Approximation Scheme for Uncertain Minimax Optimal Control Problems

  • Laura S. Aragone
  • Justina Gianatti
  • Pablo A. Lotito
  • Lisandro A. ParenteEmail author


In this work, we address an uncertain minimax optimal control problem with linear dynamics where the objective functional is the expected value of the supremum of the running cost over a time interval. By taking an independently drawn random sample, the expected value function is approximated by the corresponding sample average function. We study the epi-convergence of the approximated objective functionals as well as the convergence of their global minimizers. Then we define an Euler discretization in time of the sample average problem and prove that the value of the discrete time problem converges to the value of the sample average approximation. In addition, we show that there exists a sequence of discrete problems such that the accumulation points of their minimizers are optimal solutions of the original problem. Finally, we propose a convergent descent method to solve the discrete time problem, and show some preliminary numerical results for two simple examples.


Minimax control problems Uncertain control problems Sample average approximation Epi-convergence Numerical solutions 

Mathematics Subject Classification (2010)

49K35 49M25 49M37 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.



We thank the anonymous referees for their useful comments and suggestions.


  1. 1.
    Aragone, L.S., Di Marco, S., González, R.L.V.: Numerical analysis of a minimax optimal control problem with an additive final cost. Math. Models Methods Appl. Sci. 12(2), 183–203 (2002). MathSciNetCrossRefzbMATHGoogle Scholar
  2. 2.
    Artstein, Z., Wets, R.J.: Consistency of minimizers and the slln for stochastic programs. Journal of Convex Analysis 2(1–2), 1–17 (1995). MathSciNetzbMATHGoogle Scholar
  3. 3.
    Attouch, H.: Variational Convergence for Functions and Operators. Applicable Math- Ematics Series. Pitman, London (1984)Google Scholar
  4. 4.
    Attouch, H., Wets, R.J.B.: Approximation and convergence in nonlinear optimization. Nonlinear Programming 4, 367–394 (1981)MathSciNetGoogle Scholar
  5. 5.
    Attouch, H., Wets, R.J.B.: A convergence theory for saddle functions. Trans. Am. Math. Soc. 280(1), 1–41 (1983)MathSciNetCrossRefGoogle Scholar
  6. 6.
    Barron, E.N.: The Bellman equation for control of the running max of a diffusion and applications to look-back options. Appl. Anal. 48, 205–222 (1993). MathSciNetCrossRefzbMATHGoogle Scholar
  7. 7.
    Barron, E.N., Ishi, H.: The Bellman equation for minimizing the maximum cost. Nonlinear Anal. Theory Methods Appl. 13(9), 1067–1090 (1989). MathSciNetCrossRefzbMATHGoogle Scholar
  8. 8.
    Bokanowski, O., Picarelli, A., Zidani, H.: Dynamic programming and error estimates for stochastic control problems with maximum cost. Appl. Math. Optim. 71 (1), 125–163 (2015). MathSciNetCrossRefzbMATHGoogle Scholar
  9. 9.
    Bonnans, J.F., Shapiro, A.: Perturbation Analysis of Optimization Problems. Springer, New York (2000)CrossRefGoogle Scholar
  10. 10.
    Bulirsch, R., Montrone, F., Pesch, H.J.: Abort landing in the presence of windshear as a minimax optimal control problem, part 1: Necessary conditions. J. Optim. Theory Appl. 70(1), 1–23 (1991). MathSciNetCrossRefzbMATHGoogle Scholar
  11. 11.
    Bulirsch, R., Montrone, F., Pesch, H.J.: Abort landing in the presence of windshear as a minimax optimal control problem, part 2: Multiple shooting and homotopy. J. Optim. Theory Appl. 70(2), 223–254 (1991). MathSciNetCrossRefzbMATHGoogle Scholar
  12. 12.
    Di Marco, S., González, R.L.V.: Minimax optimal control problems. Numerical analysis of the finite horizon case ESAIM: Mathematical Modelling and Numerical Analysis 1(33), 23–54 (1999). CrossRefzbMATHGoogle Scholar
  13. 13.
    Gianatti, J., Aragone, L.S., Lotito, P.A., Parente, L.A.: Solving minimax control problems via nonsmooth optimization. Oper. Res. Lett. 44(5), 680–686 (2016). MathSciNetCrossRefGoogle Scholar
  14. 14.
    King, A.J., Wets, R.J.: Epi-consistency of convex stochastic programs. Stochastics and Stochastic Reports 34(1-2), 83–92 (1991). MathSciNetCrossRefzbMATHGoogle Scholar
  15. 15.
    Kleywegt, A.J., Shapiro, A., Homem-de Mello, T.: The sample average approximation method for stochastic discrete optimization. SIAM J. Optim. 12(2), 479–502 (2002). MathSciNetCrossRefzbMATHGoogle Scholar
  16. 16.
    Mosco, U.: Convergence of convex sets and of solutions of variational inequalities. Adv. Math. 3(4), 510–585 (1969)MathSciNetCrossRefGoogle Scholar
  17. 17.
    Oberle, H.J.: Numerical solution of minimax optimal control problems by multiple shooting technique. J. Optim. Theory Appl. 50 (2), 331–357 (1986). MathSciNetCrossRefzbMATHGoogle Scholar
  18. 18.
    Petersen, I.R., James, M.R., Dupuis, P.: Minimax optimal control of stochastic uncertain systems with relative entropy constraints. IEEE Trans. Autom. Control 45 (3), 398–412 (2000). MathSciNetCrossRefzbMATHGoogle Scholar
  19. 19.
    Phelps, C., Royset, J.O., Gong, Q.: Optimal control of uncertain systems using sample average approximations. SIAM J. Control. Optim. 54(1), 1–29 (2016). MathSciNetCrossRefzbMATHGoogle Scholar
  20. 20.
    Polak, E.: Computational Methods in Optimization. a Unified Approach. Academic Press, New York (1986)Google Scholar
  21. 21.
    Rockafellar, R., Wets, R.: Variational Analysis. Grundlehren der mathematischen Wissenschaften. Springer, Berlin (2009)Google Scholar
  22. 22.
    Royset, J.O., Polak, E.: Implementable algorithm for stochastic optimization using sample average approximations. J. Optim. Theory Appl. 122(1), 157–184 (2004). MathSciNetCrossRefzbMATHGoogle Scholar
  23. 23.
    Ugrinovskii, V., Petersen, I.: Absolute stabilization and minimax optimal control of uncertain systems with stochastic uncertainty. SIAM J. Control. Optim. 37(4), 1089–1122 (1999). MathSciNetCrossRefzbMATHGoogle Scholar
  24. 24.
    Vinter, R.B.: Minimax optimal control. SIAM J. Control. Optim. 44(3), 939–968 (2005). MathSciNetCrossRefzbMATHGoogle Scholar
  25. 25.
    Wijsman, R.A.: Convergence of sequences of convex sets, cones and functions. Bull. Am. Math. Soc. 70(1), 186–188 (1964)MathSciNetCrossRefGoogle Scholar
  26. 26.
    Wijsman, R.A.: Convergence of sequences of convex sets, cones and functions. Trans. Am. Math. Soc. II(123), 32–45 (1966)MathSciNetCrossRefGoogle Scholar
  27. 27.
    Wu, C., Teo, K.L., Wang, X.: Minimax optimal control of linear system with input-dependent uncertainty. J. Frankl. Inst. 351(5), 2742–2754 (2014). MathSciNetCrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media B.V. 2017

Authors and Affiliations

  1. 1.CIFASIS-CONICET-UNR, Ocampo y EsmeraldaRosarioArgentina
  2. 2.PLADEMA-UNCPBA-CONICET, Paraje Arroyo SecoTandilArgentina

Personalised recommendations