Abstract
For a general optimal control problem with a state constraint, we propose a proof of the maximum principle based on a v-change of the time variable t ↦ τ, under which the original time becomes yet another state variable subject to the equation dt/dτ = v(τ), while the additional control v(τ) ≥ 0 is piecewise constant and its values are arguments of the new problem. Since the state constraint generates a continuum of inequality constraints in this problem, the necessary optimality conditions involve a measure. Rewriting these conditions in terms of the original problem, we get a nonempty compact set of collections of Lagrange multipliers that fulfil the maximum principle on a finite set of values of the control and time variables corresponding to the v-change. The compact sets generated by all possible piecewise constant v-changes are partially ordered with respect to inclusion, thus forming a centered family. Taking any element of their intersection, we obtain a universal optimality condition, in which the maximum principle holds for all values of the control and time.
Similar content being viewed by others
References
L. S. Pontryagin, V. G. Boltyanskii, R. V. Gamkrelidze, and E. F. Mishchenko, The Mathematical Theory of Optimal Processes (Fizmatgiz, Moscow, 1961; Wiley, New York, 1962).
A. Ya. Dubovitskii and A. A. Milyutin, “Extremum problems in the presence of restrictions,” USSR Comp. Math. Math. Phys. 5(3), 1–80 (1965).
A. N. Kolmogorov and S. V. Fomin, Elements of the Theory of Functions and Functional Analysis (Nauka, Moscow, 1976; Dover, New York, 1999).
A. A. Milyutin, A. V. Dmitruk, and N. P. Osmolovskii, The Maximum Principle in Optimal Control (Mosk. Gos. Univ., Moscow, 2004) [in Russian]. http://www.math.msu.su/department/opu/node/139
E. M. Galeev, M. I. Zelikin, S. V. Konyagin, G. G. Magaril-Il’yaev, N. P. Osmolovskii, V. Yu. Protasov, V. M. Tikhomirov, and A. V. Fursikov, Optimal Control (MTsNMO, Moscow, 2008) [in Russian].
A. Ya. Dubovitskii and A. A. Milyutin, “Theory of the maximum principle,” in Methods of the Theory of Extremal Problems in Economics (Nauka, Moscow, 1981), pp. 6–47 [in Russian].
I. V. Girsanov, Lectures on Mathematical Theory of Extremum Problems (Izd. Mosk. Gos. Univ., Moscow, 1970; Springer, Berlin, 1972).
A. A. Milyutin, “The maximum principle in optimal control,” in A Necessary Condition in Optimal Control (Nauka, Moscow, 1990) [in Russian].
A. A. Milyutin, The Maximum Principle in the General Optimal Control Problem (Fizmatlit, Moscow, 2001) [in Russian].
A. A. Milyutin, “General schemes of necessary conditions for extrema and problems of optimal control,” Russ. Math. Surv. 25(5), 109–115 (1970).
A. D. Ioffe and V. M. Tikhomirov, Theory of Extremal Problems (Nauka, Moscow, 1974; North-Holland, New York, 1979).
A. V. Arutyunov, “Pontryagin’s maximum principle in optimal control theory,” J. Math. Sci. 94(3), 1311–1365 (1999).
R. B. Vinter and H. Zheng, “Necessary conditions for optimal control problems with state constraints,” Trans. AMS 350(3), 1181–1204 (1998).
L. Bourdin, “Note on Pontryagin maximum principle with running state constraints and smooth dynamics. Proof based on the Ekeland variational principle.” https://arxiv.org/pdf/1604.04051.pdf
J. F. Bonnans, Course on Optimal Control (Univ. Paris-Saclay, 2017). http://www.cmap.polytechnique.fr/~bonnans/notes/oc/oc.html
A. V. Arutyunov, D. Yu. Karamzin, and F. L. Pereira, “The maximum principle for optimal control problems with state constraints by R. V. Gamkrelidze: Revisited,” J. Optim. Theory Appl. 149(3), 474–493 (2011). doi https://doi.org/10.1007/s10957-011-9807-5
A. V. Dmitruk and I. A. Samylovskiy, “On the relation between two approaches to necessary optimality conditions in problems with state constraints,” J. Optim. Theory Appl. 173(2), 391–420 (2017). doi https://doi.org/10.1007/s10957-017-1089-0
A. Ya. Dubovitskii and A. A. Milyutin, “Translation of Euler’s equations,” USSR Comp. Math. Math. Phys. 9(6), 37–64 (1969).
A. V. Dmitruk, “On the development of Pontryagin’s maximum principle in the works of A.Ya. Dubovitskii and A.A. Milyutin,” Control Cybern. 38(4a), 923–958 (2009).
A. V. Dmitruk and N. P. Osmolovskii, “On the proof of Pontryagin’s maximum principle by means of needle variations,” J. Math. Sci. 218(5), 581–598 (2016).
A. V. Dmitruk and N. P. Osmolovskii, “Necessary conditions for a weak minimum in optimal control problems with integral equations subject to state and mixed constraints,” SIAM J. Control Optim. 52(6), 3437–3462 (2014). doi https://doi.org/10.1137/130921465
Funding
This work was supported by the Russian Foundation for Basic Research (project nos. 16-01-00585 and 17-01-00805).
Author information
Authors and Affiliations
Corresponding authors
Additional information
Russian Text © The Author(s), 2018, published in Trudy Instituta Matematiki i Mekhaniki UrO RAN, 2018, Vol. 24, No. 1, pp. 76–92.
Rights and permissions
About this article
Cite this article
Dmitruk, A.V., Osmolovskii, N.P. Variations of the v-Change of Time in Problems with State Constraints. Proc. Steklov Inst. Math. 305 (Suppl 1), S49–S64 (2019). https://doi.org/10.1134/S0081543819040072
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1134/S0081543819040072