Abstract
We consider an optimal control problem in which the motion of a dynamical system is described by delay differential equations, the initial conditions are determined by a piecewise continuous function, and a Bolza type cost functional is optimized. The construction of positional control strategies is proposed that permits one to obtain piecewise constant approximations to the optimal control. These strategies use quasigradients of the value functional. Strategies are calculated by searching for points of extremum on a finite-dimensional set. The fact that this set can be finite-dimensional is the main result of the paper.
Similar content being viewed by others
REFERENCES
Krasovskii, N.N. and Subbotin, A.I., Pozitsionnye differentsial’nye igry (Positional Differential Games), Moscow: Fizmatlit, 1974.
Berkovitz, L., Optimal feedback controls, SIAM J. Control Optim., 1989, vol. 27, no. 5, pp. 991–1006.
Frankowska, H., Optimal trajectories associated with a solution of the contingent Hamilton–Jacobi equation, Appl. Math. Optim., 1989, vol. 19, pp. 291–311.
Rowland, J.D.L. and Vinter, R.B., Construction of optimal feedback controls, Syst. Control Lett., 1991, vol. 16, no. 5, pp. 357–367.
Clarke, F.H., Ledyaev, Y.S., and Subbotin, A.I., Universal feedback control via proximal aiming in problems of control under disturbance and differential games, Preprint of Centre Rech. Math, Univ. Montreal, Montreal, 1994, no. 2386.
Subbotin, A.I., Generalized Solutions of First Order PDEs: The Dynamical Optimization Perspective, Berlin: Springer, 1995.
Swiech, A., Sub- and superoptimality principle of dynamic programming revisited, Nonlinear Anal. Theor. Methods Appl., 1996, vol. 26, no. 8, pp. 1429–1436.
Bardi, M. and Capuzzo-Dolcetta, I., Optimal Control and Viscosity Solutions of Hamilton–Jacobi–Bellman Equations, Boston: Springer, 1997.
Nobakhtian, S. and Stern, R.J., Universal near-optimal feedbacks, J. Optim. Theor. Appl., 2000, vol. 107, no. 1, pp. 89–122.
Osipov, Yu.S., Differential games of systems with aftereffect, Dokl. Akad. Nauk SSSR, 1971, vol. 196, no. 4, pp. 779–782.
Lukoyanov, N.Yu., Strategies of aiming in the direction of invariant gradients, Prikl. Mat. Mekh., 2004, vol. 68, no. 4, pp. 629–643.
Lukoyanov, N.Yu., On optimality conditions for the guaranteed result in control problems for time-delay systems, Proc. Steklov Inst. Math. (Suppl. Iss.), 2010, vol. 268, no. 1, pp. S175–S187.
Plaksin, A.R., On Hamilton–Jacobi–Bellman–Isaacs equation for time-delay systems, IFAC-PapersOnLine, 2019, vol. 52, no. 18, pp. 138–143.
Plaksin, A.R., Minimax and viscosity solutions of Hamilton–Jacobi–Bellman equations for time-delay systems, J. Optim. Theor. Appl., 2020, vol. 187, pp. 22–42.
Zverkin, A.M., Kamenskii, G.A., Norkin, S.B., and El’sgol’ts, L.E., Differential equations with a perturbed argument, Russ. Math. Surv., 1962, vol. 17, no. 2, pp. 77–164.
Filippov, A.F., Differentsial’nye uravneniya s razryvnoi pravoi chast’yu (Differential Equations with Discontinuous Right-Hand Side), Moscow: Nauka, 1985.
Evans, L., Partial Differential Equations, Providence, RI: Am. Math. Soc., 1998.
Kim, A.V., Functional Differential Equations. Application of \(i\)-Smooth Calculus, Dordrecht: Springer, 1999.
Bellman, R. and Cooke, K.L., Differential–Difference Equations, New York–London: Academic Press, 1963. Translated under the title: Differentsial’no-raznostnye uravneniya, Moscow: Mir, 1967.
Funding
This work was supported by the Ministry of Science and Higher Education of the Russian Federation within the framework of state order no. 075-01265-22-00 (project no. FEWS-2020-0010).
Author information
Authors and Affiliations
Corresponding authors
Additional information
Translated by V. Potapchouck
Rights and permissions
About this article
Cite this article
Lukoyanov, N.Y., Plaksin, A.R. Quasigradient Aiming Strategies in Optimal Control Problems for Time-Delay Systems. Diff Equat 58, 1514–1524 (2022). https://doi.org/10.1134/S00122661220110076
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1134/S00122661220110076