Abstract
The dynamic programming formulation of the forward principle of optimality in the solution of optimal control problems results in a partial differential equation with initial boundary condition whose solution is independent of terminal cost and terminal constraints. Based on this property, two computational algorithms are described. The first-order algorithm with minimum computer storage requirements uses only integration of a system of differential equations with specified initial conditions and numerical minimization in finite-dimensional space. The second-order algorithm is based on the differential dynamic programming approach. Either of the two algorithms may be used for problems with nondifferentiable terminal cost or terminal constraints, and the solution of problems with complicated terminal conditions (e.g., with free terminal time) is greatly simplified.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Leitmann, G., andStalford, H.,A Note on Termination in Optimal Control Problems, Journal of Optimization Theory and Applications, Vol. 8, pp. 228–230, 1971.
Larson, R. E.,State Increment Dynamic Programming, American Elsevier Publishing Company, New York, New York, 1968.
Jacobson, D. H.,A New Necessary Condition of Optimality for Singular Control Problems, SIAM Journal on Control, Vol. 7, pp. 578–595, 1969.
Peschon, J., andHenault, P. H.,Long-Term Power System Expansion Planning by Dynamic Programming and Production Cost Simulation, 9th-IEEE Symposium on Adaptive Processes, Decision, and Control, Austin, Texas, 1970.
Jacobson, D. H., andMayne, D. Q.,Differential Dynamic Programming, American Elsevier Publishing Company, New York, New York, 1970.
Ash, M.,Optimal Shutdown of Nuclear Reactors, Academic Press, New York, New York, 1966.
Kwan, H. K.,Optimal Shutdown Control of Nuclear Reactors, University of Salford, MS Dissertation, 1973.
Tapley, B. D., andWilliamson, W. E.,Comparison of Linear and Riccati Equations Used to Solve Optimal Control Problems, AIAA Journal, Vol. 10, pp. 1154–1159, 1972.
Dreyfus, S. E.,Dynamic Programming and the Calculus of Variations, Academic Press, New York, New York, 1965.
Author information
Authors and Affiliations
Additional information
Communicated by S. E. Dreyfus
Rights and permissions
About this article
Cite this article
Vit, K. Forward differential dynamic programming. J Optim Theory Appl 21, 487–504 (1977). https://doi.org/10.1007/BF00933093
Issue Date:
DOI: https://doi.org/10.1007/BF00933093