Skip to main content
Log in

Differential dynamic programming and separable programs

  • Contributed Papers
  • Published:
Journal of Optimization Theory and Applications Aims and scope Submit manuscript

Abstract

This paper deals with differential dynamic programming for solving nonlinear separable programs. The present algorithm and its derivation are rather different from differential dynamic programming algorithms and their derivations by Mayne and Jacobson, who have not proved the convergence of their algorithms. The local convergence of the present algorithm is proved, and numerical examples are given.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Mayne, D. Q., andPolak, E.,First-Order Strong Variation Algorithms for Optimal Control, Journal of Optimization Theory and Applications, Vol. 16, pp. 277–301, 1975.

    Google Scholar 

  2. Polak, E., andMayne, D. Q.,First-Order Strong Variation Algorithms for Optimal Control Problems with Terminal Inequality Constraints, Journal of Optimization Theory and Applications, Vol. 16, pp. 303–325, 1975.

    Google Scholar 

  3. Lasdon, L. S.,Optimization Theory for Large Systems, The Macmillan Company, New York, New York, 1970.

    Google Scholar 

  4. Hadley, G.,Nonlinear and Dynamic Programming, Addison-Wesley Publishing Company, Reading, Massachusetts, 1964.

    Google Scholar 

  5. Mayne, D. Q.,A Second-Order Gradient Method for Determining Optimal Trajectories of Non-Linear Discrete-Time Systems, International Journal of Control, Vol. 3, pp. 85–95, 1966.

    Google Scholar 

  6. Jacobson, D. H., andMayne, D. Q.,Differential Dynamic Programming, American Elsevier Publishing Company, New York, New York, 1970.

    Google Scholar 

  7. Gershwin, S. B., andJacobson, D. H.,A Discrete-Time Differential Dynamic Programming Algorithm with Application to Optimal Orbit Transfer, AIAA Journal, Vol. 8, pp. 1616–1626, 1970.

    Google Scholar 

  8. Havira, R. M., andLewis, J. B.,Computation of Quantized Controls Using Differential Dynamic Programming, IEEE Automatic Control, Vol. 17, pp. 191–196, 1972.

    Google Scholar 

  9. Mayne, D. Q.,Differential Dynamic Programming—A Unified Approach to the Optimization of Dynamic Systems, Control and Dynamic Systems, Vol. 10, Edited by C. T. Leondes, Academic Press, New York, New York, 1973.

    Google Scholar 

  10. Dyer, P., andMcReynolds, S. R.,The Computation and Theory of Optimal Control, Academic Press, New York, New York, 1970.

    Google Scholar 

  11. Fiacco, A. V., andMcCormick, G. P.,Nonlinear Programming: SUMT, John Wiley and Sons, New York, New York, 1968.

    Google Scholar 

  12. Ortega, J. M., andRheinboldt, W. C.,Iterative Solution of Nonlinear Equations in Several Variables, Academic Press, New York, New York, 1970.

    Google Scholar 

  13. Hearon, J. Z.,On the Singularity of a Certain Bordered Matrix, SIAM Journal on Applied Mathematics, Vol. 15, pp. 1413–1421, 1967.

    Google Scholar 

  14. Takahashi, I.,Variable Separation Principle for Mathematical Programming, Journal of the Operations Research Society of Japan, Vol. 6, pp. 82–105, 1964.

    Google Scholar 

  15. O'Neill, R. P., andWidhelm, W. B.,Computational Experience with Normed and Nonnormed Column-Generation Procedures in Nonlinear Programming, Operations Research, Vol. 23, pp. 372–382, 1975.

    Google Scholar 

  16. Tapia, R. A.,A Stable Approach to Newton's Method for General Mathematical Programming Problems in Rn, Journal of Optimization Theory and Applications, Vol. 14, pp. 453–476, 1974.

    Google Scholar 

  17. Miele, A., andLevy, A. V.,Modified Quasilinearization and Optimal Choice of the Multipliers, Part 1, Mathematical Programming Problems, Journal of Optimization Theory and Applications, Vol. 6, pp. 364–380, 1970.

    Google Scholar 

  18. Mine, H., andOhno, K.,Decomposition of Mathematical Programming Problems by Dynamic Programming and Its Application to Block-Diagonal Geometric Programs, Journal of Mathematical Analysis and Applications, Vol. 32, pp. 370–385, 1970.

    Google Scholar 

  19. Mine, H., Ohno, K., andFukushima, M.,Multilevel Decomposition of Nonlinear Programming Problems by Dynamic Programming, Journal of Mathematical Analysis and Applications, Vol. 53, pp. 7–27, 1976.

    Google Scholar 

  20. Kalman, R. E., andBertram, J. E.,Control System Analysis and Design Via the Second Method of Lyapunov, II, Discrete-Time System, Transactions of the ASME, Journal of Basic Engineering, Vol. 82, pp. 394–400, 1960.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Additional information

Communicated by D. Q. Mayne

The author would like to express his appreciation to Professors H. Mine and T. Katayama for their helpful discussions. The author is also indebted to Professor D. Q. Mayne for drawing his attention to Refs. 1–2.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Ohno, K. Differential dynamic programming and separable programs. J Optim Theory Appl 24, 617–637 (1978). https://doi.org/10.1007/BF00935303

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF00935303

Key Words

Navigation