Skip to main content
Log in

Function-space quasi-Newton algorithms for optimal control problems with bounded controls and singular arcs

  • Contributed Papers
  • Published:
Journal of Optimization Theory and Applications Aims and scope Submit manuscript

Abstract

Two existing function-space quasi-Newton algorithms, the Davidon algorithm and the projected gradient algorithm, are modified so that they may handle directly control-variable inequality constraints. A third quasi-Newton-type algorithm, developed by Broyden, is extended to optimal control problems. The Broyden algorithm is further modified so that it may handle directly control-variable inequality constraints. From a computational viewpoint, dyadic operator implementation of quasi-Newton methods is shown to be superior to the integral kernel representation. The quasi-Newton methods, along with the steepest descent method and two conjugate gradient algorithms, are simulated on three relatively simple (yet representative) bounded control problems, two of which possess singular subarcs. Overall, the Broyden algorithm was found to be superior. The most notable result of the simulations was the clear superiority of the Broyden and Davidon algorithms in producing a sharp singular control subarc.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Pagurek, B., andWoodside, C. M.,The Conjugate Gradient Method for Optimal Control Problems with Bounded Control Variables, Automatica, Vol. 4, Nos. 5/6, 1968.

  2. Horwitz, L. B., andSarachik, P. E.,Davidon's Method in Hilbert Space, SIAM Journal on Applied Mathematics, Vol. 16, No. 4, 1968.

  3. Broyden, C. G.,The Convergence of a Class of Double-Rank Minimization Algorithms, 2, The New Algorithm, Journal of the Institute of Mathematics and Applications, Vol. 6, No. 3, 1970.

  4. Lasdon, L. S.,Conjugate Direction Methods for Optimal Control, IEEE Transactions on Automatic Control, Vol. AC-15, No. 2, 1970.

  5. Porter, W. A.,Modern Foundations of Systems Engineering, The Macmillan Company, New York, New York, 1966.

    Google Scholar 

  6. Friedman, B.,Principles and Techniques of Applied Mathematics, John Wiley and Sons, New York, New York, 1966.

    Google Scholar 

  7. Lasdon, L. S., Mitter, S. K., andWaren, A. D.,The Conjugate Gradient Method for Optimal Control Problems, IEEE Transactions on Automatic Control, Vol. AC-12, No. 2, 1967.

  8. Klessig, R., andPolak, E.,Efficient Implementations of the Polak-Ribière Conjugate Gradient Algorithm, SIAM Journal on Control, Vol. 10, No. 3, 1972.

  9. Tripathi, S. S., andNarendra, K. S.,Optimization Using Conjugate Gradient Methods, IEEE Transactions on automatic Control, Vol. AC-15, No. 2, 1970.

  10. Dixon, L. C. U.,Variable Metric Algorithms; Necessary and Sufficient Conditions for Identical Behavior and Sufficient Conditions for Identical Behavior on Nonquadratic Functions, Nottingham Optimization Centre, Nottingham, England, Report No. NOC-TR26, 1971.

    Google Scholar 

  11. Powers, W. F.,A Crude-Search Davidon-Type Technique with Application to Shuttle Optimization, AIAA Journal of Spacecraft and Rockets, Vol. 10, No. 11, 1973.

  12. Bryson, A. E. Jr., andHo, Y. C.,Applied Optimal Control, Blaisdell Publishing Company, Waltham, Massachusetts, 1969.

    Google Scholar 

  13. Kelley, H. J., Uzzell, B. R., andMcKay, S. S.,Rocket Trajectory Optimization by a Second-Order Numerical Technique, AIAA Journal, Vol. 7, No. 5, 1969.

  14. Mitter, S. K.,Successive Approximation Methods for the Solution of Optimal Control Problems, Automatica, Vol. 3, Nos. 3/4, 1966.

  15. Jacobson, D. H., andMayne, D. Q.,Differential Dynamic Programming, American Elsevier Publishing Company, New York, New York, 1970.

    Google Scholar 

  16. Oi, K., Sayama, H., andTakamatsu, T.,Computational Schemes of the Davidon-Fletcher-Powerll Method in Infinite-Dimensional Space, Journal of Optimization Theory and Applications, Vol. 12, No. 5, 1973.

  17. Ladd, H. O.,A Unified Theory for Constrained Minimization on Hilbert Space, Massachusetts Institute of Technology, PhD Thesis, 1968.

  18. Pierson, B. L., andRajtora, S. G.,Computational Experience with the Davidon Method Applied to Optimal Control Problems, IEEE Transactions on System Science and Cybernetics, Vol. SSC-6, pp. 240–242, 1970.

    Google Scholar 

  19. McDanell, J. P., andPowers, W. F.,Necessary Conditions for the Joining of Optimal Singular and Nonsingular Subarcs, SIAM Journal on Control, Vol. 9, No. 2, 1971.

  20. Jacobson, D. H.,Differential Dynamic Programming Methods for Solving Bang-Bang Control Problems, IEEE Transactions on Automatic Control, Vol. AC-13, No. 6, 1968.

Download references

Author information

Authors and Affiliations

Authors

Additional information

Communicated by T. N. Edelbaum

This research was supported by the National Science Foundation under Grant Nos. GK-30115 and ENG 74-21618 and by the National Aeronautics and Space Administration under Contract No. NAS 9-12872.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Edge, E.R., Powers, W.F. Function-space quasi-Newton algorithms for optimal control problems with bounded controls and singular arcs. J Optim Theory Appl 20, 455–479 (1976). https://doi.org/10.1007/BF00933131

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF00933131

Key Words

Navigation