Springer Nature is making SARS-CoV-2 and COVID-19 research free. View research | View latest news | Sign up for updates

Function-space quasi-Newton algorithms for optimal control problems with bounded controls and singular arcs

  • 81 Accesses

  • 33 Citations

Abstract

Two existing function-space quasi-Newton algorithms, the Davidon algorithm and the projected gradient algorithm, are modified so that they may handle directly control-variable inequality constraints. A third quasi-Newton-type algorithm, developed by Broyden, is extended to optimal control problems. The Broyden algorithm is further modified so that it may handle directly control-variable inequality constraints. From a computational viewpoint, dyadic operator implementation of quasi-Newton methods is shown to be superior to the integral kernel representation. The quasi-Newton methods, along with the steepest descent method and two conjugate gradient algorithms, are simulated on three relatively simple (yet representative) bounded control problems, two of which possess singular subarcs. Overall, the Broyden algorithm was found to be superior. The most notable result of the simulations was the clear superiority of the Broyden and Davidon algorithms in producing a sharp singular control subarc.

This is a preview of subscription content, log in to check access.

References

  1. 1.

    Pagurek, B., andWoodside, C. M.,The Conjugate Gradient Method for Optimal Control Problems with Bounded Control Variables, Automatica, Vol. 4, Nos. 5/6, 1968.

  2. 2.

    Horwitz, L. B., andSarachik, P. E.,Davidon's Method in Hilbert Space, SIAM Journal on Applied Mathematics, Vol. 16, No. 4, 1968.

  3. 3.

    Broyden, C. G.,The Convergence of a Class of Double-Rank Minimization Algorithms, 2, The New Algorithm, Journal of the Institute of Mathematics and Applications, Vol. 6, No. 3, 1970.

  4. 4.

    Lasdon, L. S.,Conjugate Direction Methods for Optimal Control, IEEE Transactions on Automatic Control, Vol. AC-15, No. 2, 1970.

  5. 5.

    Porter, W. A.,Modern Foundations of Systems Engineering, The Macmillan Company, New York, New York, 1966.

  6. 6.

    Friedman, B.,Principles and Techniques of Applied Mathematics, John Wiley and Sons, New York, New York, 1966.

  7. 7.

    Lasdon, L. S., Mitter, S. K., andWaren, A. D.,The Conjugate Gradient Method for Optimal Control Problems, IEEE Transactions on Automatic Control, Vol. AC-12, No. 2, 1967.

  8. 8.

    Klessig, R., andPolak, E.,Efficient Implementations of the Polak-Ribière Conjugate Gradient Algorithm, SIAM Journal on Control, Vol. 10, No. 3, 1972.

  9. 9.

    Tripathi, S. S., andNarendra, K. S.,Optimization Using Conjugate Gradient Methods, IEEE Transactions on automatic Control, Vol. AC-15, No. 2, 1970.

  10. 10.

    Dixon, L. C. U.,Variable Metric Algorithms; Necessary and Sufficient Conditions for Identical Behavior and Sufficient Conditions for Identical Behavior on Nonquadratic Functions, Nottingham Optimization Centre, Nottingham, England, Report No. NOC-TR26, 1971.

  11. 11.

    Powers, W. F.,A Crude-Search Davidon-Type Technique with Application to Shuttle Optimization, AIAA Journal of Spacecraft and Rockets, Vol. 10, No. 11, 1973.

  12. 12.

    Bryson, A. E. Jr., andHo, Y. C.,Applied Optimal Control, Blaisdell Publishing Company, Waltham, Massachusetts, 1969.

  13. 13.

    Kelley, H. J., Uzzell, B. R., andMcKay, S. S.,Rocket Trajectory Optimization by a Second-Order Numerical Technique, AIAA Journal, Vol. 7, No. 5, 1969.

  14. 14.

    Mitter, S. K.,Successive Approximation Methods for the Solution of Optimal Control Problems, Automatica, Vol. 3, Nos. 3/4, 1966.

  15. 15.

    Jacobson, D. H., andMayne, D. Q.,Differential Dynamic Programming, American Elsevier Publishing Company, New York, New York, 1970.

  16. 16.

    Oi, K., Sayama, H., andTakamatsu, T.,Computational Schemes of the Davidon-Fletcher-Powerll Method in Infinite-Dimensional Space, Journal of Optimization Theory and Applications, Vol. 12, No. 5, 1973.

  17. 17.

    Ladd, H. O.,A Unified Theory for Constrained Minimization on Hilbert Space, Massachusetts Institute of Technology, PhD Thesis, 1968.

  18. 18.

    Pierson, B. L., andRajtora, S. G.,Computational Experience with the Davidon Method Applied to Optimal Control Problems, IEEE Transactions on System Science and Cybernetics, Vol. SSC-6, pp. 240–242, 1970.

  19. 19.

    McDanell, J. P., andPowers, W. F.,Necessary Conditions for the Joining of Optimal Singular and Nonsingular Subarcs, SIAM Journal on Control, Vol. 9, No. 2, 1971.

  20. 20.

    Jacobson, D. H.,Differential Dynamic Programming Methods for Solving Bang-Bang Control Problems, IEEE Transactions on Automatic Control, Vol. AC-13, No. 6, 1968.

Download references

Author information

Additional information

This research was supported by the National Science Foundation under Grant Nos. GK-30115 and ENG 74-21618 and by the National Aeronautics and Space Administration under Contract No. NAS 9-12872.

Communicated by T. N. Edelbaum

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Edge, E.R., Powers, W.F. Function-space quasi-Newton algorithms for optimal control problems with bounded controls and singular arcs. J Optim Theory Appl 20, 455–479 (1976). https://doi.org/10.1007/BF00933131

Download citation

Key Words

  • Optimal control
  • numerical methods
  • computing methods
  • gradient methods
  • quasi-Newton algorithms
  • bounded control problems
  • singular arcs