Skip to main content
Log in

Modified quasilinearization algorithm for optimal control problems with nondifferential constraints

  • Contributed Papers
  • Published:
Journal of Optimization Theory and Applications Aims and scope Submit manuscript

Abstract

This paper considers the numerical solution of optimal control problems involving a functionalI subject to differential constraints, nondifferential constraints, and terminal constraints. The problem is to find the statex(t), the controlu(t), and the parameter π so that the functional is minimized, while the constraints are satisfied to a predetermined accuracy.

A modified quasilinearization algorithm is developed. Its main property is the descent property in the performance indexR, the cumulative error in the constraints and the optimality conditions. Modified quasilinearization differs from ordinary quasilinearization because of the inclusion of the scaling factor (or stepsize) α in the system of variations. The stepsize is determined by a one-dimensional search on the performance indexR. Since the first variation δR is negative, the decrease inR is guaranteed if α is sufficiently small. Convergence to the solution is achieved whenR becomes smaller than some preselected value.

In order to start the algorithm, some nominal functionsx(t),u(t), π and nominal multipliers λ(t), ρ(t), μ must be chosen. In a real problem, the selection of the nominal functions can be made on the basis of physical considerations. Concerning the nominal multipliers, no useful guidelines have been available thus far. In this paper, an auxiliary minimization algorithm for selecting the multipliers optimally is presented: the performance indexR is minimized with respect to λ(t), ρ(t), μ. Since the functionalR is quadratically dependent on the multipliers, the resulting variational problem is governed by optimality conditions which are linear and, therefore, can be solved without difficulty.

To facilitate the numerical solution on digital computers, the actual time θ is replaced by the normalized timet, defined in such a way that the extremal arc has a normalized time length Δt=1. In this way, variable-time terminal conditions are transformed into fixed-time terminal conditions. The actual time τ at which the terminal boundary is reached is regarded to be a component of the parameter π being optimized.

The present general formulation differs from that of Ref. 3 because of the inclusion of the nondifferential constraints to be satisfied everywhere over the interval 0⩽t⩽1. Its importance lies in that (i) many optimization problems arise directly in the form considered here, (ii) there are problems involving state equality constraints which can be reduced to the present scheme through suitable transformations, and (iii) there are some problems involving inequality constraints which can be reduced to the present scheme through the introduction of auxiliary variables.

Numerical examples are presented for the free-final-time case. These examples demonstrate the feasibility as well as the rapidity of convergence of the technique developed in this paper.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Miele, A., Mangiavacchi, A., andAggarwal, A. K.,Modified Quasilinearization Algorithm for Optimal Control Problems with Nondifferential Constraints, Part 1, Theory, Rice University, Aero-Astronautics Report No. 112, 1973.

  2. Miele, A., Mangiavacchi, A., andAggarwal, A. K.,Modified Quasilinearization Algorithm for Optimal Control Problems with Nondifferential Constraints, Part 2, Examples, Rice University, Aero-Astronautics Report No. 113, 1973.

  3. Miele, A., Iyer, R. R., andWell, K. H.,Modified Quasilinearization and Optimal Initial Choice of the Multipliers, Part 2, Optimal Control Problems, Journal of Optimization Theory and Applications, Vol. 6, No. 5, 1970.

  4. Rovner, J. M.,Optimization of Cyclic Parallel Reactors with Decaying Catalyst, Rice University, Department of Chemical Engineering, Ph.D. Thesis, 1973.

  5. Bliss, G. A.,Lectures on the Calculus of Variations, The University of Chicago Press, Chicago, Illinois, 1946.

    Google Scholar 

  6. Hestenes, M. R.,Calculus of Variations and Optimal Control Theory, John Wiley and Sons, New York, New York, 1966.

    Google Scholar 

  7. Pontryagin, L. S., Boltyanskii, V. G., Gamkrelidze, R. V., andMischchenko, E. F.,The Mathematical Theory of Optimal Processes, John Wiley and Sons (Interscience Publishers), New York, New York, 1962.

    Google Scholar 

  8. Bryson, A. E., Jr., andHo, Y. C.,Applied Optimal Control, Blaisdell Publishing Company, Waltham, Massachusetts, 1969.

    Google Scholar 

  9. Miele, A., Editor,Theory of Optimum Aerodynamic Shapes, Academic Press, New York, New York, 1965.

    Google Scholar 

  10. Miele, A.,Method of Particular Solutions for Linear, Two-Point Boundary-Value Problems, Journal of Optimization Theory and Applications, Vol. 2, No. 4, 1968.

  11. Heideman, J. C.,Use of the Method of Particular Solutions in Nonlinear, Two-Point Boundary-Value Problems, Journal of Optimization Theory and Applications, Vol. 2, No. 6, 1968.

  12. Miele, A., andIyer, R. R.,General Technique for Solving Nonlinear, Two-Point Boundary-Value Problems via the Method of Particular Solutions, Journal of Optimization Theory and Applications, Vol. 5, No. 5, 1970.

  13. Miele, A., andIyer, R. R.,Modified Quasilinearization Method for Solving Nonlinear, Two-Point Boundary-Value Problems, Journal of Mathematical Analysis and Applications, Vol. 36, No. 3, 1971.

  14. Ralston, A.,Numerical Integration Methods for the Solution of Ordinary Differential Equations, Mathematical Methods for Digital Computers, Vol. 1, Edited by A. Ralston and H. S. Wilf, John Wiley and Sons, New York, New York, 1960.

    Google Scholar 

  15. Miele, A., Damoulakis, J. N., Cloutier, J. R., andTietze, J. L.,Sequential Gradient-Restoration Algorithm for Optimal Control Problems with Non-differential Constraints, Journal of Optimization Theory and Applications, Vol. 13, No. 2, 1974.

Additional Bibliography

  1. Breakwell, J. V., Speyer, J. L., andBryson, A. E., Jr.,Optimization and Control of Nonlinear Systems Using the Second Variations, SIAM Journal on Control, Vol. 1, No. 2, 1963.

  2. Kelley, H. J., Kopp, R., andMoyer, H. G.,A Trajectory Optimization Technique Based Upon the Theory of the Second Variation, Paper Presented at the AIAA Astrodynamics Conference, New Haven, Connecticut, 1963.

  3. McReynolds, S. R., andBryson, A. E., Jr.,A Successive Sweep Method for Solving Optimal Programming Problems, Paper Presented at the Joint Automatic Control Conference, Troy, New York, 1965.

  4. Jacobson, D. H.,New Second-Order and First-Order Algorithms for Determining Optimal Control: A Differential Dynamic Programming Approach, Journal of Optimization Theory and Applications, Vol. 2, No. 6, 1968.

  5. Bellman, R. E., andKalaba, R. E.,Quasilinearization and Nonlinear Boundary-Value Problems, The RAND Corporation, Report No. R-438-RP, 1965.

  6. Lee, E. S.,Quasilinearization and Invariant Imbedding, Academic Press, New York, New York, 1968.

    Google Scholar 

  7. Long, R. S.,Newton-Raphson Operator; Problems with Undetermined End Points, AIAA Journal, Vol. 13, No. 7, 1965.

  8. Graham, R. G., andLeondes, C. T.,An Extended Quasilinearization Algorithm, Journal of Optimization Theory and Applications, Vol. 12, No. 3, 1973.

Download references

Author information

Authors and Affiliations

Authors

Additional information

Dedicated to Professor M. R. Hestenes

This research was supported by the Office of Scientific Research, Office of Aerospace Research, United States Air Force, Grant No. AF-AFOSR-72-2185. The authors are indebted to Dr. J. L. Tietze for helpful discussions. This paper is a condensation of the investigations reported in Refs. 1–2.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Miele, A., Mangiavacchi, A. & Aggarwal, A.K. Modified quasilinearization algorithm for optimal control problems with nondifferential constraints. J Optim Theory Appl 14, 529–556 (1974). https://doi.org/10.1007/BF00932847

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF00932847

Key Words

Navigation