Skip to main content
Log in

Extending the relationship between the conjugate gradient and BFGS algorithms

  • Short Communication
  • Published:
Mathematical Programming Submit manuscript

Abstract

We wish to examine the conjugate gradient and quasi-Newton minimization algorithms. A relation noted by Nazareth is extended to an algorithm in which conjugate gradient and quasi-Newton search directions occur together and which can be interpreted as a conjugate gradient algorithm with a changing metric.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

References

  1. J.C. Allwright, “Improving the conditioning of optimal control problems using simple models”, in: D.J. Bell, ed.,Recent mathematical developments in control (Academic Press, London, 1972).

    Google Scholar 

  2. A.G. Buckley, “A combined conjugate-gradient quasi-Newton minimization algorithm”,Mathematical Programming, to appear.

  3. R. Fletcher, “A new approach to variable metric algorithms”,Computer Journal 13 (1970) 317–322.

    Google Scholar 

  4. R. Fletcher, “Conjugate direction methods”, in: W. Murray, ed.,Numerical methods for unconstrained optimization, (Academic Press, London, 1972) pp. 73–86.

    Google Scholar 

  5. M.R. Hestenes and E.L. Stiefel, “Methods of conjugate gradients for solving linear systems”,Journal of Research of the National Bureau of Standards 49 (1952) 409–436.

    Google Scholar 

  6. G.E. Myers, “Properties of the conjugate gradient and Davidon methods”,Journal of Optimization Theory and Applications 2 (1968) 209–219.

    Google Scholar 

  7. L. Nazareth, “A relationship between the BFGS and conjugate gradient algorithms”, AMD Tech. Memo 282, Argonne National Laboratory (1977).

  8. M.J.D. Powell, “Restart procedures for the conjugate gradient method”,Mathematical Programming 12 (1977) 241–254.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Buckley, A. Extending the relationship between the conjugate gradient and BFGS algorithms. Mathematical Programming 15, 343–348 (1978). https://doi.org/10.1007/BF01609038

Download citation

  • Received:

  • Revised:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF01609038

Key words

Navigation