Journal of Optimization Theory and Applications

, Volume 47, Issue 3, pp 285–300 | Cite as

A new three-term conjugate gradient method

  • L. C. W. Dixon
  • P. G. Ducksbury
  • P. Singh
Contributed Papers


In this paper, we describe an implementation and give performance results for a conjugate gradient algorithm for unconstrained optimization. The algorithm is based upon the Nazareth three-term formula and incorporates Allwright preconditioning matrices and restart tests. The performance results for this combination compare favorably with existing codes.

Key Words

Unconstrained optimization conjugate gradients 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Hestenes, M., andStiefel, E.,Methods of Conjugate Gradients for Solving Linear Systems, Journal of Research of National Bureau of Standards, Vol. 49, pp. 409–436, 1952.Google Scholar
  2. 2.
    Fletcher, R., andReeves, C. M.,Function Minimization by Conjugate Gradients, Computer Journal, Vol. 17, pp. 149–154, 1964.Google Scholar
  3. 3.
    Polak, E., andRibière, G., Note sur la Convergence de Methodes de Directions Conjugées, Revue Française d'Informatique et Recherche Operationnelle, Vol. 3, pp. 35–43, 1969.Google Scholar
  4. 4.
    Powell, M. J. D.,Restart Procedures for the Conjugate Gradient Method, Mathematical Programming, Vol. 12, pp. 241–254, 1977.Google Scholar
  5. 5.
    Wolfe, P.,Convergence Conditions for Ascent Methods, SIAM Review, Vol. 11, pp. 226–235, 1969.Google Scholar
  6. 6.
    Dixon, L. C. W.,Nonlinear Optimization: A Survey of the State of the Art, Software for Numerical Mathematics, Edited by D. J. Evans, Academic Press, New York, New York, 1974.Google Scholar
  7. 7.
    Cohen, A.,Rate of Convergence of Several Conjugate Gradient Algorithms, SIAM Journal, Vol. 9, pp. 248–259, 1972.Google Scholar
  8. 8.
    Dixon, L. C. W.,On Quadratic Termination and Second-Order Convergence, Two Properties of Unconstrained Optimization Algorithms, Toward Global Optimization, Edited by L. C. W. Dixon and G. P. Szegö, North-Holland Press, Amsterdam, Holland, 1975.Google Scholar
  9. 9.
    Dixon, L. C. W.,Conjugate Directions without Line Searches, Journal of the Institute of Mathematics and Its Applications, Vol. 11, pp. 317–328, 1973.Google Scholar
  10. 10.
    Nazareth, L.,A Conjugate Gradient Algorithm without Line Searches, Journal of Optimization Theory and Applications, Vol. 23, pp. 373–387, 1977.Google Scholar
  11. 11.
    Beale, E. M. L.,A Derivation of Conjugate Gradients, Numerical Methods for Nonlinear Optimization, Edited by F. A. Lootsma, Academic Press, London, England, 1972.Google Scholar
  12. 12.
    Allwright, J. C.,Improving the Conditioning of Optimal Control Problems Using Simple Methods, Recent Mathematical Developments in Control, Edited by O. J. Bell, Academic Press, London, England, 1972.Google Scholar
  13. 13.
    Nocedal, J.,On The Method of Conjugate Gradients for Function Minimization, Rice University, PhD Thesis, 1978.Google Scholar
  14. 14.
    Armijo, L.,Minimization of Functions Having Lipschitz Continuous First Partial Derivative, Pacific Journal of Mathematics, Vol. 16, pp. 1–16, 1966.Google Scholar
  15. 15.
    Buckley, A., andLe Nir, X. X.,QN-Like Variable Storage Conjugate Gradients, Mathematical Programming, Vol. 27, pp. 155–175, 1983.Google Scholar

Copyright information

© Plenum Publishing Corporation 1985

Authors and Affiliations

  • L. C. W. Dixon
    • 1
  • P. G. Ducksbury
    • 2
  • P. Singh
    • 1
  1. 1.Numerical Optimisation CentreHatfield PolytechnicHatfieldEngland
  2. 2.School of Information SciencesHatfield PolytechnicHatfieldEngland

Personalised recommendations