Numerical Analysis

Volume 1066 of the series Lecture Notes in Mathematics pp 122-141


Nonconvex minimization calculations and the conjugate gradient method

  • M. J. D. Powell

* Final gross prices may vary according to local VAT.

Get Access


We consider the global convergence of conjugate gradient methods without restarts, assuming exact arithmetic and exact line searches, when the objective function is twice continuously differentiable and has bounded level sets. Most of our attention is given to the Polak-Ribière algorithm, and unfortunately we find examples that show that the calculated gradients can remain bounded away from zero. The examples that have only two variables show also that some variable metric algorithms for unconstrained optimization need not converge. However, a global convergence theorem is proved for the Fletcher-Reeves version of the conjugate gradient method.