Efficient generalized conjugate gradient algorithms, part 1: Theory

  • Y. Liu
  • C. Storey
Contributed Papers


The effect of inexact line search on conjugacy is studied in unconstrained optimization. A generalized conjugate gradient method based on this effect is proposed and shown to have global convergence for a twice continuously differentiable function with a bounded level set.

Key Words

Unconstrained optimization hybrid and restart conjugate gradient methods inexact line search 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Daniel, J. W.,The Conjugate Gradient Method for Linear and Nonlinear Operator Equations, SIAM Journal on Numerical Analysis, Vol. 4, pp. 10–26, 1967.Google Scholar
  2. 2.
    Sorenson, H. W.,Comparison of Some Conjugate Direction Procedures for Function Minimization, Journal of the Franklin Institute, Vol. 288, pp. 421–441, 1969.Google Scholar
  3. 3.
    Polak, E., andRibiere, G.,Note sur la Convergence des Méthodes de Directions Conjuguées, Revue Française d'Informatique et de Recherche Operationelle, Vol. 16, pp. 35–43, 1969.Google Scholar
  4. 4.
    Fletcher, R., andReeves, C. M.,Function Minimization by Conjugate Gradients, Computer Journal, Vol. 7, pp. 149–154, 1964.Google Scholar
  5. 5.
    Powell, M. J. D.,Nonconvex Minimization Calculations and the Conjugate Gradient Method, Report No. DAMTP 1983/NA14, Department of Applied Mathematics and Theoretical Physics, University of Cambridge, Cambridge, England, 1983.Google Scholar
  6. 6.
    Al-Baali, M.,Descent Property and Global Convergence of the Fletcher-Reeves Method with Inexact Line Search, IMA Journal of Numerical Analysis, Vol. 5, pp. 121–124, 1985.Google Scholar
  7. 7.
    Shanno, D. F.,Globally Convergent Conjugate Gradient Algorithms, Mathematical Programming, Vol. 33, pp. 61–67, 1985.Google Scholar
  8. 8.
    Touati-Ahmed, D., andStorey, C.,Efficient Hybrid Conjugate Gradient Techniques, Journal of Optimization Theory and Applications, Vol. 64, No. 2, pp. 379–397, 1990.Google Scholar
  9. 9.
    Hu, Y. F., andStorey, C.,Efficient Generalized Conjugate Gradient Algorithms, Part 2: Implementation, Journal of Optimization Theory and Applications, Vol. 69, No. 1, pp. 139–152, 1991.Google Scholar

Copyright information

© Plenum Publishing Corporation 1991

Authors and Affiliations

  • Y. Liu
    • 1
  • C. Storey
    • 1
  1. 1.Department of Mathematical SciencesLoughborough University of TechnologyLoughboroughEngland

Personalised recommendations