Abstract
In this paper, a unified method to construct quadratically convergent algorithms for function minimization is described. With this unified method, a generalized algorithm is derived. It is shown that all the existing conjugate-gradient algorithms and variable-metric algorithms can be obtained as particular cases. In addition, several new practical algorithms can be generated. The application of these algorithms to quadratic functions as well as nonquadratic functions is discussed.
Similar content being viewed by others
References
Huang, H. Y.,Unified Approach to Quadratically Convergent Algorithms for Function Minimization, Rice University, Aero-Astronautics Report No. 64, 1969.
Hestenes, M. R., andStiefel, E.,Methods of Conjugate Gradients for Solving Linear Systems, Journal of Research of the National Bureau of Standards, Vol. 49, No. 6, 1952.
Fletcher, R., andReeves, C. M.,Function Minimization by Conjugate Gradients, Computer Journal, Vol. 7, No. 2, 1964.
Beckman, F. S.,The Solution of Linear Equation by the Conjugate Gradient Method, Mathematical Methods for Digital Computers, Edited by A. Ralston and H. S. Wilf, John Wiley and Sons, New York, 1960.
Miele, A., andCantrell, J. W.,Study on a Memory Gradient Method for the Minimization of Functions, Journal of Optimization Theory and Applications, Vol. 3, No. 6, 1969.
Cantrell, J. W.,Relation between the Memory Gradient Method and the Fletcher-Reeves Method, Journal of Optimization Theory and Applications, Vol. 4, No. 1, 1969.
Davidon, W. C.,Variable Metric Method for Minimization, Argonne National Laboratory, Report No. ANL-5990, 1959.
Fletcher, R., andPowell, M. J. D.,A Rapidly Convergent Descent Method for Minimization, Computer Journal, Vol. 6, No. 2, 1963.
Pearson, J. D.,On Variable Metric Methods of Minimization, Research Analysis Corporation, Technical Paper No. RAC-TP-302, 1968.
Huang, H. Y., andLevy, A. V.,Numerical Experiments on Quadratically Convergent Algorithms for Function Minimization, Rice University, Aero-Astronautics Report No. 66, 1969.
Additional bibliography
Myers, G.,Properties of the Conjugate-Gradient and Davidon Methods, Journal of Optimization Theory and Applications, Vol. 2, No. 4, 1968.
Author information
Authors and Affiliations
Additional information
Communicated by A. Miele
This research, supported by the Office of Scientific Research, Office of Aerospace Research, United States Air Force, Grant No. AF-AFOSR-828-67, is based on Ref. 1.
Rights and permissions
About this article
Cite this article
Huang, H.Y. Unified approach to quadratically convergent algorithms for function minimization. J Optim Theory Appl 5, 405–423 (1970). https://doi.org/10.1007/BF00927440
Received:
Issue Date:
DOI: https://doi.org/10.1007/BF00927440