Abstract
In this paper, we consider the DFP algorithm without exact line search. We strengthen the conditions on the line search and prove that, under the new line search conditions, the DFP algorithm is globally convergent, Q-superlinearly convergent, and n-step quadratically convergent.
Similar content being viewed by others
References
DENNIS, J. E., JR., and MORé, J., Quasi-Newton Methods: Motivation and Theory, SIAM Review, Vol. 19, pp. 46-89, 1977.
DAVIDON, W. C., Variable-Metric Algorithms for Minimization, Report, Argonne National Laboratory, 1959.
FLETCHER, R., and POWELL, M. J. D., A Rapidly Convergent Descent Method for Minimization, Computer Journal, Vol. 6, pp. 163-168, 1963.
BROYDEN, C. G., A Class of Algorithms for Solving Nonlinear Simultaneous Equations, Mathematics of Computation, Vol. 19, pp. 577-593, 1965.
DIXON, L. C. W., Variable-Metric Algorithms: Necessary and Sufficient Conditions for Identical Behavior of Nonquadratic Functions, Journal of Optimization Theory and Applications, Vol. 10, pp. 34-40, 1972.
POWELL, M. J. D., On the Convergence of the Variable-Metric Algorithm, Journal of the Institute of Mathematics and Its Applications, Vol. 7, pp. 21-36, 1971.
PU, D., and YU, W., On the Convergence Property of the DFP Algorithm, Annals of Operations Research, Vol. 24, pp. 175-194, 1990.
POWELL, M. J. D., Some Global Convergence Properties of a Variable-Metric Algorithm for Minimization without Exact Line Searches, Nonlinear Programming, Edited by R. W. Cotte and C. E. Lemke, SIAM-AMS Proceedings, SIAM, Philadephia, Pennsylvania, 1976.
Byrd, R. H., NOCEDAL, J., and YUAN, Y., Global Convergence of a Class of Quasi-Newton Methods on Convex Problems, SIAM Journal on Numerical Analysis, Vol. 24, pp. 1171-1190, 1987.
PU, D., A Class of DFP Algorithms without Exact Line Search, Asia-Pacific Journal of Operation Research, Vol. 9, pp. 207-220, 1992.
PU, D., and TIAN, W., A Class of Modified Broyden Methods, Journal of Computational Mathematics, Vol. 8, pp. 366-379, 1994.
PU, D., and TIAN, W., A Class of Modified Broyden Algorithms without Exact Line Search, Applied Mathematics: A Journal of Chinese Universities, Vol. 10, pp. 313-322, 1995.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Pu, D. Convergence of the DFP Algorithm Without Exact Line Search. Journal of Optimization Theory and Applications 112, 187–211 (2002). https://doi.org/10.1023/A:1013004914923
Issue Date:
DOI: https://doi.org/10.1023/A:1013004914923