Skip to main content
Log in

Superlinear convergence of Broyden's boundedθ-class of methods

  • Published:
Mathematical Programming Submit manuscript

Abstract

In this paper the so-called Broyden's boundedθ-class of methods is considered. It contains as a subclass Broyden's restrictedθ-class of methods, in which the updating matrices retain symmetry and positive definiteness. These iteration methods are used for solving unconstrained minimization problems of the following form:\(f(\hat x) = \min _{x \in R^n } f(x)\) It is assumed that the step-size coefficientτ k = 1 in each iteration and the functionalf : R n → R1 satisfies the standard assumptions, viz.f is twice continuously differentiable and the Hessian matrix is uniformly positive definite and bounded (there exist constantsm, M > 0 such that m∥y∥2 ⩽ 〈y,\(m\parallel y\parallel ^2 \leqslant \left\langle {y,f(\hat x)\left. y \right\rangle } \right. \leqslant M\parallel y\parallel ^2 \) for ally ∈ R n) and satisfies a Lipschitz-like condition at the optimal point\(\hat x\), the gradient vanishes at\(\hat x\) Under these assumptions the local convergence of Broyden's methods is proved. Furthermore, the Q-superlinear convergence is shown.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. C.G. Broyden, “A new double rank minimization algorithm”,Notices of the American Mathematical Society 16 (1969) 670.

    Google Scholar 

  2. C.G. Broyden, “The convergence of single-rank quasi-Newton methods”,Mathematics of Computation 24 (1970) 365–382.

    Google Scholar 

  3. C.G. Broyden, “The convergence of a class of double-rank minimization algorithms. Parts I and II”,Journal of the Institute of Mathematics and its Applications 6 (1970) 76–90, 222–231.

    Google Scholar 

  4. C.G. Broyden, J.E. Dennis Jr. and J.J. Moré, “On the local and superlinear convergence of quasi-Newton methods”,Journal of the Institute of Mathematics and its Applications 12 (1973) 223–245.

    Google Scholar 

  5. J.E. Dennis Jr. and J.J. Moré, “Quasi-Newton methods: motivation and theory”,SIAM Review 19 (1977) 46–89.

    Google Scholar 

  6. J.E. Dennis Jr. and J.J. Moré, “A characterization of Q-superlinear convergence and its applications to quasi-Newton methods”,Mathematics of Computation 28 (1974) 549–560.

    Google Scholar 

  7. R. Fletcher, “A new approach to variable metric algorithms”,Computer Journal 13 (1970) 317–322.

    Google Scholar 

  8. D. Goldfarb, “A family of variable-metric methods derived by variational means”,Mathematics of Computation 24 (1970) 23–26.

    Google Scholar 

  9. J.M. Ortega and W.C. Rheinboldt,Iterative solution of nonlinear equations in several variables (Academic Press, New York, 1970).

    Google Scholar 

  10. E. Polak,Computational methods in optimization. A unified approach (Academic Press, New York and London, 1971).

    Google Scholar 

  11. M.J.D. Powell, “On the convergence of the variable metric algorithm”,Journal of the Institute of Mathematics and its Applications 7 (1971) 21–36.

    Google Scholar 

  12. K. Ritter, “Local and superlinear convergence of a class of variable metric methods”,Computing 23 (1979) 287–297.

    Google Scholar 

  13. D.F. Shanno, “Condition of quasi-Newton methods for function minimization”,Mathematics of Computation 24 (1970) 647–656.

    Google Scholar 

  14. J. Stoer, “On the convergence rate of imperfect minimization algorithms in Broyden'sβ-class”,Mathematical Programming 9 (1975) 313–335.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Stachurski, A. Superlinear convergence of Broyden's boundedθ-class of methods. Mathematical Programming 20, 196–212 (1981). https://doi.org/10.1007/BF01589345

Download citation

  • Received:

  • Revised:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF01589345

Key words

Navigation