Abstract
To the unconstrained programme of non-convex function, this article give a modified BFGS algorithm. The idea of the algorithm is to modify the approximate Hessian matrix for obtaining the descent direction and guaranteeing the efficacious of the quasi-Newton iteration pattern. We prove the global convergence properties of the algorithm associating with the general form of line search, and prove the quadratic convergence rate of the algorithm under some conditions.
Similar content being viewed by others
References
J. J. Dennis and J. J. Moré,Quasi-Newton methods, motivation and theory [J], SIAM REIEW19 (1977), 46–89.
M. J. D. Powell,Some Global Convergence Properties of a Variable Metric Algorithm for Minimization without Exact Line Searches, Nonlinear Programming, SIAM-AMS proceedings, Cottle R W and Lemke C E, eds.9 (1976), 53–72.
J. Werner,Uber die global konvergenze von variablemetric verfahren mit nichtexakter schrittweitenbestimmong, Numer. Math.31 (1978), 321–334.
J. D. Pearson,Variable Metric Methods of Minimization, Computer J.12 (1969), 171–178.
Han and Liu,General Form of Stepsize Selection Rules of Linesearch and Relevant Analysis of Global Convergence of BFGS Algorithm (Chinese), Acta Mathematicae Appliatae Sinica1 (1995), 112–122.
R. H. Byrd and J. Nocedal,A Tool for the Analysis of Quasi-Newton Methods with Application to Unconstrained Minimization, SIAM J. Numer. Anal.3 (1989), 727–739.
J. M. Gorge, S. G. Burton and E. H. Kenneth,Testing unconstrained optimization software, ACM Trans. Math. Software7 (1981), 208–215.
Rendong Ge and Zunquan Xia,An ABS Algorithm for Solving Singular Nonlinear System with Rank One Defect, J. Appl. Math. and Computing (old:KJCAM)9 (2002), 167–184.
Rendong Ge and Zunquan Xia,An ABS Algorithm for Solving Singular Nonlinear System with Rank Defects, J. Appl. Math. & Computing5 (2003), 1–20.
Author information
Authors and Affiliations
Corresponding author
Additional information
Jian-Guo Liu is a doctoral student in Institute of System Engineering, Dalian University of Technology. His research interests are the numerical computation and software, numerical methods for optimization, System Engineering.
Qiang Guo is doctor in Department of Applied Mathematics and Physics, Dalian National University. Her research interests are the optimal design, numerical computation and software, numerical methods for optimization, optimization methods in science and engineering, nonsmooth optimization.
Rights and permissions
About this article
Cite this article
Liu, JG., Guo, Q. Global convergence properties of the modified BFGS method associating with general line search model. JAMC 16, 195–205 (2004). https://doi.org/10.1007/BF02936161
Received:
Revised:
Issue Date:
DOI: https://doi.org/10.1007/BF02936161