Properties of the block BFGS update and its application to the limited-memory block BNS method for unconstrained minimization
- 24 Downloads
A block version of the Broyden–Fletcher–Goldfarb–Shanno (BFGS) variable metric update formula and its modifications are investigated. In spite of the fact that this formula satisfies the quasi-Newton conditions with all used difference vectors and that the improvement of convergence is the best one in some sense for quadratic objective functions, for general functions, it does not guarantee that the corresponding direction vectors are descent directions. To overcome this difficulty, but at the same time utilize the advantageous properties of the block BFGS update, a block version of the limited-memory variable metric BNS method for large-scale unconstrained optimization is proposed. The global convergence of the algorithm is established for convex sufficiently smooth functions. Numerical experiments demonstrate the efficiency of the new method.
KeywordsUnconstrained minimization Block variable metric methods Limited-memory methods BFGS update Global convergence Numerical results
Unable to display preview. Download preview PDF.
We thank the anonymous referee for careful reading of the paper and for constructive suggestions.
- 7.Hu, Y.F., Storey, C.: Motivating quasi-Newton Updates by Preconditioned Conjugate Gradient Methods, Math. Report A 150, Department of Mathematical Sciences. Loughborough University of Technology, England (1991)Google Scholar
- 10.Luksan, L., Matonoha, C., Vlcek, J.: Sparse test problems for unconstrained optimization, report V-1064. Prague, ICS AS CR (2010)Google Scholar
- 11.Luksan, L., Matonoha, C., Vlcek, J.: Modified CUTE problems for sparse unconstrained optimization, Report V-1081. Prague, ICS AS CR (2010)Google Scholar
- 13.Lukšan, L., Tuma, M., Matonoha, C., Vlcek, J., Ramesová, N., Siska, M., Hartman, J.: UFO 2014. Interactive system for universal functional optimization, Report V-1218. Prague, ICS AS CR (2014)Google Scholar
- 16.Schnabel, R.B.: Quasi-Newton methods using multiple secant equations, Technical Report CU-CS-247-83, Department of Computer Science, University of Colorado at Boulder USA (1983)Google Scholar