Abstract
This paper is aimed to employ a modified quasi-Newton equation in the framework of the limited memory BFGS method to solve large-scale unconstrained optimization problems. The modified secant equation is derived by means of a forth order tensor model to improve the curvature information of the objective function. The global and local convergence properties of the modified LBFGS method, on uniformly convex problems are also studied. The numerical results indicate that the proposed limited memory method is superior to the standard LBFGS method.
Similar content being viewed by others
References
Andrei, N.: An unconstrained optimization test functions collection. Adv. Model. Optim. 10, 147–161 (2008)
Dolan, E.D., Moré, J.J.: Benchmarking optimization software with performance profiles. Math. Program. 91(2), 201–203 (2002)
Fletcher, R.: Practical Methods of Optimization, 2nd edn. Wiley, New York (1987)
Liu, D., Nocedal, J.: On the limited memory BFGS method for large-scale optimization. Math. Program. 45, 503–528 (1989)
Nocedal, J., Wright, S.J.: Numerical Optimization. Springer Series in Operations Research, 2nd edn. Springer, New York (2006)
Sun, W., Yuan, Y.-X.: Optimization Theory and Methods Nonlinear Programming. Springer Optimization and Its Applications. Springer, New York (2006)
Zhang, J.Z., Xu, C.X.: Properties and numerical performance of quasi-Newton methods with modified quasi-Newton equations. J. Comput. Appl. Math. 137, 269–278 (2001)
Zoutendijk, G.: Nonlinear programming, computational methods. In: Abadie, J. (ed.) lnteger and Nonlinear Programming, pp. 37–86. North-Holland, Amsterdam (1970)
Acknowledgments
We would like to acknowledge respective referee for his useful suggestions and comments on the previous versions of this paper, which improve this paper significantly
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Biglari, F., Ebadian, A. Limited memory BFGS method based on a high-order tensor model. Comput Optim Appl 60, 413–422 (2015). https://doi.org/10.1007/s10589-014-9678-4
Received:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10589-014-9678-4
Keywords
- Large scale nonlinear optimization
- Modified limited memory quasi-Newton method
- Curvature approximation
- Modified quasi-Newton equation
- R-linear convergence