A new nonmonotone line search technique for unconstrained optimization
- 461 Downloads
In this paper, a new nonmonotone line search rule is proposed,which is verified to be an improved version of the nonmonotone line search technique proposed by Zhang and Hager. Unlike the Zhang and Hager’s method, our nonmonotone line search is proved to own a nice property similar to the standard Armijo line search. In virtue of such a property, global convergence is established for the developed algorithm, where the search direction is supposed to satisfy some mild conditions and the stepsize is chosen by the new line search rule. R-linear convergence of the developed algorithm is proved for strongly convex objective functions. The developed algorithm is used to solve the test problems available in the CUTEr, the numerical results demonstrate that the new line search strategy outperforms the other similar ones.
KeywordsNonmonotone line search Armijo line search Global convergence R-linear convergence
Mathematics Subject Classifications (2010)90C30 62K05 68T37
Unable to display preview. Download preview PDF.
- 4.Deng, S., Wan, Z., Chen, X.: An improved spectral conjugate gradient algorithm for nonconvex unconstrained optimization problems. J. Optim. Theory Appl. (2013). doi: 10.1007/s10957-012-0239-7
- 22.Wan, Z., Chen, Y., Huang, S., Feng, D.: A modified nonmonotone BFGS algorithm for solving smooth nonlinear equations. Optim. Lett. (2014). doi: 10.1007/s11590-013-0678-6
- 25.Wan, Z., Huang, S., Zheng, X.D.: New cautious BFGS algorithm based on modified Armijo-type line search. J. Inequal. Appl. (2012). doi: 10.1186/1029-242X-2012-241
- 26.Wan, Z., Teo, K.L., Shen, X.L., Hu, C.M.: New BFGS method for unconstrained optimization problem based on modified Armijo line search. Optimization. (2012). doi: 10.1080/02331934.2011.644284