Abstract
This paper proposes an affine scaling derivative-free trust region method with interior backtracking technique for bounded-constrained nonlinear programming. This method is designed to get a stationary point for such a problem with polynomial interpolation models instead of the objective function in trust region subproblem. Combined with both trust region strategy and line search technique, at each iteration, the affine scaling derivative-free trust region subproblem generates a backtracking direction in order to obtain a new accepted interior feasible step. Global convergence and fast local convergence properties are established under some reasonable conditions. Some numerical results are also given to show the effectiveness of the proposed algorithm.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Liuzzi G, Lucidi S, and Sciandrone M, A derivative-free algorithm for linearly constrained finite minimax problems, SIAM J. Optim., 2006, 16: 1054–1075.
Conn A R, Scheinberg K, and Vicente L N, Global convergence of general derivative-free trustregion algorithms to first- and second-order critical points, SIAM J. Optim., 2009, 20: 387–415.
Liuzzi G, Lucidi S, and Sciandrone M, Sequential penalty derivative-free methods for nonlinear constrained optimization, SIAM J. Optim., 2010, 20: 2614–2635.
Zhang H, Conn A R, and Scheinberg K, A derivative-free algorithm for least-squares minimization, SIAM J. Optim., 2010, 20: 3555–3576.
Zhang H and Conn A R, On the local convergence of a derivative-free algorithm for least-squares minimization, Comput. Optim. Appl., 2012, 51: 481–507.
Powell M J and Yuan Y, A trust region algorithm for equality constrained optimization, Math. Program., 1990, 49: 189–211.
Zhu D, Curvilinear paths and trust region methods with nonmonotonic back tracking technique for unconstrained optimization, J. Comput. Math., 2001, 19: 241–258.
Jia C and Zhu D, A trust region interior point algorithm for solving bound-constrained nonlinear systems, Journal of Shanghai Normal University, 2005, 34: 1–7.
Apostolopoulou M S, Sotiropoulos D G, and Pintelas P, Solving the quadratic trust-region subproblem in a low-memory BFGS framework, Optim. Methods Softw., 2008, 23: 651–674.
Coleman T F and Li Y, An interior trust region approach for nonlinear minimization subject to bounds, SIAM J. Optim., 1996, 6: 418–445.
Heinkenschloss M, Ulbrich M, and Ulbrich S, Superlinear and quadratic convergence of affinescaling interior-point Newton methods for problems with simple bounds without strict complementarity assumption, Math. Program., 1999, 86: 615–635.
Coleman T F and Li Y, A trust region and affine scaling interior point method for nonconvex minimization with linear inequality constraints, Math. Program., 2000, 88: 1–31.
Zhu D, A new affine scaling interior point algorithm for nonlinear optimization subject to linear equality and inequality constraints, J. Comput. Appl. Math., 2003, 161: 1–25.
Zhu D, An affine scaling interior trust-region method for LC 1 minimization subject to bounds on variables, Appl. Math. Comput., 2006, 172: 1272–1302.
Kanzow C and Klug A, On affine-scaling interior-point Newton methods for nonlinear minimization with bound constraints, Comput. Optim. Appl., 2006, 35: 177–197.
Kanzow C and Klug A, An interior-point affine-scaling trust-region method for semismooth equations with box constraints, Comput. Optim. Appl., 2007, 37: 329–353.
Conn A R, Scheinberg K, and Vicente L N, Introduction to Derivative-Free Optimization, Society for Industrial and Applied Mathematics, Mathematical Programming Society, Philadelphia, PA, 2009.
Schittkowski K, More Test Examples for Nonlinear Programming Codes, Springer-Verlag, Berlin, 1987.
Floudas C A, et al., Handbook of Test Problems in Local and Global Optimization, Kluwer Academic Publishers, Dordrecht, 1999.
Gould N I M, Orban D, and Toint P L, CUTEr, a constrained and unconstrained testing environment (revisited), ACM Trans. Math. Softw., 2003, 29: 373–394.
Powell M J D, The BOBYQA algorithm for bound constrained optimization without derivatives, Technical Report, 2009, 6: 1–39.
Nocedal J and Wright S J, Numerical Optimization, Springer, New York, 2006.
Author information
Authors and Affiliations
Corresponding author
Additional information
This paper was supported by the National Science Foundation of China under Grant No. 11371253.
This paper was recommended for publication by Editor DAI Yuhong.
Rights and permissions
About this article
Cite this article
Gao, J., Zhu, D. An affine scaling derivative-free trust region method with interior backtracking technique for bounded-constrained nonlinear programming. J Syst Sci Complex 27, 537–564 (2014). https://doi.org/10.1007/s11424-014-2144-7
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11424-014-2144-7