Numerical Algorithms

, Volume 77, Issue 4, pp 1159–1182 | Cite as

An affine scaling interior trust-region method combining with line search filter technique for optimization subject to bounds on variables

Original Paper
  • 54 Downloads

Abstract

This paper proposes and analyzes an affine scaling trust-region method with line search filter technique for solving nonlinear optimization problems subject to bounds on variables. At the current iteration, the trial step is generated by the general trust-region subproblem which is defined by minimizing a quadratic function subject only to an affine scaling ellipsoidal constraint. Both trust-region strategy and line search filter technique will switch to trail backtracking step which is strictly feasible. Meanwhile, the proposed method does not depend on any external restoration procedure used in line search filter technique. A new backtracking relevance condition is given which is weaker than the switching condition to obtain the global convergence of the algorithm. The global convergence and fast local convergence rate of this algorithm are established under reasonable assumptions. Preliminary numerical results are reported indicating the practical viability and show the effectiveness of the proposed algorithm.

Keywords

Nonlinear optimization Trust-region Line search Filter method Interior point 

Mathematics Subject Classification (2010)

49M37 65K05 90C30 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Notes

Acknowledgements

The authors gratefully acknowledge the partial supports of the National Natural Science Foundation (11371253) of China.

References

  1. 1.
    Andrei, N.: An unconstrained optimization test functions collection. Adv. Model. Optim. 10(1), 147–161 (2008)MathSciNetMATHGoogle Scholar
  2. 2.
    Bjorck, A.: A direct method for sparse least squares problems with lower and upper bounds. Numer. Math. 54, 19–32 (1988)MathSciNetCrossRefMATHGoogle Scholar
  3. 3.
    Bongartz, I., Conn, A., Gould, N., Toint, P.: CUTE: constrained and unconstrained testing environment, Research Report, IBM T. Watson Research Center, Yorktown, USA (1995)Google Scholar
  4. 4.
    Conn, A., Gould, N., Toint, P.: Global convergence of a class of trust region algorithms for optimization with simple bounds. SIAM J. Numer. Anal. 25, 433–460 (1988)MathSciNetCrossRefMATHGoogle Scholar
  5. 5.
    Coleman, T., Hempel, C.: Computing a trust region step for a penalty function. SIAM J. Sci. Statist. Comput. 11, 180–201 (1990)MathSciNetCrossRefMATHGoogle Scholar
  6. 6.
    Conn, A., Gould, N., Toint, P.: Global convergence of a class of trust region algorithms for optimization with simple bounds. SIAM J. Numer. Anal. 25, 433–460 (1988)MathSciNetCrossRefMATHGoogle Scholar
  7. 7.
    Coleman, T., Li, Y.: On the convergence of reflective Newton methods for large-scale nonlinear minimization subject to bounds. Math. Programming 67, 189–224 (1994)MathSciNetCrossRefMATHGoogle Scholar
  8. 8.
    Coleman, T., Li, Y.: An interior trust-region approach for minimization subject to bounds. SIAM J. Optim. 6(3), 418–445 (1996)MathSciNetCrossRefMATHGoogle Scholar
  9. 9.
    Fletcher, R., Jackson, M.: Minimization of a quadratic function of many variables subject only to lower and upper bounds. J. Inst. Math. Appl. 14, 159–174 (1974)MathSciNetCrossRefMATHGoogle Scholar
  10. 10.
    Fletcher, R.: An algorithm for solving linearly constrained optimization problems. Math. Programming 2, 133–165 (1972)MathSciNetCrossRefMATHGoogle Scholar
  11. 11.
    Fletcher, R., Leyffer, S.: Nonlinear programming without a penalty function. Math. Programming 91, 239–269 (2002)MathSciNetCrossRefMATHGoogle Scholar
  12. 12.
    Gould, N., Sainvitu, C., Toint, P.: A filter-trust-region method for unconstrained optimization. SIAM J. Optim. 16(2), 341–357 (2005)MathSciNetCrossRefMATHGoogle Scholar
  13. 13.
    Hock, W., Schittkowski, K.: Test Examples for Nonlinear Programming Codes. Lecture Notes in Economics and Mathematics System, vol. 187. Springer (1981)Google Scholar
  14. 14.
    Lalee, M., Nocedal, J., Plantenga, T.: On the implementation of an algorithm for large-scale equality constrained optimization. SIAM J. Optim. 8, 682–706 (1998)MathSciNetCrossRefMATHGoogle Scholar
  15. 15.
    Nocedal, J., Yuan, Y.: Combining trust region and line search techniques. In: Yuan, Y. (ed.) Advances in Nonlinear Programming, pp. 153–175. Kluwer, Dordrecht (1998)CrossRefGoogle Scholar
  16. 16.
    Ortega, J., Rheinboldt, W.: Iterative Solution of Nonlinear Equations in Several Variables. Academic Press, New York (1970)MATHGoogle Scholar
  17. 17.
    Pei, Y., Zhu, D.: A trust-region algorithm combining line search filter technique for nonlinear constrained optimization. Int. J. Comput. Math. 8, 1817–1839 (2014)MathSciNetCrossRefMATHGoogle Scholar
  18. 18.
    Wächter, A., Biegler, L.: Line search filter methods for nonlinear programming: motivation and global convergence. SIAM J. Comput. 16, 1–31 (2005)MathSciNetMATHGoogle Scholar
  19. 19.
    Wächter, A., Biegler, L.: Line search filter methods for nonlinear programming: local convergence. SIAM J. Optim. 6, 32–48 (2005)MathSciNetCrossRefMATHGoogle Scholar
  20. 20.
    Yang, E., Tolle, J.: A class of methods for solving large convex quadratic programs subject to box constraints. Math. Programming 51, 223–228 (1991)MathSciNetCrossRefMATHGoogle Scholar
  21. 21.
    Zhu, D.: Nonmonotonic back-tracking trust region interior point algorithm for linear constrained optimization. J. Comput. Appl. Math. 155, 285–305 (2003)MathSciNetCrossRefMATHGoogle Scholar
  22. 22.
    Zhu, D.: An affine scaling trust-region algorithm with interior backtracking technique for solving bound-constrained nonlinear systems. J. Comput. Appl. Math. 184, 343–361 (2005)MathSciNetCrossRefMATHGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC 2017

Authors and Affiliations

  1. 1.Mathematics and Science CollegeShanghai Normal UniversityShanghaiChina

Personalised recommendations