An active set feasible method for largescale minimization problems with bound constraints
 M. De Santis,
 G. Di Pillo,
 S. Lucidi
 … show all 3 hide
Rent the article at a discount
Rent now* Final gross prices may vary according to local VAT.
Get AccessAbstract
We are concerned with the solution of the bound constrained minimization problem {minf(x), l≤x≤u}. For the solution of this problem we propose an active set method that combines ideas from projected and nonmonotone Newtontype methods. It is based on an iteration of the form x ^{ k+1}=[x ^{ k }+α ^{ k } d ^{ k }]^{♯}, where α ^{ k } is the steplength, d ^{ k } is the search direction and [⋅]^{♯} is the projection operator on the set [l,u]. At each iteration a new formula to estimate the active set is first employed. Then the components \(d_{N}^{k}\) of d ^{ k } corresponding to the free variables are determined by a truncated Newton method, and the components \(d_{A}^{k}\) of d ^{ k } corresponding to the active variables are computed by a BarzilaiBorwein gradient method. The steplength α ^{ k } is computed by an adaptation of the nonmonotone stabilization technique proposed in Grippo et al. (Numer. Math. 59:779–805, 1991). The method is a feasible one, since it maintains feasibility of the iterates x ^{ k }, and is well suited for largescale problems, since it uses matrixvector products only in the truncated Newton method for computing \(d_{N}^{k}\) . We prove the convergence of the method, with superlinear rate under usual additional assumptions. An extensive numerical experimentation performed on an algorithmic implementation shows that the algorithm compares favorably with other widely used codes for bound constrained problems.
 Andreani, R., Birgin, E.G., Martinez, J.M., Schuverdt, M.L.: Secondorder negativecurvature methods for boxconstrained and general constrained optimization. Comput. Optim. Appl. 45(2), 209–236 (2010) CrossRef
 Bertsekas, D.P.: Projected Newton methods for optimization problems with simple constraints. SIAM J. Control Optim. 20(2), 221–246 (1982) CrossRef
 Birgin, E.G., Gentil, J.M.: Evaluating boundconstrained minimization. Comput. Optim. Appl. (2012). doi:10.1007/s105890129466y
 Birgin, E.G., Martinez, J.M.: A box constrained optimization algorithm with negative curvature directions and spectral projected gradients. Computing, Suppl. 15, 49–60 (2001) CrossRef
 Birgin, E.G., Martinez, J.M.: Largescale activeset boxconstrained optimization method with spectral projected gradients. Comput. Optim. Appl. 23, 101–125 (2002) CrossRef
 Conn, A., Gould, N., Toint, Ph.: Global convergence of a class of trust region algorithms for optimization with simple bounds. SIAM J. Numer. Anal. 25, 433–460 (1988) CrossRef
 Dembo, R.S., Steihaug, T.: Truncated Newton algorithms for large scale unconstrained optimization. Math. Program. 26, 190–212 (1983) CrossRef
 Dennis, J.E., Heinkenschloss, M., Vicente, L.N.: Trustregion interiorpoint algorithms for a class of nonlinear programming problems. SIAM J. Control Optim. 36, 1750–1794 (1998) CrossRef
 Dolan, E.D., Moré, J.J.: Benchmarking optimization software with performance profile. Math. Program. 91, 201–213 (2002) CrossRef
 Fasano, G., Lucidi, S.: A nonmonotone NewtonKrylov method exploiting negative curvature directions, for large scale unconstrained optimization. Optim. Lett. 3, 521–535 (2009) CrossRef
 Facchinei, F., Lucidi, S., Palagi, L.: A truncated Newton algorithm for large scale box constrained optimization. SIAM J. Optim. 12(4), 1100–1125 (2002) CrossRef
 Friedlander, A., Martinez, J.M., Santos, S.A.: A new trust region algorithm for bound constrained minimization. Appl. Math. Optim. 30, 235–266 (1994) CrossRef
 Grippo, L., Lampariello, F., Lucidi, S.: A class of nonmonotone stabilization methods in unconstrained optimization. Numer. Math. 59, 779–805 (1991) CrossRef
 Grippo, L., Lampariello, F., Lucidi, S.: A truncated Newton method with nonmonotone line search for unconstrained optimization. J. Optim. Theory Appl. 60(3), 401–419 (1989) CrossRef
 Gould, N., Orban, D., Toint, Ph.: GALAHAD, a library of threadsafe Fortran 90 packages for largescale nonlinear optimization. ACM Trans. Math. Softw. 29(4), 353–372 (2003) CrossRef
 Gould, N.I.M., Orban, D., Toint, Ph.: CUTEr (and SifDec): a constrained and unconstrained testing environment, revisited. ACM Trans. Math. Softw. 29(4), 373–394 (2003) CrossRef
 Hager, W.W., Zhang, H.: A new active set algorithm for box constrained optimization. SIAM J. Optim. 17, 526–557 (2006) CrossRef
 Heinkenschloss, M., Ulbrich, M., Ulbrich, S.: Superlinear and quadratic convergence of affinescaling interiorpoint Newton methods for problems with simple bounds without strict complementarity assumption. Math. Program. 86, 615–635 (1999) CrossRef
 Kanzow, C., Klug, A.: On affinescaling interiorpoint Newton methods for nonlinear minimization with bound constraints. Comput. Optim. Appl. 35(2), 177–197 (2006) CrossRef
 Lin, C.J., Moré, J.J.: Nexton’s method for large boundconstrained optimization problems. SIAM J. Optim. 9(4), 1100–1127 (1999) CrossRef
 Moré, J.J., Toraldo, G.: Algorithms for bound constrained quadratic programming problems. Numer. Math. 55, 377–400 (1989) CrossRef
 Moré, J.J., Toraldo, G.: Numerical solution of large quadratic programming problems with bound constraints. SIAM J. Control Optim. 1, 93–113 (1991)
 Schwartz, A., Polak, E.: Family of projected descent methods for optimization problems with simple bounds. J. Optim. Theory Appl. 92(1), 1–31 (1997) CrossRef
 Ulbrich, M., Ulbrich, S., Heinkenschloss, M.: Global convergence of trustregion interiorpoint algorithms for infinitedimensional nonconvex minimization subject to pointwise bounds. SIAM J. Control Optim. 37, 731–776 (1999) CrossRef
 Zhang, Y.: Interiorpoint gradient methods with diagonalscalings for simplebound constrained optimization. Tech. report TR0406, Department of Computational and Applied Mathematics, Rice University, Houston, TX (2004)
 Title
 An active set feasible method for largescale minimization problems with bound constraints
 Journal

Computational Optimization and Applications
Volume 53, Issue 2 , pp 395423
 Cover Date
 20121001
 DOI
 10.1007/s1058901295067
 Print ISSN
 09266003
 Online ISSN
 15732894
 Publisher
 Springer US
 Additional Links
 Topics
 Keywords

 Bound constrained minimization problems
 Largescale minimization problems
 Active set methods
 Projected Newtontype methods
 Nonmonotone Newtontype methods
 BarzilaiBorwein gradient methods
 Industry Sectors
 Authors

 M. De Santis ^{(1)}
 G. Di Pillo ^{(1)}
 S. Lucidi ^{(1)}
 Author Affiliations

 1. Dipartimento di Informatica e Sistemistica, Sapienza Università di Roma, Via Ariosto, 25, 00185, Roma, Italy