Abstract
The CUTEr test set represents a testing environment for nonlinear optimization solvers containing more than 1,000 academic and applied nonlinear problems. It is often used to verify the robustness and performance of nonlinear optimization solvers. In this paper we perform a quantitative analysis of the CUTEr test set. As a result we see that some paradigms of nonlinear optimization and Automatic Differentiation can be verified whereas others need to be questioned. Furthermore, we will show that the CUTEr test set is probably biased, i.e., solvers that use exact derivatives and sparse linear algebra are likely to perform advantageously compared to solvers employing directional derivatives and low-rank updating.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
The run-time \({t}_{\mathit{DHess}}\) needed to evaluate the dense Hessian of the objective function is not depicted for problems with more than 104 variables due to memory shortage.
References
LAPACK - Linear Algebra PACKage. Website (2011). URL http://www.netlib.org
Andrew R. Conn, N.I.M.G., Toint, P.L.: Sif reference document (revised version). Website (2003). URL http://www.numerical.rl.ac.uk/lancelot/sif/sifhtml.html
Bosse, T., Lehmann, L., Griewank, A.: On Hessian- and Jacobian-free SQP methods - a total quasi-Newton scheme with compact storage. In: M. Diehl (ed.) Recent Advances in Optimization and its Applications in Engineering (BFG 2009). Springer (2010)
Czyzyk, J., Mesnier, M.P., Moré, J.J.: The NEOS server. IEEE Computational Science & Engineering 5(3), 68–75 (1998). URL http://www.neos-server.org
Dolan, E.: The neos server 4.0 administrative guide. Tech. rep., Mathematics and Computer Science Division, Argonne National Laboratory (2001)
Gould, N., Toint, P., Orban, D.: CUTEr Test set, small and large test set. Website (2002). URL http://www.cuter.rl.ac.uk. Used Version: After 1.12.2011
Gould, N., Toint, P., Orban, D.: General CUTEr documentation. Website (2005). URL http://www.cuter.rl.ac.uk
Griewank, A., Walther, A.: Evaluating Derivatives: Principles and Techniques of Algorithmic Differentiation, 2nd edn. No. 105 in Other Titles in Applied Mathematics. SIAM, Philadelphia, PA (2008). URL http://www.ec-securehost.com/SIAM/OT105.html
Griewank, A., Walther, A., Korzec, M.: Maintaining factorized KKT systems subject to rank-one updates of Hessians and Jacobians. Optim. Methods Softw. 22(2), 279–295 (2007)
Gropp, W., Moré, J.J.: Optimization environments and the NEOS server. Approximation Theory and Optimization pp. 167–182 (1997)
Liu, D.C., Nocedal, J.: On the limited memory BFGS method for large scale optimization. Technical Report NAM 03, Northwestern University, Evanston, Ill. (1988)
Nocedal, J., Wright, S.J.: Numerical Optimization. Springer Series in Operations Research. Springer-Verlag, New York, NY (1999)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Bosse, T., Griewank, A. (2012). The Relative Cost of Function and Derivative Evaluations in the CUTEr Test Set. In: Forth, S., Hovland, P., Phipps, E., Utke, J., Walther, A. (eds) Recent Advances in Algorithmic Differentiation. Lecture Notes in Computational Science and Engineering, vol 87. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-30023-3_21
Download citation
DOI: https://doi.org/10.1007/978-3-642-30023-3_21
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-30022-6
Online ISBN: 978-3-642-30023-3
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)