Skip to main content
SpringerLink
Log in

The optimization test environment

  • Published:
Optimization and Engineering Aims and scope Submit manuscript

Abstract

The Optimization Test Environment is an interface to efficiently test different optimization solvers. It is designed as a tool for both developers of solver software and practitioners who just look for the best solver for their specific problem class. It enables users to:

  • Choose and compare diverse solver routines;

  • Organize and solve large test problem sets;

  • Select interactively subsets of test problem sets;

  • Perform a statistical analysis of the results, automatically produced as , PDF, and JPG output.

The Optimization Test Environment is free to use for research purposes.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  • Ali M, Khompatraporn C, Zabinsky Z (2005) A numerical evaluation of several stochastic algorithms on selected continuous global optimization test problems. J Glob Optim 31(4):635–672

    Article  MATH  MathSciNet  Google Scholar 

  • Audet C, Dang C, Orban D (2010) Algorithmic parameter optimization of the DFO method with the OPAL framework. In: Software automatic tuning, from concepts to state-of-the-art results. Springer (in press). doi:10.1007/978-1-4419-6935-4

  • Brooke A, Kendrick D, Meeraus A (1988) GAMS: a user’s guide. Scientific Press, New York

    Google Scholar 

  • Byrd R, Nocedal J, Waltz R (2006) KNITRO: an integrated package for nonlinear optimization. In: Large-scale nonlinear optimization. Springer, Berlin, pp 35–59

    Chapter  Google Scholar 

  • Cox S, Haftka R, Baker C, Grossman B, Mason W, Watson L (2001) A comparison of global optimization methods for the design of a high-speed civil transport. J Glob Optim 21(4):415–432

    Article  MATH  MathSciNet  Google Scholar 

  • Dolan E, Moré J (2002) Benchmarking optimization software with performance profiles. Math Program 91(2):201–213

    Article  MATH  MathSciNet  Google Scholar 

  • Dolan E, Moré J, Munson T (2004) Benchmarking optimization software with COPS 3.0. Technical report ANL/MCS-273, Mathematics and Computer Science Division, Argonne National Laboratory

  • Dolan E, Moré J, Munson T (2006) Optimality measures for performance profiles. SIAM J Optim 16(3):891–909

    Article  MATH  MathSciNet  Google Scholar 

  • Domes F (2009) GloptLab—a configurable framework for the rigorous global solution of quadratic constraint satisfaction problems. Optim Methods Softw 24(4–5):727–747

    Article  MATH  MathSciNet  Google Scholar 

  • Domes F (2013) Test environment. Web document, http://www.mat.univie.ac.at/~dferi/testenv.html

  • Domes F, Fuchs M, Schichl H (2013) The optimization test environment. Web document, http://www.mat.univie.ac.at/~dferi/testenv_download.html

  • Drud A (1985) CONOPT: a GRG code for large sparse dynamic nonlinear optimization problems. Math Program 31(2):153–191

    Article  MATH  MathSciNet  Google Scholar 

  • Drud A (1994) CONOPT—a large-scale GRG code. ORSA J Comput 6(2):207–216

    Article  MATH  Google Scholar 

  • Ferris M, Munson T (1999) Interfaces to PATH 3.0: design, implementation and usage. Comput Optim Appl 12(1):207–227

    MATH  MathSciNet  Google Scholar 

  • Fourer R, Gay D, Kernighan B (2002) AMPL: a modeling language for mathematical programming. Duxbury/Brooks/Cole, New York

    Google Scholar 

  • Fowler K, Reese J, Kees C, Dennis J, Kelley C, Miller C, Audet C, Booker A, Couture G, Darwin R, Farthing M, Finkel D, Gablonsky J, Gray G, Kolda T (2008) Comparison of derivative-free optimization methods for groundwater supply and hydraulic capture community problems. Adv Water Resour 31(5):743–757

    Article  Google Scholar 

  • Gamsworld (2009) Performance tools. Web document, http://gamsworld.org/performance/tools.htm

  • Gilbert J, Jonsson X (2009) LIBOPT—an environment for testing solvers on heterogeneous collections of problems—the manual, version 2.1. Technical report RT-331 revised, INRIA

  • Gould N, Orban D, Toint P (2003) CUTEr and SifDec: a constrained and unconstrained testing environment, revisited. ACM Trans Math Softw 29(4):373–394

    Article  MATH  MathSciNet  Google Scholar 

  • Johnson D (2002) A theoretician’s guide to the experimental analysis of algorithms. Bull Am Math Soc 220(5–6):215–250

    Google Scholar 

  • Kallrath J (2004) Modeling languages in mathematical optimization. Kluwer Academic, Dordrecht

    Book  MATH  Google Scholar 

  • Lougee-Heimer R (2003) The common optimization INterface for operations research. IBM J Res Dev 47(1):57–66

    Article  Google Scholar 

  • Mittelmann H (2009) Benchmarks. Web document, http://plato.asu.edu/sub/benchm.html

  • Moles C, Mendes P, Banga J (2003) Parameter estimation in biochemical pathways: a comparison of global optimization methods. Genome Res 13(11):2467–2474

    Article  Google Scholar 

  • Mongeau M, Karsenty H, Rouze V, Hiriart-Urruty J (2000) Comparison of public-domain software for black box global optimization. Optim Methods Softw 13(3):203–226

    Article  MATH  MathSciNet  Google Scholar 

  • Moré J, Wild S (2009) Benchmarking derivative-free optimization algorithms. SIAM J Optim 20(1):172–191

    Article  MATH  MathSciNet  Google Scholar 

  • Murtagh B, Saunders M (1983) MINOS 5.5 user’s guide. Technical report SOL 83-20R, Systems Optimization Laboratory, Department of Operations Research, Stanford University, Stanford, CA. Available on-line at: http://www.sbsi-sol-optimize.com/manuals/Minos

  • NEOS (2013) NEOS server for optimization. http://www.neos-server.org/neos/

  • Neumaier A, Shcherbina O, Huyer W, Vinko T (2005) A comparison of complete global optimization solvers. Math Program 103(2):335–356

    Article  MATH  MathSciNet  Google Scholar 

  • Sahinidis N, Tawarmalani M (2005) BARON 7.2.5: global optimization of mixed-integer nonlinear programs. User’s manual. Available on-line at: http://www.gams.com/dd/docs/solvers/baron.pdf

  • Schichl H et al. (2000–2013) The COCONUT environment. Software

  • Schrage L (2008) Optimization modeling with LINGO. LINDO systems

  • Shcherbina O (2013) COCONUT benchmark. Web document, http://www.mat.univie.ac.at/~neum/glopt/coconut/Benchmark/Benchmark.html

  • Shcherbina O, Neumaier A, Sam-Haroud D, Vu X, Nguyen T (2003) Benchmarking global optimization and constraint satisfaction codes. In: Global optimization and constraint satisfaction. Springer, Berlin, pp 211–222

    Chapter  Google Scholar 

  • Tawarmalani M, Sahinidis N (2004) Global optimization of mixed-integer nonlinear programs: a theoretical and computational study. Math Program 99(3):563–591

    Article  MATH  MathSciNet  Google Scholar 

  • Vaz A, Vicente L (2007) A particle swarm pattern search method for bound constrained global optimization. J Glob Optim 39(2):197–219

    Article  MATH  MathSciNet  Google Scholar 

Download references

Acknowledgements

Partial funding of the project is gratefully appreciated: Ferenc Domes was supported through the research grant FS 506/003 of the University of Vienna. Hermann Schichl was supported through the research grant P18704-N13 of the Austrian Science Foundation (FWF).

Furthermore, we would like to acknowledge the help of Oleg Shcherbina in several solver and test library issues. We thank Nick Sahinidis, Alexander Meeraus, and Michael Bussieck for the support with several solver licenses. Thanks to Mihaly Markot who has resolved several issues with Cocos, and to Yahia Lebbah for his comments.

Author information

Authors and Affiliations

  1. Faculty of Mathematics, University of Vienna, Oskar-Morgenstern-Platz 1, 1090, Wien, Austria

    Ferenc Domes, Hermann Schichl & Arnold Neumaier

  2. Parallel Algorithms Team, CERFACS, 42 Avenue Gaspard Coriolis, 31057, Toulouse, France

    Martin Fuchs

Authors
  1. Ferenc Domes
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Martin Fuchs
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Hermann Schichl
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Arnold Neumaier
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Martin Fuchs.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Domes, F., Fuchs, M., Schichl, H. et al. The optimization test environment. Optim Eng 15, 443–468 (2014). https://doi.org/10.1007/s11081-013-9234-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11081-013-9234-6

Keywords

Search

Navigation