Abstract
For more than twenty years, we are benchmarking optimization software. In late 2018, an event had a major impact (the “story”) on this service which had gained considerable notoriety. The history up to this point is sketched and the developments to late 2019 and hopefully beyond are described.
This is a preview of subscription content, log in via an institution to check access.
References
Benchmarks for Optimization Software, http://plato.asu.edu/bench.html
Decision Tree for Optimization Software, http://plato.asu.edu/guide.html
A Selection of Older Benchmarks, http://plato.asu.edu/ftp/older-benchmarks
Talk at INFORMS 2006, http://plato.asu.edu/talks/pitt1.pdf
NEOS Server for Optimization, http://neos-server.org
Talk at INFORMS 2008, http://plato.asu.edu/talks/wash.pdf
A Collection of Testproblems in PDE-Constrained Optimization, http://plato.asu.edu/pdecon.html
MIPLIB2010, http://miplib2010.zib.de
Talk at EURO 2010, http://plato.asu.edu/talks/euro2010-1.pdf
Talk at INFORMS 2011, http://plato.asu.edu/talks/mittelmann-bench.pdf
A Note on Performance Profiles for Benchmarking Software, http://www.numerical.rl.ac.uk/people/j_scott/publications/2016/GouldScott.2016_TOMS.pdf
MIPLIB2010 - Mixed Integer Programming Library version 5, http://mpc.zib.de/index.php/MPC/article/view/56/28
Talk at EURO 2013, http://plato.asu.edu/talks/euro2013.pdf
Talk at ISMP 2015, http://plato.asu.edu/talks/ismp2015.pdf
Talk at INFORMS 2016, http://plato.asu.edu/talks/informs2016-bench.pdf
Talk at INFORMS 2017, http://plato.asu.edu/talks/informs2017.pdf
MIPCL solver, http://www.mipcl-cpp.appspot.com/index.html
MIPLIB2017, http://www.optimization-online.org/DB_HTML/2019/07/7285.html
MIPLIB2017, http://miplib.zib.de
Talk at ISMP 2018, http://plato.asu.edu/talks/ismp2018.pdf
Talk at INFORMS 2018, http://plato.asu.edu/talks/informs2018.pdf
Announcement by Gurobi, http://plato.asu.edu/ftp/apology.pdf
Session at INFORMS 2018, https://www.abstractsonline.com/pp8/#!/4701/session/566
FICO Blog, https://community.fico.com/s/page/a5Q2E000000DtboUAC/fico1490
Talk at EURO 2019, http://plato.asu.edu/talks/euro2019.pdf
Talk at INFORMS 2019, http://plato.asu.edu/talks/informs2019.pdf
CBLIB, http://cblib.zib.de
QPLIB, http://qplib.zib.de
Solving Constraint Integer Programs, http://scip.zib.de
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
The author declares that he has no conflict of interest.
Rights and permissions
About this article
Cite this article
Mittelmann, H.D. Benchmarking Optimization Software - a (Hi)Story. SN Oper. Res. Forum 1, 2 (2020). https://doi.org/10.1007/s43069-020-0002-0
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s43069-020-0002-0