Mathematical Programming

, Volume 91, Issue 2, pp 201–213

Benchmarking optimization software with performance profiles

Authors

  • Elizabeth D. Dolan
    • Northwestern University and Mathematics and Computer Science Division, Argonne National Laboratory, e-mail: dolan@mcs.anl.gov
  • Jorge J. Moré
    • Mathematics and Computer Science Division, Argonne National Laboratory, e-mail: more@mcs.anl.gov

DOI: 10.1007/s101070100263

Cite this article as:
Dolan, E. & Moré, J. Math. Program. (2002) 91: 201. doi:10.1007/s101070100263

Abstract.

We propose performance profiles — distribution functions for a performance metric — as a tool for benchmarking and comparing optimization software. We show that performance profiles combine the best features of other tools for performance evaluation.

Key words: benchmarking – guidelines – performance – software – testing – metric – timing

Copyright information

© Springer-Verlag Berlin Heidelberg 2001