Mathematical Programming

, Volume 91, Issue 2, pp 201–213

Benchmarking optimization software with performance profiles

  • Elizabeth D. Dolan
  • Jorge J. Moré

DOI: 10.1007/s101070100263

Cite this article as:
Dolan, E. & Moré, J. Math. Program. (2002) 91: 201. doi:10.1007/s101070100263

Abstract.

We propose performance profiles — distribution functions for a performance metric — as a tool for benchmarking and comparing optimization software. We show that performance profiles combine the best features of other tools for performance evaluation.

Key words: benchmarking – guidelines – performance – software – testing – metric – timing 

Copyright information

© Springer-Verlag Berlin Heidelberg 2001

Authors and Affiliations

  • Elizabeth D. Dolan
    • 1
  • Jorge J. Moré
    • 2
  1. 1.Northwestern University and Mathematics and Computer Science Division, Argonne National Laboratory, e-mail: dolan@mcs.anl.govUS
  2. 2.Mathematics and Computer Science Division, Argonne National Laboratory, e-mail: more@mcs.anl.govUS

Personalised recommendations