Mathematical Programming

, Volume 91, Issue 2, pp 201–213 | Cite as

Benchmarking optimization software with performance profiles

  • Elizabeth D. Dolan
  • Jorge J. Moré

Abstract.

We propose performance profiles — distribution functions for a performance metric — as a tool for benchmarking and comparing optimization software. We show that performance profiles combine the best features of other tools for performance evaluation.

Key words: benchmarking – guidelines – performance – software – testing – metric – timing 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag Berlin Heidelberg 2001

Authors and Affiliations

  • Elizabeth D. Dolan
    • 1
  • Jorge J. Moré
    • 2
  1. 1.Northwestern University and Mathematics and Computer Science Division, Argonne National Laboratory, e-mail: dolan@mcs.anl.govUS
  2. 2.Mathematics and Computer Science Division, Argonne National Laboratory, e-mail: more@mcs.anl.govUS

Personalised recommendations