Benchmarking optimization software with performance profiles

Abstract.

We propose performance profiles — distribution functions for a performance metric — as a tool for benchmarking and comparing optimization software. We show that performance profiles combine the best features of other tools for performance evaluation.

This is a preview of subscription content, log in to check access.

Author information

Affiliations

Authors

Additional information

Received: February 2001 / Accepted: May 2001¶Published online October 2, 2001

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Dolan, E., Moré, J. Benchmarking optimization software with performance profiles. Math. Program. 91, 201–213 (2002). https://doi.org/10.1007/s101070100263

Download citation

  • Key words: benchmarking – guidelines – performance – software – testing – metric – timing