Machine Learning

, Volume 65, Issue 1, pp 95–130

Cost curves: An improved method for visualizing classifier performance

Article

DOI: 10.1007/s10994-006-8199-5

Cite this article as:
Drummond, C. & Holte, R.C. Mach Learn (2006) 65: 95. doi:10.1007/s10994-006-8199-5

Abstract

This paper introduces cost curves, a graphical technique for visualizing the performance (error rate or expected cost) of 2-class classifiers over the full range of possible class distributions and misclassification costs. Cost curves are shown to be superior to ROC curves for visualizing classifier performance for most purposes. This is because they visually support several crucial types of performance assessment that cannot be done easily with ROC curves, such as showing confidence intervals on a classifier's performance, and visualizing the statistical significance of the difference in performance of two classifiers. A software tool supporting all the cost curve analysis described in this paper is available from the authors.

Keywords

Performance evaluation Classifiers ROC curves Machine learning 

Copyright information

© Springer Science + Business Media, LLC 2006

Authors and Affiliations

  1. 1.Institute for Information TechnologyNational Research Council CanadaOntarioCanada
  2. 2.Department of Computing ScienceUniversity of AlbertaEdmontonCanada

Personalised recommendations