Supervised Classification Problems: How to Be Both Judge and Jury

Abstract

In many supervised classification problems there is ambiguity about the definitions of the classes. Sometimes many alternative but similar definitions could equally be adopted. We propose taking advantage of this by choosing that particular definition which optimises some additional criterion. In particular, one can choose that definition which leads to greatest predictive classification accuracy, so that any action taken on the basis of the predicted classes is most reliable.