Gradient Descent Style Leveraging of Decision Trees and Stumps for Misclassification Cost Performance

  • Mike Cameron-Jones
Conference paper

DOI: 10.1007/3-540-45656-2_10

Part of the Lecture Notes in Computer Science book series (LNCS, volume 2256)
Cite this paper as:
Cameron-Jones M. (2001) Gradient Descent Style Leveraging of Decision Trees and Stumps for Misclassification Cost Performance. In: Stumptner M., Corbett D., Brooks M. (eds) AI 2001: Advances in Artificial Intelligence. AI 2001. Lecture Notes in Computer Science, vol 2256. Springer, Berlin, Heidelberg

Abstract

This paper investigates the use, for the task of classifier learning in the presence of misclassification costs, of some gradient descent style leveraging approaches to classifier learning: Schapire and Singer’s AdaBoost.MH and AdaBoost.MR [16], and Collins et al’s multiclass logistic regression method [4], and some modifications that retain the gradient descent style approach. Decision trees and stumps are used as the underlying base classifiers, learned from modified versions of Quinlan’s C4.5 [15]. Experiments are reported comparing the performance, in terms of average cost, of the modified methods to that of the originals, and to the previously suggested “Cost Boosting” methods of Ting and Zheng [21] and Ting [18], which also use decision trees based upon modified C4.5 code, but do not have an interpretation in the gradient descent framework. While some of the modifications improve upon the originals in terms of cost performance for both trees and stumps, the comparison with tree-based Cost Boosting suggests that out of the methods first experimented with here, it is one based on stumps that has the most promise.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag Berlin Heidelberg 2001

Authors and Affiliations

  • Mike Cameron-Jones
    • 1
  1. 1.School of ComputingUniversity of TasmaniaLauncestonAustralia

Personalised recommendations