Handling Numeric Attributes in Hoeffding Trees

  • Bernhard Pfahringer
  • Geoffrey Holmes
  • Richard Kirkby
Conference paper

DOI: 10.1007/978-3-540-68125-0_27

Part of the Lecture Notes in Computer Science book series (LNCS, volume 5012)
Cite this paper as:
Pfahringer B., Holmes G., Kirkby R. (2008) Handling Numeric Attributes in Hoeffding Trees. In: Washio T., Suzuki E., Ting K.M., Inokuchi A. (eds) Advances in Knowledge Discovery and Data Mining. PAKDD 2008. Lecture Notes in Computer Science, vol 5012. Springer, Berlin, Heidelberg

Abstract

For conventional machine learning classification algorithms handling numeric attributes is relatively straightforward. Unsupervised and supervised solutions exist that either segment the data into pre-defined bins or sort the data and search for the best split points. Unfortunately, none of these solutions carry over particularly well to a data stream environment. Solutions for data streams have been proposed by several authors but as yet none have been compared empirically. In this paper we investigate a range of methods for multi-class tree-based classification where the handling of numeric attributes takes place as the tree is constructed. To this end, we extend an existing approximation approach, based on simple Gaussian approximation. We then compare this method with four approaches from the literature arriving at eight final algorithm configurations for testing. The solutions cover a range of options from perfectly accurate and memory intensive to highly approximate. All methods are tested using the Hoeffding tree classification algorithm. Surprisingly, the experimental comparison shows that the most approximate methods produce the most accurate trees by allowing for faster tree growth.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Bernhard Pfahringer
    • 1
  • Geoffrey Holmes
    • 1
  • Richard Kirkby
    • 1
  1. 1.University of WaikatoHamiltonNew Zealand

Personalised recommendations