Implementing Decision Trees and Forests on a GPU
- Toby SharpAffiliated withMicrosoft Research
We describe a method for implementing the evaluation and training of decision trees and forests entirely on a GPU, and show how this method can be used in the context of object recognition.
Our strategy for evaluation involves mapping the data structure describing a decision forest to a 2D texture array. We navigate through the forest for each point of the input data in parallel using an efficient, non-branching pixel shader. For training, we compute the responses of the training data to a set of candidate features, and scatter the responses into a suitable histogram using a vertex shader. The histograms thus computed can be used in conjunction with a broad range of tree learning algorithms.
We demonstrate results for object recognition which are identical to those obtained on a CPU, obtained in about 1% of the time.
To our knowledge, this is the first time a method has been proposed which is capable of evaluating or training decision trees on a GPU. Our method leverages the full parallelism of the GPU.
Although we use features common to computer vision to demonstrate object recognition, our framework can accommodate other kinds of features for more general utility within computer science.
- Implementing Decision Trees and Forests on a GPU
- Book Title
- Computer Vision – ECCV 2008
- Book Subtitle
- 10th European Conference on Computer Vision, Marseille, France, October 12-18, 2008, Proceedings, Part IV
- pp 595-608
- Print ISBN
- Online ISBN
- Series Title
- Lecture Notes in Computer Science
- Series Volume
- Series ISSN
- Springer Berlin Heidelberg
- Copyright Holder
- Springer-Verlag Berlin Heidelberg
- Additional Links
- Industry Sectors
- eBook Packages
- Editor Affiliations
- 1. Computer Science Department, University of Illinois at Urbana Champaign
- 2. Department of Computing, Wheatley, Oxford Brookes University
- 3. Department of Engineering Science, University of Oxford
- Toby Sharp (4)
- Author Affiliations
- 4. Microsoft Research, Cambridge, UK
To view the rest of this content please follow the download PDF link above.