Structural Risk Minimization on Decision Trees Using an Evolutionary Multiobjective Optimization

  • DaeEun Kim
Conference paper

DOI: 10.1007/978-3-540-24650-3_32

Part of the Lecture Notes in Computer Science book series (LNCS, volume 3003)
Cite this paper as:
Kim D. (2004) Structural Risk Minimization on Decision Trees Using an Evolutionary Multiobjective Optimization. In: Keijzer M., O’Reilly UM., Lucas S., Costa E., Soule T. (eds) Genetic Programming. EuroGP 2004. Lecture Notes in Computer Science, vol 3003. Springer, Berlin, Heidelberg

Abstract

Inducing decision trees is a popular method in machine learning. The information gain computed for each attribute and its threshold helps finding a small number of rules for data classification. However, there has been little research on how many rules are appropriate for a given set of data. In this paper, an evolutionary multi-objective optimization approach with genetic programming will be applied to the data classification problem in order to find the minimum error rate for each size of decision trees. Following structural risk minimization suggested by Vapnik, we can determine a desirable number of rules with the best generalization performance. A hierarchy of decision trees for classification performance can be provided and it is compared with C4.5 application.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag Berlin Heidelberg 2004

Authors and Affiliations

  • DaeEun Kim
    • 1
  1. 1.Cognitive Robotics Max Planck Institute for Psychological Research MunichGermany

Personalised recommendations