Univariate Margin Tree

Conference paper
Part of the Lecture Notes in Electrical Engineering book series (LNEE, volume 62)

Abstract

In many pattern recognition applications, first decision trees are used due to their simplicity and easily interpretable nature. In this paper, we propose a new decision tree learning algorithm called univariate margin tree, where for each continuous attribute, the best split is found using convex optimization. Our simulation results on 47 datasets show that the novel margin tree classifier performs at least as good as C4.5 and LDT with a similar time complexity. For two class datasets it generates smaller trees than C4.5 and LDT without sacrificing from accuracy, and generates significantly more accurate trees than C4.5 and LDT for multiclass datasets with one-vs-rest methodology.

Keywords

Support Vector Machine Convex Optimization Good Split Multiclass Problem Univariate Margin 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Mitchell, T.: Machine Learning. McGraw-Hill (1997)Google Scholar
  2. 2.
    Alpaydin, E.: Introduction to Machine Learning. The MIT Press (2010)Google Scholar
  3. 3.
    Quinlan, J.R.: C4.5: Programs for Machine Learning. Morgan Kaufmann, San Meteo, CA (1993)Google Scholar
  4. 4.
    Quinlan, J.R.: Induction of decision trees. Machine Learning 1 (1986) 81–106Google Scholar
  5. 5.
    Yildiz, O.T., Alpaydin, E.: Linear discriminant trees. International Journal of Pattern Recognition and Artificial Intelligence 19(3) (2005) 323–353CrossRefGoogle Scholar
  6. 6.
    Duda, R.O., Hart, P.E., Stork, D.G.: Pattern Classification. John Wiley and Sons (2001)Google Scholar
  7. 7.
    Guo, H., Gelfand, S.B.: Classification trees with neural network feature extraction. IEEE Transactions on Neural Networks 3 (1992) 923–933CrossRefGoogle Scholar
  8. 8.
    Vapnik, V.: The Nature of Statistical Learning Theory. Springer Verlag, New York (1995)MATHGoogle Scholar
  9. 9.
    Asuncion, A., Newman, D.J.: UCI machine learning repository (2007)Google Scholar
  10. 10.
    Statnikov, A., Aliferis, C., Tsamardinos, I., Hardin, D., Levy, S.: A comprehensive evaluation of multicategory classification methods for microarray gene expression cancer diagnosis. Bioinformatics 21 (2005) 631–643CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media B.V. 2011

Authors and Affiliations

  1. 1.Department of Computer EngineeringIşik UniversityIstanbulTurkey

Personalised recommendations