Goodness-of-Fit Measures for Induction Trees

  • Gilbert Ritschard
  • Djamel A. Zighed
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2871)

Abstract

This paper is concerned with the goodness-of-fit of induced decision trees. Namely, we explore the possibility to measure the goodness-of-fit as it is classically done in statistical modeling. We show how Chi-square statistics and especially the Log-likelihood Ratio statistic that is abundantly used in the modeling of cross tables, can be adapted for induction trees. The Log-likelihood Ratio is well suited for testing the significance of the difference between two nested trees. In addition, we derive from it pseudo R2’s. We propose also adapted forms of the Akaike (AIC) and Bayesian (BIC) information criteria that prove useful in selecting the best compromise model between fit and complexity.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Agresti, A.: Categorical Data Analysis. Wiley, New York (1990)MATHGoogle Scholar
  2. 2.
    Akaike, H.: Information theory and an extension of the maximum likelihood principle. In: Petrox, B.N., Caski, F. (eds.) Second International Symposium on Information Theory, Akademiai Kiado, Budapest, p. 267 (1973)Google Scholar
  3. 3.
    Bishop, Y.M.M., Fienberg, S.E., Holland, P.W.: Discrete Multivariate Analysis. MIT Press, Cambridge (1975)MATHGoogle Scholar
  4. 4.
    Breiman, L., Friedman, J.H., Olshen, R.A., Stone, C.J.: Classification And Regression Trees. Chapman and Hall, New York (1984)MATHGoogle Scholar
  5. 5.
    Goodman, L.A., Kruskal, W.H.: Measures of association for cross classifications. Journal of the American Statistical Association 49, 732–764 (1954)MATHCrossRefGoogle Scholar
  6. 6.
    Goodman, L.A., Kruskal, W.H.: Measures of association for cross classifications IV: simplification of asymptotic variances. Journal of the American Statistical Association 67, 415–421 (1972)MATHCrossRefGoogle Scholar
  7. 7.
    Kass, R.E., Raftery, A.E.: Bayes factors. Journal of the American Statistical Association 90, 773–795 (1995)MATHCrossRefGoogle Scholar
  8. 8.
    Light, R.J., Margolin, B.H.: An analysis of variance for categorical data. Journal of the American Statistical Association 66, 534–544 (1971)MATHCrossRefMathSciNetGoogle Scholar
  9. 9.
    Olszak, M., Ritschard, G.: The behaviour of nominal and ordinal partial association measures. The Statistician 44, 195–212 (1995)CrossRefGoogle Scholar
  10. 10.
    Schwarz, G.: Estimating the dimension of a model. The Annals of Statistics 6, 461–464 (1978)MATHCrossRefMathSciNetGoogle Scholar
  11. 11.
    Theil, H.: On the estimation of relationships involving qualitative variables. American Journal of Sociology 76, 103–154 (1970)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2003

Authors and Affiliations

  • Gilbert Ritschard
    • 1
  • Djamel A. Zighed
    • 2
  1. 1.Dept of EconometricsUniversity of GenevaGeneva 4Switzerland
  2. 2.Laboratoire ERICUniversity of Lyon 2Bron CedexFrance

Personalised recommendations