Advertisement

Interpretability of Bayesian Decision Trees Induced from Trauma Data

  • Derek Partridge
  • Vitaly Schetinin
  • Dayou Li
  • Timothy J. Coats
  • Jonathan E. Fieldsend
  • Wojtek J. Krzanowski
  • Richard M. Everson
  • Trevor C. Bailey
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4029)

Abstract

Decision Tree (DT) technology with its sequential decision process composed of hard thresholds applied to individual features is often not an optimal choice. But DTs are typically credited with being predictive structures that a domain specialist can interpret as opposed to a ‘black-box’ neural network, for example. There are two anticipated classes of benefit when Artificial Intelligence technology is applied to medicine: automation of decision making and enhancement of medical knowledge. In this paper we present the use of Bayes-ian averaging as a principled approach to optimal classifier systems using DT technology in which a confidence rating can be associated with every predicted result. However, averaging over an ensemble of DTs causes the problem that such an ensemble becomes uninterpretable. Thus we also present a procedure for extracting interpretable ‘archetype’ DTs. We demonstrate these innovations by application to Trauma data.

Keywords

Markov Chain Monte Carlo Glasgow Coma Score Markov Chain Monte Carlo Method Decision Tree Model Trauma Data 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Breiman, L., Friedman, J., Olshen, R., Stone, C.: Classification and Regression Trees. Bel-mont, Wadsworth (1984)MATHGoogle Scholar
  2. 2.
    Galant, S.: Neural Network Learning and Expert Systems. MIT Press, Cambridge (1993)Google Scholar
  3. 3.
    Buntine, W.: Learning Classification Trees. Statistics and Computing 2, 63–73 (1992)CrossRefGoogle Scholar
  4. 4.
    Quinlan, J.: C4.5. In: Programs for Machine Learning, Morgan Kaufmann, San Francisco (1993)Google Scholar
  5. 5.
    Duda, R.O., Hart, P.E.: Pattern Classification. Wiley Interscience, Chichester (2001)MATHGoogle Scholar
  6. 6.
    Boyd, C.R., Tolson, M.A., Copes, W.S.: Evaluating Trauma Care: The TRISS Method. J. Trauma 27, 370–378 (1988)CrossRefGoogle Scholar
  7. 7.
    Chipman, H., George, E., McCullock, R.: Bayesian CART Model Search. J. American Statistics 93, 935–960 (1998)CrossRefGoogle Scholar
  8. 8.
    Denison, D., Holmes, C., Malick, B., Smith, A.: Bayesian Methods for Nonlinear Classifica-tion and Regression. Wiley, Chichester (2002)Google Scholar
  9. 9.
    Kuncheva, A.: Combining Pattern Classifiers: Methods and Algorithms. Wiley, Chichester (2004)MATHCrossRefGoogle Scholar
  10. 10.
    Green, P.: Reversible Jump Markov Chain Monte Carlo Computation and Bayesian Model Determination. Biometrika 82, 711–732 (1995)MATHCrossRefMathSciNetGoogle Scholar
  11. 11.
    Chipman, H., George, E., McCulloch, R.: Making Sense of a Forest of Trees. In: Weisberg, S. (ed.) Proceedings of the 30th Symposium on the Interface, Interface Foundation of North America, pp. 84–92 (1998)Google Scholar
  12. 12.
    Domingos, P.: Knowledge Discovery via Multiple Models. Intelligent Data Analysis 2, 187–202 (1998)CrossRefGoogle Scholar
  13. 13.
    Schetinin, V., Partridge, D., Krzanowski, W.J., Everson, R.M., Fieldsend, J.E., Bailey, T.C., Hernandez, A.: Experimental Comparison of Classification Uncertainty for Randomized and Bayesian Decision Tree Ensembles. J. Math. Modeling and Algorithms 4 (forthcoming, 2006)Google Scholar
  14. 14.
    Blake, C.L., Merz, C.J.: UCI Repository of Machine Learning Datasets. Irvine, University of California (1998), cs.uci.edu/mlearn/MLRepository

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Derek Partridge
    • 1
  • Vitaly Schetinin
    • 2
  • Dayou Li
    • 2
  • Timothy J. Coats
    • 3
  • Jonathan E. Fieldsend
    • 1
  • Wojtek J. Krzanowski
    • 1
  • Richard M. Everson
    • 1
  • Trevor C. Bailey
    • 1
  1. 1.School of Engineering, Computer Science and MathematicsUniversity of ExeterUK
  2. 2.Department of Computing and Information SystemsUniversity of LutonUK
  3. 3.Accident and Emergency DepartmentLeicester Royal InfirmaryUK

Personalised recommendations