Advertisement

Computational Statistics

, Volume 18, Issue 1, pp 143–162 | Cite as

Standardizing the Comparison of Partitions

  • Ursula Garczarek
  • Glaus Weihs
Article

Summary

We propose a standardized partition space that offers a unifying framework for the comparison of a wide variety of classification rules. Using standardized partition spaces, one can define measures for the performance of classifiers w.r.t. goodness concepts beyond the expected rate of correct classifications such that they are comparable for rules from so different techniques as support vector machines, neural networks, discriminant analysis, and many more. For classification problems with up to four classes, one can visualize partitions from classification rules that allow for a direct comparison of characteristic patterns of the rules. We use these visualizations to motivate measures for accuracy and non-resemblance in the sense of (Hand 1997), enhanced for non-probabilistic classifiers.

References

  1. Anderson, T. W. (1958), An Introduction to Multivariate Statistical Analysis, John Wiley & Sons, New York.zbMATHGoogle Scholar
  2. Blake, C. & Merz, C. (1998), ‘UCI repository of machine learning databases’, http://www.ics.uci.edu/~mlearn/MLRepository.html
  3. Bridle, J. S. (1990), Probabilistic interpretation of feedforward classification network outputs, with relationships to, statistical pattern recognition, in F. Fogelman Soulié & J. Hérault, eds, ‘Neuro-computing: Algorithms, Architectures and Applications’, Springer, Berlin, pp. 227–236.CrossRefGoogle Scholar
  4. Demuth, H. & Beale, M. (1998), Neural Network Toolbox User’s Guide.Google Scholar
  5. Fisher, R. A. (1936), ‘The use of multiple measurements in taxonomic problems’, Annals of Eugenics 7(2), 179–188.CrossRefGoogle Scholar
  6. Gelman, A., Carlin, J. B., Stern, H. S. & Rubin, D. B. (1995), Bayesian Data Analysis, Chapman & Hall, New York.CrossRefGoogle Scholar
  7. German, B. (1987), ‘Glass identification database’. http://www.ics.uci.edu/~mlearn/MLRepository.html
  8. Hand, D. J. (1997), Construction and Assessment of Classification Rules, John Wiley & Sons, Chichester.zbMATHGoogle Scholar
  9. Ihaka, R. & Gentleman, R. (1996), ‘R: A language for data analysis and graphics’, Journal of Computational and Graphical Statistics 5(3), 299–314.Google Scholar

Copyright information

© Physica-Verlag 2003

Authors and Affiliations

  • Ursula Garczarek
    • 1
  • Glaus Weihs
    • 1
  1. 1.Department of StatisticsUniversity of DortmundDortmundGermany

Personalised recommendations