Skip to main content

Calibrating Margin-Based Classifier Scores into Polychotomous Probabilities

  • Conference paper

Abstract

Margin-based classifiers like the SVM and ANN have two drawbacks. They are only directly applicable for two-class problems and they only output scores which do not reflect the assessment uncertainty. K-class assessment probabilities are usually generated by using a reduction to binary tasks, univariate calibration and further application of the pairwise coupling algorithm. This paper presents an alternative to coupling with usage of the Dirichlet distribution.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • ALLWEIN, E. L. and SHAPIRE, R. E. and SINGER, Y. (2000): Reducing Multiclasss to Binary: A Unifying Approach for Margin Classifiers. Journal of Machine Learning Re-search 1, 113-141.

    Article  Google Scholar 

  • DEGROOT, M. H. and FIENBERG, S. E. (1983): The Comparison and Evaluation of Fore-casters. The Statistician 32, 12-22.

    Article  Google Scholar 

  • GEBEL, M. and WEIHS, C. (2007): Calibrating classifier scores into probabilities. In: R. Decker and H. Lenz (Eds.): Advances in Data Analysis. Springer, Heidelberg, 141-148.

    Chapter  Google Scholar 

  • HASTIE, T. and TIBSHIRANI, R. (1998): Classification by Pairwise Coupling. In: M. I. Jordan, M. J. Kearns and S. A. Solla (Eds.): Advances in Neural Information Processing Systems 10. MIT Press, Cambridge.

    Google Scholar 

  • HEILEMANN, U. and MÜNCH, J. M. (1996): West german business cycles 1963-1994: A multivariate discriminant analysis. CIRET-Conference in Singapore, CIRET-Studien 50.

    Google Scholar 

  • JOHNSON, N. L. and KOTZ, S. and BALAKRISHNAN, N. (2002): Continuous Multivariate Distributions 1, Models and Applications, 2nd edition. John Wiley & Sons, New York.

    Google Scholar 

  • NEWMAN, D.J. and HETTICH, S. and BLAKE, C.L. and MERZ, C.J. (1998): UCI Reposi-tory of machine learning databases [http://www.ics.uci.edu/∼learn/MLRepository.html]. University of California, Department of Information and Computer Science, Irvine.

  • SUYKENS, J. A. K. and VANDEWALLE, J. P. L. (1999): Least Squares Support Vector Machine classifiers. Neural Processing Letters 9:3,93-300.

    Article  MathSciNet  Google Scholar 

  • ZHANG, T. (2004): Statistical behavior and consitency of classification methods based on convex risk minimization. Annals of Statistics 32:1, 56-85.

    Article  MATH  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Gebel, M., Weihs, C. (2008). Calibrating Margin-Based Classifier Scores into Polychotomous Probabilities. In: Preisach, C., Burkhardt, H., Schmidt-Thieme, L., Decker, R. (eds) Data Analysis, Machine Learning and Applications. Studies in Classification, Data Analysis, and Knowledge Organization. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-78246-9_4

Download citation

Publish with us

Policies and ethics