Skip to main content
SpringerLink
Log in

Reliability Estimation of Classification Algorithms. II. Integral Estimates

  • Informatics
  • Published:
Computational Mathematics and Modeling Aims and scope Submit manuscript

Abstract

This article concludes the examination of reliability estimates of classification algorithms. It reviews the statistical methods used for interval estimation of the reliability of classifiers in the frequency and Bayesian approaches. “Hybrid” estimates combining both approaches are also considered. These estimates are particularly important as they are applicable to the small-sample case.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

REFERENCES

  1. S. N. Bernshtein, “On Fisher ‘Confidence’ Probabilities,” in: S. N. Bershtein, Collected Works. Vol. IV. Probability Theory and Mathematical Statistics (1911–1946) [in Russian], Nauka, Moscow (1964), pp. 386–393.

    Google Scholar 

  2. L. N. Bol’shev, “A comment to S. N. Bernshtein’s paper “On Fisher ‘confidence’ probabilities”,” in: S. N. Bershtein, Collected Works. Vol. IV. Probability Theory and Mathematical Statistics (1911–1946) [in Russian], Nauka, Moscow (1964), pp. 566–569.

    Google Scholar 

  3. L. N. Bol’shev, “Construction of confidence limits,” Teoriya Veroyatnostei i Ee Primeneniya, 10, No.1, 197–192 (1965).

    Google Scholar 

  4. L. N. Bol’shev, “Application of the empirical Bayesian approach,” in: International Mathematics Congress in Nice 1970. Papers of Soviet Mathematicians [in Russian], Moscow (1972), pp. 48–55.

  5. L. N. Bol’shev and N. V. Smirnov, Statistical Tables [in Russian], Nauka, Moscow (1983).

    Google Scholar 

  6. S. I. Gurov, “Reliability estimation of classification algorithms. I. Introduction to the problem. Point frequency estimates,” Prikladnaya Matematika i Informatika, No. 15, 62–84 (2003).

  7. S. I. Gurov, “Reliability estimation of classification algorithms. II. Point Bayesian estimates,” Prikladnaya Matematika i Informatika, No. 16, 90–104 (2004).

  8. S. I. Gurov, “Consistency principle and Bayesian interval estimation,” Tavricheskii Vestnik Informatiki i Matematiki, Simferopol, No. 3 (2003) (forthcoming).

  9. L. Sachs, Statistical Estimation [Russian translation], Statistika, Moscow (1976).

    Google Scholar 

  10. S. Zacks, The Theory of Statistical Inference [Russian translation], Mir, Moscow (1975).

    Google Scholar 

  11. M. G. Kendall and A. Stuart, The Advanced Theory of Statistics: Inference and Relationship [Russian translation], Nauka, Moscow (1973).

    Google Scholar 

  12. G. P. Klimov, Invariant Methods in Statistics [in Russian], Nauka, Moscow (1973).

    Google Scholar 

  13. N. Sh. Kremer, Probability Theory and Mathematical Statistics [in Russian], Yuniti-Dana, Moscow (2000).

    Google Scholar 

  14. E. Lehmann, Testing Statistical Hypotheses [Russian translation], Nauka, Moscow (1979).

    Google Scholar 

  15. P. Mueller, P. Neumann, and R. Storm, Statistical Tables [Russian translation], Finansy i Statistika, Moscow (1982).

    Google Scholar 

  16. J. Neyman, “Statistical estimation as a problem in classical probability theory,” UMN, 10, 207–229 (1944).

    Google Scholar 

  17. D. B. Owen, Statistical Tables [Russian translation], VTs RAN, Moscow (1966).

    Google Scholar 

  18. J. Pollard, Handbook of Computational Methods in Statistics [Russian translation], Finansy i Statistika, Moscow (1982).

    Google Scholar 

  19. M. I. Tikhomirova and V. P. Gostyakov, “Normal approximation of the multivariate χ 2-distribution,” Studies in Discrete Mathematics, Vol. 4 [in Russian], Fizmatlit, Moscow (2001), pp. 259–272.

    Google Scholar 

  20. S. Wilks, Mathematical Statistics [Russian translation], Nauka, Moscow (1967).

    Google Scholar 

  21. K. Fukunaga, Introduction to Statistical Pattern Recognition Theory [Russian translation], Nauka, Moscow (1979).

    Google Scholar 

  22. L. Schmetter, An Introduction to Mathematical Statistics [Russian translation], Nauka, Moscow (1976).

    Google Scholar 

  23. J. Yanko, Mathematical and Statistical Tables [Russian translation], Gosstatizdat, Moscow (1961).

    Google Scholar 

  24. C. J. Clopper and E. S. Pearson, “The use of confidence or fiducial limits illustrated in the case of the binomial,” Biometrika, 26, 404–413 (1934).

    Google Scholar 

  25. R. A. Fisher, “The fiducial argument in statistical inference,” Ann. Eugenics, 5, 391–398 (1935).

    Google Scholar 

  26. J. Neyman, “Outline of a theory of statistical estimation based on the classical theory of probability,” Phil. Trans. Roy. Soc. London Ser. A, 236, 333–380 (1937).

    Google Scholar 

  27. E. S. Pearson and H. O. Hartley, Biometrika Tables for Statisticians, Cambridge (1966/72).

Download references

Authors
  1. S. I. Gurov
    View author publications

    You can also search for this author in PubMed Google Scholar

Additional information

__________

Translated from Prikladnaya Matematika i Informatika, No. 17, pp. 112 – 128, 2004.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Gurov, S.I. Reliability Estimation of Classification Algorithms. II. Integral Estimates. Comput Math Model 16, 279–288 (2005). https://doi.org/10.1007/s10598-005-0024-7

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10598-005-0024-7

Keywords

Search

Navigation