Misclassification Probability Estimations for Linear Decision Functions
The work is devoted to a problem of statistical robustness of deciding functions, or risk estimation. By risk we mean some measure of decision function prediction quality, for example, an error probability. For the case of discrete “independent” variable the dependence of average risk on empirical risk for the “worst” distribution (“strategies of nature”) is obtained. The result gives exact value of empirical risk bias that allows evaluating an accuracy of Vapnik–Chervonenkis risk estimations. To find a distribution providing maximum of empirical risk bias one need to solve an optimization problem on function space. The problem being very complicate in general case appears to be solvable when the “independent” feature is a space of isolated points. The space has low practical use but it allows scaling well-known estimations by Vapnik and Chervonenkis. Such scaling appears to be available for linear decision functions.
KeywordsRisk Estimation Compatible Event Decision Function Average Risk Discrete Case
- 1.Vapnik, V.N., Chervonenkis, A.J.: Theory of pattern recognition. Moscow “Nauka”, p. 415 (1974) (in Russian)Google Scholar
- 3.Lbov, G.S., Startseva, N.G.: Logical deciding functions and questions of statistical stability of decisions. Novosibirsk: Institute of mathematics, p. 211 (1999) (in Russian)Google Scholar
- 5.Berikov, V.B.: On stability of recognition algorithms in discrete statement. In: Artificial Intelligence, Ukraine, vol. (2), pp. 5–8 (2000) (in Russian)Google Scholar