Restricting the IDM for Classification
The naive credal classifier (NCC) extends naive Bayes classifier (NBC) to imprecise probabilities to robustly deal with the specification of the prior; NCC models a state of ignorance by using a set of priors, which is formalized by Walley’s Imprecise Dirichlet Model (IDM). NCC has been shown to return more robust classification than NBC. However, there are particular situations (which we precisely characterize in the paper) under which the extreme densities included by the IDM force NCC to become very indeterminate, although NBC is able to issue accurately classifications. In this paper, we propose two approaches which overcome this issue, by restricting the set of priors of the IDM . We analyze both approaches theoretically and experimentally.
KeywordsClass Problem Bayesian Model Average Feature Problem Prior Density Bayesian Model Average
Unable to display preview. Download preview PDF.
- 3.Corani, G., Zaffalon, M.: Credal Model Averaging: An Extension of Bayesian Model Averaging to Imprecise Probabilities. In: Proc. of the 2008 European Conf. on Machine Learning and Knowledge Discovery in Databases, pp. 257–271 (2008)Google Scholar
- 7.Zaffalon, M.: Statistical inference of the naive credal classifier. In: ISIPTA 2001: Proc. of the Second Int. Symp. on Imprecise Probabilities and Their Applications, The Netherlands, Shaker, pp. 384–393 (2001)Google Scholar