Likelihood-Based Robust Classification with Bayesian Networks
Bayesian networks are commonly used for classification: a structural learning algorithm determines the network graph, while standard approaches estimate the model parameters from data. Yet, with few data the corresponding assessments can be unreliable. To gain robustness in this phase, we consider a likelihood-based learning approach, which takes all the model quantifications whose likelihood exceeds a given threshold. A new classification algorithm based on this approach is presented. Notably, this is a credal classifier, i.e., more than a single class can be returned in output. This is the case when the Bayesian networks consistent with the threshold constraint assign different class labels to a test instance. This is the first classifier of this kind for general topologies. Experiments show how this approach provide the desired robustness.
KeywordsClassification likelihood-based learning Bayesian networks credal networks imprecise probabilities credal classifiers
Unable to display preview. Download preview PDF.
- 1.Antonucci, A., Cattaneo, M., Corani, G.: Likelihood-based naive credal classifier. In: ISIPTA 2011, pp. 21–30. SIPTA (2011)Google Scholar
- 2.Antonucci, A., Cattaneo, M., Corani, G.: Likelihood-based robust classification with Bayesian networks. Technical Report IDSIA-01-12, IDSIA (2012)Google Scholar
- 3.Cattaneo, M.: Statistical Decisions Based Directly on the Likelihood Function. PhD thesis, ETH Zurich (2007)Google Scholar
- 4.Cattaneo, M.: Likelihood-based inference for probabilistic graphical models: Some preliminary results. In: PGM 2010, pp. 57–64. HIIT Publications (2010)Google Scholar
- 5.Corani, G., Antonucci, A., Zaffalon, M.: Bayesian networks with imprecise probabilities: Theory and application to classification. In: Data Mining: Foundations and Intelligent Paradigms, pp. 49–93. Elsevier (2010)Google Scholar
- 9.Koller, D., Friedman, N.: Probabilistic Graphical Models. MIT Press (2009)Google Scholar
- 10.Moral, S.: Calculating uncertainty intervals from conditional convex sets of probabilities. In: UAI 1992, pp. 199–206. Morgan Kaufmann (1992)Google Scholar
- 11.Pawitan, Y.: In All Likelihood. Oxford University Press (2001)Google Scholar
- 12.Pearl, J.: Probabilistic Reasoning in Intelligent Systems. Morgan Kaufmann (1988)Google Scholar
- 13.Walley, P.: Statistical Reasoning with Imprecise Probabilities. Chapman and Hall (1991)Google Scholar