A Bayesian Active Learning Framework for a Two-Class Classification Problem
In this paper we present an active learning procedure for the two-class supervised classification problem. The utilized methodology exploits the Bayesian modeling and inference paradigm to tackle the problem of kernel-based data classification. This Bayesian methodology is appropriate for both finite and infinite dimensional feature spaces. Parameters are estimated, using the kernel trick, following the evidence Bayesian approach from the marginal distribution of the observations. The proposed active learning procedure uses a criterion based on the entropy of the posterior distribution of the adaptive parameters to select the sample to be included in the training set. A synthetic dataset as well as a real remote sensing classification problem are used to validate the followed approach.
KeywordsPosterior Distribution Active Learning Multispectral Image Relevance Vector Machine Kappa Index
Unable to display preview. Download preview PDF.
- 2.Bishop, C.M.: Pattern Recognition and Machine Learning (Information Science and Statistics). Springer (2007)Google Scholar
- 4.Elad, M.: Sparse and Redundant Representations - From Theory to Applications in Signal and Image Processing. Springer (2010)Google Scholar
- 8.Schölkopf, B., Smola, A.: Learning with Kernels. MIT Press, Cambrigde (2002)Google Scholar
- 9.Seeger, M.W., Nickisch, H.: Compressed sensing and Bayesian experimental design. In: International Conference on Machine Learning 25 (2008)Google Scholar
- 10.Settles, B.: Active learning literature survey. Computer Sciences Technical Report 1648, University of Wisconsin–Madison (2009)Google Scholar
- 11.Shawe-Taylor, J., Cristianini, N.: Kernel Methods for Pattern Analysis. Cambridge Univ. Press (2004)Google Scholar