Geometrical Approaches to Active Learning
Learning from examples is a key property of autonomous agents. In our contribution, we want to focus on a particular class of strategies which are often referred to as “optimal experimental design“ or “active learning“. Learning machines, which employ these strategies, request examples which are maximal “informative“ for learning a predictor rather than “passively“ scanning their environment. There is a large body of empirical evidence, that active learning is more efficient in terms of the required number of examples. Hence, active learning should be preferred whenever training examples are costly to obtain. In our contribution, we will report new results for active learning methods which we are currently investigating and which are based on the geometrical concept of a version space. We will derive universal hard bounds for the prediction performance using tools from differential geometry, and we will also provide practical algorithms based on kernel methods and Monte-Carlo techniques. The new techniques are applied in psychoacoustical experiments for sound design.
KeywordsActive Learning Version Space Generalization Error Inductive Learning Machine Learn Research
Unable to display preview. Download preview PDF.
- 3.M. Opper, H. S. Seung, and H. Sompolinsky. Query by committee. Proceedings of the Fifth Annual Workshop on Computational Learning Theory, pages 287-294, Pittsburgh, PA, 1992.Google Scholar
- 6.Francis R. Bach. Active learning for misspecified generalized linear models. In B. Sch ölkopf, J. Platt, and T. Hoffman, editors, Advances in Neural Information Processing Systems 19, pages 65-72. MIT Press, Cambridge, MA, 2007.Google Scholar
- 11.G. Wahba. Spline Models for Observational Data, volume 59 of CBMS-NSF Regional Conference Series in Applied Mathematics. SIAM, Philadelphia, 1990.Google Scholar
- 12.R. Herbrich. Learning Kernel Classifiers-Theory and Algorithms. Adaptive Computation and Machine Learning. MIT Press, 2002.Google Scholar
- 14.D. Rochesso and F. Fontana. The Sounding Object. Mondo Estremo, Firenze, Italy, 2003.Google Scholar