A tutorial on variational Bayesian inference
- 1.7k Downloads
This tutorial describes the mean-field variational Bayesian approximation to inference in graphical models, using modern machine learning terminology rather than statistical physics concepts. It begins by seeking to find an approximate mean-field distribution close to the target joint in the KL-divergence sense. It then derives local node updates and reviews the recent Variational Message Passing framework.
KeywordsVariational Bayes Mean-field Tutorial
Unable to display preview. Download preview PDF.
- Attias H (2000) A variational Bayesian framework for graphical models. In: Advances in neural information processing systems. MIT PressGoogle Scholar
- Bishop CM, Winn JM, Spiegelhalter D (2002) VIBES: a variational inference engine for Bayesian networks. In: Advances in neural information processing systemsGoogle Scholar