MCMC Learning of Bayesian Network Models by Markov Blanket Decomposition
We propose a Bayesian method for learning Bayesian network models using Markov chain Monte Carlo (MCMC). In contrast to most existing MCMC approaches that define components in term of single edges, our approach is to decompose a Bayesian network model in larger dependence components defined by Markov blankets. The idea is based on the fact that MCMC performs significantly better when choosing the right decomposition, and that edges in the Markov blanket of the vertices form a natural dependence relationship. Using the ALARM and Insurance networks, we show that this decomposition allows MCMC to mix more rapidly, and is less prone to getting stuck in local maxima compared to the single edge approach.
- 1.Beinlich, I.A., Suermondt, H.J., Chavez, R.M., Cooper, G.F.: The ALARM monitoring system: A case study with two probabilistic inference techniques for belief networks. In: Proc. of the European Conf. on AI in Medicine (1989)Google Scholar
- 9.Kocka, T., Castelo, R.: Improved learning of Bayesian networks. In: Koller, D., Breese, J. (eds.) Proc. of the Conf. on Uncertainty in AI, pp. 269–276 (2001)Google Scholar
- 12.Robert, C.P., Casella, G.: Monte Carlo statistical methods, 3rd edn. Springer, Heidelberg (2002)Google Scholar