Applications of Gibbs Measure Theory to Loopy Belief Propagation Algorithm
In this paper, we pursue application of Gibbs measure theory to LBP in two ways. First, we show this theory can be applied directly to LBP for factor graphs, where one can use higher-order potentials. Consequently, we show beliefs are just marginal probabilities for a certain Gibbs measure on a computation tree. We also give a convergence criterion using this tree. Second, to see the usefulness of this approach, we apply a well-known general condition and a special one, which are developed in Gibbs measure theory, to LBP. We compare these two criteria and another criterion derived by the best present result. Consequently, we show that the special condition is better than the others and also show the general condition is better than the best present result when the influence of one-body potentials is sufficiently large. These results surely encourage the use of Gibbs measure theory in this area.
KeywordsIsing Model Complete Graph Convergence Criterion Gibbs Measure Complete Characterization
Unable to display preview. Download preview PDF.
- 1.Frey, B.J.: Graphical Models for Pattern Classification, Data Compression and Channel Coding. MIT press, Cambridge (1998)Google Scholar
- 5.Mooij, J.M., Kappen, H.J.: Sufficient conditions for convergence of Loopy Belief Propagation. In: Proc. of 21st Conf. on Unc. in Art. Int., Edinburgh, pp. 396–403 (2005)Google Scholar
- 6.Murphy, K.P., Weiss, Y., Jordan, M.I.: Loopy belief propagation for approximate inference: an empirical study. In: Proc. of the 15th Conf. on Unc. in Art. Int., pp. 467–475. Morgan Kaufmann, San Francisco (1999)Google Scholar
- 8.Tatikonda, S.C., Jordan, M.I.: Loopy Belief Propagation and Gibbs Measures. In: Proc. of the 18th Conf. on Unc. in Art. Int., pp. 493–500. Morgan Kaufmann, San Francisco (2002)Google Scholar
- 9.Weiss, Y.: Correctness of Local Probability Propagation in Graphical Models with Loops, Neur. Comp., vol. 12, pp. 1–41. MIT press, Cambridge (2000)Google Scholar