Statistics and Computing

, Volume 14, Issue 2, pp 143–166

Tree consistency and bounds on the performance of the max-product algorithm and its generalizations

  • Martin Wainwright
  • Tommi Jaakkola
  • Alan Willsky
Article

DOI: 10.1023/B:STCO.0000021412.33763.d5

Cite this article as:
Wainwright, M., Jaakkola, T. & Willsky, A. Statistics and Computing (2004) 14: 143. doi:10.1023/B:STCO.0000021412.33763.d5

Abstract

Finding the maximum a posteriori (MAP) assignment of a discrete-state distribution specified by a graphical model requires solving an integer program. The max-product algorithm, also known as the max-plus or min-sum algorithm, is an iterative method for (approximately) solving such a problem on graphs with cycles. We provide a novel perspective on the algorithm, which is based on the idea of reparameterizing the distribution in terms of so-called pseudo-max-marginals on nodes and edges of the graph. This viewpoint provides conceptual insight into the max-product algorithm in application to graphs with cycles. First, we prove the existence of max-product fixed points for positive distributions on arbitrary graphs. Next, we show that the approximate max-marginals computed by max-product are guaranteed to be consistent, in a suitable sense to be defined, over every tree of the graph. We then turn to characterizing the nature of the approximation to the MAP assignment computed by max-product. We generalize previous work by showing that for any graph, the max-product assignment satisfies a particular optimality condition with respect to any subgraph containing at most one cycle per connected component. We use this optimality condition to derive upper bounds on the difference between the log probability of the true MAP assignment, and the log probability of a max-product assignment. Finally, we consider extensions of the max-product algorithm that operate over higher-order cliques, and show how our reparameterization analysis extends in a natural manner.

MAP estimationinteger programmingmax-productmin-summax-plusgraphical modelsmax-marginalsinferenceiterative decodingViterbi algorithmdynamic programming

Copyright information

© Kluwer Academic Publishers 2004

Authors and Affiliations

  • Martin Wainwright
    • 1
  • Tommi Jaakkola
    • 2
  • Alan Willsky
    • 2
  1. 1.Electrical Engineering & Computer ScienceUC BerkeleyBerkeley
  2. 2.Electrical Engineering & Computer ScienceMITCambridge