Skip to main content

Bucket Elimination: A Unifying Framework for Probabilistic Inference

  • Chapter
Learning in Graphical Models

Part of the book series: NATO ASI Series ((ASID,volume 89))

Abstract

Probabilistic inference algorithms for belief updating, finding the most probable explanation, the maximum a posteriori hypothesis, and the maximum expected utility are reformulated within the bucket elimination framework. This emphasizes the principles common to many of the algorithms appearing in the probabilistic inference literature and clarifies the relationship of such algorithms to nonserial dynamic programming algorithms. A general method for combining conditioning and bucket elimination is also presented. For all the algorithms, bounds on complexity are given as a function of the problem’s structure.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 259.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 329.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 329.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • S. Arnborg and A. Proskourowski. Linear time algorithms for np-hard problems restricted to partial k-trees. Discrete and Applied Mathematics, 23: 11–24, 1989.

    Article  MathSciNet  MATH  Google Scholar 

  • S.A. Arnborg. Efficient algorithms for combinatorial problems on graphs with bounded decomposability - a survey. BIT, 25: 2–23, 1985.

    Article  MathSciNet  MATH  Google Scholar 

  • F. Bacchus and P. van Run. Dynamic variable ordering in csps. In Principles and Practice of Constraints Programming (CP-95), Cassis, France, 1995.

    Google Scholar 

  • A. Becker and D. Geiger. A sufficiently fast algorithm for finding close to optimal jnmction trees. In Uncertainty in Al (UAI-96), pages 81–89, 1996.

    Google Scholar 

  • U. Bertele and F. Brioschi. Nonserial Dynamic Programming. Academic Press, 1972.

    Google Scholar 

  • S. Bistaгelli, U. Montanan, and F Rossi. Semiring-based constraint satisfaction and optimization. Journal of the Association of Computing Machinery (JACM), to appear, 1997.

    Google Scholar 

  • C. Boutilier. Context-specific independence in bayesian networks. In Uncertainty in Artificial Intelligence (UAI-96), pages 115–123, 1996.

    Google Scholar 

  • C. Cannings, E.A. Thompson, and H.H. Skolnick. Probability functions on complex pedigrees. Advances in Applied Probability, 10: 26–61, 1978.

    Article  MathSciNet  MATH  Google Scholar 

  • G.F. Cooper. Nestor: A computer-based medical diagnosis aid that integrates causal and probabilistic knowledge. Technical report, Computer Science department, Stanford University, Palo-Alto, California, 1984.

    Google Scholar 

  • M. Davis and H. Putnam. A computing procedure for quantification theory. Journal of the Association of Computing Machinery, 7(3), 1960.

    Google Scholar 

  • R. Dechter and J. Pearl. Network-based heuristics for constraint satisfaction problems. Artificial Intelligence, 34: 1–38, 1987.

    Article  MathSciNet  MATH  Google Scholar 

  • R. Dechter and J. Pearl. Tree clustering for constraint networks. Artificial Intelligence, pages 353–366, 1989.

    Google Scholar 

  • R. Dechter and I. Rish. Directional resolution: The davis-putnam procedure, revisited. In Principles of Knowledge Representation and Reasoning (КR-94), pages 134–145, 1994.

    Google Scholar 

  • R. Dechter and I. Rish. To guess or to think? hybrid algorithms for sat. In Principles of Constraint Programming (CP-96), 1996.

    Google Scholar 

  • R. Dechter and P. van Beek. Local and global relational consistency. In Principles and Practice of Constraint programming (CP-95), pages 240–257, 1995.

    Chapter  Google Scholar 

  • R. Dechter. Enhancement schemes for constraint processing: Backjumping, learning and cutset decomposition. Artificial Intelligence, 41: 273–312, 1990.

    Article  MathSciNet  Google Scholar 

  • R. Dechter. Constraint networks. Encyclopedia of Artificial Intelligence, pages 276–285, 1992.

    Google Scholar 

  • R. Dechter. Bucket elimination: A unifying framework for probabilistic inference algorithms. In Uncertainty in Artificial Intelligence (UAI-96), pages 211–219, 1996.

    Google Scholar 

  • R. Dechter. Topological parameters for time-space tradeoffs. In Uncertainty in Artificial Intelligence (UAI-96), pages 220–227, 1996.

    Google Scholar 

  • R. Dechter. Mini-buckets: A general scheme of generating approximations in automated reasoning. In Ijcai-97: Proceedings of the Fifteenth International Joint Conference on Artificial Intelligence, 1997.

    Google Scholar 

  • Y. El-Fattah and R. Dechter. An evaluation of structural parameters for probabilistic reasoning: results on benchmark circuits. In Uncertainty in Artificial Intelligence (UAI-96), pages 244–251, 1996.

    Google Scholar 

  • D. Geiger, T. Verma, and J. Pear. Identifying independence in bayesian networks. Networks, 20: 507–534, 1990.

    Article  MathSciNet  MATH  Google Scholar 

  • F.V. Jensen, S.L Lauritzen, and K.G. Olesen. Bayesian updating in causal probabilistic networks by local computation. Computational Statistics Quarterly, 4, 1990.

    Google Scholar 

  • U. Kjæaerulff. A computational scheme for reasoning in dynamic probabilistic networks. In Uncertainty in Artificial Intelligence (UAI-93), pages 121–149, 1993.

    Google Scholar 

  • S.L. Lauritzen and D.J. Spiegelhalter. Local computation with probabilities on graphical structures and their application to expert systems. Journal of the Royal Statistical Society, Series B, 50 (2): 157–224, 1988.

    MathSciNet  MATH  Google Scholar 

  • J. Pearl. Probabilistic Reasoningin Intelligent Systems. Morgan Kaufmann, 1988.

    Google Scholar 

  • Y. Peng and J.A. Reggia. Plausability of diagnostic hypothesis. In NationalConference on Artificial Intelligence (AAAI86), pages 140–145, 1986.

    Google Scholar 

  • Y. Peng and J.A. Reggia. A connectionist model for diagnostic problem solving, 1989.

    Google Scholar 

  • D. Poole. Probabilistic partial evaluation: Exploiting structure in probabilistic inference. In Ijcai-97: Proceedings of the Fifteenth International Joint Conference on Artificial Intelligence, 1997.

    Google Scholar 

  • S.K. Anderson R. D. Shachter and P. Solovitz. Global conditioning for probabilistic inference in belief networks. In Uncertainty in Artificial Intelligence (UAI-91), pages 514–522, 1991.

    Google Scholar 

  • B. D’Ambrosio R.D. Shachter and B.A. Del Favro. Symbolic probabilistic inference in belief networks. Automated Reasoning, pages 126 – 131, 1990.

    Google Scholar 

  • E. Santos. On the generation of alternative explanations with implications for belief revision. In Uncertainty in Artificial Intelligence (UAI-91), pages 339–347, 1991.

    Google Scholar 

  • R.D. Shachter. Evaluating influence diagrams. Operations Research, 34, 1986.

    Google Scholar 

  • R.D. Shachter. Probabilistic inference and influence diagrams. Operations Research, 36, 1988.

    Google Scholar 

  • R. D. Shachter. An ordered examination of influence diagrams. Networks, 20: 535–563, 1990.

    Article  MathSciNet  MATH  Google Scholar 

  • P.P. Shenoy. Valuation-based systems for bayesian decision analysis. Operations Research, 40: 463–484, 1992.

    Article  MathSciNet  MATH  Google Scholar 

  • S.E. Shimony and E. Charniack. A new algorithm for finding map assignments to belief networks. In P. Bonissone, M. Henrion, L. Kanal, and J. Lemmer ed., Uncertainty in Artificial Intelligence, volume 6, pages 185–193, 1991.

    Google Scholar 

  • J.A. Tatman and R.D. Shachter. Dynamic programming and influence diagrams. IEEE Transactions on Systems, Man, and Cybernetics, 1990.

    Google Scholar 

  • N.L. Zhang and D. Poole. Exploiting causal independence in bayesian network inference. Journal of Artificial Intelligence Research (JAIR), 1996.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 1998 Springer Science+Business Media Dordrecht

About this chapter

Cite this chapter

Dechter, R. (1998). Bucket Elimination: A Unifying Framework for Probabilistic Inference. In: Jordan, M.I. (eds) Learning in Graphical Models. NATO ASI Series, vol 89. Springer, Dordrecht. https://doi.org/10.1007/978-94-011-5014-9_4

Download citation

  • DOI: https://doi.org/10.1007/978-94-011-5014-9_4

  • Publisher Name: Springer, Dordrecht

  • Print ISBN: 978-94-010-6104-9

  • Online ISBN: 978-94-011-5014-9

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics