Skip to main content
Log in

A survey of techniques for inference under uncertainty

  • Published:
Artificial Intelligence Review Aims and scope Submit manuscript

Abstract

The field of automated inference under uncertainty is too large and too young for elegant, unified presentation. We present, rather, a discussion of the principal techniques under some broad classifications. For the most important or least known techniques, we present, as appendices, introductory tutorials in order to give the reader some idea of the basic methods involved; other techniques we describe more briefly. First, after this introduction, we must cover some basic terms and philosophical ideas.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Chang, C. C. & Keisler, H. J. (1973) Model Theory, Amsterdam, North Holland.

    Google Scholar 

  • Cheeseman, P. (1985) ‘In Defense of Probability’, Proceedings of the Ninth International Conference on Artificial Intelligence, pp. 1002–1009.

  • Cohen, P. R. (1985) Heuristic reasoning about uncertainty: an Artificial Intelligence approach. Pitman, Boston.

    Google Scholar 

  • Cordier, M.-O. (1988) Discussion of Dubois & Prade, 1988, pp. 315–318.

  • DeKleer, J. (1986) ‘An Assumption-Based TMS’, Artificial Intelligence, 28, pp. 127–224.

    Google Scholar 

  • DeKleer, J. & Williams, B. (1986) ‘Back to Backtracking: Controlling the ATMS’, AAAI-86, pp. 910–917.

  • Dempster, A. P. (1967) ‘Upper and Lower Probabilities Induced By A Multivalued Mapping’, Annals of Mathematical Statistics, 38, 325–339.

    Google Scholar 

  • Dempster, A. P. (1968) A generalization of Bayesian Inference, Journal of the Royal Statistical Society B, 30, 205–247.

    Google Scholar 

  • Doyle, J. (1983) ‘Methodological Simplicity In Expert System Construction: The Case of Judgments and Reasoned Assumptions’, The AI Magazine, 39–43.

  • Dressler, O. (1989) ‘An Extended Basic ATMS’. In Non-Monotonic Reasoning (eds M. Reinfrank et al.), pp. 143–163, Second International Workshop, Grassan, FRG, Springer-Verlag.

    Google Scholar 

  • Dubois, D. & Prade, H. (1985) ‘Combination and Propagation of Uncertainty With Belief Functions’, Proceedings of The Ninth International Joint Conference On Artificial Intelligence, pp. 111–113.

  • Dubois, D. & Prade, H. (1988) ‘An Introduction to Possibilistic and Fuzzy Logics’. In Non-Standard Logics for Automated Reasoning (eds P. Smets et al.), Academic Press, London.

    Google Scholar 

  • Etherington, D. (1987) ‘Formalizing Non-Monotonic Reasoning Systems’, Artificial Intelligence, 31, 41–87.

    Google Scholar 

  • Fine, T. (1973) Theories of Probabilities, Academic Press.

  • Gödel (1931) ‘Uber formal unentscheidbare Sätze der Principia Mathematica und verwand ter Systeme I’, Monatsh. Math. Phys., 38, 173–198.

    Google Scholar 

  • Griffiths, D., Mamdani, E. H. & Efstathiou, H. J. (1985) ‘Expert Systems and Fuzzy Logic’. In ‘CDC Volume On Fuzzy Sets and Decision Analysis’ (ed. J. Bezdek), Marseilles.

  • Haack, S. (1974) Deviant Logics: Some Philosophical Issues, Cambridge University Press, Cambridge.

    Google Scholar 

  • Heckerman, D. (1986) ‘Probabilistic Interpretations for MYCIN's Certainty Factors. In Uncertainty in Artificial Intelligence, (eds L. N. Kanal & J. F. Lemmer), pp. 167–196, North Holland.

  • Horvitz, Eric & Heckerman, D. (1986) ‘The Inconsistent Use of Measures of Uncertainty. In Uncertainty in Artificial Intelligence, (eds L. N. Kanal & J. F. Lemmer) pp. 137–151, North Holland.

  • Hughes, G. E. & Cresswell, M. J. (1972) An Introduction To Modal Logic. Methuen & Co., London.

    Google Scholar 

  • Kyburg, H. (1987) ‘Bayesian & Non-Bayesian Evidential Updating’, Artificial Intelligence, 31, 271–294.

    Google Scholar 

  • Kyburg, H. (1988) ‘Probabilistic Inference and Probabilistic Reasoning’. The Fourth Workshop on Uncertainty in Artificial Intelligence, pp. 221–244. The University of Minnesota.

  • Lewis, C. I. (1912) ‘Implication and the Algebra of Logic’, Mind, 21, 522–531.

    Google Scholar 

  • McAllester, D. (1980) ‘An Outlook On Truth Maintenance’, Artificial Intelligence Laboratory, AIM-551, MIT, Cambridge, MA.

    Google Scholar 

  • McCarthy, J. (1986) ‘Applications of Circumscription to Formalizing Common-Sense Reasoning’, Artificial Intelligence, 28, pp. 89–116.

    Google Scholar 

  • McDermott, D. V. & Doyle, J. (1980) ‘Non-Monotonic Logic I’, Artificial Intelligence, 13, 27–40.

    Google Scholar 

  • Moore (1988) ‘Auto-Epistemic Logic’. In Non-Standard Logics for Automated Reasoning (eds P. Smets et al.), Academic Press.

  • Nilsson, N. J. (1986) ‘Probabilistic Logic’, Artificial Intelligence, 28, 71–87.

    Google Scholar 

  • Pang, D., Bigham, J. & Mamdani, E. H. (1987) ‘Reasoning with Uncertain Information’, IEEE Proceedings, 134, Part D.

  • Pearl, J. (1986) ‘Fusion, Propagation, and Structure in Belief Networks’, Artificial Intelligence, 29, 241–288.

    Google Scholar 

  • Poole, D. (1988) ‘A Logical Framework for Default Reasoning’, Artificial Intelligence, 36, 27–48.

    Google Scholar 

  • Provan, G. M. (1987) ‘Efficiency Analysis of Multiple-Context TMSs in Scene Representation’, AAAI-87, I, 173–177.

    Google Scholar 

  • Quine, Willard van Orman (1953) ‘Reference & Modality’. In From a Logical Point of View, Harvard University Press.

  • Quinlan, J. R. (1983) ‘Inferno: A Cautious Approach to Uncertain Inference’, Computer Journal, 26, 255–269.

    Google Scholar 

  • Reiter, R. & deKleer, J. (1987) ‘Foundations of Assumption-Based TMSs’, AAAI-87, pp. 183–188.

  • Rescher, N. (1964) Hypothetical Reasoning, North-Holland.

  • Savage, L. J. (1961) ‘The Foundations of Statistics Reconstructed’. In Studies in Subjective Probability (ed. H. E. Kyburg), Wiley.

  • Shafer, G. (1976) A Mathematical Theory of Evidence, Princeton.

  • Shafer, G. (1982) ‘Belief Functions and Parametric Models’, Journal of the Royal Statistical Society B, 44, 322–352.

    Google Scholar 

  • Sheridan, F. (1988a) ‘Rankings for the ATMS: Heuristically-Guided Search for a Few Interpretations (Using the ATMS to Scan Homer)’, internal report, Department of Electrical Engineering, Queen Mary College, University of London.

  • Sheridan, F. (1988b) ‘Pencils and Cntradictions’. Discussion of Dubois & Prade, 1988, pp. 315–318.

  • Shortliffe, E. H. & Buchanan, B. G. (eds) (1984) Rule-Based Expert Systems: The MYCIN Experiment of the Stanford Heuristic Programming Project, Addison Wesley.

  • Shortliffe, E. H. & Buchanan, B. G. (1975) ‘A Model of Inexact Reasoning In Medicine’, Mathematical Biosciences, 23, 351–379.

    Google Scholar 

  • Siegel, P. & Besnard, P. (1988) ‘The Preferential Models Approach to Non-Monotonic Logics’. In Non-Standard Logics for Automated Reasoning, (eds P. Smets et al.), Academic Press.

  • Smets, P., Mamdani, E. H. et al. (1988) Non-Standard Logics for Automated Reasoning, Academic Press.

  • Snow, P. (1986) ‘Bayesian Inference without Point Estimates’, AAAI-86, pp. 233–237.

  • Williams, P. M. (1978) ‘On a New Theory of Epistemic Probability’, British Journal for the Philosophy of Science, 29, 375–387.

    Google Scholar 

  • Yu, V. L. et al. (1979) An Evaluation of MYCIN's Advice. Rule-Based Expert Systems: The MYCIN Experiment of the Stanford Heuristic Programming Project, (eds E. H. Shortliffe & B. G. Buchanan) Chapter 31, Addison-Wesley.

Further Reading

  • Barnett, J. A. (1981) ‘Computational methods for a mathematical theory of evidence’, Proceedings of the 7th International Conference On Artificial Intelligence, pp. 868–875.

  • Bundy, A. (1986) ‘Correctness Criteria of Some Algorithms for Uncertain Reasoning Using Incidence Calculus’, Journal of Automated Reasoning, 2, 109–126.

    Google Scholar 

  • Clark, D. A. (1989) Numerical and Symbolic Approaches to Uncertainty Management in Artificial Intelligence: a Review and Discussion. Technical Report, Imperial Cancer Research Fund.

  • Cohen, P. R. & Grinberg, M. R. (1983) ‘A Framework for Heuristic Reasoning About Uncertainty’, Proceedings of the Eighth International Conference On Artificial Intelligence, pp. 355–357.

  • DeKleer, J. & Williams, B. (1986b) ‘Reasoning about Multiple Faults’, AAAI-86, pp. 132–139.

  • Dixon, M. & Johan DeKleer, J. (1989) ‘Massively Parallel Assumption-Based Truth Maintenance’. In Non-Monotonic Reasoning (eds M. Reinfrank et al.) pp. 131–132. Second International Workshop, Grassan, FRG, Springer-Verlag.

    Google Scholar 

  • Doyle, J. (1979) ‘A Truth Maintenance System’. Artificial Intelligence, 12, 231–272.

    Google Scholar 

  • Dressler, O. (1986) ‘Assumption-Based Truth Maintenance’. In Proceedings TMS Workshp - Berlin (ed. H. Stoyan) Springer-Verlag Informatik Fachberichte 162.

  • Duda, R. O., Hart, P. E. & Nilsson, N. J. (1976) ‘Subjective Bayesian Methods For Rule-Based Inference Systems’, AFIPS Conference Proceedings, pp. 1075–1082.

  • Fine, T. (1973) Theories of Probabilities, Academic Press.

  • Fox, J. (1985) ‘Three Arguments for Extending The Framework of Probability’, Proceedings of Workshop on Artificial Intelligence and Decision Making, AAAI, Los Angeles.

  • Friedman, L. (1981) ‘Reasoning By Plausible Inference’, Proceedings of The 5th Conference On Automated Deduction, pp. 126–142.

  • Garvey, T. D., Lowrance, J. & Fischler, M. A. (1982) ‘An Inference Technique For Integrating Knowledge From Disparate Sources’, Proceedings of The 7th International Joint Conference On Artificial Intelligence, pp. 319–325.

  • Ginsberg, M. L. (1984) ‘Non-Monotonic Reasoning Using Dempster's Rule’, Proceedings of The National Conference On Artificial Intelligence, pp. 126–129.

  • Gordon, J. & Shortliffe, E. H. (1985) ‘A Method for Managing Evidential Reasoning In A Hierarchical Hypothesis Space’, Artificial Intelligence, 26, 323–357.

    Google Scholar 

  • Ishizuka, M., Fu, K. S. & Yao, J. T. P. (1981) ‘A Theoretical Treatment of Certainty Factor In Production Systems’, Structural Engineering Report, Purdue University, Ce-Str-81-6.

  • Lewis, D. K. (1985) Probabilities of Conditional and Conditional Probabilities, Philosophy Review, 297–315.

  • McCarthy, J. (1980) ‘Circumscription, a Form of Non-Monotonic Reasoning’, Artificial Intelligence, 13, 27–39.

    Google Scholar 

  • Paris, J. B. & Vencovská, A. (1990) ‘On the Applicability of Maximum Entropy to Inexact Reasoning’, International Journal of Approximate Reasoning, 3, pp. 1–34 (reviewed in Mathematical Reviews, 90b:03031).

    Google Scholar 

  • Pearl, J. (1988) Probabilistic reasoning in intelligence systems: networks of plausible inference, Morgan Kaufmann Publishers, Palo Alto.

    Google Scholar 

  • Pednault, E. P. D., Zucker, S. W. & Muresan, L. V. (1981) ‘On The Independence Assumption Underlying Subjective Bayesian Updating’. Artificial Intelligence, 16, 213–222.

    Google Scholar 

  • Polya, G. (1954) Patterns of Plausible Inference, Princeton University Press, Princeton.

    Google Scholar 

  • Ramsey, F. P. (1960) ‘Truth and Probability’. In The Foundations of Mathematics and Other Logical Essays (ed. R. B. Braithwaite). The Humanities Press, New York.

    Google Scholar 

  • Reiter, J. (1981) A1/X: An Inference System For Probabilistic Reasoning, M.Sc. Thesis, Department of Computer Science, University of Illinois At Urbana at Champaign.

  • Reiter, R. (1980) ‘A Logic for Default Reasoning’, Artificial Intelligence, 13, pp. 81–132.

    Google Scholar 

  • Saffiotti, A. (1988) ‘An Artificial Intelligence View of the Treatment of Uncertainty’, Knowledge Engineering Review, 2, 2.

    Google Scholar 

  • Smets, P. (1986) ‘Bayes’ Theorem Generalized For Belief Functions, Université Libre De Bruxelles, Belgium.

    Google Scholar 

  • Sullivan, M. & Cohen, P. R. (1985) ‘An Endorsement-Based Plan Recognition Program’, Proceedings of The Ninth International Joint Conference on Artificial Intelligence, pp. 475–2479.

  • Touretzky, D. S. (1984) ‘Implicit Ordering of Defaults in Inheritance Systems’, Proceedings of The National Conference On Artificial Intelligence, pp. 322–325.

  • Turner, R. (1984) Logics For Artificial Intelligence, Ellis Horwood Series In Artificial Intelligence.

  • Tversky, A. & Kahneman, D. (1974) ‘Judgment Under Uncertainty: Heuristics and Biases’, Science, 185, 1124–1131.

    Google Scholar 

  • Yager, R. R. (1982) Generalized Probabilities of Fuzzy Events From Fuzzy Belief Structures, Information Sciences, 28, 45–62.

    Google Scholar 

  • Zadeh, L. A. (1979) ‘On The Validity of Dempster's Rule of Combination of Evidence, Electronics Research Laboratory Memorandum UCB/Erl M79/24, University of California, Berkeley.

    Google Scholar 

  • Zadeh, L. A. (1984) AI Magazine, 5, 81–83.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Sheridan, F.K.J. A survey of techniques for inference under uncertainty. Artif Intell Rev 5, 89–119 (1991). https://doi.org/10.1007/BF00129537

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF00129537

Keywords

Navigation