Abstract
This article lays the groundwork for theprobabilistic multi-knowledge-base system (PMKBS), a new decision aid specifically tailored to the needs of a decision-maker faced with the derivation of a consensus diagnosis. In this article, we develop the PMKBS architecture in several ways. First, we define the basic problem that it addresses, and review the fundamental tools upon which it is based. Next, we describe its underlying theory, and explain how some general elicitation and modeling procedures form a viable design paradigm. Finally, we describe a small family of prototype PMKBSs that address problems related to pathologies of the lymph system, and evaluate their performance. Taken together, these discussions and prototypes demonstrate that the PMKBS architecture appears to be flexible, practical, and powerful.
Similar content being viewed by others
References
A. H. Bond and L. Gasser, eds.,Readings in Distributed Artificial Intelligence Morgan Kaufmann: San Mateo, CA, 1988.
L. Gasser and M. N. Huhns, eds.,Distributed Artificial Intelligence, vol. 2, Morgan Kaufmann: San Mateo, CA, 1989.
D. E. Heckerman, E. J. Horvitz, and B. N. Nathwani, “Toward normative expert systems: Part I. The Pathfinder project,”Meth. Inf. Med. vol. 31, pp. 90–105, 1992.
D. E. Heckerman and B. N. Nathwani, “An evaluation of the diagnostic accuracy of Pathfinder,”Computers Biomed. Res. vol. 25, pp. 56–74, 1992.
D. E. Heckerman and B. N. Nathwani, “Toward normative expert systems: Part II. Probability-based representations for efficient knowledge acquisition and inference,”Meth. Inf. Med. vol. 31, pp. 106–116, 1992.
D. B. Lenat and R. V. Guha,Building Large Knowledge-Based Systems: Representation and Inference in the CYC Project Addison-Wesley: Reading, MA, 1990.
J. H. Boose, “A knowledge acquisition program for expert systems based on personal construct psychology,”Int. J. Man-Machine Studies vol. 23, pp. 495–525, 1985.
J. H. Boose,Expertise Transfer for Expert System Design Elsevier: Amsterdam, 1986.
J. H. Boose, “Rapid acquisition and combination of knowledge from multiple experts in the same domain,”Future Comput. Syst. vol. 1, no. 2, pp. 191–216, 1986.
J. H. Boose and J. M. Bradshaw, “Expertise transfer and complex problems: Using AQUINAS as a knowledge acqusition workbench for expert systems,” inKnowledge-Based Systems: Knowledge Acquisition Tools for Expert Systems edited by J. H. Boose and B. R. Gaines, vol. 2, Academic Press: New York, pp. 39–64, 1988.
H. Raiffa,Decision Analysis: Introductory Lectures on Choices under Uncertainty Addison-Wesley: Reading, MA, 1968.
L. J. Savage,The Foundations of Statistics 2nd edition, Dover: New York, 1972.
F. Hayes-Roth, D. A. Waterman, and D. B. Lenat, editors,Building Expert Systems Addison-Wesley: Reading, MA, 1983.
D. A. Waterman,A Guide to Expert Systems Addison-Wesley: Reading, MA, 1986.
R. A. Howard and J. E. Matheson, editors,The Principles and Applications of Decision Analysis Strategic Decision Group: Menlo Park, CA, 1984.
L. J. Savage, “Elicitation of personal probabilities and expectations,”J. Am. Statist. Assoc. vol. 66, no. 336, pp. 783–801, 1971.
D. von Winterfeldt and W. Edwards,Decision Analysis and Behavioral Research Cambridge University Press: Cambridge, 1986.
C. Genest and J. V. Zidek, “Combining probability distributions: A critique and an annotated bibliography,”Statistical Sci. vol. 1, no. 1, pp. 114–148, 1986.
R. L. Winkler, “The consensus of subjective probability distribution,”Management Sci. vol. 15, no. 2, pp. B61-B75, 1968.
B. Abramson and A. J. Finizza, “Using belief networks to forecast oil prices,”Int. J. Forecasting vol. 7, no. 3, pp. 299–316, 1991.
S. Holtzman,Intelligent Decision Systems Addison-Wesley: Reading, MA, 1989.
E. J. Horvitz, J. S. Breese, and M. Henrion, “Decision theory in expert systems and artificial intelligence,”Int. J. Approx. Reasoning vol. 2, pp. 247–302, 1988.
S. L. Lauritzen and D. J. Spiegelhalter, “Local computations with probabilities on graphical structures and their applications to expert systems,”J. R. Statist. Soc. B vol. 50, no. 2, pp. 157–224, 1988.
J. Pearl,Probabilistic Reasoning in Intelligent Systems Morgan Kaufmann: San Mateo, CA, 1988.
R. F. Bordley, “A multiplicative formula for aggregation of individual probability assessments 39–64,”Management Sci. vol. 28, no. 10, pp. 1137–1148, 1982.
R. T. Clemen, “Combining forecasts: A review and annotated bibliography,”Int. J. Forecasting vol. 5, pp. 559–583, 1989.
N. C. Dalkey, “Towards a theory of group estimation,” inThe Delphi Method: Techniques and Applications edited by H. A. Limstone and M. Turoff, Addison-Wesley: Reading, MA, pp. 236–261, 1975.
S. French, “Group consensus probability distribution: A critical survey,” inBayesian Statistics 2 edited by J. M. Bernardo, M. H. DeGroot, D. V. Lindley, and A. F. M. Smith, Elsevier Science Publishers: Amsterdam, pp. 183–202, 1985.
C. W. J. Granger, “Combining forecasts—Twenty years later,”J. Forecasting vol. 8, pp. 167–173, 1989.
S. Makridakis, A. Andersen, R. Carbone, R. Fildes, M. Hibon, R. Lewandowski, J. Newton, E. Parsen, and R. L. Winkler, “The accuracy of extrapolation (time series) methods: Results of a forecasting competition,”J. Forecasting vol. 1, pp. 111–153, 1982.
P. A. Morris, “Decision analysis expert use,”Management Sci. vol. 20, no. 9, pp. 1233–1241, 1974.
M. Stone, “The opinion pool,”Ann. Math. Statist. vol. 32, pp. 1339–1342, 1961.
C. Baral, S. Kraus, and J. Minker, “Combining multiple knowledge bases,”IEEE Trans. Knowledge Data Eng. vol. 3, no. 2, pp. 208–220, 1991.
S. Mittal and C. L. Dym, “Knowledge acquisition from multiple experts,”The AI Mag. vol. 6, no. 2, pp. 32–36, 1985.
R. Reboh, “Extracting useful advice from conflicting expertise,” inProc. Eighth Int. Joint Conf. Artif. Intell. William Kaufmann: Los Altos, CA, 1983, pp. 145–150.
G. Kelly,The Psychology of Personal Construct Norton: New York, NY, 1985.
A. P. Massey and W. A. Wallace, “Focus groups as a knowledge elicitation technique: An exploratory study,”IEEE Trans. Knowledge Data Eng. vol. 3, no. 2, pp. 193–200, 1991.
K. L. McGraw and K. Harbison-Briggs,Knowledge Acquisition: Principles and Guidelines Prentice Hall: Englewood Cliffs, NJ, 1989.
V. Jagannathan and A. Elmaghraby, “MEDKAT: Multiple Expert Delphi-Based Knowledge Acqusition Tool,” Technical report, Engineering Mathematics and Computer Science Department, University of Louisville, Louisville, KY, 1985.
A. Trice and R. Davis, “Consensus knowledge acquisition,” Massachusetts Institute of Technology, Artificial Intelligence Laboratory, Technical Report AI Memo No. 1183, 1989.
K.-C. Ng. and B. Abramson, “Consensus diagnosis: A simulation study,”IEEE Trans. Syst. Man Cybernet. vol. 22, no. 5, pp. 916–928, 1992.
B. de Finetti, “Probabilities of probabilities: A real problem or a misunderstanding,” inNew Developments in the Applications of Bayesian Methods edited by A. Aykac and C. Brumat, North-Holland: Amsterdam, pp. 1–10, 1977.
D. E. Heckerman and H. Jimison, “A Bayesian perspective on confidence,” inUncertainty in Artificial Intelligence 3 edited by L. N. Kanal, T. S. Levitt, and J. F. Lemmer, Elsevier Science Publishers B.V. (North Holland): Amsterdam, pp. 149–160, 1989.
D. J. Spiegelhalter, “A statistical view of uncertainty in expert systems,” inArtificial Intelligence & Statistics edited by W. A. Gales, Addison-Wesley: Reading, MA, pp. 17–55, 1986.
H. P. Nii, “Blackboard systems: The blackboard model of problem solving and the evolution of blackboard architecture,”AI Mag. vol. 7, no. 2, pp. 38–53, 1986.
H. P. Nii, “Blackboard systems: Blackboard application systems, blackboard systems from a knowledge engineering perspective,”AI Mag. vol. 7, no. 3, pp. 82–106, 1986.
D. E. Heckerman,Probabilistic Similarity Networks MIT Press: Cambridge, MA, 1991.
K.-C. Ng,Probabilistic Multi-Knowledge-Base Systems: Automated Group Decision Making in Expert Systems Ph.D. thesis, Computer Science Department, University of Southern California, Los Angeles, CA, 1990.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Ng, KC., Abramson, B. Probabilistic multi-knowledge-base systems. Appl Intell 4, 219–236 (1994). https://doi.org/10.1007/BF00872110
Issue Date:
DOI: https://doi.org/10.1007/BF00872110