Converting a Naive Bayes Models with Multi-valued Domains into Sets of Rules

  • Bartłomiej Śnieżyński
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4080)


Nowadays, several knowledge representation methods are being used in knowledge based systems, machine learning, and data mining. Among them are decision rules and Bayesian networks. Both methods have specific advantages and disadvantages. A conversion method would allow to exploit advantages of both techniques. In this paper an algorithm that converts Naive Bayes models with multi-valued attribute domains into sets of rules is proposed. Experimental results show that it is possible to generate rule-based classifiers, which have relatively high accuracy and are simpler than original models.


Decision Rule Bayesian Network Medical Informatics Default Rule Bayesian Belief Network 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Heckerman, D.: Probabilistic interpretation for MYCIN’s uncertainty factors, pp. 167–196. North-Holland, Amsterdam (1986)Google Scholar
  2. 2.
    Heckerman, D.: An empirical comparison of three inference methods. In: Proceedings of the Fourth Workshop on Uncertainty in Artificial Intelligence, pp. 158–169. Association for Uncertainty in Artificial Intelligence, Mountain View, CA (1988)Google Scholar
  3. 3.
    Lucas, P., Janssens, A.: Development and validation of hepar, an expert system for the diagnosis of disorders of the liver and biliary tract. Medical Informatics 16, 259–270 (1991)CrossRefGoogle Scholar
  4. 4.
    Newell, A., Simon, H.: Human Problem Solving. Prentice-Hall, Englewood Cliffs (1972)Google Scholar
  5. 5.
    Sniezynski, B.: Converting a naive bayes model into a set of rules. In: Kłopotek, M., et al. (eds.) Intelligent Information Processing and Web Mining. Advances in Soft Computing. Springer, Heidelberg (2006) (accepted for publication)Google Scholar
  6. 6.
    Friedman, N., Geiger, D., Goldszmidt, M.: Bayesian network classifiers. Machine Learning 29, 131–163 (1997)MATHCrossRefGoogle Scholar
  7. 7.
    Buchanan, B., Shortliffe, H.: Rule-based expert systems: The MYCIN experiments of the Stanford heuristic programming project. Addison-Wesley, Reading (1984)Google Scholar
  8. 8.
    Newman, D., Hettich, S., Blake, C., Merz, C.: UCI repository of machine learning databases (1998)Google Scholar
  9. 9.
    Druzdzel, M.: A development environment for graphical decision-analytic models. In: Proc. of the 1999 Annual Symposium of the American Medical Informatics Association (AMIA 1999), Washington, D.C, p. 1206 (1999)Google Scholar
  10. 10.
    Lucas, P.: Certainty-factor-like structures in bayesian belief networks. Knowl.-Based Syst. 14, 327–335 (2001)CrossRefGoogle Scholar
  11. 11.
    Poole, D.: Probabilistic horn abduction and bayesian networks. Artificial Intelligence 64, 81–129 (1993)MATHCrossRefGoogle Scholar
  12. 12.
    Korver, M., Lucas, P.: Converting a rule-based expert system into a belief network. Medical Informatics 18, 219–241 (1993)CrossRefGoogle Scholar
  13. 13.
    Shwe, M., Middleton, B., Heckerman, D.E., Henrion, M., Horvitz, E.J., Lehmann, H., Cooper, G.F.: Probabilistic diagnosis using a reformulation of the INTERNIST-1/QMR knowledge base i: Probabilistic model and inference algorithms. Methods of Information in Medicine 30, 241–255 (1991)Google Scholar
  14. 14.
    Middleton, B., Shwe, M., Heckerman, D., Henrion, M., Horvitz, E., Lehmann, H., Cooper, G.: Probabilistic diagnosis using a reformulation of the INTERNIST-1/QMR knowledge base ii: Evaluation of diagnostic performance. Methods of Information in Medicine 30, 256–267 (1991)Google Scholar
  15. 15.
    van der Gaag, L.: Probability-based models for plausible reasoning. PhD thesis, University of Amsterdam (1990)Google Scholar
  16. 16.
    Quinlan, J.: C4.5: Programs for Machine Learning. Morgan Kaufmann, San Francisco (1993)Google Scholar
  17. 17.
    Michalski, R.S., Imam, I.: Learning problem-oriented decision structures from decision rules: The aqdt-2 system. In: Raś, Z.W., Zemankova, M. (eds.) ISMIS 1994. LNCS (LNAI), vol. 869, pp. 416–426. Springer, Heidelberg (1994)Google Scholar
  18. 18.
    Koller, D., Pfeffer, A.: Probabilistic frame-based systems. In: Proc. of 15th National Conference on Artificial Intelligence AAAI 1998, pp. 580–587 (1998)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Bartłomiej Śnieżyński
    • 1
  1. 1.Department of Computer ScienceAGH University of Science and TechnologyKrakowPoland

Personalised recommendations