Encyclopedia of Database Systems

Living Edition
| Editors: Ling Liu, M. Tamer Özsu

Bayesian Classification

Living reference work entry
DOI: https://doi.org/10.1007/978-1-4899-7993-3_556-2



In classification, the objective is to build a classifier that takes an unlabeled example and assigns it to a class. Bayesian classification does this by modeling the probabilistic relationships between the attribute set and the class variable. Based on the modeled relationships, it estimates the class membership probability of the unseen example.

Historical Background

The foundation of Bayesian classification goes back to Reverend Bayes himself [2]. The origin of Bayesian belief nets can be traced back to [15]. In 1965, Good [4] combined the independence assumption with the Bayes formula to define the Naïve Bayes Classifier. Duda and Hart [14] introduced the basic notion of Bayesian classification and the naïve Bayes representation of joint distribution. The modern treatment and development of Bayesian belief networks is attributed to Pearl [8]. Heckerman [13] later reformulated the Bayes results and defined the probabilistic similarity networks...


Bayesian Network Directed Acyclic Graph Credit Risk Home Owner Bayesian Classifier 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
This is a preview of subscription content, log in to check access.


  1. 1.
    Aggarwal JK, Ghosh J, Nair D, Taha I. A comparative study of three paradigms for object recognition – Bayesian statistics, neural networks, and expert systems. In: Advances in image understanding: a festschrift for Azriel Rosenfeld. Washington, DC: IEEE Computer Society Press; 1996. p. 241–62.Google Scholar
  2. 2.
    Bayes T. An essay towards solving a problem in the doctrine of chances. Philos Trans R Soc. 1763;53:370–418.MathSciNetCrossRefMATHGoogle Scholar
  3. 3.
    Domingos P, Pazzani M. Beyond independence: conditions for the optimality of the simple Bayesian classifier. In: Proceedings of the 13th international conference on machine learning. 1996. p. 105–12.Google Scholar
  4. 4.
    Duda RO, Hart PE. Pattern classification and scene analysis. New York: Wiley; 1973.MATHGoogle Scholar
  5. 5.
    Dumais S, Platt J, Heckerman D, Sahami M. Inductive learning algorithms and representations for text categorization. In: Proceedings of the international conference on information and knowledge management. 1998.Google Scholar
  6. 6.
    Friedman N, Geiger D, Goldszmidt M. Bayesian network classifiers. Mach Learn. 1997;29:131–63.CrossRefMATHGoogle Scholar
  7. 7.
    Good IJ. The estimation of probabilities: an essay on modern Bayesian methods. Cambridge, MA: MIT Press; 1965.MATHGoogle Scholar
  8. 8.
    Heckerman D. Probabilistic similarity networks. ACM doctoral dissertation award series. MIT Press, Cambridge, MA, 1991.Google Scholar
  9. 9.
    Jaeger M. Probabilistic classifiers and the concepts they recognize. In: Proceedings of the 20th international conference on machine learning. 2003. p. 266–73.Google Scholar
  10. 10.
    Jensen FV. An introduction to Bayesian networks. New York: Springer; 1996.Google Scholar
  11. 11.
    Keogh E, Pazzani M. Learning augmented Bayesian classifiers: a comparison of distribution-based and classification-based approaches. In: Proceedings of the 7th international workshop on artificial intelligence and statistics. 1999.Google Scholar
  12. 12.
    Kononenko I, Bratko I, Kukar M. Application of machine learning to medical diagnosis. Machine learning, data mining and knowledge discovery: methods and applications. New York: Wiley; 1998.Google Scholar
  13. 13.
    Langley P, Iba W, Thompson K. An analysis of Bayesian classifiers. In: Proceedings of the 10th national conference on Artificial Intelligence. 1992. p. 3–8.Google Scholar
  14. 14.
    Pearl J. Probabilistic reasoning in intelligenet systems: networks of plausible inference. San Mateo: Morgan Kaufmann; 1988.Google Scholar
  15. 15.
    Wright S. Correlation and causation. J Agric Res. 1921;20(7):557–85.Google Scholar

Copyright information

© Springer Science+Business Media New York 2016

Authors and Affiliations

  1. 1.National University of SingaporeSingaporeSingapore