Abstract
Naive Bayes is a well known and studied algorithm both in statistics and machine learning. Bayesian learning algorithms represent each concept with a single probabilistic summary. In this paper we present an iterative approach to naive Bayes. The iterative Bayes begins with the distribution tables built by the naive Bayes. Those tables are iteratively updated in order to improve the probability class distribution associated with each training example. Experimental evaluation of Iterative Bayes on 25 benchmark datasets shows consistent gains in accuracy. An interesting side effect of our algorithm is that it shows to be robust to attribute dependencies.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
C. Blake, E. Keogh, and C.J. Merz. UCI repository of Machine Learning databases, 1999.
Carla E. Brodley and Paul E. Utgoff. Multivariate decision trees. Machine Learning, 19:45–77, 1995.
Pedro Domingos and Michael Pazzani. On the optimality of the simple bayesian classifier under zero-one loss. Machine Learning, 29:103–129, 1997.
J. Dougherty, R. Kohavi, and M. Sahami. Supervised and unsupervised discretization of continuous features. In A. Prieditis and S. Russel, editors, Machine Learning Proc. of 12th International Conference. Morgan Kaufmann, 1995.
R.O. Duda and P.E. Hart. Pattern Classification and scene analysis. New York, Willey and Sons, 1973.
George John. Enhancements to the data mining process. PhD thesis, Stanford University, 1997.
R. Kohavi. Scaling up the accuracy of naive bayes classifiers: a decision tree hybrid. In Proceedings of the 2nd International Conference on Knowledge Discovery and Data Mining. AAAI Press, 1996.
Ron Kohavi and David H. Wolpert. Bias plus variance decomposition for zero-one loss functions. In L. Saitta, editor, Machine Learning, Proceedings of the 13th International Conference. Morgan Kaufmann, 1996.
I. Kononenko. Semi-naive bayesian classifier. In Y. Kodratoff, editor, European Working Session on Learning-EWSL91. LNAI 482 Springer Verlag, 1991.
P. Langley. Induction of recursive bayesian classiffers. In P. Brazdil, editor, Machine Learning: ECML-93. LNAI 667, Springer Verlag, 1993.
D. Michie, D.J. Spiegelhalter, and C. Taylor. Machine Learning, Neural and Statistical Classification. Ellis Horwood, 1994.
Tom Mitchell. Machine Learning. MacGraw-Hill Companies, Inc., 1997.
Brian D. Ripley. Pattern Recognition and Neural Networks. Cambridge University Press, 1996.
G. Webb and M. Pazzani. Adjusted probability naive bayesian induction. In 11th Australian Joint Conference on Artificial Intelligence. World Scientific, 1998.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1999 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Gama, J. (1999). Iterative Naive Bayes. In: Arikawa, S., Furukawa, K. (eds) Discovery Science. DS 1999. Lecture Notes in Computer Science(), vol 1721. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-46846-3_8
Download citation
DOI: https://doi.org/10.1007/3-540-46846-3_8
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-66713-1
Online ISBN: 978-3-540-46846-2
eBook Packages: Springer Book Archive