Advertisement

Discretization Methods

  • Ying Yang
  • Geoffrey I. Webb
  • Xindong Wu
Chapter

Summary

Data-mining applications often involve quantitative data. However, learning from quantitative data is often less effective and less efficient than learning from qualitative data. Discretization addresses this issue by transforming quantitative data into qualitative data. This chapter presents a comprehensive introduction to discretization. It clarifies the definition of discretization. It provides a taxonomy of discretization methods together with a survey of major discretization methods. It also discusses issues that affect the design and application of discretization methods.

Key words

Discretization quantitative data qualitative data 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. An, A. and Cercone, N. (1999). Discretization of continuous attributes for learning classification rules. In Proceedings of the 3rd Pacific-Asia Conference on Methodologies for Knowledge Discovery and Data Mining, pages 509–514.Google Scholar
  2. Bay, S. D. (2000). Multivariate discretization of continuous variables for set mining. In Proceedings of the 6th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pages 315–319.Google Scholar
  3. Bluman, A. G. (1992). Elementary Statistics, A Step By Step Approach. Wm.C.Brown Publishers. page5-8.Google Scholar
  4. Catlett, J. (1991). On changing continuous attributes into ordered discrete attributes. In Proceedings of the European Working Session on Learning, pages 164–178.Google Scholar
  5. Chmielewski, M. R. and Grzymala-Busse, J. W. (1996). Global discretization of continuous attributes as preprocessing for machine learning. International Journal of Approximate Reasoning, 15:319–331.zbMATHCrossRefGoogle Scholar
  6. Dougherty, J., Kohavi, R., and Sahami, M. (1995). Supervised and unsupervised discretization of continuous features. In Proceedings of the 12th International Conference on Machine Learning, pages 194–202.Google Scholar
  7. Fayyad, U. M. and Irani, K. B. (1993). Multi-interval discretization of continuous-valued attributes for classification learning. In Proceedings of the 13th International Joint Conference on Artificial Intelligence, pages 1022–1027.Google Scholar
  8. Frank, E. andWitten, I. H. (1999). Making better use of global discretization. In Proceedings of the 16th International Conference on Machine Learning, pages 115–123. Morgan Kaufmann Publishers.Google Scholar
  9. Freitas, A. A. and Lavington, S. H. (1996). Speeding up knowledge discovery in large relational databases by means of a new discretization algorithm. In Advances in Databases, Proceedings of the 14th British National Conference on Databases, pages 124–133.Google Scholar
  10. Hsu, C.-N., Huang, H.-J., and Wong, T.-T. (2000). Why discretization works for naïve Bayesian classifiers. In Proceedings of the 17th International Conference on Machine Learning, pages 309–406.Google Scholar
  11. Hsu, C.-N., Huang, H.-J., and Wong, T.-T. (2003). Implications of the Dirichlet assumption for discretization of continuous variables in naive Bayesian classifiers. Machine Learning, 53(3):235–263.zbMATHCrossRefGoogle Scholar
  12. Ishibuchi, H., Yamamoto, T., and Nakashima, T. (2001). Fuzzy Data Mining: Effect of fuzzy discretization. In The 2001 IEEE International Conference on Data Mining.Google Scholar
  13. Kerber, R. (1992). Chimerge: Discretization for numeric attributes. In National Conference on Artificial Intelligence, pages 123–128. AAAI Press.Google Scholar
  14. Kohavi, R. and Sahami, M. (1996). Error-based and entropy-based discretization of continuous features. In Proceedings of the 2nd International Conference on Knowledge Discovery and Data Mining, pages 114–119.Google Scholar
  15. Macskassy, S. A., Hirsh, H., Banerjee, A., and Dayanik, A. A. (2001). Using text classifiers for numerical classification. In Proceedings of the 17th International Joint Conference on Artificial Intelligence.Google Scholar
  16. Mitchell, T. M. (1997). Machine Learning. McGraw-Hill Companies.Google Scholar
  17. Mora, L., Fortes, I., Morales, R., and Triguero, F. (2000). Dynamic discretization of continuous values from time series. In Proceedings of the 11th European Conference on Machine Learning, pages 280–291.Google Scholar
  18. Pazzani, M. J. (1995). An iterative improvement approach for the discretization of numeric attributes in Bayesian classifiers. In Proceedings of the 1st International Conference on Knowledge Discovery and Data Mining, pages 228–233.Google Scholar
  19. Quinlan, J. R. (1986). Induction of decision trees. Machine Learning, 1:81–106.Google Scholar
  20. Quinlan, J. R. (1993). C4.5: Programs for Machine Learning. Morgan Kaufmann Publishers.Google Scholar
  21. Rokach, L., Averbuch, M., and Maimon, O., Information retrieval system for medical narrative reports (pp. 217228). Lecture notes in artificial intelligence, 3055. Springer-Verlag (2004).Google Scholar
  22. Richeldi, M. and Rossotto, M. (1995). Class-driven statistical discretization of continuous attributes (extended abstract). In European Conference on Machine Learning, 335-338. Springer.Google Scholar
  23. Samuels, M. L. and Witmer, J. A. (1999). Statistics For The Life Sciences, Second Edition. Prentice-Hall. page10-11.Google Scholar
  24. Wu, X. (1995). Knowledge Acquisition from Databases. Ablex Publishing Corp.  Chapter 6.
  25. Wu, X. (1996). A Bayesian discretizer for real-valued attributes. The Computer Journal, 39(8):688–691.CrossRefGoogle Scholar
  26. Wu, X. (1999). Fuzzy interpretation of discretized intervals. IEEE Transactions on Fuzzy Systems, 7(6):753–759.CrossRefGoogle Scholar
  27. Yang, Y. (2003). Discretization for Naive-Bayes Learning. PhD thesis, School of Computer Science and Software Engineering, Monash University, Melbourne, Australia.Google Scholar
  28. Yang, Y. and Webb, G. I. (2001). Proportional k-interval discretization for naive-Bayes classifiers. In Proceedings of the 12th European Conference on Machine Learning, pages 564–575.Google Scholar
  29. Yang, Y. and Webb, G. I. (2002). Non-disjoint discretization for naive-Bayes classifiers. In Proceedings of the 19th International Conference on Machine Learning, pages 666–673.Google Scholar
  30. Yang, Y. and Webb, G. I. (2004). Discretization for naive-Bayes learning: Managing discretization bias and variance. Submitted for publication.Google Scholar

Copyright information

© Springer Science+Business Media, LLC 2009

Authors and Affiliations

  1. 1.School of Computer Science and Software EngineeringMonash UniversityMelbourneAustralia
  2. 2.Faculty of Information TechnologyMonash UniversityVictoriaAustralia
  3. 3.Department of Computer ScienceUniversity of VermontBurlingtonUSA

Personalised recommendations