Knowledge and Information Systems

, Volume 3, Issue 4, pp 491–512

Multivariate Discretization for Set Mining

  • Stephen D. Bay
Regular Paper

DOI: 10.1007/PL00011680

Cite this article as:
Bay, S. Knowledge and Information Systems (2001) 3: 491. doi:10.1007/PL00011680

Abstract.

Many algorithms in data mining can be formulated as a set-mining problem where the goal is to find conjunctions (or disjunctions) of terms that meet user-specified constraints. Set-mining techniques have been largely designed for categorical or discrete data where variables can only take on a fixed number of values. However, many datasets also contain continuous variables and a common method of dealing with these is to discretize them by breaking them into ranges. Most discretization methods are univariate and consider only a single feature at a time (sometimes in conjunction with a class variable). We argue that this is a suboptimal approach for knowledge discovery as univariate discretization can destroy hidden patterns in data. Discretization should consider the effects on all variables in the analysis and that two regions X and Y should only be in the same interval after discretization if the instances in those regions have similar multivariate distributions (FxFy) across all variables and combinations of variables. We present a bottom-up merging algorithm to discretize continuous variables based on this rule. Our experiments indicate that the approach is feasible, that it will not destroy hidden patterns and that it will generate meaningful intervals.

Keywords: Data mining; Multivariate discretization; Set mining

Copyright information

© Springer-Verlag London Limited 2001

Authors and Affiliations

  • Stephen D. Bay
    • 1
  1. 1.Department of Information and Computer Science, University of California, Irvine, California, USAUS