Foundation of Mining Class-Imbalanced Data
Mining class-imbalanced data is a common yet challenging problem in data mining and machine learning. When the class is imbalanced, the error rate of the rare class is usually much higher than that of the majority class. How many samples do we need in order to bound the error of the rare class (and the majority class)? If the misclassification cost of the class is known, can the cost-weighted error be bounded as well? In this paper, we attempt to answer those questions with PAC-learning. We derive several upper bounds on the sample size that guarantee the error on a particular class (the rare and majority class) and the cost-weighted error, with the consistent and agnostic learners. Similar to the upper bounds in traditional PAC learning, our upper bounds are quite loose. In order to make them more practical, we empirically study the pattern observed in our upper bounds. From the empirical results we obtain some interesting implications for data mining in real-world applications. As far as we know, this is the first work providing theoretical bounds and the corresponding practical implications for mining class-imbalanced data with unequal cost.
KeywordsPositive Error Cost Ratio Negative Error Class Imbalance Positive Class
Unable to display preview. Download preview PDF.
- 1.Asuncion, A., Newman, D.: UCI machine learning repository (2007), http://www.ics.uci.edu/~mlearn/mlrepository.html
- 4.Japkowicz, N.: Class imbalances: Are we focusing on the right issue? In: ICML-KDD 2003 Workshop: Learning from Imbalanced Data Sets (2003)Google Scholar
- 7.Ting, K.M.: The problem of small disjuncts: its remedy in decision trees. In: Proceeding of the Tenth Canadian Conference on Artificial Intelligence, pp. 91–97 (1994)Google Scholar
- 10.WEKA Machine Learning Project: Weka, http://www.cs.waikato.ac.nz/~ml/weka