IbPRIA 2017: Pattern Recognition and Image Analysis pp 335-343 | Cite as
A Study of Prototype Selection Algorithms for Nearest Neighbour in Class-Imbalanced Problems
Abstract
Prototype Selection methods aim at improving the efficiency of the Nearest Neighbour classifier by selecting a set of representative examples of the training set. These techniques have been studied in situations in which the classes at issue are balanced, which is not representative of real-world data. Since class imbalance affects the classification performance, data-level balancing approaches that artificially create or remove data from the set have been proposed. In this work, we study the performance of a set of prototype selection algorithms in imbalanced and algorithmically-balanced contexts using data-driven approaches. Results show that the initial class balance remarkably influences the overall performance of prototype selection, being generally the best performances found when data is algorithmically balanced before the selection stage.
Keywords
kNN Imbalanced data Prototype selectionNotes
Acknowledgements
Work partially supported by the Spanish Ministerio de Economía y Competitividad through Project TIMuL (No. TIN2013-48152-C2-1-R supported by EU FEDER funds), the Spanish Ministerio de Educación, Cultura y Deporte through FPU program (AP2012–0939) and the Vicerrectorado de Investigación, Desarrollo e Innovación de la Universidad de Alicante through FPU program (UAFPU2014–5883).
References
- 1.Duda, R.O., Hart, P.E., Stork, D.G.: Pattern Classification, 2nd edn. Wiley, New York (2001)MATHGoogle Scholar
- 2.García, S., Luengo, J., Herrera, F.: Data Preprocessing in Data Mining. Intelligent Systems Reference Library, vol. 72. Springer, Heidelberg (2015)Google Scholar
- 3.García, S., Derrac, J., Cano, J., Herrera, F.: Prototype selection for nearest neighbor classification: taxonomy and empirical study. IEEE Trans. Pattern Anal. Mach. Intell. 34(3), 417–435 (2012)CrossRefGoogle Scholar
- 4.García, V., Sánchez, J., Mollineda, R.: An empirical study of the behavior of classifiers on imbalanced and overlapped data sets. In: Rueda, L., Mery, D., Kittler, J. (eds.) CIARP 2007. LNCS, vol. 4756, pp. 397–406. Springer, Heidelberg (2007). doi: 10.1007/978-3-540-76725-1_42 CrossRefGoogle Scholar
- 5.López, V., Fernández, A., García, S., Palade, V., Herrera, F.: An insight into classification with imbalanced data: empirical results and current trends on using data intrinsic characteristics. Inf. Sci. 250, 113–141 (2013)CrossRefGoogle Scholar
- 6.García, V., Salvador, J.S., Mollineda, R.A.: On the effectiveness of preprocessing methods when dealing with different levels of class imbalance. Knowl. Based Syst. 25(1), 13–21 (2012)CrossRefGoogle Scholar
- 7.Fernández, A., García, S., Herrera, F.: Addressing the classification with imbalanced data: open problems and new challenges on class distribution. In: Corchado, E., Kurzyński, M., Woźniak, M. (eds.) HAIS 2011. LNCS, vol. 6678, pp. 1–10. Springer, Heidelberg (2011). doi: 10.1007/978-3-642-21219-2_1 CrossRefGoogle Scholar
- 8.Rico-Juan, J.R., Iñesta, J.M.: New rank methods for reducing the size of the training set using the nearest neighbor rule. Pattern Recogn. Lett. 33(5), 654–660 (2012)CrossRefGoogle Scholar
- 9.Chawla, N.V., Bowyer, K.W., Hall, L.O., Kegelmeyer, W.P.: SMOTE: synthetic minority over-sampling technique. J. Artif. Intell. Res. 16, 321–357 (2002)MATHGoogle Scholar
- 10.Han, H., Wang, W.-Y., Mao, B.-H.: Borderline-SMOTE: a new over-sampling method in imbalanced data sets learning. In: Huang, D.-S., Zhang, X.-P., Huang, G.-B. (eds.) ICIC 2005. LNCS, vol. 3644, pp. 878–887. Springer, Heidelberg (2005). doi: 10.1007/11538059_91 CrossRefGoogle Scholar
- 11.Prati, R.C., Batista, G.E., Monard, M.C.: Data mining with imbalanced class distributions: concepts and methods. In: Proceedings of the 4th Indian International Conference on Artificial Intelligence, India, pp. 359–376 (2009)Google Scholar
- 12.Valero-Mas, J.J., Iñesta, J.M., Pérez-Sancho, C.: Onset detection with the user in the learning loop. In: Proceedings of the 7th International Workshop on Music and Machine Learning (MML), Barcelona, Spain (2014)Google Scholar
- 13.Calvo-Zaragoza, J., Valero-Mas, J.J., Rico-Juan, J.R.: Improving kNN multi-label classification in prototype selection scenarios using class proposals. Pattern Recogn. 48(5), 1608–1622 (2015)CrossRefGoogle Scholar