Abstract
Classification datasets, which feature a skewed class distribution, are said to be class imbalance. Traditional methods favor the larger classes. We propose pairwise ranking as a method for imbalance classification so that learning compares pairs of observations from each class, and therefore both contribute equally to the decision boundary. In previous work, we suggested treating the binary classification as a ranking problem, followed by a threshold mapping to convert back the ranking score to the original classes. In this work, the method is extended to multi-class ordinal classification, and a new mapping threshold is proposed. Results are compared with traditional and ordinal SVMs, and ranking obtains competitive results.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Chawla, N.V., Bowyer, K.W., Hall, L.O., Philip Kegelmeyer, W.: SMOTE: synthetic minority over-sampling technique. J. Artif. Intell. Res. 16, 321–357 (2002)
Pérez-Ortiz, M., Gutiérrez, P.A., Hervás-Martínez, C., Yao, X.: Graph-based approaches for over-sampling in the context of ordinal regression. IEEE Trans. Knowl. Data Eng. 27(5), 1233–1245 (2015)
Domingos, P.: MetaCost: a general method for making classifiers cost-sensitive. In: Proceedings of the Fifth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, vol. 55, pp. 155–164 (1999)
Hanley, J.A., McNeil, B.J.: The meaning and use of the area under a receiver operating characteristic (roc) curve. Radiology 143(1), 29–36 (1982)
Liu, X.-Y., Jianxin, W., Zhou, Z.-H.: Exploratory undersampling for class imbalance learning. IEEE Trans. Syst. Man Cybern. 39(2), 539–550 (2009)
Cruz, R., Fernandes, K., Cardoso, J.S., Pinto Costa, J.F.: Tackling class imbalance with ranking. In: International Joint Conference on Neural Networks (IJCNN). IEEE (2016)
Herbrich, R., Graepel, T., Obermayer, K.: Support vector learning for ordinal regression a risk formulation for ordinal regression. In: Proceedings of the Ninth International Conference on Artificial Neural Networks, pp. 97–102 (1999)
Herbrich, R., Graepel, T., Obermayer, K.: Support vector learning for ordinal regression. In: Ninth International Conference on Artificial Neural Networks, ICANN 1999 (Conf. Publ. No. 470), vol. 1, pp. 97–102. IET (1999)
Chu, W., Keerthi, S.S.: New approaches to support vector ordinal regression. In: Proceedings of the 22nd International Conference on Machine Learning, pp. 145–152. ACM (2005)
Cardoso, J.S., Costa, J.F.: Learning to classify ordinal data: the data replication method. J. Mach. Learn. Res. 8, 1393–1429 (2007)
Cruz-Ramírez, M., Hervás-Martínez, C., Sánchez-Monedero, J., Gutiérrez, P.A.: Metrics to guide a multi-objective evolutionary algorithm for ordinal classification. Neurocomputing 135, 21–31 (2014)
Pinto, J.F., Costa, R.S., Cardoso, J.S.: An all-at-once unimodal SVM approach for ordinal classification. In: 2010 Ninth International Conference on Machine Learning and Applications (ICMLA), pp. 59–64. IEEE (2010)
Acknowledgment
This work was funded by the Project “NanoSTIMA: Macro-to-Nano Human Sensing: Towards Integrated Multimodal Health Monitoring and Analytics/NORTE-01-0145-FEDER-000016” financed by the North Portugal Regional Operational Programme (NORTE 2020), under the PORTUGAL 2020 Partnership Agreement, and through the European Regional Development Fund (ERDF), and also by Fundação para a Ciência e a Tecnologia (FCT) within PhD grant numbers SFRH/BD/122248/2016 and SFRH/BD/93012/2013.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Cruz, R., Fernandes, K., Pinto Costa, J.F., Ortiz, M.P., Cardoso, J.S. (2017). Ordinal Class Imbalance with Ranking. In: Alexandre, L., Salvador Sánchez, J., Rodrigues, J. (eds) Pattern Recognition and Image Analysis. IbPRIA 2017. Lecture Notes in Computer Science(), vol 10255. Springer, Cham. https://doi.org/10.1007/978-3-319-58838-4_1
Download citation
DOI: https://doi.org/10.1007/978-3-319-58838-4_1
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-58837-7
Online ISBN: 978-3-319-58838-4
eBook Packages: Computer ScienceComputer Science (R0)