Advertisement

Cost Sensitive Learning in the Presence of Symmetric Label Noise

  • Sandhya TripathiEmail author
  • Nandyala Hemachandra
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11439)

Abstract

In binary classification framework, we are interested in making cost sensitive label predictions in the presence of uniform/symmetric label noise. We first observe that 0–1 Bayes classifiers are not (uniform) noise robust in cost sensitive setting. To circumvent this impossibility result, we present two schemes; unlike the existing methods, our schemes do not require noise rate. The first one uses \(\alpha \)-weighted \(\gamma \)-uneven margin squared loss function, \(l_{\alpha , usq}\), which can handle cost sensitivity arising due to domain requirement (using user given \(\alpha \)) or class imbalance (by tuning \(\gamma \)) or both. However, we observe that \(l_{\alpha , usq}\) Bayes classifiers are also not cost sensitive and noise robust. We show that regularized ERM of this loss function over the class of linear classifiers yields a cost sensitive uniform noise robust classifier as a solution of a system of linear equations. We also provide a performance bound for this classifier. The second scheme that we propose is a re-sampling based scheme that exploits the special structure of the uniform noise models and uses in-class probability estimates. Our computational experiments on some UCI datasets with class imbalance show that classifiers of our two schemes are on par with the existing methods and in fact better in some cases w.r.t. Accuracy and Arithmetic Mean, without using/tuning noise rate. We also consider other cost sensitive performance measures viz., F measure and Weighted Cost for evaluation.

References

  1. 1.
    Dheeru, D., Karra Taniskidou, E.: UCI Machine Learning Repository (2017)Google Scholar
  2. 2.
    Elkan, C.: The foundations of cost-sensitive learning. In: International Joint Conference on Artificial Intelligence, vol. 17, pp. 973–978 (2001)Google Scholar
  3. 3.
    Ghosh, A., Manwani, N., Sastry, P.S.: Making risk minimization tolerant to label noise. Neurocomputing 160, 93–107 (2015)CrossRefGoogle Scholar
  4. 4.
    Manwani, N., Sastry, P.S.: Noise tolerance under risk minimization. IEEE Trans. Cybern. 43(3), 1146–1151 (2013)CrossRefGoogle Scholar
  5. 5.
    Masnadi-Shirazi, H., Vasconcelos, N.: Risk minimization, probability elicitation, and cost-sensitive SVMs. In: International Conference on Machine Learning, pp. 759–766 (2010)Google Scholar
  6. 6.
    Natarajan, N., Dhillon, I.S., Ravikumar, P., Tewari, A.: Cost-sensitive learning with noisy labels. J. Mach. Learn. Res. 18(155), 1–33 (2018)MathSciNetzbMATHGoogle Scholar
  7. 7.
    Natarajan, N., Dhillon, I.S., Ravikumar, P.K., Tewari, A.: Learning with noisy labels. In: Advances in Neural Information Processing Systems, pp. 1196–1204 (2013)Google Scholar
  8. 8.
    Patrini, G., Nielsen, F., Nock, R., Carioni, M.: Loss factorization, weakly supervised learning and label noise robustness. In: International Conference on Machine Learning, pp. 708–717 (2016)Google Scholar
  9. 9.
    Reid, M.D., Williamson, R.C.: Composite binary losses. J. Mach. Learn. Res. 11(Sep), 2387–2422 (2010)MathSciNetzbMATHGoogle Scholar
  10. 10.
    Scott, C.: Calibrated asymmetric surrogate losses. Electron. J. Stat. 6, 958–992 (2012)MathSciNetCrossRefGoogle Scholar
  11. 11.
    Sugiyama, M.: Superfast-trainable multi-class probabilistic classifier by least-squares posterior fitting. IEICE Trans. Inf. Syst. 93(10), 2690–2701 (2010)CrossRefGoogle Scholar
  12. 12.
    Sugiyama, M., Nakajima, S., Kashima, H., Buenau, P.V., Kawanabe, M.: Direct importance estimation with model selection and its application to covariate shift adaptation. In: Advances in Neural Information Processing Systems, pp. 1433–1440 (2008)Google Scholar
  13. 13.
    Van Rooyen, B., Menon, A., Williamson, R.C.: Learning with symmetric label noise: the importance of being unhinged. In: Advances in Neural Information Processing Systems, pp. 10–18 (2015)Google Scholar
  14. 14.
    Zhu, X., Wu, X., Khoshgoftaar, T.M., Shi, Y.: An empirical study of the noise impact on cost-sensitive learning. In: International Joint Conference on Artificial Intelligence, pp. 1168–1174 (2007)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.IEORIndian Institute of Technology BombayMumbaiIndia

Personalised recommendations