Skip to main content
Log in

A classification problem of credit risk rating investigated and solved by optimisation of the ROC curve

  • Original Paper
  • Published:
Central European Journal of Operations Research Aims and scope Submit manuscript

Abstract

Estimation of probability of default has considerable importance in risk management applications where default risk is referred to as credit risk. Basel II (Committee on Banking Supervision) proposes a revision to the international capital accord that implies a more prominent role for internal credit risk assessments based on the determination of default probability of borrowers. In our study, we classify borrower firms into rating classes with respect to their default probability. The classification of firms into rating classes necessitates the finding of threshold values separating the rating classes. We aim at solving two problems: to distinguish the defaults from non-defaults, and to put the firms in an order based on their credit quality and classify them into sub-rating classes. For using a model to obtain the probability of default of each firm, Receiver Operating Characteristics (ROC) analysis is employed to assess the distinction power of our model. In our new functional approach, we optimise the area under the ROC curve for a balanced choice of the thresholds; and we include accuracy of the solution into the program. Thus, a constrained optimisation problem on the area under the curve (or its complement) is carefully modelled, discretised and turned into a penalized sum-of-squares problem of nonlinear regression; we apply the Levenberg–Marquardt algorithm. We present numerical evaluations and their interpretations based on real-world data from firms in the Turkish manufacturing sector. We conclude with a discussion of structural frontiers, parametrical and computational features, and an invitation to future work.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Adams R (1999) Calculus: a complete course. Addison-Wesley, Longman

  • Akteke-Öztürk B (2010) New approaches to desirability functions by nonsmooth and nonlinear optimization. PhD. thesis at Institute of Applied Mathematics of METU, Ankara

  • Akteke-Öztürk B, Koksal G, Weber GW (2010) Optimization of desirability functions as a DNLP model by GAMS/BARON in the proceedings of PCO 2010, 3rd global conference on power control and optimization. Gold Coast, Queensland, Australia. ISBN:978-983-44483-1-8

  • Akyüz S (2009) A contribution of statistical learning and continuous optimization using infinite and semi infinite programming to computational statistics. Dissertation, Middle East Technical University, Ankara

  • Aster A, Borchers B, Thurber C (2004) Parameter estimation and inverse problems. Academic Press, New York

    Google Scholar 

  • Bain LJ, Engelhardt M (1992) Introduction to probability and mathematical statistics. PWS-KENT Publishers, Boston

    Google Scholar 

  • Bank B, Guddat J, Klatte D, Kummer B, Tammer K (1983) Non-linear parametric optimization. Birkhauser, Basel, Boston

    Google Scholar 

  • Breiman L, Friedman JH, Olshen R, Stone C (1998) Classification and regression trees. Chapman & Hall, New York

    Google Scholar 

  • Hastie T, Tibshirani R, Friedman JH (2001) The element of statistical learning. Springer, New York

    Google Scholar 

  • Hermann GA, Herrera N, Sugiura HT (1982) Comparison of interlaboratory survey data in terms of ROC indices. J Nucl Med 23: 525–531

    Google Scholar 

  • Hopley L, Schalkwyk JV (2001) The magnificent ROC. http://www.anaesthetist.com/mnm/stats/roc/Findex.htm

  • Hosmer DW, Lemeshow S Jr Jr (2000) Applied logistic regression. Wiley, New York

    Book  Google Scholar 

  • Indiana University, Stat/Math Center (2006) http://www.indiana.edu/~statmath/stat/all/cdvm/cdvm1.html

  • Kalyanmov D (2001) Multi-objective optimization using evolutionary algorithms. Wiley, New York

    Google Scholar 

  • Korn R, Baydar E (2006) Workshop on credit rating in view of Basel II. Fraunhofer Institute for Industrial Mathematics, University of Kaiserslautern, Germany

    Google Scholar 

  • Krommer AR, Ueberhuber WC (1998) Computational integration. SIAM, Philadelphia

    Book  Google Scholar 

  • Levenberg K (1944) A method for the solution of certain non-linear problems in Least Squares. Appl Math 2: 164–168

    Google Scholar 

  • Marquardt D (1963) An algorithm for Least-Squares estimation of nonlinear parameters. SIAM J Appl Math 11(2): 431–441

    Article  Google Scholar 

  • Maubach JM (2004) Course notes. Eindhoven University of Technology, Netherlands. http://www.win.tue.nl/~maubach/university/education/lectures/2n330/lectures/integration/integration.pdf

  • Metz CE, Herman BA, Shen JH (1998) Maximum likelihood estimation of ROC curves from continuously-distributed data. Stat Med 17: 1033–1053

    Article  Google Scholar 

  • Müller M (2004) Course notes. Generalized linear models. Fraunhofer Institute for Industrial Mathematics (ITWM), Kaiserslautern, Germany. http://www.marlenemueller.de/publications/HandbookCS.pdf

  • Nash G, Griva I, Sofer A (2011) Linear and nonlinear programming. McGraw-Hill, New York

    Google Scholar 

  • National Institute of Standards and Technology, Information Technology Laboratory, Statistical Engineering (2003) e-Handbook of Statistical Methods. http://www.itl.nist.gov/div898/handbook/pmd/section1/pmd142.htm

  • Özmen A, Weber GW, Batmaz I (2010) The new robust CMARS (RCMARS) method. In: 24th mini EURO conference on continuous optimization and information-based technologies in the financial sector, MEC EurOPT2010, Selected papers, ISI proceedings. Izmir, Turkey, pp 362–368, June 23–June 26

  • Polyak R, Griva I (2004) Primal-dual nonlinear rescaling method for convex optimization. J Optim Theory Appl 122(1): 111–156

    Article  Google Scholar 

  • Ranganathan A (2004) The Levenberg-Marquardt algorithm. Technical report. http://www.scribd.com/doc/10093320/Levenberg-Marquardt-Algorithm

  • Silvia EM (1999) Riemann-Stieltjes integration. Technical report, One Shields Avenue, University of California Davis

  • Tang TC, Chi LC (2005) Predicting multilateral trade credit risks: comparisons of Logit and Fuzzy Logic models using ROC curve analysis. Expert Syst Appl 28: 547–556

    Article  Google Scholar 

  • Taylan P, Weber GW, Beck A (2007) New approaches to regression by generalized additive models and continuous optimization for modern applications in finance, science and technology. Optimization 56: 1–24

    Article  Google Scholar 

  • Taylan P, Weber GW (2008) Organization in finance prepared by stochastic differential equations with additive and nonlinear models and continuous optimization. Organizacija (Organ J Manag Inf Syst Hum Resour) 41: 185–193

    Google Scholar 

  • Taylan P, Weber GW, Yerlikaya F (2008) Continuous optimization applied in MARS for modern applications in finance, science and technology. In: ISI proceedings of 20th mini-EURO conference. Neringa, Lithuania, pp 317–322

  • Ueberhuber WC (1997) Numerical computation: methods, software, and analysis. Springer, New York

    Google Scholar 

  • Vasisht AK (2007) Logit and probit analysis. Technical report, Indian Agricultural Statistics Research Institute, (IASRI), Library Avenue, New Delhi, 110 012. http://www.iasri.res.in/ebook/EBADAT/index.htm (Module VI- Sect. 6.5)

  • Zemcov A, Barclay LL, Sansone J, Metz C (1985) Receiver operating characteristic analysis of regional cerebral blood flow in Alzheimer’ s disease. J Nucl Med 26: 1002–1010

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Efsun Kürüm.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Kürüm, E., Yildirak, K. & Weber, GW. A classification problem of credit risk rating investigated and solved by optimisation of the ROC curve. Cent Eur J Oper Res 20, 529–557 (2012). https://doi.org/10.1007/s10100-011-0224-5

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10100-011-0224-5

Keywords

Navigation