Annals of Operations Research

, Volume 271, Issue 2, pp 853–886 | Cite as

Multi-criteria ranking of corporate distress prediction models: empirical evaluation and methodological contributions

  • Mohammad Mahdi MousaviEmail author
  • Jamal Ouenniche
Original Research


Although many modelling and prediction frameworks for corporate bankruptcy and distress have been proposed, the relative performance evaluation of prediction models is criticised due to the assessment exercise using a single measure of one criterion at a time, which leads to reporting conflicting results. Mousavi et al. (Int Rev Financ Anal 42:64–75, 2015) proposed an orientation-free super-efficiency DEA-based framework to overcome this methodological issue. However, within a super-efficiency DEA framework, the reference benchmark changes from one prediction model evaluation to another, which in some contexts might be viewed as “unfair” benchmarking. In this paper, we overcome this issue by proposing a slacks-based context-dependent DEA (SBM-CDEA) framework to evaluate competing distress prediction models. In addition, we propose a hybrid cross-benchmarking-cross-efficiency framework as an alternative methodology for ranking DMUs that are heterogeneous. Furthermore, using data on UK firms listed on London Stock Exchange, we perform a comprehensive comparative analysis of the most popular corporate distress prediction models; namely, statistical models, under both mono criterion and multiple criteria frameworks considering several performance measures. Also, we propose new statistical models using macroeconomic indicators as drivers of distress.


Corporate distress prediction Performance criteria Performance measures Context-dependent data envelopment analysis Slacks-based measure 


  1. Agarwal, V., & Taffler, R. (2008). Comparing the performance of market-based and accounting-based bankruptcy prediction models. Journal of Banking & Finance, 32(8), 1541–1551.Google Scholar
  2. Altman, E. I. (1968). Financial ratios, discriminant analysis and the prediction of corporate bankruptcy. The Journal of Finance, 23(4), 589–609.Google Scholar
  3. Altman, E. I. (1973). Predicting railroad bankruptcies in America. The Bell Journal of Economics and Management Science, 4(1), 184.Google Scholar
  4. Altman, E. (1983). Corporate financial distress: A complete guide to predicting, avoiding and dealing with bankruptcy. New York: Wiley.Google Scholar
  5. Altman, E. I., Iwanicz-Drozdowska, M., Laitinen, E. K., & Suvas, A. (2017). Financial distress prediction in an international context: A review and empirical analysis of Altman’s Z-score model. Journal of International Financial Management & Accounting, 28(2), 131–171.Google Scholar
  6. Andersen, P. K. (1992). Repeated assessment of risk factors in survival analysis. Statistical Methods in Medical Research, 1(3), 297–315.Google Scholar
  7. Avkiran, N. K., & Cai, L. (2014). Identifying distress among banks prior to a major crisis using non-oriented super-SBM. Annals of Operations Research, 217(1), 31–53.Google Scholar
  8. Bahrammirzaee, A. (2010). A comparative survey of artificial intelligence applications in finance: artificial neural networks, expert system and hybrid intelligent systems. Neural Computing and Applications, 19(8), 1165–1195.Google Scholar
  9. Bandyopadhyay, A. (2006). Predicting probability of default of Indian corporate bonds: Logistic and Z-score model approaches. Journal of Risk Finance, 7(3), 255–272.Google Scholar
  10. Banker, R. D. (1984). Estimating most productive scale size using data envelopment analysis. European Journal of Operational Research, 17(1), 35–44.Google Scholar
  11. Banker, R. D., Charnes, A., & Cooper, W. W. (1984). Some models for estimating technical and scale inefficiencies in data envelopment analysis. Management Science, 30(9), 1078–1092.Google Scholar
  12. Banker, R. D., Cooper, W. W., Seiford, L. M., Thrall, R. M., & Zhu, J. (2004). Returns to scale in different DEA models. European Journal of Operational Research, 154(2), 345–362.Google Scholar
  13. Barboza, F., Kimura, H., & Altman, E. (2017). Machine learning models and bankruptcy prediction. Expert Systems with Applications, 83, 405–417.Google Scholar
  14. Basel Committee (1999). Principles for the management of credit risk. Basel Committee on Banking Supervision.Google Scholar
  15. Bauer, J., & Agarwal, V. (2014). Are hazard models superior to traditional bankruptcy prediction approaches? A comprehensive test. Journal of Banking & Finance, 40, 432–442.Google Scholar
  16. Beaver, W. H. (1966). Financial ratios as predictors of failure. Journal of Accounting Research, 4, 71–111.Google Scholar
  17. Beaver, W. H. (1968). Alternative accounting measures as predictors of failure. Accounting Review, 43(1), 113–122.Google Scholar
  18. Beck, N., Katz, J. N., & Tucker, R. (1998). Taking time seriously: Time-series-cross-section analysis with a binary dependent variable. American Journal of Political Science, 42, 1260–1288.Google Scholar
  19. Bharath, S. T., & Shumway, T. (2008). Forecasting default with the Merton distance to default model. The Review of Financical Studies, 21(3), 1339–1369.Google Scholar
  20. Bhimani, A., Gulamhussen, M. A., & Lopes, S. D. R. (2013). The role of financial, macroeconomic, and non-financial information in bank loan default timing prediction. European Accounting Review, 22(4), 739–763.Google Scholar
  21. Branch, B. (2002). The costs of bankruptcy: A review. International Review of Financial Analysis, 11(1), 39–57.Google Scholar
  22. Callejón, A. M., Casado, A. M., Fernández, M. A., & Peláez, J. I. (2013). A system of insolvency prediction for industrial companies using a financial alternative model with neural networks. International Journal of Computational Intelligence Systems, 6(1), 29–37.Google Scholar
  23. Campbell, J. Y., Hilscher, J., & Szilagyi, J. (2008). In search of distress risk. The Journal of Finance, 63(6), 2899–2939.Google Scholar
  24. Charalambous, C., Charitou, A., & Kaourou, F. (2000). Comparative analysis of artificial neural network models: Application in bankruptcy prediction. Annals of Operations Research, 99(1–4), 403–425.Google Scholar
  25. Charnes, A., Cooper, W. W., & Rhodes, E. (1978). Measuring the efficiency of decision making units. European Journal of Operational Research, 2(6), 429–444.Google Scholar
  26. Chava, S., & Jarrow, R. A. (2004). Bankruptcy prediction with industry effects. Review of Finance, 8(4), 537–569.Google Scholar
  27. Chen, L. S., Yen, M. F., Wu, H. M., Liao, C. S., Liou, D. M., Kuo, H. S., et al. (2005). Predictive survival model with time-dependent prognostic factors: Development of computer-aided SAS Macro program. Journal of Evaluation in Clinical Practice, 11(2), 181–193.Google Scholar
  28. Chen, M. Y. (2011). Bankruptcy prediction in firms with statistical and intelligent techniques and a comparison of evolutionary computation approaches. Computers & Mathematics with Applications, 62(12), 4514–4524.Google Scholar
  29. Chen, N., Ribeiro, B., & Chen, A. (2016). Financial credit risk assessment: A recent review. Artificial Intelligence Review, 45(1), 1–23.Google Scholar
  30. Cleary, S., & Hebb, G. (2016). An efficient and functional model for predicting bank distress: In and out of sample evidence. Journal of Banking & Finance, 64, 101–111.Google Scholar
  31. Collins, R. A., & Green, R. D. (1982). Statistical methods for bankruptcy forecasting. Journal of Economics and Business, 34(4), 349–354.Google Scholar
  32. Cooper, W. W., Seiford, L. M., & Tone, K. (2006). Introduction to data envelopment analysis and its uses. Berlin: Springer.Google Scholar
  33. Crapp, H. R., & Stevenson, M. (1987). Development of a method to assess the relevant variables and the probability of financial distress. Australian journal of management, 12(2), 221–236.Google Scholar
  34. Davydenko, S. A., Strebulaev, I. A., & Zhao, X. (2012). A market-based study of the cost of default. The Review of Financial Studies, 25(10), 2959–2999.Google Scholar
  35. du Jardin, P. (2015). Bankruptcy prediction using terminal failure processes. European Journal of Operational Research, 242(1), 286–303.Google Scholar
  36. Elkamhi, R., Ericsson, J., & Parsons, C. A. (2012). The cost and timing of financial distress. Journal of Financial Economics, 105(1), 62–81.Google Scholar
  37. Fare, R., Grosskopf, S., & Lovell, C. K. (1994). Production frontiers. Cambridge: Cambridge University Press.Google Scholar
  38. Fethi, M. D., & Pasiouras, F. (2010). Assessing bank efficiency and performance with operational research and artificial intelligence techniques: A survey. European Journal of Operational Research, 204(2), 189–198.Google Scholar
  39. Geng, R., Bose, I., & Chen, X. (2015). Prediction of financial distress: An empirical study of listed Chinese companies using data mining. European Journal of Operational Research, 241(1), 236–247.Google Scholar
  40. Gruber, M. J., & Warner, J. B. (1977). Bankruptcy costs: Some evidence. The Journal of Finance, 32(2), 337–347.Google Scholar
  41. Gupta, J., Gregoriou, A., & Healy, J. (2015). Forecasting bankruptcy for SMEs using hazard function: To what extent does size matter? Review of Quantitative Finance and Accounting, 45(4), 845–869.Google Scholar
  42. Hillegeist, S. A., Keating, E. K., Cram, D. P., & Lundstedt, K. G. (2004). Assessing the probability of bankruptcy. Review of Accounting Studies, 9(1), 5–34.Google Scholar
  43. Hosmer, D. W., Jr., & Lemeshow, S. (1999). Applied survival analysis: Regression modelling of time to event data. European Journal of Orthodontics, 25(21), 561–562.Google Scholar
  44. Huang, Z., Chen, H., Hsu, C.-J., Chen, W.-H., & Wu, S. (2004). Credit rating analysis with support vector machines and neural networks: A market comparative study. Decision Support Systems, Data Mining for Financial Decision Making, 37(4), 543–558.Google Scholar
  45. Jackson, R. H., & Wood, A. (2013). The performance of insolvency prediction and credit risk models in the UK: A comparative study. The British Accounting Review, 45(3), 183–202.Google Scholar
  46. Jiang, C., Wang, Z., Wang, R., & Ding, Y. (2017). Loan default prediction by combining soft information extracted from descriptive text in online peer-to-peer lending. Annals of Operations Research. Scholar
  47. Kerstens, K., & Eeckaut, P. V. (1999). Estimating returns to scale using non-parametric deterministic technologies: A new method based on goodness-of-fit. European Journal of Operational Research, 113(1), 206–214.Google Scholar
  48. Kim, H. J., Jo, N. O., & Shin, K. S. (2016). Optimization of cluster-based evolutionary undersampling for the artificial neural networks in corporate bankruptcy prediction. Expert Systems with Applications, 59, 226–234.Google Scholar
  49. Kim, M. H., & Partington, G. (2015). Dynamic forecasts of financial distress of Australian firms. Australian Journal of Management, 40(1), 135–160.Google Scholar
  50. Kou, G., Peng, Y., & Lu, C. (2014). MCDM approach to evaluating bank loan default models. Technological and Economic Development of Economy, 20(2), 292–311.Google Scholar
  51. Kumar, P. R., & Ravi, V. (2007). Bankruptcy prediction in banks and firms via statistical and intelligent techniques—A review. European Journal of Operational Research, 180(1), 1–28.Google Scholar
  52. Lane, W. R., Looney, S. W., & Wansley, J. W. (1986). An application of the Cox proportional hazards model to bank failure. Journal of Banking & Finance, 10(4), 511–531.Google Scholar
  53. Lennox, C. (1999). Identifying failing companies: A re-evaluation of the logit, probit and DA approaches. Journal of Economics and Business, 51(4), 347–364.Google Scholar
  54. Li, Z., Crook, J., & Andreeva, G. (2014). Chinese companies distress prediction: An application of data envelopment analysis. Journal of the Operational Research Society, 65(3), 466–479.Google Scholar
  55. Li, Z., Crook, J., & Andreeva, G. (2017). Dynamic prediction of financial distress using Malmquist DEA. Expert Systems with Applications, 80, 94–106.Google Scholar
  56. Liang, D., Lu, C. C., Tsai, C. F., & Shih, G. A. (2016). Financial ratios and corporate governance indicators in bankruptcy prediction: A comprehensive study. European Journal of Operational Research, 252(2), 561–572.Google Scholar
  57. Lo, A. W. (1986). Logit versus discriminant analysis: A specification test and application to corporate bankruptcies. Journal of Econometrics, 31(2), 151–178.Google Scholar
  58. Luoma, M., & Laitinen, E. K. (1991). Survival analysis as a tool for company failure prediction. Omega, 19(6), 673–678.Google Scholar
  59. Lyandres, E., & Zhdanov, A. (2013). Investment opportunities and bankruptcy prediction. Journal of Financial Markets, 16(3), 439–476.Google Scholar
  60. Maddala, G. S. (1986). Limited-dependent and qualitative variables in econometrics. Cambridge: Cambridge University Press.Google Scholar
  61. Martin, D. (1977). Early warning of bank failure: A logit regression approach. Journal of Banking & Finance, 1(3), 249–276.Google Scholar
  62. Meyer, P. A., & Pifer, H. W. (1970). Prediction of bank failures. The Journal of Finance, 25(4), 853–868.Google Scholar
  63. Mousavi, M. M., Ouenniche, J., & Xu, B. (2015). Performance evaluation of bankruptcy prediction models: An orientation-free super-efficiency DEA-based framework. International Review of Financial Analysis, 42, 64–75.Google Scholar
  64. Nam, C. W., Kim, T. S., Park, N. J., & Lee, H. K. (2008). Bankruptcy prediction using a discrete-time duration model incorporating temporal and macroeconomic dependencies. Journal of Forecasting, 27, 493–506.Google Scholar
  65. Neves, J. C., & Vieira, A. (2006). Improving bankruptcy prediction with Hidden Layer Learning Vector Quantization. European Accounting Review, 15, 253–271.Google Scholar
  66. Ohlson, J. A. (1980). Financial ratios and the probabilistic prediction of bankruptcy. Journal of Accounting Research, 18(1), 109–131.Google Scholar
  67. Ouenniche, J., & Tone, K. (2017). An out-of-sample evaluation framework for DEA with application in bankruptcy prediction. Annals of Operations Research, 254(1–2), 235–250.Google Scholar
  68. Ouenniche, J., Xu, B., & Tone, K. (2014). Relative performance evaluation of competing crude oil prices’ volatility forecasting models: a slacks-based super-efficiency DEA model. American Journal of Operations Research, 4(4), 235–245.Google Scholar
  69. Piesse, J., Lee, C. F., Kuo, H. C., & Lin, L. (2006). Corporate failure: Definitions, methods, and failure prediction models. In C. F. Lee & A. Lee (Eds.), Encyclopedia of finance (pp. 477–490). New York: Springer.Google Scholar
  70. Pindado, J., Rodrigues, L., & de la Torre, C. (2008). Estimating financial distress likelihood. Journal of Business Research, 61(9), 995–1003.Google Scholar
  71. Premachandra, I. M., Bhabra, G. S., & Sueyoshi, T. (2009). DEA as a tool for bankruptcy assessment: A comparative study with logistic regression technique. European Journal of Operational Research, 193(2), 412–424.Google Scholar
  72. Premachandra, I. M., Chen, Y., & Watson, J. (2011). DEA as a tool for predicting corporate failure and success: A case of bankruptcy assessment. Omega, 39(6), 620–626.Google Scholar
  73. Press, S. J., & Wilson, S. (1978). Choosing between logistic regression and discriminant analysis. Journal of the American Statistical Association, 73(364), 699–705.Google Scholar
  74. Reisz, A. S., & Perlich, C. (2007). A market-based framework for bankruptcy prediction. Journal of Financial Stability, 3(2), 85–131.Google Scholar
  75. Seiford, L. M., & Zhu, J. (2003). Context-dependent data envelopment analysis—measuring attractiveness and progress. Omega, 31(5), 397–408.Google Scholar
  76. Shin, K.-S., Lee, T. S., & Kim, H. (2005). An application of support vector machines in bankruptcy prediction model. Expert Systems with Applications, 28(1), 127–135.Google Scholar
  77. Shin, K.-S., & Lee, Y.-J. (2002). A genetic algorithm application in bankruptcy prediction modelling. Expert Systems with Applications, 23(3), 321–328.Google Scholar
  78. Shumway, T. (2001). Forecasting bankruptcy more accurately: A simple hazard model. Journal of Business, 74(1), 101–124.Google Scholar
  79. Sun, J., Fujita, H., Chen, P., & Li, H. (2017). Dynamic financial distress prediction with concept drift based on time weighting combined with Adaboost support vector machine ensemble. Knowledge-Based Systems, 120, 4–14.Google Scholar
  80. Taffler, R. J. (1984). Empirical models for the monitoring of UK corporations. Journal of Banking & Finance, 8(2), 199–227.Google Scholar
  81. Theodossiou, P. (1991). Alternative models for assessing the financial condition of business in Greece. Journal of Business Finance & Accounting, 18(5), 697–720.Google Scholar
  82. Tinoco, M. H., & Wilson, N. (2013). Financial distress and bankruptcy prediction among listed companies using accounting, market and macroeconomic variables. International Review of Financial Analysis, 30, 394–419.Google Scholar
  83. Tone, K. (2001a). On returns to scale under weight restrictions in data envelopment analysis. Journal of Productivity Analysis, 16(1), 31–47.Google Scholar
  84. Tone, K. (2001b). A slacks-based measure of efficiency in data envelopment analysis. European Journal of Operational Research, 130(3), 498–509.Google Scholar
  85. Trujillo-Ponce, A., Samaniego-Medina, R., & Cardone-Riportella, C. (2014). Examining what best explains corporate credit risk: Accounting-based versus market-based models. Journal of Business Economics and Management, 15, 253–276.Google Scholar
  86. Wilson, R. L., & Sharda, R. (1994). Bankruptcy prediction using neural networks. Decision Support Systems, 11(5), 545–557.Google Scholar
  87. Wu, J., & An, Q. (2013). Slacks-based measurement models for estimating returns to scale. International Journal of Information and Decision Sciences, 5(1), 25–35.Google Scholar
  88. Wu, Y., Gaunt, C., & Gray, S. (2010). A comparison of alternative bankruptcy prediction models. Journal of Contemporary Accounting & Economics, 6(1), 34–45.Google Scholar
  89. Yeh, C. C., Chi, D. J., & Hsu, M. F. (2010). A hybrid approach of DEA, rough set and support vector machines for business failure prediction. Expert Systems with Applications, 37(2), 1535–1541.Google Scholar
  90. Zhou, L. (2013). Performance of corporate bankruptcy prediction models on imbalanced dataset: The effect of sampling methods. Knowledge-Based Systems, 41, 16–25.Google Scholar
  91. Zhou, L., Lu, D., & Fujita, H. (2015). The performance of corporate financial distress prediction models with features selection guided by domain knowledge and data mining approaches. Knowledge-Based Systems, 85, 52–61.Google Scholar
  92. Zmijewski, M. E. (1984). Methodological issues related to the estimation of financial distress prediction models. Journal of Accounting Research, 22, 59–82.Google Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2018

Authors and Affiliations

  1. 1.Kean University, Wenzhou CampusWenzhouChina
  2. 2.University of Edinburgh, Business SchoolEdinburghUK

Personalised recommendations