Ranking consistency of systemic risk measures: a simulation-based analysis in a banking network model

  • Peter GrundkeEmail author
Original Research


In a banking network model, I analyse the ranking consistency of common systemic risk measures (SRMs). In contrast to previous studies, this model-based analysis offers the advantage that the sensitivity of the ranking consistency with respect to bank and network characteristics can easily be checked. The employed network model accounts, among others, for bank insolvencies as well as illiquidities, stochastic dependencies of non-bank loans as well as of liquidity buffer assets across various banks, bank rating-dependent volumes of deposits and interbank liabilities, and the funding liquidity reducing effect of fire sales of other banks. Within the assumed banking network model, I find that, in general, the ranking consistency (measured by the rank correlation) of various SRMs is rather low. A further finding is that the ranking consistency can significantly vary in statistical terms, for example for an increasing correlation between the returns of the liquidity buffer assets across banks, an increasing volatility of these assets or an increasing default rate in the non-bank loan portfolios. However, forecasting which effect a specific change in parameters, bank behavior or network characteristics has on the ranking consistency of SRMs seems to be difficult because the sign of the effect can be different for different pairs of SRMs. Furthermore, the economic significance of these changes on the overall ranking consistency as measured by Kendall’s coefficient of concordance in general is rather low.


Banking network model Credit risk Funding risk Market risk Systemic risk 

JEL Classification

G01 G21 G28 



I thank Michael Abendschein for excellent research assistance. For helpful comments, I thank an anonymous reviewer, Matthias Bank, Jens Dick-Nielsen, Thomas Gehrig, Maria-Chiara Iannino, Alois Knobloch, Jochen Lawrenz, Andreas Pfingsten and Bernhard Schwetzler as well as participants of the annual meeting of the German Academic Association for Business Research in Munich 2016, the EUROFIDAI-AFFI Paris December Finance Meeting in 2016 and the workshop “Regulation as a factor of systemic risk” organized by the research group on ‘Financial Crisis’ of the Österreichische Forschungsgemeinschaft in Innsbruck 2016.

Supplementary material

11156_2018_732_MOESM1_ESM.doc (372 kb)
Supplementary material 1 (DOC 371 kb)


  1. Abendschein M, Grundke P (2017) On the ranking consistency of global systemic risk measures: empirical evidence. Working paper, Osnabrück UniversityGoogle Scholar
  2. Acemoglu D, Ozdaglar A, Tahbaz-Salehi A (2015) Systemic risk and stability in financial networks. Am Econ Rev 105(2):564–608CrossRefGoogle Scholar
  3. Acharya VV, Engle R, Richardson M (2012) Capital shortfall: a new approach to ranking and regulation systemic risk. Am Econ Rev 102(3):59–64CrossRefGoogle Scholar
  4. Acharya VV, Engle R, Pierret D (2014) Testing macroprudential stress tests: the risk of regulatory risk weights. J Monet Econ 65:36–53CrossRefGoogle Scholar
  5. Acharya VV, Pedersen LH, Philippon T, Richardson M (2017) Measuring systemic risk. Rev Financ Stud 30(1):2–47CrossRefGoogle Scholar
  6. Adrian T, Brunnermeier MK (2016) CoVaR. Am Econ Rev 106(7):1705–1741CrossRefGoogle Scholar
  7. Aikman D, Alessandri P, Eklund B, Gai P, Kapadia S, Martin E, Mora N, Sterne G, Willison M (2011) Funding liquidity risk in a quantitative model of systemic stability. In: Alfaro R (ed) Financial stability, monetary policy, and central banking, Santiago, Chile: Central Bank of Chile (Series on central banking, analysis, and economic policies, 15), pp 371–410Google Scholar
  8. Alexander C (2008) Market risk analysis, volume II, practical financial econometrics. Wiley, ChichesterGoogle Scholar
  9. Allen F, Gale D (2000) Financial contagion. J Polit Econ 108(1):1–33CrossRefGoogle Scholar
  10. Barnhill T, Schumacher L (2014) Modeling correlated systemic bank liquidity risks. In: Ong LL (ed) A guide to IMF stress testing. Methods and models, IMF, Washington DC, pp 123–133Google Scholar
  11. Basel Committee on Banking Supervision (BCBS) (2013) Global systemically important banks: updated assessment methodology and the higher loss absorbency requirement. July, Bank for International SettlementsGoogle Scholar
  12. Battiston S, Gatti DD, Gallegati M, Greenwald B, Stiglitz JE (2012a) Default cascades: When does risk diversification increase stability? J Financ Stab 8(3):138–149CrossRefGoogle Scholar
  13. Battiston S, Gatti DD, Gallegati M, Greenwald B, Stiglitz JE (2012b) Liaisons dangereuses: increasing connectivity, risk sharing, and systemic risk. J Econ Dyn Control 36(8):1121–1141CrossRefGoogle Scholar
  14. Battiston S, Puliga M, Kaushik R, Tasca P, Caldarelli G (2012c) DebtRank: too central to fail? Financial networks, the FED and systemic risk. Sci Rep. Google Scholar
  15. Battiston S, Caldarelli G, D’Errico M, Gurciullo S (2016) Leveraging the network: a stress-test framework based on DebtRank. Working paperGoogle Scholar
  16. Baxamusa M, Javaid S, Harery K (2015) Network centrality and mergers. Rev Quant Financ Acc 44:393–423CrossRefGoogle Scholar
  17. Benoit S, Colletaz G, Hurlin C, Pérignon C (2013) A theoretical and empirical comparison of systemic risk measures. Working paperGoogle Scholar
  18. Benoit S, Colliard J-E, Hurlin C, Pérignon C (2017) Where the risks lie: a survey on systemic risk. Rev Financ 21(1):109–152CrossRefGoogle Scholar
  19. Bisias D, Flood M, Lo AW, Valavanis S (2012) A survey of systemic risk analytics. Ann Rev Financ Econ 4(1):255–296CrossRefGoogle Scholar
  20. Blasques F, Bräuning F, van Lelyveld I (2015) A dynamic network model of the unsecured interbank lending market. Bank for International Settlements, BIS Working papers No. 491Google Scholar
  21. Brownlees C, Engle R (2017) SRISK: a conditional capital shortfall index for systemic risk measurement. Rev Financ Stud 30(1):48–79CrossRefGoogle Scholar
  22. Brownlees C, Chabot B, Ghysels E, Kurz C (2015) Backtesting systemic risk measures during historical bank runs. Federal Reserve Bank of Chicago WP 2015-09Google Scholar
  23. Chinazzi M, Fagiolo G (2015) Systemic risk, contagion, and financial networks: a survey. Working paperGoogle Scholar
  24. Cifuentes R, Ferrucci G, Shin HS (2005) Liquidity risk and contagion. J Eur Econ Assoc 3(2–3):556–566CrossRefGoogle Scholar
  25. Craig B, von Peter G (2014) Interbank tiering and money center banks. J Financ Intermed 23(3):322–347CrossRefGoogle Scholar
  26. Danielsson J, James K, Valenzuela M, Zer I (2016a) Model risk of risk models. J Financ Stab 23:79–91CrossRefGoogle Scholar
  27. Danielsson J, James K, Valenzuela M, Zer I (2016b) Can we prove a bank guilty of creating systemic risk? A minority report. J Money Credit Bank 48(4):795–812CrossRefGoogle Scholar
  28. Dias JG, Ramos SB (2014) The aftermath of the subprime crisis: a clustering analysis of world banking sector. Rev Quant Financ Acc 42:293–308CrossRefGoogle Scholar
  29. Dobrić J, Schmid F (2005) Nonparametric estimation of the lower tail dependence λL in bivariate copulas. J Appl Stat 32(4):387–407CrossRefGoogle Scholar
  30. Domikowsky C, Kaposty F, Pfingsten A (2015) Market discipline, deposit insurance, and competetive advantages: evidence from the financial crisis. Working paperGoogle Scholar
  31. Döring B, Wewel C, Hartmann-Wendels T (2016) Systemic risk measures and their viability for banking supervision. Working paperGoogle Scholar
  32. Eisenberg L, Noe TH (2001) Systemic risk in financial systems. Manag Sci 47(2):236–249CrossRefGoogle Scholar
  33. Elliott M, Golub B, Jackson MO (2014) Financial networks and contagion. Am Econ Rev 104(10):3115–3153CrossRefGoogle Scholar
  34. Engle R, Jondeau E, Rockinger M (2015) Systemic risk in Europe. Rev Financ 19(1):145–190CrossRefGoogle Scholar
  35. Eng-Uthaiwat H (2017) Stock market return predictability: does network topology matter? Rev Quant Financ Acc. Google Scholar
  36. Fink K, Krüger U, Meller B, Wong LH (2014) BSLoss—a comprehensive measure for interconnectedness. Working paperGoogle Scholar
  37. Freixas X, Parigi B, Rochet JC (2000) Systemic risk, interbank relations and liquidity provision by the central bank. J Money Credit Bank 32:611–638CrossRefGoogle Scholar
  38. Frey R, Hledik J (2014) Correlation and contagion as sources of systemic risk. Working paperGoogle Scholar
  39. Gai P, Kapadia S (2010) Contagion in financial networks. Proc Royal Soc 466:2401–2423CrossRefGoogle Scholar
  40. Gai P, Haldane A, Kapadia S (2011) Complexity, concentration and contagion. J Monet Econ 58(5):453–470CrossRefGoogle Scholar
  41. Georg C-P (2013) The effect of the interbank network structure on contagion and common shocks. J Bank Financ 37(7):2216–2228CrossRefGoogle Scholar
  42. Giglio S, Kelly BT, Pruitt S (2016) Systemic risk and the macroeconomy: an empirical evaluation. J Financ Econ 119(3):457–471CrossRefGoogle Scholar
  43. Girardi G, Ergün AT (2013) Systemic risk measurement: multivariate GARCH estimation of CoVaR. J Bank Financ 37(8):3169–3180CrossRefGoogle Scholar
  44. Glasserman P, Young HP (2015) How likely is contagion in financial networks? J Bank Financ 50:383–399CrossRefGoogle Scholar
  45. Gravelle T, Li F (2013) Measuring systemic importance of financial institutions: an extreme value theory approach. J Bank Financ 37(7):2196–2209CrossRefGoogle Scholar
  46. Grundke P, Tuchscherer M (2017) Global systemic risk measures and their forecasting power for systemic events. Working paper, Osnabrück UniversityGoogle Scholar
  47. Huang X, Zhou H, Haibin Z (2012) Systemic risk contributions. J Financ Serv Res 42:55–83CrossRefGoogle Scholar
  48. Hurd TR, Cellai D, Cheng H, Melnik S, Shao Q (2014) Illiquidity and insolvency: a double cascade model of financial crisis. Working paperGoogle Scholar
  49. In’t Veld D, van Lelyveld I (2014) Finding the core: network structure in interbank markets. J Bank Financ 49(1):27–40CrossRefGoogle Scholar
  50. Iori G, Jafarey S, Padilla FG (2006) Systemic risk on the interbank market. J Econ Behav Organ 61(4):525–542CrossRefGoogle Scholar
  51. Jiang C (2012) Does tail dependence make a difference in the estimation of systemic risk? ΔCoVaR and MES. Working paperGoogle Scholar
  52. Kendall M, Gibbons JD (1990) Rank correlation methods, 5th edn. Oxford University Press, New YorkGoogle Scholar
  53. Krause A, Giansante S (2012) Interbank lending and the spread of bank failures: a network model of systemic risk. J Econ Behav Organ 83(3):583–608CrossRefGoogle Scholar
  54. Lin EMH, Sun EW, Yu M-T (2018) Systemic risk, financial markets, and performance of financial institutions. Ann Oper Res 262:579–603CrossRefGoogle Scholar
  55. Löffler G, Raupach P (2018) Pitfalls in the use of systemic risk measures. J Financ Quant Anal 53(7):269–298CrossRefGoogle Scholar
  56. López-Espinosa G, Moreno A, Rubia A, Valderrama L (2012) Short-term wholesale funding and systemic risk: a global CoVaR approach. J Bank Financ 36(12):3150–3162CrossRefGoogle Scholar
  57. López-Espinosa G, Moreno A, Rubia A, Valderrama L (2015) Systemic risk and asymmetric responses in the financial industry. J Bank Financ 58:471–485CrossRefGoogle Scholar
  58. Merton RC (1974) On the pricing of corporate debt: the risk structure of interest rates. J Financ 29(2):449–470Google Scholar
  59. Nucera F, Schwaab B, Koopmann SJ, Lucas A (2016) The information in systemic risk rankings. J Empir Financ 38:461–475CrossRefGoogle Scholar
  60. Roukny T, Bersini H, Pirotte H, Caldarelli G, Battiston S (2013) Default cascades in complex networks: topology and systemic risk. Sci Rep. Google Scholar
  61. Schmidt R, Stadtmüller U (2006) Nonparametric estimation of tail dependence. Scand J Stat 33(2):307–335CrossRefGoogle Scholar
  62. Trapp M, Wewel C (2013) Transatlantic systemic risk. J Bank Financ 37(11):4241–4255CrossRefGoogle Scholar
  63. Vasicek OA (1987) Probability of loss on loan portfolio. KMV, San FranciscoGoogle Scholar
  64. Vasicek OA (2002) Loan portfolio value. Risk 15(12):160–162Google Scholar
  65. Weiß GNF, Bostandzic D, Neumann S (2014a) What factors drive systemic risk during international financial crisis? J Bank Financ 41(4):78–96CrossRefGoogle Scholar
  66. Weiß GNF, Neumann S, Bostandzic D (2014b) Systemic risk and bank consolidation: international evidence. J Bank Financ 40(3):165–181CrossRefGoogle Scholar
  67. Wong E, Hui C-H (2011) A liquidity risk stress-testing framework with interaction between market and credit risks. Working paper, Hong Kong Monetary AuthorityGoogle Scholar
  68. Zhang Q, Vallascas F, Keasey K, Cai CX (2015) Are market-based measures of global systemic importance of financial institutions useful to regulators and supervisors? J Money Credit Bank 47(7):1403–1442CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2018

Authors and Affiliations

  1. 1.Chair of Banking and Finance, Osnabrück UniversityOsnabrückGermany

Personalised recommendations