Skip to main content

Advertisement

Log in

Testing for Systemic Risk Using Stock Returns

  • Published:
Journal of Financial Services Research Aims and scope Submit manuscript

Abstract

The literature proposes several stock return-based measures of systemic risk but does not include a classical hypothesis tests for detecting systemic risk. Using a joint null hypothesis of Gaussian returns and the absence of systemic risk, we develop a hypothesis test statistic to detect systemic risk in stock returns data. We apply our tests on conditional value-at-risk (CoVaR) and marginal expected shortfall (MES) estimates of the 50 largest US financial institutions using daily stock return data between 2006 and 2007. The CoVaR test identifies only one institution as systemically important while the MES test identifies 27 firms including some of the financial institutions that experienced distress in the past financial crisis. We perform a simulation analysis to assess the reliability of our proposed test statistics and find that our hypothesis tests have weak power, especially tests using CoVaR. We trace the power issue to the inherent variability of the nonparametric CoVaR and MES estimators that have been proposed in the literature. These estimators have large standard errors that increase as the tail dependence in stock returns strengthens.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2

Similar content being viewed by others

Notes

  1. These papers include: Acharya et al. (2010), (2012), and Brownlees and Engle (2012). While these studies define firm-level systemic risk measures, Allen et al. (2012) introduce an aggregate systemic risk measure for the financial sector. See Flood et al. (2012) for a recent survey of this literature. Kupiec (2012) or Benoit et al. (2012) provide a critical assessment.

  2. As defined and estimated in Adrian and Brunnermeier (2011).

  3. As defined and estimated in Acharya et al. (2010).

  4. See, for example, the discussions in Blancher et al. (2013), or the Financial Stability Board (2011).

  5. Longin and Solnik (2001) also use a Gaussian null hypothesis and a Wald test to assess the statistical significance of the association between international stocks in the extreme tails of the return distributions.

  6. A full discussion of the SRISK measure and SRISK hypothesis test statistic are postponed until Section 6.

  7. That is, the estimator does not assume a parametric distribution for stock returns.

  8. We have also done the analysis using the CRSP value-weighted portfolio as the reference portfolio and our conclusions are unchanged.

  9. Our definition of MES is the negative of the MES definition in Acharya et al. (2010). They calculate the conditional expectation of –Rm in the definition of MES to make the measure positive. We modify this by taking the expectation of +Rm so that both MES and ΔCoVaR have comparable signs in the test statistics and the analysis throughout the paper.

  10. Hausman (1978) Theorem 2.1 and 2.2. This test is also developed in Greene (2012, p. 275).

  11. See Girardi and Ergun (2013) and Jiang (2012) for an analysis of the characteristics of alternative parametric estimators of MES and CoVaR systemic risk measures.

  12. See the discussion in Kmenta (1971), p. 159–160.

  13. For example, in a stylized model of a macro economy with multiple sectors, Acemoglu et al. (2015) show that, when an economy is “balanced”, Gaussian microeconomic shocks (sector shocks) will aggregate into Gaussian macro-level shocks. A balanced economy is one in which no single sector has an outsized influence in generating aggregate economic output. When an economy is unbalanced, microeconomic shocks in a few key firms (or sectors) may cause extremely large aggregate shocks.

  14. The threshold of comparison is the sampling distributions of the ΔCoVaR and MES estimators when returns do not exhibit systemic risk.

  15. Adrian and Brunnermeier (Sept 15, 2011), p. 15, Eq. (9).

  16. While we do not provide a theoretical proof, we have performed extensive Monte Carlo simulations that strongly suggest that \( {\widehat{b}}_2\left(\varDelta CoVaR\right)-{\widehat{b}}_1\left(\varDelta CoVaR\right) \), and \( {\widehat{b}}_2(MES)-{\widehat{b}}_1(MES) \) both have sampling distributions that are approximately normal when stock returns are Gaussian. Because these random variables are approximately normally distributed, bootstrap resampling provides consistent estimators for \( Var\left({\widehat{b}}_2\left(\varDelta CoVaR\right)-{\widehat{b}}_1\left(\varDelta CoVaR\right)\right) \) and \( Var\left({\widehat{b}}_2(MES)-{\widehat{b}}_1(MES)\right) \) See Horowitz (2001) for further discussion.

  17. We obtain quantitatively similar ∆CoVaR and MES estimates when we use the CRSP value-weighted index as the reference portfolio. The correlation between statistics based on equal-weighted and value-weighted references portfolios is 0.85 for ∆CoVaR and 0.93 for MES. When we sort the firms based on the magnitude of ∆CoVaR and MES measured against the CRSP value-weighted portfolio return the ranking remains similar.

  18. We obtained similar levels of test statistics when we estimated the variance terms with 250 or 500 bootstrap repetitions.

  19. When returns are Gaussian the percentage should be compared to the confidence level of the test, i.e., 0.10, 0.05, and 0.01 respectively.

  20. Carr et al. (2002) and Singleton and Wingender (1986) also report negative skewness of market returns and positive skewness of firm returns.

  21. A way to mitigate the power issue could be to employ intraday returns in the estimation of systemic risk proxies. As a result, the number of return series used in the estimation will increase and the nonparametric estimators can become more efficient. For instance, Zhang, Zhou, and Zhu (2009) show that volatility measures based on high-frequency tick data can better explain the likelihood of tail events, such as default probabilities. A caveat of this approach is that trading noise in tick data might adversely bias the systemic risk estimates.

  22. Consider the distribution of market return Rm conditional on the firm return, Rj; Rm | { Rj < X }. If we scale the conditioning variable Rj by firm size the new distribution becomes Rm | { Size* Rj < Size*X}. The conditioning event remains essentially the same and has no impact on any statistics derived from the conditional distribution of Rm.

  23. α is identical to skewness but monotonically related to it. α=0 implies a symmetric non-skewed distribution, whereas α > 0 (α < 0 implies positive (negative) skewness. It is also called the “shape” or the “slant” parameter.

  24. Ω is equal to the covariance matrix of y only when the skewness and kurtosis are both zero (α = 0, ν = ∞).

References

  • Acemoglu D, Ozdaglar A, Tahbaz-Salehi A (2015) Systemic risk and stability in financial networks. Am Econ Rev 105(2):564–608

  • Acharya VV, Pedersen L, Philippon T, Richardson M (2010) Measuring systemic risk, Technical report, Department of Finance, Working paper, NYU Stern School of Business

  • Acharya V, Engle R, Richardson M (2012) Capital shortfall: a new approach to ranking and regulating systemic risks. Am Econ Rev 102:59–64

    Article  Google Scholar 

  • Adrian T, Brunnermeier MK (2011) CoVaR, FRB of New York. Staff Report No. 348

  • Allen L, Bali TG, Tang Y (2012) Does systemic risk in the financial sector predict future economic downturns? Rev Financ Stud 25:3000–3036

    Article  Google Scholar 

  • Azzalini A (2005) Skew-normal distribution and related multivariate families. Scand J Stat 32:159–188

    Article  Google Scholar 

  • Benoit S, Colletaz G, Hurlin C, Perignon C (2012) A theoretical and empirical comparison of systemic risk measures. Working Paper, University of Orleans, France

  • Blancher N, Mitra S, Morsy H, Otani A, Severo T, Valderrama L (2013) Systemic risk monitoring (―SysMo‖) Toolkit—A User Guide,” IMF Working Paper WP/13/168, http://www.imf.org/external/pubs/ft/wp/2013/wp13168.pdf

  • Bortot P (2010) Tail dependence in bivariate skew-Normal and skew-t distributions, Department of Statistical Sciences, Working paper, University of Bologna

  • Brownlees C, Engle R (2012) Volatility, Correlation and tails for systemic risk measurement, Working Paper, New York University

  • Carr P, Geman H, Madan DB, Yor M (2002) The fine structure of asset returns: an empirical investigation. J Bus 75(2):305–333

    Article  Google Scholar 

  • Durbin J (1954) Errors in variables. Rev Int Stat Inst 22:23–32

    Article  Google Scholar 

  • Fama EF (1970) Efficient capital markets: a review of theory and empirical work. J Financ 25(2):383–417

    Article  Google Scholar 

  • Financial Stability Board (2011) Policy measures to address systemically important financial institutions, http://www.financialstabilityboard.org/wp-content/uploads/r_111104bb.pdf?page_moved=1

  • Girardi G, Ergun TA (2013) Systemic risk measurement: multivariate Garch estimation of CoVar. J Bank Financ 37:3169–3180

    Article  Google Scholar 

  • Greene W (2012) Econometric analysis, 7th edn. Prentice Hall, London

    Google Scholar 

  • Guntay L, Kupiec PH (2014). Taking the risk out of systemic risk measurement (August 13, 2014). Available at SSRN: http://ssrn.com/abstract=2375236

  • Hausman JA (1978) Specification tests in econometrics. Econometrica 46(6):1251–1271

    Article  Google Scholar 

  • Horowitz E (2001) The Bootstrap. In Heckman JJ, Leamer E (eds.), The handbook of econometrics 5, 3159–3228

  • Huang X, Zhou H, Zhu H (2012) Systemic risk contributions. J Financ Serv Res 42(1–2):55–83

    Article  Google Scholar 

  • Jiang C (2012). Does tail dependence make a difference in the estimation of systemic risk? CoVaR and MES Working Paper, Boston College

  • Kmenta J (1971) Elements of Econometrics. Macmillian Publishing Co., Inc., New York

    Google Scholar 

  • Kupiec P (2012) Discussion of Acharya V, Engle R, Richardson M. Capital shortfall: a new approach to ranking and regulating systemic risks, American Economic Association Meetings, Chicago, Ill., January 2012. https://www.aei.org/publication/discussion-of-measuring-systemic-risk

  • Longin F, Solnik B (2001) Extreme correlation of international equity markets. J Financ 61(2):649–676

    Article  Google Scholar 

  • Mainik G, Schaanning E (2014) On dependence consistency of CoVaR and some other systemic risk measures. Stat Risk Model 31(1):49–77

    Google Scholar 

  • Singleton C, Wingender J (1986) Skewness persistence in common stock returns. J Financ Quant Anal 21(3):335–341

    Article  Google Scholar 

  • Wu De-Min (1973) Alternative tests of independence between stochastic regressors and distrubances. Econometrica 41(4):733–750

  • Zhang B, Zhou H, Zhu H (2009) Explaining credit default swap spreads with the equity volatility and jump risk of individual firms. Rev Financ Stud 22(12):5099–5131

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Paul Kupiec.

Additional information

The views in this paper are those of the authors alone. They do not represent the official views of the American Enterprise Institute.

Appendix

Appendix

1.1 Parametric estimator for ∆CoVaR when returns are gaussian

In this section, we derive the CoVaR measure for the returns on a market portfolio, \( {\tilde{R}}_M, \) conditional on a specific stock return, \( {\tilde{R}}_j, \) equal to its 1 % VaR. The market portfolio conditional return distribution is given by,

$$ {\tilde{R}}_M\left|\left({\tilde{R}}_j={\mathrm{F}}^{-1}\left(.01,\ {\tilde{R}}_j\right)\right) \sim N\left[{\mu}_M+\rho \frac{\sigma_M}{\sigma_j}\left({\Phi}^{-1}\left(.01,\ {\tilde{R}}_j\right) - {\mu}_j\right),\ \left(1-{\rho}_{jM}^2\right){\sigma}_M^2\right], \right. $$
(A1)

where \( {\mathrm{F}}^{-1}\left(.01,\ {\tilde{R}}_j\right) \) represents the inverse cumulative normal distribution of the unconditional return \( {\tilde{R}}_j \) evaluated at the 0.01 cumulative probability. Using, \( {\mathrm{F}}^{-1}\left(.01,\ {\tilde{R}}_j\right)={\mu}_j-2.32635\ {\sigma}_j \), the 1 % CoVaR for the market conditional on \( {\tilde{R}}_j \) equal to its 1 % VaR is,

$$ CoVaR\left(\left.{\tilde{R}}_M\right|\left({\tilde{R}}_j={\mathrm{F}}^{-1}\left(.01,\ {\tilde{R}}_j\right)\right)\right)={\mu}_M-{\rho}_{jM}\frac{\sigma_M}{\sigma_j}\left(2.32635\ {\sigma}_j\right)-2.32635\ {\sigma}_M\sqrt{1-{\rho}_{jM}^2} $$
(A2)

Similarly, the return distribution for \( {\tilde{R}}_M, \) conditional on \( {\tilde{R}}_j \) equal to its median is,

$$ \left.{\tilde{R}}_M\right|\left({\tilde{R}}_j={\mathrm{F}}^{-1}\left(.50,\ {\tilde{R}}_j\right)\right) \sim N\left[{\mu}_M,\ \left(1-{\rho}_{jM}^2\right){\sigma}_M^2\right] $$
(A3)

Consequently, the CoVaR for the portfolio with \( {\tilde{R}}_j \) evaluated at its median return is,

$$ CoVaR\left(\left.{\tilde{R}}_M\right|\left({\tilde{R}}_j={\mathrm{F}}^{-1}\left(.50,\ {\tilde{R}}_j\right)\right)\right)={\mu}_M-2.32635{\sigma}_M\sqrt{1-{\rho}_{jM}^2} $$
(A4)

Subtracting (A4) from (A2) gives the so-called contribution CoVaR measure, ∆CoVaR,

$$ \varDelta CoVaR\left(\left.{\tilde{R}}_M\right|\left({\tilde{R}}_j={\mathrm{F}}^{-1}\left(.01,\ {\tilde{R}}_j\right)\right)\right)=-2.32635\ {\rho}_{jM}{\sigma}_M $$
(A5)

1.2 Parametric estimator for MES when returns are gaussian

The marginal expected shortfall measure is the expected shortfall calculated from a conditional return distribution. The conditioning event is the return on a market portfolio, \( {\tilde{R}}_M, \) less than or equal to its 5 % VaR value.

Under the assumption of bivariate normality, the conditional stock return is normally distributed, and consequently,

$$ E\left(\left.{\tilde{R}}_j\right|{\tilde{R}}_M={r}_M\right)={\mu}_j-\rho \frac{\sigma_j}{\sigma_M}\ {\mu}_M+\rho \frac{\sigma_j}{\sigma_M}{r}_M. $$
(A6)

Now, if \( {\tilde{R}}_M \) is normally distributed with mean μ M and standard deviation σ M , then the expected value of the market return truncated above the value “b” is

$$ E\left(\left.{\tilde{R}}_M\right|{\tilde{R}}_M<b\right)={\mu}_M-{\sigma}_M\left[\frac{\phi \left(\frac{b-{\mu}_M}{\sigma_P}\right)}{\phi \left(\frac{b-{\mu}_M}{\sigma_M}\right)}\right], $$
(A7)

If b is the lower 5 % tail value, b = μ M  − 1.645σ M , the expected shortfall measure becomes:

$$ \begin{array}{c}\hfill E\left(\left.{\tilde{R}}_j\right|{\tilde{R}}_M<VaR\left({\tilde{R}}_M,\ 5\%\right)\right)={\mu}_j-\rho {\sigma}_j\left[\frac{\phi \left(-1.645\right)}{\Phi \left(-1.645\right)}\right]\hfill \\ {}\hfill ={\mu}_j-2.062839\ {\rho}_{jM}{\sigma}_M\hfill \end{array} $$
(A8)

1.3 Bivariate skew-t distribution

We use the definition of the multivariate skew-t definition given in Azzalini (2005). Let d be the dimension of the multivariate distribution. Let y be a (d × 1) random vector, and β and α (d × 1) vectors of constants. Ω is a (d × d) positive definite matrix. ν ∈ (0, ∞) be a scalar degrees of freedom parameter. The multivariate skew-t density y ~ f T (y, β, Ω, α, ν) is defined as:

$$ {f}_T\left(y,\beta, \Omega, \alpha, \nu \right)=2{t}_d\left(y;\beta, \varOmega, \nu \right){T}_1\left({\alpha}^T{\omega}^{-1}\left(y-\beta \right){\left(\frac{\nu +d}{Q_y+\nu}\right)}^{0.5};\nu +d\right) $$
(20)

where,\( {t}_d\left(y;\beta, \varOmega, \nu \right)=\frac{\varGamma \left(0.5\left(\nu +d\right)\right)}{{\left|\varOmega \right|}^{0.5}{\left(\pi \nu \right)}^{d/2}\varGamma \left(0.5\nu \right){\left(1+{Q}_y/\nu \right)}^{\left(\nu +d\right)/2}} \)is the density function of a d-dimensional student t random variate with ν degrees of freedom. T 1 (x;ν + d) denotes the scalar t distribution with ν + d degrees of freedom; β is the location parameter that controls the distribution means; α is the parameter that controls the skewness of the distributionFootnote 23; and, Ω is a generalized covariance matrix.Footnote 24 The remaining parameters are, ω = diag(Ω)0.5 and Q y  = (y − β)T Ω − 1(y − β).

The skew-t distribution nests the symmetric t-distribution, (α = 0 , 0 < ν < ∞), the skew-Gaussian distribution, (α ≠ 0, ν = ∞), and the symmetric Gaussian distribution, (α = 0, ν = ∞). The flexibility of the skew-t distribution is ideal for evaluating the behavior of the W ΔCoVaR and W MES test statistics under a number of alternative hypothesis that generate realistic representations of stock return data.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kupiec, P., Güntay, L. Testing for Systemic Risk Using Stock Returns. J Financ Serv Res 49, 203–227 (2016). https://doi.org/10.1007/s10693-016-0254-1

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10693-016-0254-1

Keywords

Navigation