Skip to main content
Log in

Macroeconomic and credit forecasts during the Greek crisis using Bayesian VARs

  • Published:
Empirical Economics Aims and scope Submit manuscript

Abstract

We investigate the ability of small- and medium-scale Bayesian VARs (BVARs) to produce accurate macroeconomic (output and inflation) and credit (loans and lending rate) out-of-sample forecasts during the latest Greek crisis. We implement recently proposed Bayesian shrinkage techniques based on Bayesian hierarchical modeling, and we evaluate the information content of forty-two (42) monthly macroeconomic and financial variables in terms of point and density forecasting. Alternative competing models employed in the study include Bayesian autoregressions (BARs) and time-varying parameter VARs with stochastic volatility, among others. The empirical results reveal that, overall, medium-scale BVARs enriched with economy-wide variables can considerably and consistently improve short-term inflation forecasts. The information content of financial variables, on the other hand, proves to be beneficial for the lending rate density forecasts across forecasting horizons. Both of the above-mentioned results are robust to alternative specification choices, while for the rest of the variables smaller-scale BVARs, or even univariate BARs, produce superior forecasts. Finally, we find that the popular, data-driven, shrinkage methods produce, on average, inferior forecasts compared to the theoretically grounded method considered here.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2

Similar content being viewed by others

Notes

  1. Alternatively, factor methods have also been used in studies that involve a large number of variables (e.g., see Stock and Watson, 2002, 2006 among others).

  2. The authors also show that models with more than 20 variables can hardly improve forecasting performance.

  3. Hyperparameter is a coefficient that is used to parameterize a prior distribution.

  4. See Provopoulos (2014) for the origins of the Greek crisis and Gibson et al. (2014a) for an overview of the crisis in the Euro area.

  5. Successive recession may be attributed to reduced internal demand (due to increased unemployment and reduced salaries) and weak dynamics in exports (due to firms’ reduced ability to access credit channels) (Kiriakidis and Kargas 2013).

  6. The FSSI is a composite systemic stress index that applies the insights from the standard portfolio theory to summarize stress measures of different market segments into an aggregate index. The key feature of the FSSI is the time-varying cross-correlations among the stress measures, which form the mechanism that captures the systemic nature of stress. For an alternative version of the FSSI, see also Louzis and Vouldis (2012).

  7. Macroeconomic variables include the industrial production index and the consumers price index, while credit variables include the outstanding amount of total loans granted to the private sector and the corresponding lending rate (see Sect. 3 and Table 7 for details).

  8. See also the discussion in Kazanas and Tzavalis (2014).

  9. For a recent example of the marginal approach, see Caraiani (2014).

  10. The term conjugate prior is used to define the prior that comes from the same family of distributions along with the posterior.

  11. An alternative approach to impose the N-IW prior is to use a fictitious prior data set as in Banbura et al. (2010).

  12. Since the prior mean of \(\varSigma \) is defined as \(\left( {d-n-1} \right) ^{-1}\varSigma \), \(d=n+2\) is the minimum value that guarantees its existence.

  13. The Minnesota prior was originally developed by Litterman (1979, (1980).

  14. Hierarchical modeling refers to models that place priors on hyperparameters (i.e., hyperpriors), and thus, one more step is added to the prior structure in a hierarchical manner.

  15. See Giannone et al. (2015) and references therein for a list of studies using these methods.

  16. We use the industrial production index as a proxy for the aggregate output as in Caraiani (2014), since it is the only index of economic activity for Greece available at a monthly frequency. The industrial production index is also one of the main determinants of the Greek GDP (Kiriakidis and Kargas 2013).

  17. We use the Euro OverNight Index Average (EONIA) as a proxy for the monetary policy stance in the Euro zone. The EONIA rate is defined as the average of overnight rates for unsecured interbank lending in Euro area. The Governing council of the European Central Bank (ECB) determines the range of fluctuation of the EONIA rate, which is given by the following range: [deposit facility rate, marginal lending facility rate]. The EONIA rate is considered an efficient proxy of the monetary policy stance in the Euro area, as compared to other money market instruments, such as the Euribor, the overnight interest swap (OIS) rate on EONIA rate or the repo rates (see the discussion in Ciccarelli et al. 2010; Gerlach and Lewis 2014).

  18. As already mentioned there are also data availability issues, which pose limitations to this kind of analysis.

  19. Estimation of the various constant parameter BVAR models is based on the MATLAB code kindly provided by Domenico Giannone in his homepage: http://homepages.ulb.ac.be/~dgiannon/. For the estimation of the TVP-VAR we use the MATLAB code kindly provided by Haroon Mumtaz in his homepage: https://sites.google.com/site/hmumtaz77/.

  20. Recall that the baseline model uses the variables of Table 7.

  21. In practice we set \(\lambda =10^{-4}\) and \(\lambda =10^{4}\) for the dogmatic and flat priors, respectively, as in Berg and Henzel (2015).

  22. This is analogous to the use of principal components implemented by Banbura et al. (2010, p. 80).

  23. The only exception is the TVP-VAR which is estimated recursively.

  24. The description of the evaluation metrics as well as the presentation of the results follows closely the contributions of Carriero et al. (2015a, (2015b).

  25. This is equivalent to testing whether relative RMSFE \(< 1\) and \(\Delta \) SCORE \(> 0\), respectively.

  26. I would like to thank an anonymous reviewer for proposing to incorporate the AR model into the analysis.

  27. Particularly, the BVAR + FSSI outranks the benchmark in 33 % of the cases, while the \(\hbox {Medium}^{\mathrm{Fin}}\)-BVAR in 17 % of the cases across variables and forecasting horizons.

  28. The average \(\lambda \) estimates for \(\hbox {Medium}^{\mathrm{Ec}}\)-BVAR, \(\hbox {Medium}^{\mathrm{Fin}}\)-BVAR are 0.21 and 0.20 for the CKM method and 0.27 and 0.26 for the GLP method.

  29. Other studies that implement TVP-VARs in forecasting exercises use long data sets with quarterly frequencies that cover time periods that range between 20 and 60 years (e.g., see D’Agostino et al. 2013; Barnet et al. 2014; Carriero et al. 2015a).

  30. We use the first seventy (70) observations of our sample as an in-sample period.

  31. The method implies rolling or recursive estimation. For \(\tau =1\) (i.e., the first point in the out-of-sample period) for which \(\lambda _{m}^{*} (\tau +1)\) is not available we set \(\lambda _{m}^{*} (1)=0.2\), which is a benchmark value used by many researchers (see Carriero et al. 2015b and references therein).

References

  • Adolfson M, Linde J, Villani M (2007) Forecasting performance of an open economy DSGE model. Econom Rev 26:289–328

    Article  Google Scholar 

  • Amisano G, Giacomini R (2007) Comparing density forecasts via weighted likelihood ratio tests. J Bus Econ Stat 25:177–190

    Article  Google Scholar 

  • Banbura M, Giannone D, Reichlin L (2010) Large Bayesian vector auto regressions. J Appl Econom 25:71–92

    Article  Google Scholar 

  • Bank of Greece, 2014 (2013) Stress test of the Greek banking sector. Bank of Greece March 2014

  • Barnet A, Mumtaz H, Theodoridis K (2014) Forecasting UK GDP growth and inflation under structural change. A comparison of models with time-varying parameters. Int J Forecast 30:129–143

    Article  Google Scholar 

  • Berg TO, Henzel SR (2015) Point and density forecasts for the euro area using Bayesian VARs. Int J Forecast 31:1067–1095

    Article  Google Scholar 

  • Blanchard O, Leigh D (2013) Growth forecast errors and fiscal multipliers. IMF working paper WP/13/1

  • Caraiani P (2014) Do money and financial variables help forecasting output in emerging European economies? Empir Econ 46:743–763

    Article  Google Scholar 

  • Carriero A, Kapetanios G, Marcellino M (2009) Forecasting exchange rates with large Bayesian VAR. Int J Forecast 25:400–417

    Article  Google Scholar 

  • Carriero A, Kapetanios G, Marcellino M (2012) Forecasting government bond yields with large Bayesian vector autoregressions. J Bank Finance 36:2026–2047

    Article  Google Scholar 

  • Carriero A, Mumtaz H, Theophilopoulou A (2015a) Macroeconomic information, structural change, and the prediction of fiscal aggregates. Int J Forecast 31:325–348

    Article  Google Scholar 

  • Carriero A, Clarck TE, Marcellino M (2015b) Bayesian VARs: specification choices and forecast accuracy. J Appl Econom 30:46–73

    Article  Google Scholar 

  • Ciccarelli M, Maddaloni A, Peydro J-L (2010) Trusting the bankers: a new look at the credit channel of monetary policy. ECB working papers series no 1228, July 2010

  • Clark T, McCracken M (2013) Advances in forecast evaluation. In: Elliot G, Timmermann A (eds) Handbook of economic forecasting, vol 2(B). Elsevier, Amsterdam, pp 1107–1201

    Google Scholar 

  • D’Agostino A, Gambetti L, Giannone D (2013) Macroeconomic forecasting and structural change. J Appl Econom 28:82–101

    Article  Google Scholar 

  • De Mol C, Giannone D, Reichlin L (2008) Forecasting using a large number of predictors: is Bayesian regression a valid alternative to principal components? J Econom 146:318–328

    Article  Google Scholar 

  • Diebold FX, Mariano RS (1995) Comparing predictive accuracy. J Bus Econ Stat 13:253–263

    Google Scholar 

  • Doan T, Litterman R, Sims C (1984) Forecasting and conditional projection using realistic prior distributions. Econom Rev 3:1–144

    Article  Google Scholar 

  • Faust J, Wright JH (2009) Comparing Greenbook and reduced form forecasts using a large realtime dataset. J Bus Econ Stat 27:468–479

    Article  Google Scholar 

  • Geweke J, Amisano G (2010) Comparing and evaluating Bayesian predictive distributions of asset returns. Int J Forecast 26:216–230

    Article  Google Scholar 

  • Giannone D, Lenza M, Momferatou D (2014) Short-term inflation projections: a Bayesian vector autoregressive approach. Int J Forecast 30:635–644

    Article  Google Scholar 

  • Giannone D, Lenza M, Primiceri G (2015) Prior selection for vector autoregressions. Rev Econ Stat 97:436–451

    Article  Google Scholar 

  • Gibson HD, Hall SG, Tavlas GS (2012) The Greek financial crisis: growing imbalances and sovereign spreads. J Int Money Finance 31(3):498–516

    Article  Google Scholar 

  • Gibson HD, Palivos T, Tavlas GS (2014a) The crisis in the Euro area: an analytic overview. J Macroecon 39:233–239

    Article  Google Scholar 

  • Gibson HD, Hall SG, Tavlas GS (2014b) Fundamentally wrong: market pricing of sovereigns and the Greek financial crisis. J Macroecon 39:405–419

    Article  Google Scholar 

  • Gerlach S, Lewis J (2014) Zero lower bound, ECB interest rate policy and the financial crisis. Empir Econ 46(3):865–886

    Article  Google Scholar 

  • Gupta R, Kabundi A (2010) Forecasting macroeconomic variables in a small open economy: a comparison between small- and large-scale models. J Forecast 29:168–185

    Article  Google Scholar 

  • Harvey D, Leybourne S, Newbold P (1997) Testing the equality of prediction mean squared errors. Int J Forecast 13:281–291

    Article  Google Scholar 

  • Hristov N, Hulsewig O, Wollmershauser T (2012) Loan supply shocks during the financial crisis: evidence for the Euro area. J Int Money Finance 31:569–592

    Article  Google Scholar 

  • Kadiyala K, Karlsson S (1997) Numerical methods for estimation and inference in Bayesian VAR models. J Appl Econom 12:99–132

    Article  Google Scholar 

  • Karlsson S (2013) Forecasting with Bayesian vector autoregression. Handb Econ Forecast 2:791–897

    Article  Google Scholar 

  • Kazanas T, Tzavalis E (2014) Comment on “Fundamentally wrong: market mispricing of sovereigns and the Greek financial crisis”. J Macroecon 39:420–423

    Article  Google Scholar 

  • Kiriakidis M, Kargas A (2013) Greek GDP forecast estimates. Appl Econ Lett 20:767–772

    Article  Google Scholar 

  • Koop G, Korobilis D (2010) Bayesian multivariate time series methods for empirical macroeconomics. Foun Trends Econom 3:267–358

    Article  Google Scholar 

  • Koop G (2013) Forecasting with medium and large Bayesian VARs. J Appl Econom 28:177–203

    Article  Google Scholar 

  • Litterman RB (1979) Techniques of forecasting using vector autoregressions. Federal Reserve of Minneapolis working paper 115

  • Litterman RB (1980) A Bayesian procedure for forecasting with vector autoregressions. Working paper, Massachusetts Institute of Technology, Department of Economics

  • Litterman RB (1986) Forecasting with Bayesian vector autoregressions: five years of experience. J Bus Econ Stat 4:25–38

    Google Scholar 

  • Louzis DP, Vouldis AT (2012) A methodology for constructing a financial systemic stress index: an application to Greece. Econ Model 29:1228–1241

    Article  Google Scholar 

  • Louzis DP, Vouldis AT (2013) A financial systemic stress index for Greece. ECB working paper series no 1563, July 2013

  • Louzis DP (2015) Measuring spillover effects in Euro area financial markets: a disaggregate approach. Empir Econ 49:1367–1400

    Article  Google Scholar 

  • Marcellino M (2008) A linear benchmark for forecasting GDP growth and inflation? J Forecast 27:305–340

    Article  Google Scholar 

  • Provopoulos G (2014) The Greek economy and banking system: recent developments and the way forward. J Macroecon 39:240–249

    Article  Google Scholar 

  • Sims C (1980) Macroeconomics and reality. Econometrica 48:1–48

    Article  Google Scholar 

  • Sims C (1993) A nine-variable probabilistic macroeconomic forecasting model. In: Business cycles, indicators and forecasting, nber chapters. National Bureau of Economic Research, Inc. pp 179–212

Download references

Acknowledgments

I gratefully acknowledge three anonymous reviewers, Robert Kunst (the Editor), Heather Gibson and Hiona Balfoussia for their constructive and insightful comments and suggestions that considerably improved this article. I would also like to acknowledge Dimitris Malliaropulos and the colleagues from the Department of Economic Analysis and Research of the Bank of Greece for their helpful comments and discussions. The views expressed in this article do not necessarily represent Bank of Greece.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Dimitrios P. Louzis.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (pdf 1194 KB)

Appendices

Appendix 1

See Tables 7, 8, and 9

Table 7 Variables used in the baseline BVAR
Table 8 Additional economy-wide variables used in the BVARs
Table 9 Additional financial variables used in the BVARs

Appendix 2: Heuristic methods of selecting hyperparameters

Banbura et al. (2010) (BGR) method. The BGR method selects \(\lambda \) on the basis of the in-sample fit of large-scale VARs, which has to be as close as possible to the in-sample fit of a parsimonious small-scale VAR. In particular, we define as ‘Small’ a VAR model with the five variables of Table 7 and 3 lags. The implicit assumption here is that the small-scale VAR does not suffer from overfitting. After defining an in-sample period, the “Fit” for each model m is defined as follows:Footnote 30

$$\begin{aligned} Fit_{m} (\lambda )=\frac{1}{n}\sum \limits _{i=1}^{n} \frac{{ MSFE}_{m} ( {i,\lambda } )}{{ MSFE}_{Small} ( {i,0} )} \end{aligned}$$
(20)

where \({ MSFE}_{m} ( {i,\lambda } )\) is the one-step ahead mean squared forecast error (MSFE) for model m. The MSFE is computed for each of the n variables of interest, i, and for a given level of \(\lambda \). Then, it is normalized by the \({ MSFE}_{Small} ( {i,0} )\), which is the MSFE produced by the small-scale model using the prior (i.e., for \(\lambda =0\)). Finally, the normalized MSFE measure is averaged across the n target variables. We employ grid search methods in order to choose the value of \(\lambda \), which minimizes the following criterion:

$$\begin{aligned} \lambda _{m}^{*} =\arg \mathop {\min }\limits _{\lambda } \left| {Fit_{m} ( \lambda )-Fit_{Small} ( \infty )} \right| \end{aligned}$$
(21)

with \(\lambda \) incrementing by 0.0001.

Carriero et al. (2009) (CKM) method. This method is based on a real-time process that can be described as follows. First, we choose a range of values for \(\lambda \) over which we estimate the respective VAR models. Next, we produce one-step ahead forecasts at \(\tau \) point in time, with \(\tau \) belonging to the out-of-sample period, and compute the sum of squared forecasting errors (SFE) over the n variables of interest, i.e., \({ SFE}_{m} (\tau ,\lambda )=\sum _{i=1}^{n} {FE_{m}^{i} (\tau ,\lambda )}\). Finally, in the next period (\(\tau +1)\), we chose the \(\lambda \) that minimizes the SFE in the previous period (\(\tau \)), i.e.:

$$\begin{aligned} \lambda _{m}^{*} (\tau +1)=\arg \mathop {\min }\limits _\lambda \left\{ {{ SFE}_m (\tau ,\lambda )} \right\} \end{aligned}$$
(22)

Compared to the BGR, the CKM method is dynamic, since \(\lambda \) is optimized for each sample estimated in the forecasting procedure.Footnote 31 It is also based on the out-of-sample accuracy instead of the in-sample fitting of the BGR method. For comparability reasons we use the same grid of values for \(\lambda (t)\), as in the BGR method.

Moreover, following common practice and for both methods, we set \(\sigma _{0,j} =\left( {d-n-1} \right) ss_j \), for \(j=1,\ldots ,n\), where \(ss_j \) is the residual variance of an AR(1) model estimated with OLS (e.g., see Kadiyala and Karlsson 1997; Carriero et al. 2015a, b). Finally, for the BVAR models using data in levels, the “sum of coefficients” and “dummy initial observation” hyperparameters, \(\mu \) and \(\delta \), respectively, are set equal to the default value of 1 as in the study of Carriero et al. (2015b).

Appendix 3: Marginal likelihood

According to Giannone et al. (2015), the marginal likelihood (ML) is defined as:

$$\begin{aligned} p( Y )=\left( {\frac{1}{\pi }} \right) ^{\frac{n( {T-p} )}{n}}\frac{\varGamma _{n} \left( {\frac{T-p+d}{2}} \right) }{\varGamma _{n} \left( {\frac{d}{2}} \right) }\cdot \left| {\varOmega _{0}} \right| ^{-\frac{n}{2}}\cdot \left| {\varSigma _{0}} \right| ^{\frac{d}{2}}\cdot \left| {{X}^{\prime }X+\varOmega _{0}^{-1} } \right| ^{-\frac{n}{2}}\cdot \nonumber \\ \left| {\varSigma _{0} +{\hat{E}}^{\prime }}{\hat{E}}+\left( {\hat{B}}- B_{0} \right) \varOmega _{0}^{-1} \left( {\hat{B}}-B_0 \right) \right| ^{-\frac{T-p+d}{2}} \end{aligned}$$
(23)

The ML is also used to select the optimal lag length as in Carriero et al. (2015a, (2015b):

$$\begin{aligned} \hbox {p}^{*}=\mathop {\arg \max }\limits _{\mathrm{p}} \ln p( Y ) \end{aligned}$$
(24)

where we optimize over the grid \(\hbox {p} = 1,{\ldots }, 12\) or 13 depending on whether we use models with variables in differences or levels.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Louzis, D.P. Macroeconomic and credit forecasts during the Greek crisis using Bayesian VARs. Empir Econ 53, 569–598 (2017). https://doi.org/10.1007/s00181-016-1128-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00181-016-1128-y

Keywords

JEL Classification

Navigation