Abstract
In this paper, we investigate whether there are benefits in disaggregating GDP into its components when nowcasting GDP. To answer this question, we conduct a realistic out-of-sample experiment that deals with the most prominent problems in short-term forecasting: mixed frequencies, ragged-edge data, asynchronous data releases and a large set of potential information. We compare a direct leading indicator-based GDP forecast with two bottom-up procedures—that is, forecasting GDP components from the production side or from the demand side. Generally, we find that the direct forecast performs relatively well. Among the disaggregated procedures, the production side seems to be better suited than the demand side to form a disaggregated GDP nowcast.
Similar content being viewed by others
Notes
Most European countries apply a GDP measure which is primarily based on the production side, while the US GDP measure is focused on the demand side. Therefore, one would expect different implications for the predictive performance of leading indicators for the two bottom-up procedures.
We select K among 9 and 12 months and take into account q between 1 and 3. We also experimented with higher polynomials and longer lags, but did not find much improvement.
Table 4 in the Appendix indicates the average number of indicators that are used at each forecasting round to generate a pooled forecast.
According to the recursive model selection scheme of each indicator model, only those models survive for the model averaging scheme that obtain a smaller SIC than the AR model (which exclusively consists of a constant and its own lags). The time-varying nature is mostly taken into account by a rolling estimation scheme which implies that in- and out-of-sample criteria get updated at each point in time.
Due to space limitations, we only present a subset of model combination schemes overall considered. Additional combination schemes are Bayesian model averaging and Granger-Ramanathan weights (with and without shrinkage). Details are available on request.
Since the number of models retained varies with each forecast round, we only consider those models for the MSFE weighting scheme that are actually different from the AR model. This implies that we then set \(\lambda ^{-1}_{it}=0\).
The optimal degree of discounting (which controls the degree of time variation of the weights) is generally unknown. Most of the literature tends to set \(\delta \) between 0.9 and 1 (see, Stock and Watson 2004), but also very low values of \(\delta \) of about 0.3 are found to work well (e.g., Drechsel and Scheufele 2012b). In general the optimal \(\delta \) depends on the stability of the models under investigation. In our study, the relative performance of MSFE weighting is not much affected by the choice of \(\delta \).
Obviously, a broad range of procedures to estimate dynamic factor models exist and may differ in terms of forecasting performance (see Schumacher 2007, for a comparison for German GDP). One possible augmentation of the factor model would be to allow for autocorrelation in the idiosyncratic component (see Banbura et al. 2011, for an application) which could provide a more flexible way to take into account the persistency in many macroeconomic time series. To check for this possibility, we ran Ljung-Box Q statistic tests to check for remaining autocorrelations in the idiosyncratic component up to lag 1 and 4 in each estimation sample. For GDP and its subcomponents as well as for most of the indicator variables, we find little evidence of remaining autocorrelation in the idiosyncratic components. This suggests little room for efficiency gains by incorporating a more flexible error specification.
As a robustness check, we estimate factor models based on the total data set. However, in particular for the GDP components, this results in much less precise forecasts.
For most of our target variables, we use a minimum correlation of 0.3 in absolute terms. Only for the subcomponents private consumption and public administration, we needed to scale down the threshold (using 0.2) in order to retain a meaningful number of the variables in our data set.
Mariano and Murasawa (2003) or Banbura et al. (2013) have proposed a slightly different aggregation rule, where monthly series are included as monthly changes. In our setting, applying their aggregation rule does lead to inferior forecasting results. Therefore, we apply the aggregation rule proposed by Angelini et al. (2010) and Angelini et al. (2011).
While it is easy to investigate the absolute contributions of a single indicator, it may be more difficult to compare the revision process for one forecasting round to the next. As we employ a direct forecasting approach (parameters estimates may change from one round to the next) and combination weights are also allowed to change, forecasts for different rounds may be hard to compare. This is easier within the DFM framework, where the model remains the same during the forecast rounds.
Detailed results for GDP components are available upon request.
The results can be provided by request.
References
Andreou E, Ghysels E, Kourtellos A (2011) Forecasting with mixed-frequency data. In: Clements MP, Hendry DF (eds) The Oxford handbook of economic forecasting; chap 8. Oxford University Press, Oxford
Andreou E, Ghysels E, Kourtellos A (2013) Should macroeconomic forecasters use daily financial data and how? J Bus Econ Stat 31(2):240–251
Angelini E, Banbura M, Rünstler G (2010) Estimating and forecasting the euro area monthly national accounts from a dynamic factor model. OECD J J Bus Cycle Meas Anal 2010:1–22
Angelini E, Camba-Mendez G, Giannone D, Reichlin L, Rünstler G (2011) Short-term forecasts of euro area GDP growth. Econom J 14(1):C25–C44
Antipa P, Barhoumi K, Brunhes-Lesage V, Darné O (2012) Nowcasting German GDP: a comparison of bridge and factor models. J Policy Model 34:864–878
Baffigi A, Golinelli R, Parigi G (2004) Bridge models to forecast the euro area GDP. Int J Forecast 20(3):447–460
Bai J (2003) Inferential theory for factor models of large dimensions. Econometrica 71(1):135–171
Bai J, Ng S (2007) Determining the number of primitive shocks in factor models. J Bus Econ Stat 25(1):52–60
Bai J, Ng S (2008) Forecasting economic time series using targeted predictors. J Econom 146(2):304–317
Banbura M, Rünstler G (2011) A look into the factor model black box: publication lags and the role of hard and soft data in forecasting GDP. Int J Forecast 27(2):333–346
Banbura M, Giannone D, Reichlin L (2011) Nowcasting. In: Clements MP, Hendry DF (eds) The Oxford handbook of economic forecasting; chap 7. Oxford University Press, Oxford, pp 193–224
Banbura M, Giannone D, Modugno M, Reichlin L (2013) Now-casting and the real-time data flow. In: Elliot G, Timmermann A (eds) Handbook of economic forecasting, chap 4, vol 2A. Elsevier, Amsterdam, pp 195–237
Banerjee A, Marcellino M, Masten I (2005) Leading indicators for euro-area inflation and GDP growth. Oxf Bull Econ Stat 67(S1):785–813
Barhoumi K, Darné O, Ferrara L, Pluyaud B (2012) Monthly GDP forecasting using bridge models: application for the French economy. Bull Econ Res 64:s53–s70
Bates JM, Granger CWJ (1969) The combination of forecasts. Oper Res Q 20(4):451–468
Bermingham C, D’Agostino A (2014) Understanding and forecasting aggregate and disaggregate price dynamics. Empir Econ 46(2):765–788
Boivin J, Ng S (2006) Are more data always better for factor analysis? J Econom 132:169–194
Clark TE, McCracken MW (2010) Averaging forecasts from VARs with uncertain instabilities. J Appl Econom 25(1):5–29
Clemen RT (1989) Combining forecasts: a review and annotated bibliography. Int J Forecast 5(4):559–583
Clements M, Galvão A (2009) Forecasting US output growth using leading indicators: an appraisal using MIDAS models. J Appl Econom 24(7):1187–1206
Clements MP (2004) Evaluating econometric forecasts of economic and financial variables. Palgrave Macmillan, London
Clements MP, Hendry DF (2011) Forecasting from mis-specified models in the presence of unanticipated location shifts. In: Clements MP, Hendry DF (eds) The Oxford handbook of economic forecasting. Oxford University Press, Oxford, pp 271–314
Cors A, Kouzine V (2003) An approach for timely estimations of the German GDP. Allg Stat Arch 87(2):201–220
Cristadoro R, Forni M, Reichlin L, Veronese G (2005) A core inflation indicator for the euro area. J Money Credit Bank 37(3):539–560
Doz C, Giannone D, Reichlin L (2011) A two-step estimator for large approximate dynamic factor models based on Kalman filtering. J Econom 164(1):188–205
Drechsel K, Scheufele R (2012a) The financial crisis from a forecaster’s perspective. Kredit Kap 1:1–26
Drechsel K, Scheufele R (2012b) The performance of short-term forecasts of the German economy before and during the 2008/2009 recession. Int J Forecast 28(2):428–445
Dreger C, Schumacher C (2005) Out-of-sample perfomance of leading indicators for the German business cycle: single vs combined forecasts. J Bus Cycle Meas Anal 2(1):71–88
Esteves PS (2013) Direct vs bottom-up approach when forecasting GDP: reconciling literature results with institutional practice. Econ Model 33:416–420
Eurostat (2008) Metadata: Statistical classification of economic activities in the European Community, rev. 1.1 (2002). http://ec.europa.eu/eurostat/ramon
Fair RC, Shiller RJ (1990) Comparing information in forecasts from econometric models. Am Econ Rev 80(3):375–389
Frale C, Marcellino M, Mazzi GL, Proietti T (2011) Euromind: a monthly indicator of the euro area economic conditions. J R Stat Soc Ser A 174:439–470
Ghysels E, Santa-Clara P, Valkanov R (2004) The MIDAS touch: mixed DAta sampling regression models. mimeo, Chapel Hill
Giacomini R, Komunjer I (2005) Evaluation and combination of conditional quantile forecasts. J Bus Econ Stat 23:416–431
Giacomini R, White H (2006) Tests of conditional predictive ability. Econometrica 74(6):1545–1578
Giannone D, Reichlin L, Small D (2008) Nowcasting: The real-time informational content of macroeconomic data. J Monet Econ 55(4):665–676
Golinelli R, Parigi G (2007) The use of monthly indicators to forecast quarterly GDP in the short run: an application to the G7 countries. J Forecast 26(2):77–94
Granger CW, Newbold P (1977) Forecasting economic time series. Academic Press, New York
Granger CW, Ramanathan R (1984) Improved methods of combining forecasting. J Forecast 3(2):197–204
Grassi S, Proietti T, Frale C, Marcellino M, Mazzi G (2015) EuroMInd-C: a disaggregate monthly indicator of economic activity for the euro area and member countries. Int J Forecast 31(3):712–738
Grunfeld Y, Griliches Z (1960) Is aggregation necessarily bad? Rev Econ Stat 42(1):1–13
Hahn E, Skudelny F (2008) Early estimates of euro area real GDP growth—a bottom up approach from the production side. Working Paper Series 975, European Central Bank
Hansen BE (2007) Least squares model averaging. Econometrica 75(4):1175–1189
Hansen BE (2008) Least-squares forecast averaging. J Econom 146(2):342–350
Harvey DI, Leybourne SJ, Newbold P (1998) Tests for forecast encompassing. J Bus Econ Stat 16(2):254–259
Hendry DF, Clements MP (2004) Pooling of forecasts. Econom J 7(1):1–31
Hendry DF, Hubrich K (2011) Combining disaggregate forecasts or combining disaggregate information to forecast an aggregate. J Bus Econ Stat 29(2):216–227
Higgins PC (2014) GDPNow: a model for GDP nowcasting. Working paper 2014-7, Federal Reserve Bank of Atlanta
Hubrich K (2005) Forecasting euro area inflation: Does aggregating forecasts by HICP component improve forecast accuracy? Int J Forecast 21(1):119–136
Judge GG, Griffiths WE, Hill RC, Lütkepohl H, Lee TC (1985) The Theory and Practice of Econometrics, 2nd edn. Wiley, Hoboken
Kitchen J, Monaco R (2003) Real-time forecasting in practice. Bus Econ 38(4):10–19
Kuzin V, Marcellino M, Schumacher C (2009) Pooling versus model selection for nowcasting with many predictors: an application to German GDP. Discussion papers 7197, C.E.P.R
Kuzin V, Marcellino M, Schumacher C (2011) Midas vs. mixed-frequency VAR: nowcasting GDP in the euro area. Int J Forecast 27(2):529–542
Kuzin V, Marcellino M, Schumacher C (2013a) Pooling versus model selection for nowcasting GDP with many predictors: empirical evidence for six industrialized countries. J Appl Econom 28(3):392–411
Kuzin V, Marcellino M, Schumacher C (2013b) Pooling versus model selection for nowcasting gdp with many predictors: empirical evidence for six industrialized countries. J Appl Econom 28(3):392–411
Luciani M, Ricci L (2014) Nowcasting Norway. Int J Cent Bank 10(4):215–248
Lütkepohl H (1984) Forecasting contemporanously aggregated vector ARMA processess. J Bus Econ Stat 2(3):201–214
Marcellino M, Schumacher C (2010) Factor MIDAS for nowcasting and forecasting with ragged-edge data: a model comparison for german GDP. Oxf Bull Econ Stat 72(4):518–550
Marcellino M, Stock JH, Watson MW (2003) Macroeconomic forecasting in the euro area: country specific versus area-wide infromation. Eur Econ Rev 47(1):1–18
Mariano RS, Murasawa Y (2003) A new coincident index of business cycles based on monthly and quarterly series. J Appl Econom 18:427–443
Parigi G, Schlitzer G (1995) Quarterly forecasts of the Italian business cycle by means of monthly economic indicators. J Forecast 14(2):117–141
Poncela P, Garcia-Ferrer A (2014) The effects of disaggregation on forecasting nonstationary time series. J Forecast 33(4):300–314
Rünstler G, Barhoumi K, Benk S, Cristadoro R, Den Reijer A, Jakaitiene A, Jelonek P, Rua A, Ruth K, Van Nieuwenhuyze C (2009) Short-term forecasting of GDP using large datasets: a pseudo real-time forecast evaluation exercise. J Forecast 28(7):595–611. doi:10.1002/for.1105
Schumacher C (2007) Forecasting German GDP using alternative factor models based on large datasets. J Forecast 26(4):271–302
Schumacher C, Breitung J (2008) Real-time forecasting of German GDP based on a large factor model with monthly and quarterly data. Int J Forecast 24(3):386–398
Stock JH, Watson MW (2002) Macreconomic forecasting using diffusion indexes. J Bus Econ Stat 20(2):147–162
Stock JH, Watson MW (2003) Forecasting output and inflation: the role of asset prices. J Econ Lit 47(3):788–829
Stock JH, Watson MW (2004) Combination forecasts of output growth in a seven-country data set. J Forecast 23(6):405–430
Theil H (1954) Linear aggrgation of economic relations. North Holland, Amsterdam
Timmermann A (2006) Forecast combinations. In: Elliot G, Granger CW, Timmermann A (eds) Handbook of forecasting, chap 4, vol 1. Elsevier, Amsterdam, pp 135–196
West KD (1996) Inference about predictive ability. Econometrica 64(5):1067–1084
Zellner A, Tobias J (2000) A note on aggregation, disaggregation and forecasting performance. J Forecast 19(5):457–469
Acknowledgements
We would like to thank Antonello D’Agostino, Christian Schumacher, Atilim Seymen, the editors and anonymous referees as well as the participants of the Annual International Symposium on Forecasting 2011, the Annual International Conference on Macroeconomic Analysis 2011, the Annual Conference of the German Economic Association 2011, the (EC)\(^2\) Conference 2011, the CSDA International Conference on Computational and Financial Econometrics 2011 and the ESEM Annual Meeting 2012 for helpful comments and suggestions.
Author information
Authors and Affiliations
Corresponding author
Appendix
Appendix
Rights and permissions
About this article
Cite this article
Heinisch, K., Scheufele, R. Bottom-up or direct? Forecasting German GDP in a data-rich environment. Empir Econ 54, 705–745 (2018). https://doi.org/10.1007/s00181-016-1218-x
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00181-016-1218-x
Keywords
- Contemporaneous aggregation
- Nowcasting
- Leading indicators
- MIDAS
- Forecast combination
- Dynamic factor models
- Forecast evaluation