Abstract
This paper analyzes forecasts, for ten key annually observed economic variables for the Netherlands, created by the Netherlands Bureau for Economic Policy Analysis (CPB) for 1971–2007. These CPB forecasts are all manually modified model forecasts, where the model is a (very) large multi-equation macro model. The CPB forecasts are held against real-time forecasts obtained from simple autoregressive time series models, and for seven of the ten cases, CPB’s forecasts are significantly more accurate. Combining CPB’s forecasts with the real time autoregressive forecasts shows that four of the ten combined forecasts are significantly better than CPB’s forecasts, and seven of the ten are better than the time series forecasts. This suggests that CPB’s manual adjustment efforts could perhaps be directed to modifying simple model forecasts and not the forecasts from the own large macro model.
Similar content being viewed by others
References
Chevillon, G. (2007). Direct multi-step estimation and forecasting. Journal of Economic Surveys, 21, 746–785.
Clark, T. E., & McCracken, M. W. (2001). Tests of equal forecast accuracy and encompassing for nested models. Journal of Econometrics, 105, 85–110.
Elbourne, A., Kranendonk, H., Luginbuhl, R., Smid, B., & Vromans, M. (2008). Evaluating CPB’s published GDP growth forecasts: A comparison with individual and pooled VAR based forecasts. CPB Document 172, Netherlands Bureau of Economic Policy Analysis.
Ericsson, N. R. (1992). Parameter constancy, mean square forecast errors, and measuring forecast performance: An exposition, extensions, and illustration. Journal of Policy Modeling, 14, 465–495.
Franses, P. H. (2014). Expert adjustments of model forecasts: Theory practice and strategies for improvement. Cambridge: Cambridge University Press.
Franses, P. H., Kranendonk, H., & Lanser, D. (2011). One model and various experts: Evaluating Dutch macroeconomic forecasts. International Journal of Forecasting, 27, 482–495.
Kranendonk, H., de Jong, J., & Verbruggen, J. (2009). Trefzekerheid CPB-prognoses 1971–2007 (Accuracy of CPB forecasts 1971–2007). CBP Document 178, Netherlands Bureau of Economic Policy Analysis.
Author information
Authors and Affiliations
Corresponding author
Additional information
The author thanks two anonymous reviewers, the editor (Frank de Jong) and various participants at the CPB seminar on October 8 2013 for their very helpful suggestions.
Rights and permissions
About this article
Cite this article
Franses, P.H. Evaluating CPB’s Forecasts. De Economist 162, 215–221 (2014). https://doi.org/10.1007/s10645-014-9230-z
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10645-014-9230-z