Skip to main content

Advertisement

Log in

Calibration and combination of monthly near-surface temperature and precipitation predictions over Europe

  • Published:
Climate Dynamics Aims and scope Submit manuscript

Abstract

A Bayesian method known as the Forecast Assimilation (FA) was used to calibrate and combine monthly near-surface temperature and precipitation outputs from seasonal dynamical forecast systems. The simple multimodel (SMM), a method that combines predictions with equal weights, was used as a benchmark. This research focuses on Europe and adjacent regions for predictions initialized in May and November, covering the boreal summer and winter months. The forecast quality of the FA and SMM as well as the single seasonal dynamical forecast systems was assessed using deterministic and probabilistic measures. A non-parametric bootstrap method was used to account for the sampling uncertainty of the forecast quality measures. We show that the FA performs as well as or better than the SMM in regions where the dynamical forecast systems were able to represent the main modes of climate covariability. An illustration with the near-surface temperature over North Atlantic, the Mediterranean Sea and Middle-East in summer months associated with the well predicted first mode of climate covariability is offered. However, the main modes of climate covariability are not well represented in most situations discussed in this study as the seasonal dynamical forecast systems have limited skill when predicting the European climate. In these situations, the SMM performs better more often.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Notes

  1. http://gmao.gsfc.nasa.gov/research/climate/NMME/. Accessed 15 December 2016.

References

  • Alessandri A, Borrelli A, Navarra A, Arribas A, Déqué M, Rogel P, Weisheimer A (2011) Evaluation of probabilistic quality and value of the ENSEMBLES multimodel seasonal forecasts: comparison with DEMETER. Mon Weather Rev 139:581–607

    Article  Google Scholar 

  • Arribas A, Glover M, Maidens A, Peterson K, Gordon M, MacLachlan C, Graham R, Fereday D, Camp J, Scaife AA, Xavier P, McLean P, Colman A, Cusack S (2011) The GloSea4 ensemble prediction system for seasonal forecasting. Mon Weather Rev 139:1891–1910

    Article  Google Scholar 

  • Barnett TP, Preisendorfer R (1987) Origins and levels of monthly and seasonal forecast skill for United States surface air temperatures determined by canonical correlation analysis. Mon Weather Rev 115:1825–1850

    Article  Google Scholar 

  • Coelho CAS, Pezzulli S, Balmaseda M, Doblas-Reyes FJ, Stephenson DB (2004) Forecast calibration and combination: a simple Bayesian approach for ENSO. J Clim 17:1504–1516

    Article  Google Scholar 

  • Coelho CAS, Stephenson DB, Balmaseda M, Doblas-Reyes FJ, van Oldenborgh GJ (2006) Toward an integrated seasonal forecasting system for South America. J Clim 19:3704–3721

    Article  Google Scholar 

  • Dee DP, Uppala SM, Simmons AJ, Berrisford P, Poli P, Kobayashi S, Andrae U, Balmaseda MA, Balsamo G, Bauer P, Bechtold P, Beljaars ACM, van de Berg L, Bidlot J, Bormann N, Delsol C, Dragani R, Fuentes M, Geer AJ, Haimberger L, Healy SB, Hersbach H, Holm EV, Isaksen L, Kallberg P, Kohler M, Matricardi M, McNally AP, Monge-Sanz BM, Morcrette J-J, Park B-K, Peubey C, Rosnay P, Tavolato C, Thepaut J-N, Vitart F (2011) The ERA-Interim reanalysis: configuration and performance of the data assimilation system. Q J R Meteorol Soc 137:553–597

    Article  Google Scholar 

  • Doblas-Reyes FJ, Déqué M, Piedelievre JP (2000) Multi-model spread and probabilistic seasonal forecasts in PROVOST. Q J R Meteorol Soc 126:2069–2087

    Article  Google Scholar 

  • Doblas-Reyes FJ, Hagedorn R, Palmer TN (2005) The rationale behind the success of multi-model ensembles in seasonal forecasting. Part II: calibration and combination. Tellus A 57:234–252

    Google Scholar 

  • Doblas-Reyes FJ, Weisheimer A, Déqué M, Keenlyside N, McVean M, Murphy JM, Rogel P, Smith D, Palmer TN (2009) Addressing model uncertainty in seasonal and annual dynamical seasonal forecasts. Q J R Meteorol Soc 135:1538–1559

    Article  Google Scholar 

  • Doblas-Reyes FJ, Garcia-Serrano J, Lienert F, Pinto-Biescas A, Rodrigues LRL (2013) Seasonal climate predictability and forecasting: status and prospects. WIREs Clim Change 4:245–268

    Article  Google Scholar 

  • Eden JM, van Oldenborgh GJ, Hawkins E, Suckling EB (2015) A global empirical system for probabilistic seasonal climate prediction. Geosci Model Dev Discuss 8:3941–3970

    Article  Google Scholar 

  • EEA (2015) European Environment Agency: Global and European temperatures (CSI 012/CLIM 001) Assessment. http://www.eea.europa.eu/data-and-maps/indicators/global-and-european-temperature-1/assessment. Accessed 7 Aug 2015

  • Gneiting T, Raftery AE, Westveld AH, Goldman T (2005) Calibrated probabilistic forecasting using ensemble model output statistics and minimum CRPS estimation. Mon Weather Rev 133:1098–1118

    Article  Google Scholar 

  • Goddard L, Mason SJ, Zebiak SE, Ropelewski CF, Basher R, Cane MA (2001) Current approaches to seasonal to interannual climate predictions. Int J Climatol 21:1111–1152

    Article  Google Scholar 

  • Graham RJ, Gordon M, McLean PJ, Ineson S, Huddleston MR, Davey MK, Brookshaw A, Barnes RTH (2005) A performance comparison of coupled and uncoupled versions of the Met Office seasonal prediction general circulation model. Tellus A 57:320–339

    Article  Google Scholar 

  • Hagedorn R, Doblas-Reyes FJ, Palmer TN (2005) The rationale behind the success of multi-model ensembles in seasonal forecasting-I. Basic concept. Tellus A 57:219–233

    Google Scholar 

  • Hersbach H (2000) Decomposition of the continuous ranked probability score for ensemble prediction systems. Weather Forecast 15:559–570

    Article  Google Scholar 

  • Huffman GJ, Bolvin DT (2013) GPCP Version 2.2 combined precipitation data set documentation, internet publication, pp 1–46. http://www1.ncdc.noaa.gov/pub/data/gpcp/gpcp-v2.2/doc/V2.2_doc.pdf. Accessed 16 Nov 2012

  • Johansson A, Barnston A, Saha S, van den Dool H (1998) On the level and origin of seasonal forecast skill in northern Europe. J Atmos Sci 55:103–127

    Article  Google Scholar 

  • Jolliffe IT, Stephenson DB (2012) Forecast verification: a practitioner’s guide in atmospheric science, Second edn. Wiley, Chichester

    Google Scholar 

  • Kim HM, Webster PJ, Curry JA (2012) Seasonal prediction skill of ECMWF System 4 and NCEP CFSv2 retrospective forecast for the Northern Hemisphere Winter. Clim Dyn 39:2957–2973

    Article  Google Scholar 

  • Kirtman BP, Min D, Infanti JM, Kinter JL III, Paolino DA, Zhang Q, van den Dool H, Saha S, Mendez MP, Becker E, Peng P, Tripp P, Huang J, DeWitt DG, Tippett MK, Barnston AG, Li S, Rosati A, Schubert SD, Rienecker M, Suarez M, Li ZE, Marshak J, Lim Y-K, Tribbia J, Pegion K, Merryfield WJ, Denis B, Wood EF (2014) The North American multimodel ensemble: phase-1 seasonal-to-interannual prediction; phase-2 toward developing intraseasonal prediction. Bull Am Meteorol Soc 95:585–601

    Article  Google Scholar 

  • Mason SJ (2008) Understanding forecast verification statistics. Meteorol Appl 15:31–40

    Article  Google Scholar 

  • Mason SJ, Baddour O (2008) Statistical modeling. In: Troccoli A, Harrison MSJ, Anderson DLT, Mason SJ (eds) Seasonal climate: forecasting and managing risk. Springer Academic Publishers, Dordrecht, pp 167–206

    Google Scholar 

  • Mason SJ, Goddard L, Graham NE, Yulaeva E, Sun L, Arkin PA (1999) The IRI seasonal climate prediction system and the 1997/98 El Niño Event. Bull Am Meteorol Soc 80:1853–1873

    Article  Google Scholar 

  • Merryfield WJ, Lee W-S, Boer GJ, Kharin VV, Scinocca JF, Flato GM, Ajayamohan RS, Fyfe JC, Tang Y, Polavarapu S (2013) The canadian seasonal to interannual prediction System. part i: models and initialization. Mon Weather Rev 141:2910–2945

    Article  Google Scholar 

  • Molteni F, Stockdale T, Balmaseda M, Balsamo G, Buizza R, Ferranti L, Magnusson L, Mogensen K, Palmer T, Vitart F (2011) The new ECMWF seasonal forecast system (System 4). ECMWF Technical Memorandum 656. http://www.ecmwf.int/publications/library/do/references/list/14. Accessed 20 Dec 2012

  • Robertson AW, Lall U, Zebiak SE, Goddard L (2004) Improved combination of multiple atmospheric GCM ensembles for seasonal prediction. Mon Weather Rev 132:2732–2744

    Article  Google Scholar 

  • Rodrigues LRL, Doblas-Reyes FJ, Coelho CAS (2014a) Multi-model calibration and combination of tropical seasonal sea surface temperature forecasts. Clim Dyn 42:597–616

    Article  Google Scholar 

  • Rodrigues LRL, García-Serrano J, Doblas-Reyes FJ (2014b) Seasonal forecast quality of the West African monsoon rainfall regimes by multiple forecast systems. J Geophys Res 119:7908–7930

    Google Scholar 

  • Saha S, Moorthi S, Wu X, Wang J, Nadiga S, Tripp P, Behringer D, Hou Y-T, Chuang H, Iredell M, Ek M, Meng J, Yang R, Mendez MP, van den Dool H, Zhang Q, Wang W, Chen M, Becker E (2014) The NCEP climate forecast system version 2. J Clim 27:2185–2208

    Article  Google Scholar 

  • Scaife AA, Arribas A, Blockley E, Brookshaw A, Clark RT, Dunstone N, Eade R, Fereday D, Folland CK, Gordon M, Hermanson L, Knight JR, Lea DJ, MacLachlan C, Maidens A, Martin M, Peterson AK, Smith D, Vellinga M, Wallace E, Waters J, Williams A (2014) Skillful long-range prediction of European and North American winters. Geophys Res Lett 41:2514–2519

    Article  Google Scholar 

  • Stephenson DB, Coelho CAS, Doblas-Reyes FJ, Balmaseda M (2005) Forecast assimilation: a unified framework for the combination of multi-model weather and climate predictions. Tellus A 57:253–264

    Article  Google Scholar 

  • Stockdale TN, Molteni F, Ferranti L (2015) Atmospheric initial conditions and the predictability of the Arctic Oscillation. Geophys Res Lett 42:1173–1179

    Article  Google Scholar 

  • Vernieres G, Rienecker MM, Kovach R, Keppenne CL (2012) The GEOS-iODAS: Description and evaluation. NASA Technical Report Series on Global Modeling and Data Assimilation TM2012-104606 30

  • Vitart F, Huddleston MR, Déqué M, Peake D, Palmer TN, Stockdale TN, Davey MK, Ineson S, Weisheimer A (2007) Dynamically-based seasonal forecasts of Atlantic tropical storm activity issued in June by EUROSIP. Geophys Res Lett 34:L16815

    Article  Google Scholar 

  • Wang B, Li J-Y, Kang I-S, Shukla J, Park C-K, Kumar A, Schemm J, Cocke S, Kug J-S, Luo J-J, Fu X, Yun W-T, Alves O, Jin E, Kinter J, Kirtman B, Krishnamurti T, Lau N, Lau W, Liu P, Pegion P, Rosati T, Schubert S, Stern W, Suarez M, Yamagate T (2009) Advance and prospectus of seasonal prediction: assessment of the APCC/CliPAS 14 model ensemble retrospective seasonal prediction (1980–2004). Clim Dyn 33:93–117

    Article  Google Scholar 

  • Yuan X, Wood EF, Luo L, Pan M (2011) A first look at climate forecast system version 2 (CFSv2) for hydrological seasonal prediction. Geophys Res Lett 38:L1340

    Google Scholar 

  • Zhang S, Harrison MJ, Rosati A, Wittenberg A (2007) System design and evaluation of coupled ensemble data assimilation for global oceanic climate studies. Mon Weather Rev 135:3541–3564

    Article  Google Scholar 

Download references

Acknowledgements

The authors thank NOAA, NCEP, IRI and NCAR personnel in creating, updating and maintaining the NMME archive. The NMME project and data dissemination is supported by NOAA, NSF, NASA and DOE. Météo-France and ECMWF are appreciated for making available their seasonal prediction hindcasts. This study was supported by the Seventh Framework Programme SPECS project (contract 308378) and the H2020 EUCP project (contract 776613). CASC was supported by Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq) processes 304586/2016-1. LRLR and CASC acknowledge the support of FAPESP, process 2015/50687-8 (CLIMAX project). The authors acknowledge two anonymous reviewers for their useful comments and suggestions.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Luis R. L. Rodrigues.

Additional information

This paper is a contribution to the special collection on the North American Multi-Model Ensemble (NMME) seasonal prediction experiment. The special collection focuses on documenting the use of the NMME system database for research ranging from predictability studies, to multi-model prediction evaluation and diagnostics, to emerging applications of climate predictability for subseasonal to seasonal predictions. This special issue is coordinated by Annarita Mariotti (NOAA), Heather Archambault (NOAA), Jin Huang (NOAA), Ben Kirtman (University of Miami) and Gabriele Villarini (University of Iowa).

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Rodrigues, L.R.L., Doblas-Reyes, F.J. & Coelho, C.A.S. Calibration and combination of monthly near-surface temperature and precipitation predictions over Europe. Clim Dyn 53, 7305–7320 (2019). https://doi.org/10.1007/s00382-018-4140-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00382-018-4140-4

Keywords

Navigation