Climate Dynamics

, Volume 35, Issue 2–3, pp 407–422 | Cite as

Weighting of model results for improving best estimates of climate change

  • Jouni Räisänen
  • Leena Ruokolainen
  • Jussi Ylhäisi
Article

Abstract

Climate projections from multi-model ensembles are commonly represented by the multi-model mean (MMM) climate change. As an alternative, various subjectively formulated schemes for performance-based weighting of models have been proposed. Here, a more objective framework for model weighting is developed. A key ingredient of this scheme is a calibration step quantifying the relationship between intermodel similarity in observable climate and intermodel similarity in simulated climate change. Models that simulate the observable climate better are only given higher weight where and when such an intermodel relationship is found, and the difference in weight between better and worse performing models increases with the strength of this relationship. The method is applied to projections of temperature change from the Third Coupled Model Intercomparison Project. First, cross-validation is used to estimate the potential of the method to improve the accuracy of climate change estimates and to search for suitable predictor variables. The decrease in cross-validation error allowed by the weighting is relatively modest but not negligible, and it could potentially be increased if better predictor variables were found. Second, observations are used to weight the models, to study the differences between the weighted mean and MMM estimates of twenty-first century temperature change and the sensitivity of these differences to the predictor variables and observational data sets used.

Keywords

Climate change Temperature change Climate projection Weighting Cross-validation CMIP3 

Notes

Acknowledgments

We acknowledge the modeling groups, the Program for Climate Model Diagnosis and Intercomparison (PCMDI) and the WCRP’s Working Group on Coupled Modelling (WGCM) for their roles in making available the WCRP CMIP3 multi-model dataset. Support of this dataset is provided by the Office of Science, U.S. Department of Energy. We also acknowledge the comments of two anonymous reviewers, which lead us to substantially widen the scope of our original manuscript. This research has been supported by the Academy of Finland (decision 127239) and by the ACCLIM II project within the Finnish Climate Change Adaptation Research Programme ISTO.

References

  1. Adler RF, Huffman GJ, Chang A, Ferraro R, Xie P, Janowiak J, Rudolf B, Schneider U, Curtis S, Bolvin D, Gruber A, Susskind J, Arkin P (2003) The version 2 global precipitation climatology project (GPCP) monthly precipitation analysis (1979-Present). J Hydrometeorol 4:1147–1167CrossRefGoogle Scholar
  2. Allan RJ, Ansell TJ (2006) A new globally complete monthly historical mean sea level pressure data set (HadSLP2): 1850–2004. J Climate 19:5816–5842CrossRefGoogle Scholar
  3. Christensen JH, Hewitson B, Busuioc A, Chen A, Gao X, Held I, Jones R, Kolli RK, Kwon W-T, Laprise R, Magaña Rueda V, Mearns L, Menéndez CG, Räisänen J, Rinke A, Sarr A, Whetton P (2007) Regional climate projections. In: Solomon S et al (eds) Climate change 2007: the physical science basis. Cambridge University Press, Cambridge, pp 847–940Google Scholar
  4. DelSole T, Shukla J (2009) Artificial skill due to predictor screening. J Climate 22:331–345CrossRefGoogle Scholar
  5. Furrer R, Sain SR, Nychka D, Meehl GA (2007) Multivariate Bayesian analysis of atmosphere-ocean general circulation models. Environ Ecol Stat 14:249–266CrossRefGoogle Scholar
  6. Giorgi F, Mearns LO (2002) Calculation of average, uncertainty range, and reliability of regional climate changes from AOGCM simulations via the “reliability ensemble averaging” (REA) method. J Climate 15:1141–1158CrossRefGoogle Scholar
  7. Gleckler PJ, Taylor KE, Doutriaux C (2008) Performance metrics for climate models. J Geophys Res 113. doi: 10.1029/2007JD008972
  8. Greene AM, Goddard L, Lall U (2006) Probabilistic multimodel regional temperature change projections. J Climate 19:4326–4343CrossRefGoogle Scholar
  9. Kistler R, Kalnay E, Collins W, Saha S, White G, Woollen J, Chelliah M, Ebisuzaki W, Kanamitsu M, Kousky V, van den Dool H, Jenne R, Fiorino M (2001) The NCEP-NCAR 50-year reanalysis: monthly means CD-ROM and documentation. Bull Am Meteorol Soc 82:247–267CrossRefGoogle Scholar
  10. Krishnamurti TN, Kishtawal CM, Zhang Z, LaRow T, Bachiochi D, Williford E, Gadgil S, Surendran S (2000) Multimodel ensemble forecasts for weather and seasonal climate. J Climate 13:4196–4216CrossRefGoogle Scholar
  11. Lambert SJ, Boer GJ (2001) CMIP1 evaluation and intercomparison of coupled climate models. Clim Dyn 17:83–106CrossRefGoogle Scholar
  12. Meehl GA, Covey C, Delworth T, Latif M, McAvaney B, Mitchell JFB, Stouffer RJ, Taylor KE (2007a) The WCRP CMIP3 multimodel dataset: a new era in climate change research. Bull Am Meteorol Soc 88:1383–1394CrossRefGoogle Scholar
  13. Meehl GA, Stocker TF, Collins W, Friedlingstein P, Gaye A, Gregory J, Kitoh A, Knutti R, Murphy J, Noda A, Raper S, Watterson I, Weaver A, Zhao Z-C (2007b) Global climate projections. In: Solomon S et al (eds) Climate change 2007: the physical science basis. Cambridge University Press, Cambridge, pp 747–845Google Scholar
  14. Murphy JM, Sexton DMH, Barnett DN, Jones GS, Webb MJ, Collins M, Stainforth DA (2004) Quantification of modelling uncertainties in a large ensemble of climate change simulations. Nature 430:768–772CrossRefGoogle Scholar
  15. Nakićenović N, Alcamo J, Davis G, de Vries B, Fenhann J, Gaffin S, Gregory K, Grübler A, Jung TY, Kram T, La Rovere EL, Michaelis L, Mori S, Morita T, Pepper W, Pitcher H, Price L, Raihi K, Roehrl A, Rogner H-H, Sankovski A, Schlesinger M, Shukla P, Smith S, Swart R, van Rooijen S, Victor N, Dadi Z (2000) Emission scenarios. A special report of Working Group III of the Intergovernmental Panel on Climate Change. Cambridge University Press, Cambridge, 599 ppGoogle Scholar
  16. Randall DA, Wood RA, Bony S, Colman R, Fichefet T, Fyfe J, Kattsov V, Pitman A, Shukla J, Srinivasan J, Stouffer RJ, Sumi A, Taylor KE (2007) Climate models and their evaluation. In: Solomon S et al (eds) Climate change 2007: the physical science basis. Cambridge University Press, Cambridge, pp 589–662Google Scholar
  17. Rossow WB, Schiffer RA (1999) Advances in understanding clouds from ISCCP. Bull Am Meteorol Soc 80:2261–2288CrossRefGoogle Scholar
  18. Stainforth DA, Aina T, Christensen C, Collins M, Fauli N, Frame DJ, Kettleborough JA, Knight S, Martin A, Murphy JM, Piani C, Sexton D, Smith LA, Spicer RA, Thorpe AJ, Allen MR (2005) Uncertainty in the predictions of the climate response to rising levels of greenhouse gases. Nature 433:403–406CrossRefGoogle Scholar
  19. Tebaldi C, Smith RL, Nychka D, Mearns LO (2005) Quantifying uncertainty in projections of regional climate change: a Bayesian approach to the analysis of multimodel ensembles. J Climate 18:1524–1540CrossRefGoogle Scholar
  20. Uppala SM, Kållberg PW, Simmons AJ, Andrae U, da Costa Bechtold V, Fiorino M, Gibson JK, Haseler J, Hernandez A, Kelly GA, Li X, Onogi K, Saarinen S, Sokka N, Allan RP, Andersson E, Arpe K, Balmaseda MA, Beljaars ACM, van de Berg L, Bidlot J, Bormann N, Caires S, Chevallier F, Dethof A, Dragosavac M, Fisher M, Fuentes M, Hagemann S, Hólm E, Hoskins BJ, Isaksen L, Janssen PAEM, Jenne R, McNally AP, Mahfouf JF, Morcrette JJ, Rayner NA, Saunders RW, Simon P, Sterl A, Trenberth KE, Untch A, Vasiljevic D, Viterbo P, Woollen J (2005) The ERA-40 re-analysis. Quart J R Meteorol Soc 131:2961–3012CrossRefGoogle Scholar
  21. Watterson IG (2008) Calculation of probability density functions for temperature and precipitation change under global warming. J Geophys Res 113:D12106. doi: 10.1029/2007JD009254 CrossRefGoogle Scholar
  22. Whetton P, Macadam I, Batholds I, O’Grady J (2007) Assessment of the use of current climate patterns to evaluate regional enhanced greenhouse response patterns of climate models. Geophys Res Lett 34:L14701. doi: 10.1029/2007GL030025 CrossRefGoogle Scholar

Copyright information

© Springer-Verlag 2009

Authors and Affiliations

  • Jouni Räisänen
    • 1
  • Leena Ruokolainen
    • 1
  • Jussi Ylhäisi
    • 1
  1. 1.Department of PhysicsUniversity of HelsinkiUniversity of HelsinkiFinland

Personalised recommendations