Abstract
The article presents an approach for creating a computationally efficient stochastic weather generator. In this work the method is tested by the stochastic simulation of sea level pressure over the sub-polar North Atlantic. The weather generator includes a hidden Markov model, which propagates regional circulation patterns identified by a self organising map analysis, conditioned on the state of large-scale interannual weather regimes. The remaining residual effects are propagated by a regression model with added noise components. The regression step is performed by one of two methods, a linear model or artificial neural networks and the performance of these two methods is assessed and compared. The resulting simulations express the range of the major regional patterns of atmospheric variability and typical time scales. The long term aims of this work are to provide ensembles of atmospheric data for applied regional studies and to develop tools applicable in down-scaling large-scale ocean and atmospheric simulations.
Similar content being viewed by others
Notes
The software used here is freely available from: www.cis.hut.fi/research/som_pak/.
For the ANNs used in this project the non-linear transforms are the arctan function.
The software used for these experiments is freely available from: http://www.cs.toronto.edu/~radford/fbm.software.html.
References
Aguilar-Martinez S, Hsieh WW (2009) Forecasts of tropical Pacific sea surface temperatures by neural networks and support vector regression. Int J Oceanogr. doi:10.1155/2009/167239
Baigorria G, Jones J (2010) GiST, A stochastic model for generating spatially and temporally correlated daily rainfall data. J Clim 23:5990–6008
Benestad RE, Hanssen-Bauer I, Chen D (2008) Empirical–statistical downscaling. World Scientific Publishing, Singapore
Bersch M, Yashayaev I, Koltermann KP (2007) Recent changes of the thermohaline circulation in the subpolar North Atlantic. Ocean Dyn 57(3):223–235
Bezdek JC (1981) Pattern recognition with fuzzy objective function algorithms. Plenum Press, New York
Burnham KP (2004) Multimodel inference: understanding AIC and BIC in model selection. Sociol Methods Res 33(2):261–304
Cappe O (2005) Inference in hidden Markov models. Springer, New York
Cassano E. N, Lynch AH, Cassano JJ, Koslow MR (2005) Classification of synoptic patterns in the western Arctic associated with extreme events at Barrow, Alaska, USA. Clim Res 20(2):83
Cassou C (2008) Intraseasonal interaction between the Madden–Julian oscillation and the North Atlantic oscillation. Nature 455(7212):523–527
Cassou C, Terray L, Hurrell J W, Deser C (2004) North Atlantic winter climate regimes: spatial asymmetry, stationarity with time, and oceanic forcing. J Clim 17:1055–1068
Cattiaux J, Vautard R, Cassou C, Yiou P, Masson-Delmotte V, Codron F (201) Winter 2010 in Europe: a cold extreme in a warming climate. Geophys Res Lett 37(20):L20704
Cheng X, Wallace J (1991) Cluster analysis of the Northern Hemisphere 500-hPa height field: spatial patterns. J Atmos Sci 50(16):2674–2696
Chowdhury M, Alouani A, Hossain F (2010) Comparison of ordinary kriging and artificial neural network for spatial mapping of arsenic contamination of groundwater. Stoch Environ Res Risk Assess 24(1):1–7
Corti S, Molteni F, Palmer T (1999) Signature of recent climate change in frequencies of natural atmospheric circulation regimes. Nature 398:799–802
Duchon CE (1979) Lanczos filtering in one and two dimensions. J Appl Meteorol 18:1016–1022
Feldstein SB (2000) The timescale, power spectra, and climate noise properties of teleconnection patterns. J Clim 13(24):4430–4440
Ferraris L, Gabellani S, Rebora N, Provenzale A (2003) A comparison of stochastic models for spatial rainfall downscaling. Water Resour Res 39(12):1368–1384
Fraley C, Raftery AE (2002) Model-based clustering, discriminant analysis and density estimation. J Am Stat Assoc 97:611–631
Fraley C, Raftery AE (2006) MCLUST version 3 for R: Normal mixture modeling and model-based clustering, University of Washington
Furrer EM, Katz RW (2007) Generalized linear modeling approach to stochastic weather generators. Clim Res 34(2):129
Grimm AM (2011) Interannual climate variability in South America: impacts on seasonal precipitation, extreme events, and possible effects of climate change. Stoch Environ Res Risk Assess 25(4):537–554
Guo J, Chen H, Xu CY, Guo S, Guo J (2012) Prediction of variability of precipitation in the Yangtze River Basin under the climate change conditions based on automated statistical downscaling. Stoch Environ Res Risk Assess 26(2):157–176
Hakkinen S, Rhines PB, Worthen DL (2011) Atmospheric blocking and Atlantic multidecadal ocean variability. Science 334(6056):655–659
Hashmi MZ, Shamseldin AY, Melville BW (2011) Comparison of SDSM and LARS-WG for simulation and downscaling of extreme precipitation events in a watershed. Stoch Environ Res Risk Assess 25(4):475–484
Hewitson BC, Crane RG (2002) Self-organizing maps: applications to synoptic climatology. Clim Res 22(1):13–26
Hoskins BJ, Hodges KI (2010) New perspectives on the Northern Hemisphere winter storm tracks. J Atmos Sci 59(6):1041–1061
Hauser T, Keats A, Tarasov L (2011) Artificial neural network assisted Bayesian calibration of climate models Clim Dyn 39(1–2):137–154
Heckerling PS, Gerber BS, Tape TG, Wigton RS (2003) Entering the black box of neural networks. Methods Inf Med 42(3):287–296
Hurrell J. W, Kushnir Y, Ottersen G, Visbeck M (2003) An overview of the North Atlantic oscillation. Am Geophys Union 134:1–36
Jones PD, Harpham C, Kilsby C, Glenis V, Burton A (2009) Projections of future daily climate for the UK from the weather generator. Met Office, Exeter
Kalnay E, Kanamitsu M, Kistler R, Collins W, Deaven D, Gadin L, Iredell M, Saha S, White G, Woollen J, Zhu Y, Chelliah M, Ebisuzaki W, Higgins W, Janowiak J, Mo K, Ropelewski C, Wang J, Leetmaa A, Reynolds R, Jenne R, Joseph D (1996) The NCEP/NCAR 40 year reanalysis project. Bull Am Meteorol Soc 77:437–470
Kaufman L, Rousseeuw PJ (1990) Finding groups in data: an introduction to cluster analysis. Wiley, New York
Kohonen T, Hynninen J, Kangas J, Laaksonen J (1996) Som pak: the self-organizing map program package, A31, Helsinki University of Technology, Laboratory of Computer and Information Science, Espoo, Finland
Kravtsov S, Kondrashov D, Ghil M (2005) Multilevel regression modeling of nonlinear processes: derivation and applications to climatic variability. J Clim 18(21):4404–4424
Kravtsov, S, Kondrashov D, Ghil M (2010) Empirical model reduction and the modelling hierarchy in climate dynamics and the geosciences. Stoch Phys Clim Model 1:35–72
Lee H (2006) Bayesian nonparametrics via neural networks. ASA-SIAM, Philadelphia
Lohmann K, Drange H, Bentsen M (2008) Response of the North Atlantic subpolar gyre to persistent North Atlantic oscillation like forcing. Clim Dyn 32(2–3):273–285
Luo D, Diao Y, Feldstein SB (2011) The variability of the Atlantic storm track and the North Atlantic oscillation: a link between intraseasonal and interannual variability. J Atmos Sci 68(3):577–601
MacKay D (2003) Information theory, inference, and learning algorithms, Cambridge University Press, Cambridge
Maechler M, Rousseeuw P, Struyf A, Hubert M (2012) Cluster: cluster analysis basics and extensions. R package version 1.14.3
Marsh, R, Josey SA, de Cuevas BA, Redbourn LJ, Quartly GD (2008) Mechanisms for recent warming of the North Atlantic: insights gained with an eddy-permitting model. J Geophys Res 113(C4). doi:10.1029/2007JC004096
Maraun D, Wetterhall F, Ireson AM, Chandler RE., Kendon, EJ, Widmann M, Brienen S, Rust HW, Sauter T, Themel M, Venema VKC, Chun KP, Goodess CM, Jones RG, Onof C, Vrac M, Thiele-Eich I (2010) Precipitation downscaling under climate change: recent developments to bridge the gap between dynamical models and the end user. Rev Geophys 48(3):RG3003
Molteni F, Kucharski F, Corti S (2006) On the predictability of flow-regime properties on interannual to interdecadal timescales, Predictability of weather and climate. Cambridge University Press, Cambridge
Minville M, Brissette F, Leconte R (2008) Uncertainty of the impact of climate change on the hydrology of a nordic watershed. J Hydrol 358(1):70–83
Neal R (1991) Bayesian mixture modeling by Monte Carlo simulation, University of Toronto, CRG-TR-91-2
Neal R (1996) Bayesian learning for neural networks, Lecture notes in statistics, vol 118. Springer, New York
Oelschlagel B (1995) A method for downscaling global climate model calculations by a statistical weather generator. Ecol Model 82(2):199–204
OrtizBeviá MJ, SánchezGómez E, Alvarez-García FJ (2011) North Atlantic atmospheric regimes and winter extremes in the Iberian peninsula. Nat Hazards Earth Syst Sci 11(3):971–980
Palmer TN (1999) A nonlinear dynamical perspective on climate prediction. J Clim 12(2):575–591
Reusch D, Alley R, Hewitson B (2007) North Atlantic climate variability from a self-organizing map perspective. J Geophys Res 112:1–20
Robson J, Sutton R, Lohmann K, Smith D, Palmer M (2012) Causes of the rapid warming of the North Atlantic ocean in the mid-1990s. J Clim 25:4116–4134
Rust HW, Vrac M, Lengaigne M, Sultan B (2010) Quantifying differences in circulation patterns based on probabilistic models. J Clim 23:6573–6589
Sarafanov A, Falina A, Sokov A, Demidov A (2008) Intense warming and salinification of intermediate waters of southern origin in the eastern subpolar North Atlantic in the 1990s to mid-2000s. J Geophys Res 113:C12022
Schaefer J, Strimmer K (2005) A shrinkage approach to large-scale covariance matrix estimation and implications for functional genomics. Stat Appl Genet Mol Biol 4(1):32
Semenov M, Barrow E (1997) Use of a stochastic weather generator in the development of climate change scenarios. Clim Chang 35:397–494
Severijns CA, Hazeleger W (2010) The efficient global primitive equation climate model SPEEDO V2. Geosci Model Dev 3:105–122
Sexton DMH, Murphy JM (2011) Multivariate probabilistic projections using imperfect climate models. Part II: robustness of methodological choices and consequences for climate sensitivity. Clim Dyn 38(11–12):2543–2558
Strounine K, Kravtsov S, Kondrashov D, Ghil M (2010) Reduced models of atmospheric low-frequency variability: parameter estimation and comparative performance. Physical D 239(3–4):145–166
Tang Y, Hsieh WW (2010) Hybrid coupled models of the tropical Pacific—II ENSO prediction. Clim Dyn 19(3–4): 343–353
Tang Y, Hsieh W, Tang B, Haines K (2001) A neural network atmospheric model for hybrid coupled modeling. Clim Dyn 17:445–455
Thomson DWJ, Lee S, Baldwin MP (2003) Atmospheric processes governing the Northern Hemisphere annular mode/North Atlantic oscillation. The North Atlantic Oscillation, Geophysical Monograph, vol 134. American Geophysics Union 81112
Vallis GK, Gerber EP, Kushner PJ, Cash BA (2004) A mechanism and simple dynamical model of the North Atlantic Oscillation and annular modes. J Atmos Sci 61(3):264–280
von Hardenberg J, Ferraris L, Rebora N, Provenzale A (2007) Meteorological uncertainty and rainfall downscaling. Nonlinear Process Geophys 14(3):193–199
Wallace JM, Gutzler DS (1981) Teleconnections in the geopotential height field during the Northern Hemisphere Winter. Mon Weather Rev 109:784–812
Yiou P (2004) Extreme climatic events and weather regimes over the North Atlantic: when and where? Geophys Res Lett 31(7):L07202
Zhu J, Demirov E (2011) On the mechanism of interannual variability of the Irminger Water in the Labrador Sea. J Geophys Res 116:C03029
Acknowledgements
Support provided by: CFI, NSERC, and ACE-Net. This work strongly benefited from discussions with Joel Finnis, Jonas Roberts and Lev Tarasov, as well as from detailed comments from two anonymous reviewers.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Hauser, T., Demirov, E. Development of a stochastic weather generator for the sub-polar North Atlantic. Stoch Environ Res Risk Assess 27, 1533–1551 (2013). https://doi.org/10.1007/s00477-013-0688-z
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00477-013-0688-z