NN Ensembles and Their Applications

  • Vladimir M. Krasnopolsky
Part of the Atmospheric and Oceanographic Sciences Library book series (ATSL, volume 46)


In this chapter, various neural network (NN) ensemble applications including applications in data assimilation systems, nonlinear multi-model ensembles, ensembles with perturbed model physics, and others are introduced and discussed. It is shown that in many cases, NN ensemble approaches provide a better and more adequate emulation of the complex nonlinear mappings than a single NN. In this chapter, an NN ensemble approach is applied to introduce analytic approximations for highly complex functional dependencies and mappings between the model variables in an oceanic data assimilation system which enables 3-D assimilation of surface 2-D variables like the surface elevation. An NN ensemble approach is applied to derive a nonlinear multi-model ensemble for improving 24-h precipitation forecasts over the continental US (ConUS). Different possibilities for using the NN emulation technique in combination with the NN ensemble approach for generating stochastic or perturbed model physics and ensembles with perturbed model physics are considered. The chapter contains an extensive list of references giving extended background and further detail to the interested reader on each examined topic. It can serve as a textbook and an introductory reading for students and beginning and advanced investigators interested in learning how to apply the NN ensemble technique to various problems.


Ensemble Member Ensemble Approach Neural Network Technique Neural Network Ensemble Ensemble Mean 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. Barai SV, Reich Y (1999) Ensemble modeling or selecting the best model: many could be better than one. AI EDAM 13:377–386CrossRefGoogle Scholar
  2. Bleck R (2002) An oceanic general circulation model framed in hybrid isopycnic-cartesian coordinates. Ocean Model 4:55–88CrossRefGoogle Scholar
  3. Broccoli AJ, Dixon KW, Delworth TL, Knutson TR, Stouffer RJ (2003) Twentieth-century temperature and precipitation trends in ensemble climate simulations including natural and anthropogenic forcing. J Geophys Res 108(D24):4798–4811. doi: 10.1029/2003JD003812 CrossRefGoogle Scholar
  4. Buizza R (1997) Potential forecast skill of ensemble prediction and spread and skill distributions of the ECMWF Ensemble Prediction System. Mon Weather Rev 125:99–119CrossRefGoogle Scholar
  5. Buizza R, Palmer TN (1998) Impact of ensemble size on ensemble prediction. Mon Weather Rev 126:2503–2518CrossRefGoogle Scholar
  6. Buizza R, Miller M, Palmer TN (1999) Stochastic representation of model uncertainties in the ECMWF Ensemble Prediction System. Q J R Meteorol Soc 125:2887–2908CrossRefGoogle Scholar
  7. Buizza R, Houtekamer PL, Toth Z, Pellerin G, Wei M, Zhu Y (2005) A comparison of the ECMWF, MSC, and NCEP Global Ensemble Prediction Systems. Mon Weather Rev 133:1076–1097CrossRefGoogle Scholar
  8. Chassignet EP, Smith LT Jr, Halliwell GR Jr, Bleck R (2003) North Atlantic simulations with the hybrid coordinate ocean model (HYCOM): impact of the vertical coordinate choice, reference pressure, and thermobaricity. J Phys Oceanogr 33:2504–2526CrossRefGoogle Scholar
  9. Collins WD, Hackney JK, Edwards DP (2002) A new parameterization for infrared emission and absorption by water vapor in the National Center for Atmospheric Research Community Atmosphere Model. J Geophys Res 107:1–20Google Scholar
  10. Du J, Mullen SL, Sanders F (1997) Short-range ensemble forecasting of quantitative precipitation. Mon Weather Rev 125:2427–2459CrossRefGoogle Scholar
  11. Ebert EE (2001) Ability of a poor man’s ensemble to predict the probability and distribution of precipitation. Mon Weather Rev 129:2461–2480CrossRefGoogle Scholar
  12. Guinehut S, Le Traon PY, Larnicol G, Philipps S (2004) Combining argo and remote-sensing data to estimate the ocean three-dimensional temperature fields – a first approach based on simulated data. J Mar Syst 46:85–98CrossRefGoogle Scholar
  13. Kharin VV, Zwiers FW (2000) Changes in the extremes in an ensemble of transient climate simulations with a coupled atmosphere–ocean GCM. J Climate 13:3760–3788CrossRefGoogle Scholar
  14. Krasnopolsky VM (2007a) Neural network emulations for complex multidimensional geophysical mappings: applications of neural network techniques to atmospheric and oceanic satellite retrievals and numerical modeling. Rev Geophys. doi: 10.1029/2006RG000200 Google Scholar
  15. Krasnopolsky VM (2007b) Reducing uncertainties in neural network Jacobians and improving accuracy of neural network emulations with NN ensemble approaches. Neural Netw 20:454–461CrossRefGoogle Scholar
  16. Krasnopolsky VM, Fox-Rabinovitz MS (2006) Complex hybrid models combining deterministic and machine learning components for numerical climate modeling and weather prediction. Neural Netw 19:122–134CrossRefGoogle Scholar
  17. Krasnopolsky VM, Lin Y (2012) A neural network nonlinear multimodel ensemble to improve precipitation forecasts over continental US. Adv Meteorol, 2012:11pp. Article ID 649450, doi: 10.1155/2012/649450.
  18. Krasnopolsky VM, Fox-Rabinovitz MS, Chalikov DV (2005) New approach to calculation of atmospheric model physics: accurate and fast neural network emulation of long wave radiation in a climate model. Mon Weather Rev 133:1370–1383CrossRefGoogle Scholar
  19. Krasnopolsky VM, Lozano CJ, Spindler D, Rivin I, Rao DB (2006) A new NN approach to extract explicitly functional dependencies and mappings from numerical outputs of numerical environmental models. In: Proceedings of the IJCNN2006, Vancouver, BC, Canada, 16–21 July, pp 8732–8734Google Scholar
  20. Krasnopolsky VM, Fox-Rabinovitz MS, Belochitski A (2008) Ensembles of numerical climate and weather prediction models using neural network emulations of model physics. In: Proceedings of the 2008 IEEE World congress on computational intelligence, Hong Kong, 1–6 June, paper NN0498, pp 1524–1531Google Scholar
  21. Krasnopolsky V, Fox-Rabinovitz M, Belochitski A, Rasch P, Blossey P, Kogan Y (2011) Development of neural network convection parameterizations for climate and NWP models using cloud resolving model simulations. NCEP office note 469.
  22. Krishnamurti TN, Kishtawal CM, LaRow TE, Bachiochi DR, Zhang Z, Williford CE, Gadgil S, Surendran S (1999) Improved weather and seasonal climate forecasts from multimodel superensemble. Science 285:1548–1550CrossRefGoogle Scholar
  23. Krishnamurti TN, Kishtawal CM, Zhang Z, LaRow T, Bachiochi D, Williford E, Gadgil S, Surendran S (2000) Multimodel ensemble forecasts for weather and seasonal climate. J Climate 13:4196–4216CrossRefGoogle Scholar
  24. Lin Y, Krasnopolsky VM (2011) Simple- and modified-poor man’s QPF ensembles, and a neural network approach. In: 91th annual AMS meeting, AMS 24th conference on weather and forecasting/20th conference on numerical weather prediction, Paper 6A.2Google Scholar
  25. Mellor GL, Ezer T (1991) A Sulf Stream model and an altimetry assimilation scheme. J Geophys Res 96:8779–8795CrossRefGoogle Scholar
  26. Murphy JM, Sexton DM, Barnett DN, Jones GS, Webb MJ, Collins M, Stainforth DA (2004) Quantification of modelling uncertainties in a large ensemble of climate change simulations. Nature 430:768–772CrossRefGoogle Scholar
  27. Novak DR, Bailey C, Brill K, Eckert M, Petersen D, Rausch R, Schichtel M (2011) Human improvement to numerical weather prediction at the Hydrometeorological Prediction Center. In: 91th annual AMS meeting, AMS 24th conference on weather and forecasting/20th conference on numerical weather prediction, Paper No 440Google Scholar
  28. Palmer TN et al (2007) The ensemble prediction system – recent and ongoing developments. ECMWF Tech Memorandum No 540Google Scholar
  29. Speer MS, Leslie LM (1997) An example of the utility of ensemble rainfall forecasting. Aust Meteorol Mag 46:75–78Google Scholar
  30. Stainforth DA et al (2005) Uncertainty in predictions of the climate responses to rising levels of greenhouse gases. Nature 433:403–406CrossRefGoogle Scholar
  31. Stensrud DJ, Bao J-W, Warner TT (2000) Using initial condition and model physics perturbations in short-range ensemble simulations of mesoscale convective systems. Mon Weather Rev 128:2077–2107CrossRefGoogle Scholar
  32. Tang Y, Hsieh WW (2003) ENSO simulation and prediction in a hybrid coupled model with data assimilation. J Meteorol Soc Jpn 81:1–19CrossRefGoogle Scholar
  33. Wilks DS (2011) Statistical methods in the atmospheric sciences, 3rd edn. Academic, San DiegoGoogle Scholar
  34. Yoshimori M, Stocker TF, Raible CC, Renold M (2005) Externally forced and internal variability in ensemble climate simulations of the maunder minimum. J Climate 18:4253–4270CrossRefGoogle Scholar
  35. Zhang Z, Krishnamurti TN (1997) Ensemble forecasting of hurricane tracks. Bull Am Meteorol Soc 78:2785–2795CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media Dordrecht(outside the USA.) 2013

Authors and Affiliations

  • Vladimir M. Krasnopolsky
    • 1
  1. 1.NOAA Center for Weather and Climate PredictionCamp SpringUSA

Personalised recommendations