Advances in Atmospheric Sciences

, Volume 27, Issue 6, pp 1425–1437 | Cite as

The use of Rank Histograms and MVL diagrams to characterize ensemble evolution in weather forecasting

  • Jorge A. Revelli
  • Miguel A. Rodríguez
  • Horacio S. Wio
Article
First Online:
Received:
Revised:

Abstract

Rank Histograms are suitable tools to assess the quality of ensembles within an ensemble prediction system or framework. By counting the rank of a given variable in the ensemble, we are basically making a sample analysis, which does not allow us to distinguish if the origin of its variability is external noise or comes from chaotic sources. The recently introduced Mean to Variance Logarithmic (MVL) Diagram accounts for the spatial variability, being very sensitive to the spatial localization produced by infinitesimal perturbations of spatiotemporal chaotic systems. By using as a benchmark a simple model subject to noise, we show the distinct information given by Rank Histograms and MVL Diagrams. Hence, the main effects of the external noise can be visualized in a graphic. From the MVL diagram we clearly observe a reduction of the amplitude growth rate and of the spatial localization (chaos suppression), while from the Rank Histogram we observe changes in the reliability of the ensemble. We conclude that in a complex framework including spatiotemporal chaos and noise, both provide a more complete forecasting picture.

Key words

rank histogram MVL diagram ensemble evolution noise space-time chaos forecasting 
This is a preview of subscription content, log in to check access.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Anderson, J. L., 1996: A method of producing and evaluating probabilistic forecasts from ensemble model integrations. J. Climate, 9, 1518–1530.CrossRefGoogle Scholar
  2. Anishchenko, V. S., A. B. Neimann, and M. A. Safanova, 1993: Stochastic resonance in chaotic systems. Journal of Statistical Physics, 70, 183–196.CrossRefGoogle Scholar
  3. Balanov, A. G., N. B. Janson, and P. V. E. McClintock, 2003: Coherence resonance of the noise-induced motion on the way to breakdown of synchronization in chaotic systems. Fluctuation and Noise Letters, 3, L113–L120.CrossRefGoogle Scholar
  4. Barabási, A. L., and H. E. Stanley, 1995: Fractal Concepts in Surface Growth. Cambridge University Press, 368pp.Google Scholar
  5. Benzi, R., and G. F. Carnevale, 1989: A possible measure of local predictability. J. Atmos. Sci., 46, 3595–3598.CrossRefGoogle Scholar
  6. Caroll, T. L., and L. M. Pecora, 1993a: Stochastic Resonance and Crises. Phys. Rev. Lett., 70, 576–579.CrossRefGoogle Scholar
  7. Caroll, T. L., and L. M. Pecora, 1993b: Stochastic resonance as a crisis in a period-doubled circuit. Phys. Rev. E., 47, 3941–3949.CrossRefGoogle Scholar
  8. Choe, C. U., K. Hohne, H. Benner, and Y. S. Kivshar, 2005: Chaos suppression in the parametrically driven Lorenz system. Phys. Rev. E., 72, 036206.CrossRefGoogle Scholar
  9. Fernández, J., C. Primo, A. S. Cofino, J. M. Gutiérrez, M. A. Rodríguez, 2009: MVL Spatiotemporal Analysis for Model Intercorison in EPS. Application to the Demeter Multi-model Ensemble. Climate Dyn., doi: 10/1007/s00382-008-0456-9.Google Scholar
  10. Gneiting, T., and A. Raftery, 2005: Atmospheric Science: Weather Forecasting with Ensemble Methods. Science, 310, 248–249.CrossRefGoogle Scholar
  11. Gottwald, G. A., and I. Melbourne, 2005: Testing for chaos in deterministic systems with noise. Physica D, 212, 100–110.CrossRefGoogle Scholar
  12. Gutiérrez, J. M., A. Iglesias, and M. A. Rodríguez, 1993: Logistic map driven by dichotomous noise. Phys. Rev. E., 48, 2507–2513.CrossRefGoogle Scholar
  13. Gutiérrez, J. M., C. Primo, M. A. Rodríguez, and J. Fernández, 2008: Spatiotemporal characterization of ensemble prediction systems-The Mean-Variance of Logarithms (MVL) diagram. Nonlinear Processes in Geophysics. 15, 109–114.CrossRefGoogle Scholar
  14. Hagedorn, R., F. J. Doblas-Reyes, and T. N. Palmer, 2005: The rationale behind the success of multimodel ensembles in seasonal forecasting—I. Basic concept. Tellus, 57A, 219–233.Google Scholar
  15. Hamill, T. M., 2001: Interpretation of rank histograms for verifying ensemble forecasts. Monthly Weather Rev., 129, 550–560.CrossRefGoogle Scholar
  16. Hamill, T. M., and S. J. Colluci, 1996: Proc. 13th Conf. on Probability and Statistics in the Atmospheric Sciences. Amer. Meteor. Soc., 51–56.Google Scholar
  17. Harrison, M. S. J., D. S. Richardson, K. Robertson, and A. Woodcock, 1995: UKMO Tech. Rep. Mediumrange ensembles using both the ECMWF T63 and unified models—An initial report. U. K. Meteorological Office, No. 153, 25pp.Google Scholar
  18. Kalnay, E., 2002: Atmospheric Modeling, Data Assimilation and Predictability. Cambridge University Press, 341pp.Google Scholar
  19. Liao, T. L., J. J. Yan, and Y. Y. Hou, 2008: Robust chaos suppression for the family of nonlinear chaotic systems with noise perturbation. Nonlinear Analysis: Theory Methods & Applications, 69, 14–23.CrossRefGoogle Scholar
  20. López, J. M., C. Primo, M. A. Rodríguez, and I. Szendro I, 2004: Scaling properties of growing non infinitesimal perturbations in space-time chaos. Phys. Rev. E., 70, 056224.CrossRefGoogle Scholar
  21. Lorenz, E. N., 1996: The Essence of Chaos. University of Washington Press, 244pp.Google Scholar
  22. Lorenz, E. N., and K. A. Emanuel, 1998: Optimal sites for supplementary weather observations: Simulations with a small model. J. Atmos. Sci., 55, 399–414.CrossRefGoogle Scholar
  23. Molteni, F., T. Palmerand, and T. Petroliagis, 1996: The ECMWF Ensemble Prediction System: Methodology and Validation. Quart. J. Roy. Meteor. Soc., 122, 73–119.CrossRefGoogle Scholar
  24. Orrell, D., 2003: Model error and predictability over different timescales in the Lorenz 6 systems. J. Atmos. Sci., 60, 2219–2228.CrossRefGoogle Scholar
  25. Palmer, N. T., 2002: The economic value of ensemble forecasts as a tool for risk assessment. From days to decades. Quart. J. Roy. Meteor. Soc., 128, 747–774.CrossRefGoogle Scholar
  26. Pikovsky, A. and A. Politi, 1998: Dynamic localization of Lyapunov vectors in spacetime chaos. Nonlinearity, 11, 1049–1062.CrossRefGoogle Scholar
  27. Primo, C., I. G. Szendro, M. A. Rodríguez, and J. M. López, 2006: Dynamic scaling of bred vectors in spatially extended chaotic systems. Europhysics Letters, 76, 767–772.CrossRefGoogle Scholar
  28. Primo, C., M. A. Rodríguez, and J. M. Gutierrez, 2008: Logarithmic bred vectors. A new ensemble method with adjustable spread and calibration time. J. Geophys. Res., 113, D04116.CrossRefGoogle Scholar
  29. Revelli, J. A., M. A. Rodriguez, and H. S. Wio, 2008a: Resonant phenomena in extended chaotic systems subject to external noise: the Lorenz’96 model case. Physica A, 387, 3103–3110.Google Scholar
  30. Revelli, J. A., M. A. Rodriguez, and H. S. Wio, 2008b: Noise effects in extended chaotic system: study of the Lorenz’96 model. Progress in Statistical Mechanics Research, J. S. Moreno, Ed., Nova Science Pub., NY, 413–425.Google Scholar
  31. Smith, L. A., 1999: Disentangling uncertainty and error: On the probability of nonlinear systems. Nonlinear Dynamics and Statistics, Alistair E. Mees, Ed., Birkhauer Press, 31–64.Google Scholar
  32. Talagrand, O., R. Vautard, and B. Strauss, 1997: Proc. ECMWF Workshop on Predictability, ECMWF, Reading, 1–25.Google Scholar
  33. Wilks, D. S., 2005: Effects of stochastic parametrization in Lorenz’96 system. Quart. J. Roy. Meteor. Soc. (B), 131, 389–407.CrossRefGoogle Scholar

Copyright information

© Chinese National Committee for International Association of Meteorology and Atmospheric Sciences, Institute of Atmospheric Physics, Science Press and Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Jorge A. Revelli
    • 1
  • Miguel A. Rodríguez
    • 1
  • Horacio S. Wio
    • 1
  1. 1.Instituto de Física de Cantabria (UC and CSIC)SantanderSpain

Personalised recommendations