Skip to main content

Advertisement

SpringerLink
Log in

Kalman filter sensitivity tests for the NWP and analog-based forecasts post-processing

  • Original Paper
  • Published:
Meteorology and Atmospheric Physics Aims and scope Submit manuscript

Abstract

The goal of this study is to perform a detailed sensitivity test to find the optimal value of the variance ratio r for four different post-processing forecasts that use the Kalman filter (KF) for the point-based wind gust predictions. The four forecasts analyzed in this paper are KF (KF applied to the raw NWP time series), KFAN (KF applied to the simple analog method time series), KFAS (KF applied to NWP forecasts in analog space), and KF-KFAS (KF applied to the KFAS time series). The wind gust impacts the severity of wind-related events. It is usually not a prognostic but a diagnostic variable in NWP models, which makes it an excellent candidate for post-processing. The results suggest that for the KF and KFAS forecasts the r value of 0.01 should be used, whereas for the KFAN and KF-KFAS forecasts the r value should be set to 0.001. The proposed values are considered optimal since they lead to excellent results for the overall data, and the results remain satisfactory even for strong wind. It, however, needs to be mentioned that the usage of different r values always comes with certain trade-offs. The r values smaller than proposed can sometimes slightly improve the overall result, but often lead to considerably worse results for the strong wind. On the other hand, the r values greater than proposed often show good quality of strong wind forecasts but lead to worse results overall. Even so, if the focus is set on extreme events, higher r values than proposed could be considered, but with caution.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

Data availability statement

The datasets generated during and/or analyzed during the current study are available from the corresponding author on reasonable request.

References

  • Alessandrini S, Delle Monache L, Sperati S, Cervone G (2015) An analog ensemble for short-term probabilistic solar power forecast. Appl Energy 157:95–110

    Article  Google Scholar 

  • Baštak Duran I (2013) Report from stay in Ljubljana: 5–31 May 2013. Ljubljana. https://www.rclace.eu/?page=12. Accessed 15 Dec 2021

  • Bouttier F, Courtier P (2002) Data assimilation concepts and methods, meteorological training course lecture series. ECMWF. https://www.ecmwf.int/en/elibrary/16928-data-assimilation-concepts-and-methods. Accessed 14 Dec 2021

  • Bozic SM (1994) Digital and Kalman filtering. Edward Arnold, London

    Google Scholar 

  • Cervone G, Clemente-Harding L, Alessandrini S, Delle Monache L (2017) Short-term photovoltaic power forecasting using artificial neural networks and an analog ensemble. Renew Energy 108:274–286. https://doi.org/10.1016/j.renene.2017.02.052

    Article  Google Scholar 

  • Che C, Peng X, Delle Monache L, Kawaguchi T, Xiao F (2016) A wind power forecasting system based on the weather research and forecasting model and Kalman filtering over a wind-farm in Japan. J Renew Sustain Energy. https://doi.org/10.1063/1.4940208

    Article  Google Scholar 

  • Delle Monache L, Nipen T, Deng X, Zhou Y, Stull R (2006) Ozone ensemble forecasts: 2. A Kalman filter predictor bias correction. J Geophys Res 111:05308

    Article  Google Scholar 

  • Delle Monache L, Wilczak J, McKeen S, Grell G, Pagowski M, Peckham S, Stull R, McHenry J, McQueen J (2008) A Kalman-filter bias correction method applied to deterministic, ensemble averaged and probabilistic forecasts of surface ozone. Tellus B 60:238–249

    Article  Google Scholar 

  • Delle Monache L, Nipen T, Liu Y, Roux G, Stull R (2011) Kalman filter and analog schemes to postprocess numerical weather predictions. Mon Weather Rev 139(11):3554–3570. https://doi.org/10.1175/2011MWR3653.1

    Article  Google Scholar 

  • Delle Monache L, Eckel FA, Rife DL, Nagarajan B, Searight K (2013) Probabilistic weather prediction with an analog ensemble. Mon Weather Rev 141(10):3498–3516. https://doi.org/10.1175/MWR-D-12-00281.1

    Article  Google Scholar 

  • Djalalova I, Wilczak J, McKeen S, Grell G, Peckham S, Pagowski M, Delle Monache L et al (2010) Ensemble and bias-correction techniques for air quality model forecasts of surface O3 and PM2.5 during the TEXAQS-II experiment of 2006. Atmos Environ 44(4):455–467. https://doi.org/10.1016/j.atmosenv.2009.11.007

    Article  Google Scholar 

  • Djalalova I, Delle Monache L, Wilczak J (2015) PM2.5 analog forecast and Kalman filter post-processing for the community multiscale air quality (CMAQ) model. Atmos Environ 108:76–87

    Article  Google Scholar 

  • Fischer C, Montmerle T, Berre L, Auger L, Briceag S (2006) An overview of the variational assimilation in the ALADIN/France NWP system. Q J R Meteorol Soc 131:3477–3492

    Article  Google Scholar 

  • Homleid M (1995) Diurnal corrections of short-term surface temperature forecasts using the Kalman filter. Weather Forecast 10(4):689–707. https://doi.org/10.1175/1520-0434(1995)010%3c0689:DCOSTS%3e2.0.CO;2

    Article  Google Scholar 

  • Horvath K, Ivatek-Šahdan S, Ivančan-Picek B, Grubišić V (2009) Evolution and structure of two severe cyclonic bora events: contrast between the northern and southern adriatic. Weather Forecast 24(4):946–964. https://doi.org/10.1175/2009WAF2222174.1

    Article  Google Scholar 

  • Horvath K, Koracin D, Vellore R, Jiang J, Belu R (2012) Sub-kilometer dynamical downscaling of near-surface winds in complex terrain using WRF and MM5 mesoscale models. J Geophys Res Atmos 117:D11111

    Article  Google Scholar 

  • Hrastinski M, Horvath K, Odak Plenković I, Ivatek-Šahdan S, Bajić A (2015) Verification of the operational 10 m wind forecast obtained with the ALADIN mesoscale numerical weather prediction model. Hrvatski Meteorološki Časopis 50(50):105–120

    Google Scholar 

  • Kang D, Mathur R, Rao ST, Yu S (2008) Bias adjustment techniques for improving ozone air quality forecasts. J Geophys Res 113:D23308

    Article  Google Scholar 

  • Kang D, Mathur R, Rao ST (2010) Assessment of bias-adjusted PM2.5 air quality forecasts over the continental United States during 2007. Geosci Model Dev 3(1):309–320

    Article  Google Scholar 

  • Keller DE, Fischer AM, Liniger MA, Appenzeller C, Knutti R (2017) Testing a weather generator for downscaling climate change projections over Switzerland. Int J Climatol 37:928–942

    Article  Google Scholar 

  • McCollor D, Stull R (2008) Hydrometeorological accuracy enhancement via postprocessing of numerical weather forecasts in complex terrain. Weather Forecast 23(1):131–144. https://doi.org/10.14288/1.0041845

    Article  Google Scholar 

  • Murphy AH (1988) Skill scores based on the mean square error and their relationships to the correlation coefficient. Mon Weather Rev 116(1):2417–2424. https://doi.org/10.1175/1520-0493(1988)116%3c2417:SSBOTM%3e2.0.CO;2

    Article  Google Scholar 

  • Nagarajan B, Delle Monache L, Hacker JP, Rife DL, Searight K, Knievel JC, Nipen TN (2015) An evaluation of analog-based postprocessing methods across several variables and forecast models. Weather Forecast 30(6):1623–1643. https://doi.org/10.1175/WAF-D-14-00081.1

    Article  Google Scholar 

  • Odak Plenković I, Delle Monache L, Horvath K, Hrastinski M (2018) Deterministic wind speed predictions with analog-based methods over complex topography. J Appl Meteorol Climatol 57:2047–2070

    Article  Google Scholar 

  • Odak Plenković I, Schicker I, Dabernig M, Horvath K, Keresturi E (2020) Analog-based post-processing of the ALADIN-LAEF ensemble predictions in complex terrain. Q J R Meteorol Soc 146:1842–1860

    Article  Google Scholar 

  • Otero-Casal C, Patlakas P, Prósper MA, Galanis G, Miguez-Macho G (2019) Development of a high-resolution wind forecast system based on the WRF model and a hybrid Kalman-Bayesian filter. Energies 12(16):3050

    Article  Google Scholar 

  • Pelosi A, Medina H, Van den Bergh J, Vannitsem S, Battista Chirico G (2017) Adaptive Kalman filtering for postprocessing ensemble numerical weather predictions. Mon Weather Rev 145(12):4837–4854

    Article  Google Scholar 

  • Rabier F, McNally A, Andersson E, Courtier P, Undén P, Eyre J, Hollingsworth A, Bouttier F (1998) The ECMWF implementation of three-dimensional variational assimilation (3D-Var). II: Structure functions. Q J R Meteorol Soc 124:1809–1829

    Article  Google Scholar 

  • Rincón A, Jorba O, Baldasano J (2010) Development of a short-term irradiance prediction system using post-processing tools on WRF-ARW meteorological forecasts in Spain. Extended Abstracts, European Conf. on Applied Meteorology, Vol. 7, Zurich, Switzerland, European Meteorological Society, EMS2010–406

  • Roeger C, Stull R, McClung D, Hacker J, Deng X, Modzelewsk H (2003) Verification of mesoscale numerical weather forecasts in mountainous terrain for application to avalanche prediction. Weather Forecast 18(6):1140–1160. https://doi.org/10.1175/1520-0434(2003)018%3c1140:VOMNWF%3e2.0.CO;2

    Article  Google Scholar 

  • Samalot A, Astitha M, Yang J, Galanis G (2019) Combined Kalman filter and universal kriging to improve storm wind speed predictions for the northeastern United States. Weather Forecast 34(3):587–601

    Article  Google Scholar 

  • Telišman Prtenjak M, Grisogono B (2007) Sea/land breeze climatological characteristics along the northern Croatian Adriatic. Theor Appl Climatol 90:201–215

    Article  Google Scholar 

  • Tudor M, Ivatek-Šahdan S, Stanešić A, Horvath K, Hrastinski M, Odak Plenković I, Bajić A, Kovačić T (2015) Changes in the Aladin operational suite in croatia in the period 2011–2015. Hrvatski Meteorološki Časopis 50(50):71–89

    Google Scholar 

  • Vannitsem S, Bremnes JB, Demaeyer J, Evans GR, Flowerdew J, Hemri S, Lerch S, Roberts N, Theis S, Atencia A, Ben Bouallègue Z, Bhend J, Dabernig M, De Cruz L, Hieta L, Mestre O, Moret L, Odak Plenković I, Schmeits M, Taillardat M, Van den Bergh J, Van Schaeybroeck B, Whan K, Ylhaisi J (2021) Statistical postprocessing for weather forecasts: review, challenges, and avenues in a big data world. Bull Am Meteorol Soc 102(3):E681–E699

    Article  Google Scholar 

  • Vanvyve E, Delle Monache L, Monaghan AJ, Pinto JO (2015) Wind resource estimates with an analog ensemble approach. Renew Energy 74:761–773

    Article  Google Scholar 

  • Vujec I (2020) Evaluacija naknadne obrade prognoze numeričkog modela. Dissertation, Sveučilište u Zagrebu, Prirodoslovno-matematički fakultet. https://repozitorij.pmf.unizg.hr/islandora/object/pmf:8911. Accessed 14 Dec 2021

  • Welch P (1967) The use of fast Fourier transform for the estimation of power spectra: a method based on time averaging over short, modified periodograms. IEEE Trans Audio Electroacoust 15(2):70–73

    Article  Google Scholar 

  • Yang D (2019) On post-processing day-ahead NWP forecasts using Kalman filtering. Sol Energy 182:179–181

    Article  Google Scholar 

  • Žagar N, Cedilnik J, Žagar M, Gregorič G, Rakovec J (2006) Validation of mesoscale low-level winds obtained by dynamical downscaling of ERA40 over complex terrain. Tellus a: Dyn Meteorol Oceanogr 58:445–455

    Article  Google Scholar 

  • Zhang J, Draxl C, Hopson T, Delle Monache L, Vanvyve E, Hodge BM (2015) Comparison of numerical weather prediction based deterministic and probabilistic wind resource assessment methods. Appl Energy 156:528–541

    Article  Google Scholar 

  • Zhang H, Wang J, Castro García L, Ge C, Plessel T, Szykman T, Murphy M, Spero TL (2020) Improving surface PM2.5 forecasts in the United States using an ensemble of chemical transport model outputs: 1. Bias correction with surface observations in nonrural areas. J Geophys Res Atmos. https://doi.org/10.1029/2019JD032293

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Meteorological Research and Development Sector, Croatian Meteorological and Hydrological Service, Zagreb, Croatia

    Ivan Vujec & Iris Odak Plenković

Authors
  1. Ivan Vujec
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Iris Odak Plenković
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Iris Odak Plenković.

Ethics declarations

Conflict of interest

The authors have no relevant financial or non-financial interests to disclose.

Additional information

Responsible Editor: Clemens Simmer, Ph.D.

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Below is the link to the electronic supplementary material.

Supplementary file1 (PDF 414 KB)

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Vujec, I., Odak Plenković, I. Kalman filter sensitivity tests for the NWP and analog-based forecasts post-processing. Meteorol Atmos Phys 135, 1 (2023). https://doi.org/10.1007/s00703-022-00939-w

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s00703-022-00939-w

Search

Navigation