Abstract
The high dimensionality and computational constraints associated with filtering problems in large-scale geophysical applications are particularly challenging for the Particle Filter (PF). Approximate but efficient methods such as the Ensemble Kalman Filter (EnKF) are therefore usually preferred. A key element of these approximate methods is localization, which is a general technique to avoid the curse of dimensionality and consists in limiting the influence of observations to neighboring sites. However, while it works effectively with the EnKF, localization introduces harmful discontinuities in the estimated physical fields when applied blindly to the PF. In the present paper, we explore two possible local algorithms based on the Ensemble Kalman Particle Filter (EnKPF), a hybrid method combining the EnKF and the PF. A simulation study in a conjugate normal setup allows to highlight the trade-offs involved when applying localization to PF algorithms in the high-dimensional setting. Experiments with the Lorenz96 model demonstrate the ability of the local EnKPF algorithms to perform well even with a small number of particles compared to the problem size.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Doucet, A., De Freitas, N., Gordon, N.: Sequential Monte Carlo Methods in Practice. Springer New-York (2001)
Evensen, G.: Sequential data assimilation with a nonlinear quasi-geostrophic model using Monte Carlo methods to forecast error statistics. J. Geophys. Res. Oceans 99(C5), 10143–10162 (1994)
Evensen, G.: The ensemble Kalman filter: theoretical formulation and practical implementation. Ocean Dyn. 53(4), 343–367 (2003)
Frei, M., Künsch, H.R.: Bridging the ensemble Kalman and particle filters. Biometrika 100(4), 781–800 (2013)
Gaspari, G., Cohn, S.E.: Construction of correlation functions in two and three dimensions. Q. J. R. Meteorol. Soc. 125(554), 723–757 (1999)
Gordon, N., Salmond, D., Smith, A.: Novel approach to nonlinear non-Gaussian Bayesian state estimation. IEE Proc. Radar Signal Process. 140(2), 107–113 (1993)
Houtekamer, P.L., Mitchell, H.L.: A sequential ensemble Kalman filter for atmospheric data assimilation. Mon. Weather Rev. 129(1), 123–137 (2001)
Hunt, B.R., Kostelich, E.J., Szunyogh, I.: Efficient data assimilation for spatiotemporal chaos: a local ensemble transform Kalman filter. Physica D: Nonlinear Phenomena 230(1–2), 112–126 (2007)
Künsch, H.R.: Recursive Monte Carlo filters: algorithms and theoretical analysis. Ann. Stat. 33(5), 1983–2021 (2005)
Lorenz, E.N., Emanuel, K.A.: Optimal sites for supplementary weather observations: simulation with a small model. J. Atmos. Sci. 55(3), 399–414 (1998)
Musso, C., Oudjane, N., Le Gland, F.: Improving regularised particle filters. In: A. Doucet, N. De Freitas, N. Gordon (eds.) Sequential Monte Carlo Methods in Practice, pp. 247–271. Springer, New-York (2001)
Ott, E., Hunt, B.R., Szunyogh, I., Zimin, A.V., Kostelich, E.J., Corazza, M., Kalnay, E., Patil, D.J., Yorke, J.A.: A local ensemble Kalman filter for atmospheric data assimilation. Tellus A 56(5), 415–428 (2004)
Pitt, M.K., Shephard, N.: Filtering via simulation: auxiliary particle filters. J. Am. Stat. Assoc. 94(446), 590–599 (1999)
Rebeschini, P., Handel, R.v.: Can local particle filters beat the curse of dimensionality? Ann. Appl. Prob. 25(5), 2809–2866 (2015)
Robert, S., Künsch, H.R.: Local Ensemble Kalman Particle Filters for Efficient Data Assimilation. Tellus A 69(1), 1–14 (2017)
Snyder, C., Bengtsson, T., Bickel, P., Anderson, J.: Obstacles to high-dimensional particle filtering. Mon. Weather Rev. 136(12), 4629–4640 (2008)
Snyder, C., Bengtsson, T., Morzfeld, M.: Performance bounds for particle filters using the optimal proposal. Mon. Weather Rev. 143(11), 4750–4761 (2015)
van Leeuwen, P.J.: Nonlinear data assimilation in geosciences: an extremely efficient particle filter. Q. J. R. Meteorol. Soc. 136(653), 1991–1999 (2010)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Robert, S., Künsch, H.R. (2017). Localization in High-Dimensional Monte Carlo Filtering. In: Argiento, R., Lanzarone, E., Antoniano Villalobos, I., Mattei, A. (eds) Bayesian Statistics in Action. BAYSM 2016. Springer Proceedings in Mathematics & Statistics, vol 194. Springer, Cham. https://doi.org/10.1007/978-3-319-54084-9_8
Download citation
DOI: https://doi.org/10.1007/978-3-319-54084-9_8
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-54083-2
Online ISBN: 978-3-319-54084-9
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)