Skip to main content

Localization in High-Dimensional Monte Carlo Filtering

  • Conference paper
  • First Online:
Bayesian Statistics in Action (BAYSM 2016)

Part of the book series: Springer Proceedings in Mathematics & Statistics ((PROMS,volume 194))

Included in the following conference series:

Abstract

The high dimensionality and computational constraints associated with filtering problems in large-scale geophysical applications are particularly challenging for the Particle Filter (PF). Approximate but efficient methods such as the Ensemble Kalman Filter (EnKF) are therefore usually preferred. A key element of these approximate methods is localization, which is a general technique to avoid the curse of dimensionality and consists in limiting the influence of observations to neighboring sites. However, while it works effectively with the EnKF, localization introduces harmful discontinuities in the estimated physical fields when applied blindly to the PF. In the present paper, we explore two possible local algorithms based on the Ensemble Kalman Particle Filter (EnKPF), a hybrid method combining the EnKF and the PF. A simulation study in a conjugate normal setup allows to highlight the trade-offs involved when applying localization to PF algorithms in the high-dimensional setting. Experiments with the Lorenz96 model demonstrate the ability of the local EnKPF algorithms to perform well even with a small number of particles compared to the problem size.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Doucet, A., De Freitas, N., Gordon, N.: Sequential Monte Carlo Methods in Practice. Springer New-York (2001)

    Google Scholar 

  2. Evensen, G.: Sequential data assimilation with a nonlinear quasi-geostrophic model using Monte Carlo methods to forecast error statistics. J. Geophys. Res. Oceans 99(C5), 10143–10162 (1994)

    Article  Google Scholar 

  3. Evensen, G.: The ensemble Kalman filter: theoretical formulation and practical implementation. Ocean Dyn. 53(4), 343–367 (2003)

    Article  Google Scholar 

  4. Frei, M., Künsch, H.R.: Bridging the ensemble Kalman and particle filters. Biometrika 100(4), 781–800 (2013)

    Article  MathSciNet  MATH  Google Scholar 

  5. Gaspari, G., Cohn, S.E.: Construction of correlation functions in two and three dimensions. Q. J. R. Meteorol. Soc. 125(554), 723–757 (1999)

    Article  Google Scholar 

  6. Gordon, N., Salmond, D., Smith, A.: Novel approach to nonlinear non-Gaussian Bayesian state estimation. IEE Proc. Radar Signal Process. 140(2), 107–113 (1993)

    Article  Google Scholar 

  7. Houtekamer, P.L., Mitchell, H.L.: A sequential ensemble Kalman filter for atmospheric data assimilation. Mon. Weather Rev. 129(1), 123–137 (2001)

    Article  Google Scholar 

  8. Hunt, B.R., Kostelich, E.J., Szunyogh, I.: Efficient data assimilation for spatiotemporal chaos: a local ensemble transform Kalman filter. Physica D: Nonlinear Phenomena 230(1–2), 112–126 (2007)

    Article  MathSciNet  MATH  Google Scholar 

  9. Künsch, H.R.: Recursive Monte Carlo filters: algorithms and theoretical analysis. Ann. Stat. 33(5), 1983–2021 (2005)

    Article  MathSciNet  MATH  Google Scholar 

  10. Lorenz, E.N., Emanuel, K.A.: Optimal sites for supplementary weather observations: simulation with a small model. J. Atmos. Sci. 55(3), 399–414 (1998)

    Article  Google Scholar 

  11. Musso, C., Oudjane, N., Le Gland, F.: Improving regularised particle filters. In: A. Doucet, N. De Freitas, N. Gordon (eds.) Sequential Monte Carlo Methods in Practice, pp. 247–271. Springer, New-York (2001)

    Google Scholar 

  12. Ott, E., Hunt, B.R., Szunyogh, I., Zimin, A.V., Kostelich, E.J., Corazza, M., Kalnay, E., Patil, D.J., Yorke, J.A.: A local ensemble Kalman filter for atmospheric data assimilation. Tellus A 56(5), 415–428 (2004)

    Article  Google Scholar 

  13. Pitt, M.K., Shephard, N.: Filtering via simulation: auxiliary particle filters. J. Am. Stat. Assoc. 94(446), 590–599 (1999)

    Article  MathSciNet  MATH  Google Scholar 

  14. Rebeschini, P., Handel, R.v.: Can local particle filters beat the curse of dimensionality? Ann. Appl. Prob. 25(5), 2809–2866 (2015)

    Google Scholar 

  15. Robert, S., Künsch, H.R.: Local Ensemble Kalman Particle Filters for Efficient Data Assimilation. Tellus A 69(1), 1–14 (2017)

    Google Scholar 

  16. Snyder, C., Bengtsson, T., Bickel, P., Anderson, J.: Obstacles to high-dimensional particle filtering. Mon. Weather Rev. 136(12), 4629–4640 (2008)

    Article  Google Scholar 

  17. Snyder, C., Bengtsson, T., Morzfeld, M.: Performance bounds for particle filters using the optimal proposal. Mon. Weather Rev. 143(11), 4750–4761 (2015)

    Article  Google Scholar 

  18. van Leeuwen, P.J.: Nonlinear data assimilation in geosciences: an extremely efficient particle filter. Q. J. R. Meteorol. Soc. 136(653), 1991–1999 (2010)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Sylvain Robert .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Robert, S., Künsch, H.R. (2017). Localization in High-Dimensional Monte Carlo Filtering. In: Argiento, R., Lanzarone, E., Antoniano Villalobos, I., Mattei, A. (eds) Bayesian Statistics in Action. BAYSM 2016. Springer Proceedings in Mathematics & Statistics, vol 194. Springer, Cham. https://doi.org/10.1007/978-3-319-54084-9_8

Download citation

Publish with us

Policies and ethics