Skip to main content
SpringerLink
Log in

Iterative Bayesian inversion with Gaussian mixtures: finite sample implementation and large sample asymptotics

  • ORIGINAL PAPER
  • Published:
Computational Geosciences Aims and scope Submit manuscript

Abstract

Approximate solutions for Bayesian estimation in large scale models is a topic under investigation in many scientific communities. We define an iterative method based on the adaptive Gaussian mixture filter with batch updates as a robust alternative to adaptive importance sampling. We prove asymptotic optimality under certain conditions, contrary to other methods discussed where the sample distribution depends on the nonlinearity and scaling of the model. The finite sample implementation of the method is compared to an ensemble smoother with multiple data assimilation and an ensemble-based randomized maximum likelihood approach on a synthetic 1D reservoir model.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Andrieu, C., Doucet, A., Holenstein, R.: Particle Markov chain Monte Carlo methods. J. R. Stat. Soc.: Ser. B (Stat. Methodol.) 72(3), 269–342 (2010)

    Article  Google Scholar 

  2. Bengtsson, T., Bickel, P., Li, B.: Curse-of-dimensionality revisited: collapse of particle filter in very large scale systems. Probab. Stat. 2, 316–334 (2008)

    Google Scholar 

  3. Beskos, A., Crisan, D., Jasra, A.: On the stability of sequential Monte Carlo methods in high dimensions arXiv preprint (2011). arXiv:1103.3965

  4. Burgers, G., van Leeuwen, P., Evensen, G.: Analysis scheme in the ensemble Kalman filter. Mon. Weather Rev. 126(6), 1719–1724 (1998)

    Article  Google Scholar 

  5. Cappé, O., Guillin, A., Marin, J.-M., Robert, C.P.: Population Monte Carlo. J. Comput. Graph. Stat. 13(4) (2004)

  6. Chen, R., Liu, J.S.: Mixture Kalman filters. J. R. Stat. Soc. Ser. B-Stat. Methodol. 60, 493–508 (2000)

    Article  Google Scholar 

  7. Chen, Y., Oliver, D.S.: Ensemble randomized maximum likelihood method as an iterative ensemble smoother. Math. Geosci. 44(1), 1–26 (2012)

    Article  Google Scholar 

  8. Chen, Y., Oliver, D.S.: Levenberg-Marquardt forms of the iterative ensemble smoother for efficient history matching and uncertainty quantification. Comput. Geosci., 1–15 (2013)

  9. Christie, M., Blunt, M.: Tenth SPE comparative solution project: a comparison of upscaling techniques. SPE Reserv. Eval. Eng. 4(4), 308–317 (2001)

    Article  Google Scholar 

  10. Cotter, C. J., Reich, S.: Ensemble filter techniques for intermittent data assimilation-a survey arXiv preprint (2012). arXiv:1208.6572

  11. Cotter, S., Roberts, G., Stuart, A., White, D.: MCMC methods for functions modifying old algorithms to make them faster. Statistical Science (2012)

  12. Del Moral, P., Doucet, A., Jasra, A.: An adaptive sequential Monte Carlo method for approximate Bayesian computation. Stat. Comput. 22(5), 1009–1020 (2012)

    Article  Google Scholar 

  13. Douc, R., Guillin, A., Marin, J.-M., Robert, C.P.: Convergence of adaptive mixtures of importance sampling schemes. Ann. Stat. 35(1), 420–448 (2007)

    Article  Google Scholar 

  14. Doucet, A., Del Moral, P., Jasra, A.: Sequential Monte Carlo samplers. J. R. Stat. Soc. B 68(3), 411–436 (2006)

    Article  Google Scholar 

  15. Emerick, A.: History matching and uncertainty characterization using ensemble-based methods. University of Tulsa, PhD thesis (2012)

    Google Scholar 

  16. Emerick, A., Reynolds, A.: Ensemble smoother with multiple data assimilation.Computers & Geosciences (Available online 17 March (2012)

  17. Evensen, G.: Sampling strategies and square root analysis schemes for the EnKF. Ocean Dyn. 54(6), 539–560 (2004)

    Article  Google Scholar 

  18. G: Evensen. Data Assimilation: the ensemble Kalman filter. Springer (2007)

  19. Fossum, K., Mannseth, T., Oliver, D., Skaug, H.: Numerical comparison of ensemble Kalman filter and randomized maximum likelihood. In ECMOR XIII-13th European Conference on the Mathematics of Oil Recovery (2012)

  20. Frei, M., Künsch, H.R.: Mixture ensemble Kalman filters. Computational statistics and data analysis (2011)

  21. Givens, G., Raftery, A.: Local adaptive importance sampling for multivariate densities with strong nonlinear relationships. J. Am. Stat. Assoc. 91(433), 132–141 (1996)

    Article  Google Scholar 

  22. Gray, A.G., Moore, A.W.: N-Body’problems in statistical learning. Adv. neural Inf. Process. Syst., 521–527 (2001)

  23. Hoteit, I., Pham, D. T., Triantafyllou, G., Korres, G.: A new approximate solution of the optimal nonlinear filter for data assimilation in meteorology and oceanography. Mon. Weather Rev. 136(1), 317–334. doi:10.1175/2007MWR1927.1. JAN 2008. ISSN 0027-0644

  24. Ionides, E.L.: Truncated importance sampling, Vol. 17 (2008)

  25. Kitanidis, P.K.: Quasi-linear geostatistical theory for inversing. Water Resour. Res. 31(10), 2411–2419 (1995)

    Article  Google Scholar 

  26. Kong, A., Liu, J., Wong, W.: Sequential imputations and Bayesian missing data problems. J. Am. Stat. Assoc. 89(425), 278–288 (1994)

    Article  Google Scholar 

  27. Kotecha, J.H., Djurić, P.M.: Gaussian sum particle filtering. IEEE 51(10), 2602–2612 (October 2003)

    Google Scholar 

  28. Le Gland, F., Monbet, V., Tran, V.-D., et al.: Large sample asymptotics for the ensemble Kalman filter. Oxf. Handb. Nonlinear Filtering, 598–631 (2011)

  29. Ledoux, M., Talagrand, M.: Probability in Banach Spaces, Isoperimetry and Processes.23. Springer (1991)

  30. Neal, R.M.: Annealed importance sampling. Stat. Comput. 11(2), 125–139 (2001)

    Article  Google Scholar 

  31. Oh, M.-S., Berger, J.O.: Adaptive importance sampling in monte carlo integration. J. Stat. Comput. Simul. 41(3-4), 143–168 (1992)

    Article  Google Scholar 

  32. Oliver, D.S., Chen, Y.: Recent progress on reservoir history matching: a review. Comput. Geosci. 15(1), 185–221 (2011)

    Article  Google Scholar 

  33. Oliver, D.S., Reynolds, A.C., Liu, N.: Inverse theory for petroleum reservoir characterization and history matching.Cambridge (2008)

  34. Ristic, B., Arulampalam, S., Gordon, N.: Beyond the Kalman filter, pages 45–47.Artech House (2004)

  35. Sakov, P., Oke, P.R.: Implications of the form of the ensemble transformation in the ensemble square root filters.Mon.Wea. Rev. 136, 1042–1053 (2008)

  36. Silverman, B.W.: Density estimation for statistics and data analysis.Chapman and Hall (1986)

  37. Stordal, A., Lorentzen, R.: An iterative version of the adaptive Gaussian mixture filter. Comput. Geosci. (2014). doi:10.1007/s10596-014-9402-6

    Google Scholar 

  38. Stordal, A., Karlsen, H., Nævdal, G., Skaug, H., Vallès, B.: Bridging the ensemble Kalman filter and particle filters. Comput. Geosci. 15(2), 293–305 (2011)

    Article  Google Scholar 

  39. Stordal, A., Karlsen, H., Nævdal, G., Oliver, D., Skaug, H.: Filtering with state space localized Kalman gain. Phys. D 241(13), 1123–1135 (2012)

    Article  Google Scholar 

  40. Stuart, A.M.: Inverse problems: a Bayesian perspective. Acta Numerica 19(1), 451–559 (2010)

    Article  Google Scholar 

  41. van Leeuwen, P.J., Evensen, G.: Data assimilation and inverse methods in terms of a probabalistic formulation. Mon. Weather Rev. 124, 2898–2913 (1996)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. IRIS, Bergen, Norway

    Andreas S. Stordal

Authors
  1. Andreas S. Stordal
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Andreas S. Stordal.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Stordal, A.S. Iterative Bayesian inversion with Gaussian mixtures: finite sample implementation and large sample asymptotics. Comput Geosci 19, 1–15 (2015). https://doi.org/10.1007/s10596-014-9444-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10596-014-9444-9

Keywords

Mathematics Subject Classification (2010)

Search

Navigation