Skip to main content
Log in

Improving the Ensemble Estimate of the Kalman Gain by Bootstrap Sampling

  • Published:
Mathematical Geosciences Aims and scope Submit manuscript

Abstract

Using a small ensemble size in the ensemble Kalman filter methodology is efficient for updating numerical reservoir models but can result in poor updates following spurious correlations between observations and model variables. The most common approach for reducing the effect of spurious correlations on model updates is multiplication of the estimated covariance by a tapering function that eliminates all correlations beyond a prespecified distance. Distance-dependent tapering is not always appropriate, however. In this paper, we describe efficient methods for discriminating between the real and the spurious correlations in the Kalman gain matrix by using the bootstrap method to assess the confidence level of each element from the Kalman gain matrix. The new method is tested on a small linear problem, and on a water flooding reservoir history matching problem. For the water flooding example, a small ensemble size of 30 was used to compute the Kalman gain in both the screened EnKF and standard EnKF methods. The new method resulted in significantly smaller root mean squared errors of the estimated model parameters and greater variability in the final updated ensemble.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Aanonsen SI, Nævdal G, Oliver DS, Reynolds AC, Vallès B (2009) Ensemble Kalman filter in reservoir engineering—a review. SPE J 14(3):393–412

    Google Scholar 

  • Anderson JL (2007) Exploring the need for localization in ensemble data assimilation using a hierarchical ensemble filter. Physica D: Nonlinear Phenom 230(1–2):99–111

    Article  Google Scholar 

  • Burgers G, van Leeuwen P, Evensen G (1998) Analysis scheme in the ensemble Kalman filter. Mon Weather Rev 126(6):1719–1724

    Article  Google Scholar 

  • Chen Y, Oliver DS (2010) Cross-covariances and localization for EnKF in multiphase flow data assimilation. Comput Geosci. doi:10.1007/s10596-009-9174-6

    Google Scholar 

  • Efron B, Tibshirani RJ (1993) An introduction to the bootstrap, 1st edn. Chapman & Hall/CRC, London/Boca Raton

    Google Scholar 

  • Evensen G (1994) Sequential data assimilation with a nonlinear quasi-geostrophic model using Monte Carlo methods to forecast error statistics. J Geophys Res 99(C5):10143–10162

    Article  Google Scholar 

  • Friedman JH (1989) Regularized discriminant analysis. J Am Stat Assoc 84(405):165–175

    Article  Google Scholar 

  • Furrer R, Bengtsson T (2007) Estimation of high-dimensional prior and posterior covariance matrices in Kalman filter variants. J Multivar Anal 98(2):227–255

    Article  Google Scholar 

  • Hacker JP, Anderson JL, Pagowski M (2007) Improved vertical covariance estimates for ensemble-filter assimilation of near-surface observations. Mon Weather Rev 135(3):1021–1036

    Article  Google Scholar 

  • Hamill TM, Whitaker JS, Snyder C (2001) Distance-dependent filtering of background error covariance estimates in an ensemble Kalman filter. Mon Weather Rev 129(11):2776–2790

    Article  Google Scholar 

  • Houtekamer PL, Mitchell HL (1998) Data assimilation using an ensemble Kalman filter technique. Mon Weather Rev 126(3):796–811

    Article  Google Scholar 

  • Houtekamer PL, Mitchell HL (2001) A sequential ensemble Kalman filter for atmospheric data assimilation. Mon Weather Rev 129(1):123–137

    Article  Google Scholar 

  • Houtekamer PL, Mitchell HL, Pellerin G, Buehner M, Charron M, Spacek L, Hansen B (2005) Atmospheric data assimilation with an ensemble Kalman filter: results with real observations. Mon Weather Rev 133(3):604–620

    Article  Google Scholar 

  • Kepert JD (2006) Localisation, balance and choice of analysis variable in an ensemble Kalman filter. In: 7th adjoint workshop, vol 12

  • Lorenc AC (2003) The potential of the ensemble Kalman filter for NWP—a comparison with 4D-Var. Q J R Meteorol Soc 129(595):3183–3203

    Article  Google Scholar 

  • Vallès B, Nævdal G (2008) Comparing different ensemble Kalman filter approaches. In: the 11th European conference on the mathematics of oil recovery, EAGE

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yanfen Zhang.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Zhang, Y., Oliver, D.S. Improving the Ensemble Estimate of the Kalman Gain by Bootstrap Sampling. Math Geosci 42, 327–345 (2010). https://doi.org/10.1007/s11004-010-9267-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11004-010-9267-8

Keywords

Navigation