Abstract
Much of the recent work on history matching reservoir models has focused on the iterative Ensemble Smoother (iES) method. This is well suited for practical applications because it avoids frequent simulation restarts which can be expensive for traditional Ensemble Kalman Filter (EnKF) approaches. In this paper, we derive a novel, adaptive iES method (ES-LM) based on the Levenberg-Marquardt algorithm for nonlinear least squares optimization. We demonstrate that the solution of the linearized least squares subproblems from each iteration of ES-LM have a similar structure to those of the standard ensemble smoother update equation. This allows us to use the ensemble smoother as an approximate linear least squares solver and thus avoid expensive adjoint calculations. The proposed algorithm may therefore be seen as a variant of iES whose regularization parameter can be updated using the usual trust region method. The resulting parameter update equation is similar to those in existing iES methods, but our derivation provides new insights into iES that enable us to extend the adaptive ES-LM to two new formulations: (1) Auto ES-LM, where the measurement error has unknown variance that will be estimated by the algorithm; and (2) Robust ES-LM, where the measurement error follows a Cauchy distribution. Robust ES-LM, in particular, reduces the effect of outliers in the data, which can be critical for real-world applications. Although estimating measurement error and adding robustness are common for data assimilation with EnKF, they have not been incorporated into iES within the reservoir engineering community. The three resulting algorithms are easy for reservoir engineers to use for practical history matching applications without the need for deep understanding of the computational details. Finally, we demonstrate the effectiveness and robustness of these algorithms on two synthetic reservoir models.
Similar content being viewed by others
References
Aanonsen, S.I., Nævdal, G., Oliver, D.S., Reynolds, A.C., Vallès, B.: The Ensemble Kalman filter in reservoir engineering–a review. SPE Journal 14(3), 393–412 (2009)
Aravkin, A.Y., Burke, J.V., Pillonetto, G.: Optimization viewpoint on Kalman smoothing with applications to robust and sparse estimation. In: Compressed Sensing and Sparse Filtering, pp 237–280. Springer, Berlin (2014)
Bell, B.M.: The iterated Kalman smoother as a Gauss-Newton method. SIAM J. Optim. 4(3), 626–636 (1994)
Bergou, E., Gratton, S., Vicente, L.N.: Levenberg-Marquardt methods based on probabilistic gradient models and inexact subproblem solution, with application to data assimilation. SIAM Journal on Uncertainty Quantification 4(1), 924–951 (2016)
Chen, Y., Oliver, D.S.: Ensemble randomized maximum likelihood method as an iterative ensemble smoother. Math Geosci. 44, 1–26 (2012)
Chen, Y., Oliver, D.S.: Levenberg-Marquardt forms of the iterative enemble smoother for efficient history matching and uncertainty quantification. Comput. Geosci. 17(4), 689–703 (2013)
Chen, Y., Oliver, D.S.: History matching of the norne full-field model with an iterative ensemble smoother. SPE Reservoir Evaluation & Engineering 17(2), 244–256 (2014)
Chen, Y., Oliver, D.S.: Localization and regularization for iterative ensemble smoothers. Comput. Geosci. 21(1), 13–30 (2017)
Desroziers, G., Ivanov, S.: Diagnosis and adaptive tuning of observation-error parameters in a variational assimilation. Q. J. Roy. Meteorol. Soc. 127(574), 1433–1452 (2001)
Doicu, A., Trautmann, T., Schreier, F.: Numerical regularization for atmospheric inverse problems. Springer, Berlin (2010)
Elsheikh, A., Wheeler, M., Hoteit, I.: An iterative stochastic ensemble method for parameter estimation of subsurface flow models. J. Comput. Phys. 242, 696–714 (2013)
Elsheikh, A., Wheeler, M., Hoteit, I.: Sparse calibration of subsurface flow models using a stochastic ensemble method. Adv. Water Resour. 56, 14–26 (2013)
Emerick, A.A.: Analysis of the performance of ensemble-based assimilation of production and seismic data. J. Pet. Sci. Eng. 139, 219–239 (2016)
Emerick, A.A., Reynolds, A.C.: Ensemble smoother with multiple data assimilations. Computers & Geosciences 55, 3–15 (2013)
Emerick, A.A., Reynolds, A.C.: Investigation of the sampling performance of ensembl-based methods with a simple reservoir model. Comput. Geosci. 17, 325–350 (2013)
Etnyre, L.M.: Estimation of petrophysical parameters using a robust Levenberg-Marquardt procedure. The Log Analyst 33(04), 373–389 (1992)
Evensen, G.: Data assimilation: the Ensemble Kalman filter. Springer, Berlin (2009)
Evensen, G.: Analysis of iterative ensemble smoothers for solving inverse problems. Comput. Geosci. 22(3), 885–908 (2018)
Fan, J., Pan, J.: Convergence properties of a self-adaptive Levenberg-Marquardt algorithm under local error bound condition. Comput. Optim. Appl. 34(1), 47–62 (2006)
Gao, G., Reynolds, A.C.: An improved implementation of the lbfgs algorithm for automatic history matching. SPE J. 11(1), 5–17 (2006)
Hanke, M.: A regularizing Levenberg-Marquardt scheme, with applications to inverse groundwater filtration problems. Inverse Problems 13(1), 79–95 (1997)
Holland, P.W., Welsch, R.E.: Robust regression using iteratively reweighted least-squares. Communications in Statistics - Theory and Methods 6(9), 813–827 (1977)
Huber, P.J., Ronchetti, E.M.: Robust statistics, 2nd edn. Wiley, Hoboken, New Jersey (2009)
Iglesias, M.A.: Iterative regularization for ensemble data assimilation in reservoir models. Comput. Geosci. 19(1), 177–212 (2015)
Iglesias, M.A.: A regularizing iterative ensemble Kalman method for PDE-constrained inverse problems. Inverse Problems 32(2), 025,002(45pp) (2016)
Iglesias, M.A., Dawson, C.: The regularizing Levenberg-Marquardt scheme for history matching of petroleum reservoirs. Comput. Geosci. 17(6), 1033–1053 (2013)
Jin, B., Zou, J.: Augmented Tikhonov regularization. Inverse Problems 25(2), 025,001(25pp) (2009)
Jin, Q.: On a regularized Levenberg-Marquardt method for solving nonlinear inverse problems. Numer. Math. 115(2), 229–259 (2010)
Kanzow, C., Yamashita, N.: Levenberg-Marquardt methods with strong local convergence properties for solving nonlinear equations with convex constraints. J. Comput. Appl. Math. 172(2), 375–397 (2004)
Kuchuk, F.J., Onur, M., Hollaender, F.: Pressure transient formation and well testing: convolution, deconvolution and nonlinear estimation, developments in petroleum science, vol. 57, chap. 5 Elsevier B.V (2010)
Le, D.H., Emerick, A.A., Reynolds, A.C.: An adaptive ensemble smoother with multiple data assimilation for assisted history matching. SPE J. 21(06), 2195–2207 (2016)
van Leeuwen, P.J.: A variance-minimizing filter for large-scale applications. Mon. Rev. 131(9), 2071–2084 (2003)
van Leeuwen, P.J., Evensen, G.: Data assimilation and inverse methods in terms of a probabilistic formulation. Mon. Weather. Rev. 124, 2898–2913 (1996)
Levenberg, K.: A method for the solution of certain problems in least squares. Quart. Appl. Math. 2, 164–168 (1944)
Li, G., Reynolds, A.C.: An iterative ensemble Kalman filter for data assimilation. In: SPE Annual Technical Conference and Exhibition. Society of Petroleum Engineers, 11-14 November, Anaheim, California, United States. 1-109808-MS (2007)
Lin, B., Crumpton, P.I., Dogru, A.H.: Field-scale assisted history matching using a systematic, massively parallel ensemble Kalman smoother procedure. In: SPE Reservoir Simulation Conference. Society of Petroleum Engineers, 20-22 February, Montgomery, Texas, United States. 1-182617-MS (2017)
Luo, X., Bhakta, T.: Estimating observation error covariance matrix of seismic data from a perspective of image denoising. Comput. Geosci. 21(02), 205–222 (2017)
Luo, X., Bhakta, T., Jakobsen, M., Nævdal, G.: An ensemble 4D-seismic history-matching framework with sparse representation based on wavelet multiresolution analysis. SPE J. 22(03), 985–1010 (2017)
Luo, X., Bhakta, T., Nævdal, G.: Correlation-based adaptive localization with applications to ensemble-based 4d-seismic history matching. SPE J. 23(02), 396–427 (2018)
Luo, X., Hoteit, I.: Robust ensemble filtering and its relation to covariance inflation in the Ensemble Kalman filter. Mon. Weather. Rev. 139, 3938–3953 (2011)
Luo, X., Hoteit, I.: Covariance inflation in the ensemble Kalman filter: A residual nudging perspective and some implications. Mon. Weather. Rev. 141, 3360–3366 (2013)
Luo, X., Stordal, A.S., Lorentzen, R.J., Nævdal, G.: Iterative ensemble smoother as an approximate solution to a regularized minimum-average-cost problem: Theory and applications. SPE J. 20(05), 962–982 (2015)
Ma, X., Borden, Z., Porto, P., Burch, D., Huang, N., Benkendorfer, P.: Real-time production surveillance and optimization at a mature subsea asset. In: SPE Intelligent Energy International Conference and Exhibition. Society of Petroleum Engineers, 6-8 September, Aberdeen, Scotland, United Kingdom. 1-109808-MS (2016)
Ma, X., Zabaras, N.: An efficient bayesian inference approach to inverse problems based on an adaptive sparse grid collocation method. Inverse Problems 25(3), 035,013 (2009)
Madsen, K., Nielsen, H. B., Tingleff, O.: Methods for nonlinear least squares problems. Tech. Rep., Informatics and Mathematical Modelling, Technical University of Danmark (2004)
Mandel, J., Bergou, E., G.S., Gratton, S., Kasanický, I.: Hybrid Levenberg-Marquardt and weak-constraint ensemble Kalman smoother method. Nonlin. Processes Geophys. 23, 59–73 (2016)
Marquardt, D.: An algorithm for least-squares estimation of nonlinear parameters. J. Appl. Math. 11, 431–441 (1963)
Motulsky, H.J., Brown, R.E.: Detecting outliers when fitting data with nonlinear regression – a new method based on robust nonlinear regression and the false discovery rate. BMC Bioinforma. 7(1), 123 (2006)
Nocedal, J., Wright, S.J.: Numerical optimization, 2nd edn. Springer, New York (2006)
Oliver, D.S., Alfonzo, M.: Calibration of imperfect models to biased observations. Comput. Geosci. Appeared online 26 June (2017)
Oliver, D.S., Chen, Y.: Recent progress on reservoir history matching: A review. Comput. Geosci. 13(1), 185–221 (2010)
Oliver, D.S., He, N.: Conditioning permeability fields to pressure data. In: ECMOR V - 5th European Conference on the Mathematics of Oil Recovery (1996)
Oliver, D.S., Reynolds, A.C., Liu, N.: Inverse theory for petroleum reservoir characterization and history matching. Cambridge University Press, Cambridge (2008)
Onur, M., Kuchuk, F.J.: Nonlinear regression analysis of well-test pressure data with uncertain variance. In: SPE Annual Technical Conference and Exhibition. Society of Petroleum Engineers, 1-4 October, Dallas, Texas, United States. 1-62918-MS (2000)
Reynolds, A.C., Zafari, M.: Iterative forms of the Ensemble Kalman filter. In: ECMOR X - 10th European Conference on the Mathematics of Oil Recovery. 4-7 September, Amsterdam (2006)
Roh, S., Genton, M., Jun, M., Szunyogh, I., Hoteit, I.: Observation quality control with a robust Ensemble Kalman filter. Mon. Weather. Rev. 141, 4414–4428 (2013)
Sakov, P., Oliver, D.S., Bertino, L.: An iterative enKF for strongly nonlinear systems. Mon. Weather. Rev. 140, 1988–2004 (2012)
Skjervheim, J., Evensen, G.: An ensemble smoother for assisted history matching. In: SPE Reservoir Simulation Symposium. Society of Petroleum Engineers, 21-23 February, the Woodlands, Texas, United States. 1-141929-MS (2011)
Thiel, M., Omeragic, D., Habashy, T.: Robust nonlinear parametric Gauss-Newton inversion for well-logging applications. In: 2012 SEG Annual Meeting. 4-9 November, Las Vegas, Nevada, United States. 1-2012-1215 (2012)
Zafari, M., Reynolds, A.C.: Assessing the uncertainty in reservoir description and performance predictions with the Ensemble Kalman filter. In: SPE Annual Technical Conference and Exhibition. Society of Petroleum Engineers, 9-12 October, Dallas, Texas, United States. 1-95750-MS (2005)
Zhang, Y., Bhark, E.W., Phale, H.A., Dehghani, K.: Case studies: The ensemble-based approach to history matching and model parameter estimation. In: SPE Annual Technical Conference and Exhibition. Society of Petroleum Engineers, 27-29 October, Amsterdam, the Netherlands. 1-170726-MS (2014)
Zupanski, M.: Maximum likelihood ensemble filter: theoretical aspects. Mon. Weather. Rev. 133(6), 1710–1726 (2005)
Acknowledgements
The authors would like to acknowledge the support of ExxonMobil Upstream Research Company for the permission to publish this paper.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Ma, X., Bi, L. A robust adaptive iterative ensemble smoother scheme for practical history matching applications. Comput Geosci 23, 415–442 (2019). https://doi.org/10.1007/s10596-018-9786-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10596-018-9786-9