Abstract
I consider the problem of model diagnostics, that is, the problem of criticizing a model prior to history matching by comparing data to an ensemble of simulated data based on the prior model (prior predictions). If the data are not deemed as a credible prior prediction by the model diagnostics, some settings of the model should be changed before history matching is attempted. I particularly target methodologies that are computationally feasible for large models with large amounts of data. A multiscale methodology, that can be applied to analyze differences between data and prior predictions in a scale-by-scale fashion, is proposed for this purpose. The methodology is computationally inexpensive, straightforward to apply, and can handle correlated observation errors without making approximations. The multiscale methodology is tested on a set of toy models, on two simplistic reservoir models with synthetic data, and on real data and prior predictions from the Norne field. The tests include comparisons with a previously published method (termed the Mahalanobis methodology in this paper). For the Norne case, both methodologies led to the same decisions regarding whether to accept or discard the data as a credible prior prediction. The multiscale methodology led to correct decisions for the toy models and the simplistic reservoir models. For these models, the Mahalanobis methodology either led to incorrect decisions, and/or was unstable with respect to selection of the ensemble of prior predictions.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Data Availability
Python code that will reproduce the results with the Toy models (Figs. 2-7 in the paper) is on GitHub:https://github.com/TrondMannseth/MMD. The other datasets generated during and/or analysed during the current study are available from the author on reasonable request.
References
Aanonsen, S.I., Fossum, K., Mannseth, T.: Bayesian model evaluation for multiple scenarios. Comput. Geosci. 27(6), 1001–1021 (2023)
Aanonsen, S.I., Naevdal, G., Oliver, D.S., Reynolds, A.C., Brice, V.: The ensemble Kalman filter in reservoir engineering-a review. 14(3):393–412 (2009)
Alfonzo, M., Oliver, D.S.: Evaluating prior predictions of production and seismic data. Comput. Geosci. 23(6), 1331–1347 (2019)
Alfonzo, M., Oliver, D.S.: Seismic data assimilation with an imperfect model. Comput. Geosci. 24(2), 889–905 (2020)
Chen, Y., Oliver, D.S: Ensemble-based closed-loop optimization applied to Brugge field. SPE Reserv. Eval. Engin. 13(1), 56–71 (2010)
Yan, C., Dean, S.O.: History matching of the Norne full-field model with an iterative ensemble smoother. SPE Reserv. Eval. Engin. 17(2), 244–256 (2014)
Daubechies, I.: Ten lectures on wavelets. SIAM, (1992)
Emerick, A.A., Reynolds, A.C.: History matching a field case using the ensemble Kalman filter with covariance localization. SPE Reserv. Eval. Engin. 14(4), 443–452 (2011)
Evensen, G., Vossepoel, F.C., Leeuwen, P.J.V.: Data assimilation fundamentals: A unified formulation of the state and parameter estimation problem. Springer Nature, (2022)
Fang, J., Gong, B., Caers, J.: Data-driven model falsification and uncertainty quantification for fractured reservoirs. Engineering 18, 116–128 (2022)
Ferreira, C.J., Alessandra, D.J., Schiozer, D.J.: Use of a probabilistic and multi-objective history matching for uncertainty reduction for the Norne benchmark case. In SPE Europec featured at EAGE Conference and Exhibition, page D121S011R008. SPE, (2017)
Haar, A.: Zur theorie der orthogonalen funktionensysteme. Math. Ann. 69(3), 331–371 (1910)
He, J., Tanaka, S., Wen, X., Kamath, J.: Rapid S-curve update using ensemble variance analysis with model validation. In SPE Western Regional Meeting, OnePetro (2017)
Hermans, T., Nguyen, F., Caers, J.: Uncertainty in training image-based inversion of hydraulic head data constrained to ERT data: Workflow and case study. Water Resour. Res. 51(7), 5332–5352 (2015)
Hoeting, J.A, Madigan, D., Raftery, A.E., Volinsky, C.T.,:Bayesian model averaging: a tutorial. Stat. Sci.14 (4):382–417, (1999)
Hubert, M., Debruyne, M.: Minimum covariance determinant. Wiley interdisciplinary reviews: Computational statistics 2(1), 36–43 (2010)
Ledoit, O., Wolf, M.: A well-conditioned estimator for large-dimensional covariance matrices. Journal of multivariate analysis 88(2), 365–411 (2004)
Leung, P.L., Chan, W.Y.: Estimation of the scale matrix and its eigenvalues in the Wishart and the multivariate F distributions. Ann. Inst. Stat. Math. 50(3), 523–530 (1998)
Lorentzen, R.J., Bhakta, T., Grana, D., Luo, X., Valestrand, R., Naevdal, G.: History matching of real production and seismic data in the Norne field. In ECMOR XVI-16th European conference on the mathematics of oil recovery, European Association of Geoscientists & Engineers vol. 2018, pp. 1–16 (2018)
Morell, E.: History matching of the Norne field. Master’s thesis, Norges teknisk-naturvitenskapelige universitet (2010)
Park, H., Scheidt, C., Fenwick, D., Boucher, A., Caers, J.: History matching and uncertainty quantification of facies models with multiple geological interpretations. Comput. Geosci. 17, 609–621 (2013)
Rwechungura, R., Dadashpour, M., Kleppe, J.: Application of particle swarm optimization for parameter estimation integrating production and time lapse seismic data. In SPE Offshore Europe Conference and Exhibition, pp. SPE–146199. SPE (2011)
Schafer, J., Strimmer, K.: A shrinkage approach to large-scale covariance matrix estimation and implications for functional genomics. Stat. Appl. Genet. Mol. Biol. 4(1) (2005)
Scheidt, C., Jeong, C., Mukerji, T., Caers, J.: Probabilistic falsification of prior geologic uncertainty with seismic amplitude data: Application to a turbidite reservoir case. Geophysics 80(5), M89–M100 (2015)
Schulze-Riegert, R., Nwakile, M., Skripkin, S., Willen, Y.: Scalability and performance efficiency of history matching workflows using MCMC and adjoint techniques applied to the Norne North Sea reservoir case study. In 78th EAGE Conference and Exhibition 2016, European Association of Geoscientists Engineers vol. 2016, pp. 1–21 (2016)
Wang, L., Yin, D.Z., Caers, J.: Data Science for the Geosciences. Cambridge University Press, (2023)
Yao, Y., Vehtari, A., Simpson, D., Gelman, A.: Using stacking to average Bayesian predictive distributions (with discussion). Bayesian Anal. 13(3), 917–944 (2018)
Zhen, Yin., Strebelle, S., Caers, Jef.: Automated Monte Carlo-based quantification and updating of geological uncertainty with borehole data (AutoBEL v1.0). Geoscientific Model Development, 13(2), 651–672 (2020)
Zhang, Y., Leeuwenburgh, O., Carpentier, S., Steeghs, P.: 4D seismic history matching of the Norne field model using ensemble-based methods with distance parameterization. In IOR 2017-19th European Symposium on Improved Oil Recovery, European Association of Engineers vol. 2017, pp. 1–12 (2017)
Acknowledgements
The author thanks Equinor (operator of the Norne field) and its license partners Eni Norge (now, Vår Energi) and Petoro for the release of the Norne data. The author acknowledges the (former) Center for Integrated Operations at NTNU for cooperation and coordination of the Norne cases. The views expressed in this paper are the views of the author and do not necessarily reflect the views of Equinor and the Norne license partners.
Funding
Open access funding provided by NORCE Norwegian Research Centre AS. Partial financial support was provided by “NCS2030 - National Centre for Sustainable Subsurface Utilization of the Norwegian Continental Shelf”, which is funded by industry partners Aker BP, DNO Norge, Equinor, Landmark Graphics, OKEA, Schlumberger Information Solutions, Vår Energi, and Wintershall DEA, as well as the Research Council of Norway (PETROMAKS2)
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Ethical standards
The manuscript is written in full compliance with the ethical standards of the Journal.
Competing interests
The author has no competing interests to declare that are relevant to the content of this article.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Mannseth, T. Multiscale model diagnostics. Comput Geosci 28, 715–732 (2024). https://doi.org/10.1007/s10596-024-10289-8
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10596-024-10289-8