Abstract
Traditional uncertainty analysis for subsurface models is typically based on a single dynamic model with a number of uncertain parameters. Improved and more robust forecasting can be obtained by combining several models in a Bayesian setting using model averaging. The traditional Bayesian Model Averaging (BMA), however, suffers from several drawbacks, such as too large sensitivity to prior model assumptions and instability with respect to measurement perturbations, especially when the number of measurements is large. We suggest a modified version of BMA (MBMA) where the calculations are stabilized using an ensemble of measurements. Bayesian stacking (BS) is a method that is directly focused on the performance of the combined predictive distribution of several models. The original version of BS (BSLOO) is based on leave-one-out cross-validation and requires a Bayesian inversion for each data point which may be very time consuming. We suggest a modified version of stacking (MBS) that requires only a single history match and uses an ensemble of measurements. MBS may be used with either prior (MBS-pri) or posterior (MBS-post) predictive distributions. The behavior of the methods is illustrated using three synthetic, linear examples. One is a simple mixture model. The other two are inspired by 4D seismic data. The results with MBS-pri are very similar to the results with MBMA. The results with MBS-post are similar to those of BSLOO when the data are uncorrelated. MBS can take into account correlated data or measurement errors, while correlations are neglected in the BSLOO weight calculations.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Data statement
This manuscript has no associated data.
References
Genell, A., Nemes, S., Steineck, G., Dickman, P.W.: Model selection in medical research: a simulation study comparing bayesian model averaging and stepwise regression. BMC Med. Res. Methodol. 10, 1317–1399 (2010)
Carrassi, A., Bocquet, M., Hannart, A., Ghil, M.: Estimating model evidence using data assimilation. Q. J. R. Meteorol. Soc. 143, 866–880 (2017)
Carson, J., Crucifix, M., Preston, S., Wilkinson, R.D.: Bayesian model selection for the glacial-interglacial cycle. preprint arXiv:1511.03467
Hoeting, J.A., Madigan, D., Raftery, A.E., Volinsky, C.T.: Bayesian Model Averaging: A Tutorial. Statistical Sci. 14(4), 382–417 (1999)
Yao, Y., Vehtari, A., Simpson, D., Gelman, A.: Using stacking to average bayesian predictive distributions (with discussion). Bayesian Anal. 13(3), 917–1007 (2018)
Minka, T.P.: Bayesian model averaging is not model combination. Technical report, 2002. Available online: http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.34.1359& rank=4
Höge, M., Guthke, A., Nowak, W.: Bayesian model weighting: The many faces of model averaging. Water 12(309) (2020)
Gelman, A., Carlin, J.B., Stern, H.S., Dunson, D.B., Vehtari, A., Rubin, D.B: Bayesian Data Analysis. Chapman & Hall/CRS Press, third edition (2014)
Hong, A., Bratvold, R.B., Lake, L.W., Maraggi, L.M.R.: Integrating model uncertainty in probabilistic decline curve analysis for unconventional oil production forecasting. SPE Reservoir Eval. Eng. 22(03), 861–876 (2019)
Aanonsen, S.I., Tveit, S., Alerini, M.: Using bayesian model probability for ranking different prior scenarios in reservoir history matching. SPE J. 24(04), 1490–1507 (2019)
Cheng, Y., Wang, Y., McVay, D.A., Lee, W.J.: Practical application of a probabilistic approach to estimate reserves using production decline data. SPE Economics & Management 2(01), 19–31 (2010)
Vehtari, A., Gelman, A., Gabry, J.: Pareto smoothed importance sampling. (2017). ArXiv e-print: arXiv:1507.02646
Vehtari, A., Gelman, A., Gabry, J.: Practical bayesian model evaluation using leave-one-out cross-validation and waic. Stat. Comput. 27(5), 1413–1432 (2017)
Mannseth, T., Aanonsen, S.I., Fossum, K.: Calculating bayesian model evidence for porous-media flow using a multilevel estimator. Submitted (2022)
Fahimuddin, A.: 4D Seismic History Matching Using the Ensemble Kalman Filter (EnKF): Possibilities and Challenges. PhD thesis, Department of Mathematics, University of Bergen, Bergen, Norway, March (2010)
Stewart, A.M., Dance, S.L., Nichols, N.K.: Information content of spatially correlated observation errors. Technical report, Department of Mathematics, The University of Reading, Numerical analysis report 4/06 (2006)
Bishop, C.M.: Pattern Recognition and Machine Learning (Information Science and Statistics). Springer-Verlag, Berlin, Heidelberg (2006)
Acknowledgements
The authors acknowledge financial support from the NORCE research project "Assimilating 4D Seismic Data: Big Data Into Big Models", which is funded by industry partners, Equinor Energy AS, Aker BP ASA, Repsol Norge AS, Shell Global Solutions International B. V., TotalEnergies EP Norge AS, and Wintershall Dea Norge AS, as well as the Research Council of Norway (PETROMAKS2).
Funding
Open access funding provided by NORCE Norwegian Research Centre AS.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Competing interests
The authors have no competing interests to declare that are relevant to the content of this article.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Kristian Fossum and Trond Mannseth contributed equally to this work.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Aanonsen, S.I., Fossum, K. & Mannseth, T. Bayesian model evaluation for multiple scenarios. Comput Geosci 27, 1001–1021 (2023). https://doi.org/10.1007/s10596-023-10241-2
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10596-023-10241-2