From Model Calibration and Validation to Reliable Extrapolations

  • Gabriel TerejanuEmail author
Conference paper
Part of the Conference Proceedings of the Society for Experimental Mechanics Series book series (CPSEMS)


The purpose of this paper is to propose and explore a validation and predictive assessment process that supports extrapolative predictions for models with known sources of error. In general, the ultimate purpose of most computational models is to make predictions, which are not experimentally observable. As a result assessing the validity of extrapolative predictions is more challenging than situations encountered in classical validation, where model outputs for observed quantities are compared to observations. In this paper a comprehensive approach is proposed to justify extrapolative predictions for models with known sources of error. The connection between model calibration, validation and prediction is made through the introduction of alternative uncertainty models used to model the localized errors. In addition a prediction assessment tool is introduced to characterize the reliability of model predictions in the absence of data. The proposed methodology is applied to an illustrative extrapolation problem involving a misspecified nonlinear oscillator.


Prediction validation Model error Discrepancy model Structural uncertainty Bayesian inference 


  1. 1.
    Babuška, I., Nobile, F., Tempone, R.: A systematic approach to model validation based on Bayesian updates and prediction related rejection criteria. Comput. Methods Appl. Mech. Eng. 197, 2517–2539 (2008)CrossRefzbMATHGoogle Scholar
  2. 2.
    Balci, O.: Verification validation and accreditation of simulation models. In: Proceedings of the 29th Winter Simulation Conference, WSC ’97, pp. 135–141. IEEE Computer Society, Washington, DC (1997)Google Scholar
  3. 3.
    Kennedy, M.C., O’Hagan, A.: Bayesian calibration of computer models. J. R. Stat. Soc. Ser. B (Stat Methodol.) 63 (3), 425–464 (2001)Google Scholar
  4. 4.
    Oberkampf, W., Roy, C.: Verification and Validation in Scientific Computing. Cambridge University Press, Cambridge (2010)CrossRefzbMATHGoogle Scholar
  5. 5.
    Oberkampf, W.L., Trucano, T.G.: Verification and validation benchmarks. Technical Report SAND2007-0853, Sandia National Laboratories (2007). Unlimited ReleaseGoogle Scholar
  6. 6.
    Oliver, T.A., Terejanu, G., Simmons, C.S., Moser, R.D.: Validating predictions of unobserved quantities. Comput. Methods Appl. Mech. Eng. 283, 1310–1335 (2015)CrossRefGoogle Scholar
  7. 7.
    Roache, P.J.: Perspective: validation - what does it mean? ASME J. Fluid Eng. 131 (3), 1–3 (2008)Google Scholar
  8. 8.
    Roache, P.J.: Fundamentals of Verification and Validation. Hermosa Publishers, Albuquerque (2009)Google Scholar
  9. 9.
    Sargent, R.G.: Verification and validation of simulation models. In: Proceedings of the 30th Winter Simulation Conference, WSC ’98, Los Alamitos, CA, pp. 121–130. IEEE Computer Society Press, New York (1998)Google Scholar

Copyright information

© The Society for Experimental Mechanics, Inc. 2016

Authors and Affiliations

  1. 1.Department of Computer Science and EngineeringUniversity of South CarolinaColumbiaUSA

Personalised recommendations