Validation Approach for Statistical Extrapolation

  • Timothy C. SmithEmail author
Part of the Fluid Mechanics and Its Applications book series (FMIA, volume 119)


Statistical extrapolation is the estimation of rare, extreme responses from data sets that consist primarily, if not entirely, of lower (non-rare) values. The validation of statistical extrapolation involves elements common to all validation efforts with the additional difficulty of needing to determine the true value and its uncertainty. The determination of the true value requires an extensive amount of data in order to observe multiple rare events. In some cases, the desired extreme events may be so rare that validation is forced to accept a less rare event such as a lower threshold value. This paper reviews the basics of simulation validation and focuses on the challenges of the validation of statistical extrapolation.


  1. Ammeen, E., 1994, “Evaluation of Correlation Measures,” CRDKNSWC-HD-0406, March.Google Scholar
  2. American Society of Mechanical Engineers, 2009, “Standard for Verification and Validation in Computational Fluid Dynamics and Heat Transfer,” American Society of Mechanical Engineers, New York.Google Scholar
  3. American Institute for Aeronautics and Astronautics, 1998, Guide for the Verification and Validation of Computational Fluid Dynamics Simulations, AIAA-G-077-1998, Reston, VA.Google Scholar
  4. Anastopoulos, P.A., Spyrou, K.J., Bassler, C.C. and V. Belenky, 2015, “Towards an Improved Critical Wave Groups Method for the Probabilistic Assessment of Large Ship Motions in Irregular Sea” Probabilistic Engineering Mechanics Vol. 44, pp 18–27.CrossRefGoogle Scholar
  5. Bales, N.K., 1980, “Optimizing the Seakeeping Performance of Destroyer-Type Hulls,” Proc. 13th Symp. Naval Hydrodynamics, Tokyo, Japan.Google Scholar
  6. Belenky, V. and K.M. Weems, 2012, “Probabilistic Properties of Parametric Roll”, Chapter 6 of Parametric Resonance in Dynamical Systems, Fossen, T. I. and H. Nijmeijer, eds., Springer, ISBN 978-1-4614-10423-0, pp. 129–146.Google Scholar
  7. Belenky, V., Pipiras, V., Kent, C., Hughes, M., Campbell, B. and Smith, T., 2013, “On the Statistical Uncertainties of Time-domain-based Assessment of Stability Failures: Confidence Interval for the Mean and Variance of a Time Series,” Proc. 13th Intl. Ship Stability Workshop, Brest, France, pp. 251–258.Google Scholar
  8. Belenky, V., Pipiras, V. and Weems, K., 2015, “Statistical Uncertainty of Ship Motion Data,” Proc. 12th Intl. Conf. on Stability of Ships and Ocean Vehicles, Glasgow, UKGoogle Scholar
  9. Belenky, V., Weems, K. and Lin, W.M. 2016, “Split-time Method for Estimation of Probability of Capsizing Caused by Pure Loss of Stability” Ocean Engineering, Vol. 122, pp. 333–343.CrossRefGoogle Scholar
  10. Belknap, W.F., Smith, T.C., Campbell, B.L., 2011, “Addressing Challenges in the Validation of Dynamic Stability Simulation Tools,” Proc. 12th Intl. Ship Stability Workshop, Washington, DC., USA pp 81–90.Google Scholar
  11. Belknap, W, Belenky, V., Campbell, B. and Smith, T., 2012, “A Guide for Validation of Simulation-Based Approach for Predicting Ship Stability Failure Probabilities” Proc. 29th Symp. Naval Hydrodynamics, Gothenburg, SwedenGoogle Scholar
  12. Bendat, J. and Piersol, 1966, Measurement and Analysis of Random Data, John Wiley & Sons.Google Scholar
  13. Campbell, B., Belenky, V. and Pipiras, V., 2016, “Application of the Envelope Peaks over Threshold (EPOT) Method for Probabilistic Assessment of Dynamic Stability,” Ocean Engineering, Vol. 120, pp. 298–304.CrossRefGoogle Scholar
  14. Coleman, H. W. and Steele, W. G., 1989, Experimentation and Uncertainty Analysis for Engineers, John Wiley & Sons.Google Scholar
  15. Coles, S., 2001, An Introduction to Statistical Modeling of Extreme Values. Springer-Verlag, London.CrossRefGoogle Scholar
  16. de Kat, J. O. and Paulling, J. R., 1989, “The Simulation of Ship Motions and Capsizing in Severe Seas,” Trans. SNAME vol. 97.Google Scholar
  17. DoD, 2009, DoD Modeling and Simulation, (M&S) Verification, Validation, and Accreditation, (VVA), Instruction 5000.61, 9 Dec 2009.Google Scholar
  18. DoN, 2004, Department of the Navy Modeling and Simulation, (M&S) VVA Implementation Handbook, 30 March 2004.Google Scholar
  19. IEEE, 2012, Standard for System and Software Verification and Validation, 1012–2012, Rev o.Google Scholar
  20. International Towing Tank Conference, 2011, “Loads and Responses Seakeeping Verification and Validation of Linear and Weakly Nonlinear Seakeeping Computer Codes,” 26th ITTC Seakeeping Committee Procedure 7.5 – 02 07-02.5 rev 1.Google Scholar
  21. ITTC Specialist Committee on Stability in Waves, 2011, Final Report and Recommendations to the 26th ITTC, Proc. 26th International Towing Tank Conference, Vol II, Rio de Janeiro, Brazil.Google Scholar
  22. Glotzer, D., Pipiras, V., Belenky, V., Campbell, B., Smith, T., 2017, “Confidence Interval for Exceedance Probabilities with Application to Extreme Ship Motions,” REVSTAT Statistical J. Vol. 15, No 4, pp. 537–563.Google Scholar
  23. Griffith, A. A. and Locke, W. M., 2006, An Analysis of the U.S. Navy Verification, Validation, and Accreditation, (VVA) Process for Modeling and Simulation, M(&S) Used for Operation Test (OT) of Surface Ships and Weapons, Thesis Naval Post Graduate School, June 2006.Google Scholar
  24. Lee, E., Fullerton, A., Geiser, J., Schleicher, C., Merril, C., Weil, C., Jiang, M., Stern, F., and Mousaviraad, M., 2016, “Experimental and Computation Comparisons of the R/V Athena in Calm Water,” Proc. 31st Symp. Naval Hydrodynamics, Monterey, California, USA.Google Scholar
  25. Lin, W.M., Yue, D.K.P., 1990, “Numerical Solutions for Large Amplitude Ship Motions in the Time-Domain.” Proc. 18th Symp. Naval Hydrodynamics, Ann Arbor, Michigan, USA. pp. 41–66.Google Scholar
  26. Oberkampf, W., Blottner, F., 1997, Issues in Computational Fluid Dynamics Code Verification and Validation, Sandia National Laboratories Report SAND95-1352.Google Scholar
  27. Priestley, M. B., 1981, Spectral Analysis and Time Series, Vol. 1, Academic Press, New York.Google Scholar
  28. Reed, A. M., 2011, “26th ITTC Parametric Roll Benchmark Study,” Proc. 12th Intl Ship Stability Workshop, Washington DC., USAGoogle Scholar
  29. Reed, A. M. and Zuzick, A., 2015, “Direct Assessment Will Require Accreditation - What This Means,” Proc. 12th Intl. Conf. on the Stability of Ships and Ocean Vehicles, Glasgow, UK, pp. 51–78Google Scholar
  30. Sec. of Navy, 1999, “Verification, Validation, and Accreditation (VVA) of Models and Simulations,” SECNAVINST 5200.40, 19 April 1999.Google Scholar
  31. Shin, Y.S., Belenky, V., Lin, W.M. Weems, K.M. and Engle, A.H., 2003, “Nonlinear Time Domain Simulation Technology for Seakeeping and Wave-Load Analysis for Modern Ship Design,” Trans. SNAME, Vol. 111.Google Scholar
  32. Smith, T.C., 2011, “Statistical Data Set Comparison for Continuous, Dependent Data” Proc. 12th Intl. Ship Stability Workshop, Washington DC, USA, pp. 75–80.Google Scholar
  33. Smith, T.C., 2012, “Approaches to Ship Motion Simulation Acceptance Criteria” Proc. of 11th Intl Conference of the Stability of Ships and Ocean Vehicles, Athens, Greece. pp. 101–114.Google Scholar
  34. Smith, T. and Campbell, B. 2013, “On the Validation of Statistical Extrapolation for Stability Failure Rate,” Proc. 13th Intl. Ship Stability Workshop, Brest, France.Google Scholar
  35. Smith, T., Campbell, B., Zuzick, A., Belknap, W., and Reed, A., 2014, “Approaches to Validation of Ship Motion Prediction Tools and Extrapolation Procedures for Large Excursion of Ship Motions in Irregular Seas” Proc. 7th Intl. Conf. of Computational Stochastic Mechanics, Santorini, Greece. ISBN: 978-981-09-5347-8Google Scholar
  36. Smith, T. C., 2014, “Example of Validation of Statistical Extrapolation Example of Validation of Statistical Extrapolation,” Proc. 14th Intl. Ship Stability Workshop, Kuala Lumpur, Malaysia.Google Scholar
  37. Smith, T. and Zuzick, A., 2015, “Validation of Statistical Extrapolation Methods for Large Motion Prediction,” Proc. 12th Intl. Conf. on Stability of Ships and Ocean Vehicles, Glasgow, UK.Google Scholar
  38. Stern, F., Wilson, R., Coleman, H., Paterson, E., 1999, Verification and Validation of CFD Simulations, Iowa Institute of Hydraulic Research Report No. 407.Google Scholar
  39. Stern. F., Wilson, R., and Shao, J., 2005, “Quantitative V&V of CFD Simulations and Certification of CFD Codes,” Intl. J. Numerical Methods in Fluid. Vol 50: pp 1335–1355.CrossRefGoogle Scholar
  40. Weems, K. and Wundrow, D., 2013, “Hybrid Models for Fast Time-Domain Simulation of Stability Failures in Irregular Waves with Volume-Based Calculations for Froude Krylov and Hydrostatic Force”, Proc. 13th Intl. Ship Stability Workshop, Brest, France.Google Scholar
  41. Weems, K. and Belenky, V., 2015, “Fast Time-Domain Simulation in Irregular Waves With Volume-Based Calculations for Froude Krylov and Hydrostatic Force” Proc. 12th Intl Conference on Stability of Ships and Ocean Vehicles, Glasgow, UK.Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.David Taylor Model Basin (NSWCCD)West BethesdaUSA

Personalised recommendations