Abstract
Statistical model calibration is a practical tool for computational model development processes. However, in optimization-based model calibration, the quality of the calibrated model is often unsatisfactory due to inefficiency and/or inaccuracy of calibration metrics. This paper proposes a new calibration metric, namely, probability residual (PR). PR quantifies the degree of agreement or disagreement between the computational response and experimental results. The PR metric is defined as the sum of the product of a scale factor and the squared residual. First, the scale factor defines the shape of the squared residual to maintain consistent sensitivity during the optimization process. Thus, the number of function evaluations can be reduced. Second, the mathematical form of the squared residuals is used to make convex optimization feasible. Therefore, the existence of a global minimum is guaranteed. To evaluate the performance of the proposed metric, numerical examples are shown in a case study. Various system functions—including linear, non-linear, and elliptical—are incorporated into the statistical model calibration. A case study that examines journal bearing rotor systems is presented to demonstrate the application of the proposed calibration metric to a real-world engineered system.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Abbas A, H. Cadenbach A, Salimi E (2017) A Kullback–Leibler view of maximum entropy and maximum log-probability methods. Entropy 19:232
Ageno M, Bolzon G, Maier G (2009) An inverse analysis procedure for the material parameter identification of elastic–plastic free-standing foils. Struct Multidiscip Optim 38:229–243. https://doi.org/10.1007/s00158-008-0294-8
AIAA (1998) Guide for the verification and validation of computational fluid dynamic simulations, American Institute of Aeronautics and Astronautics
ASME (2006) Guide for verification and validation in computational solid mechanics. American Society of Mechanical Engineers, New York
Bao N, Wang C (2015) A Monte Carlo simulation based inverse propagation method for stochastic model updating. Mech Syst Signal Process 60-61:928–944. https://doi.org/10.1016/j.ymssp.2015.01.011
Campbell K (2006) Statistical calibration of computer simulations. Reliab Eng Syst Saf 91:1358–1363. https://doi.org/10.1016/j.ress.2005.11.032
Cha S-H (2007) Comprehensive survey on distance/similarity measures between probability density functions. Int J Math Models Methods Appl Sci 1:300–307
Fang S-E, Ren W-X, Perera R (2012) A stochastic model updating method for parameter variability quantification based on response surface models and Monte Carlo simulation. Mech Syst Signal Process 33:83–96. https://doi.org/10.1016/j.ymssp.2012.06.028
Ferson S, Oberkampf WL, Ginzburg L (2008) Model validation and predictive capability for the thermal challenge problem. Comput Methods Appl Mech Eng 197:2408–2430. https://doi.org/10.1016/j.cma.2007.07.030
Gao BB, Xing C, Xie CW, Wu J, Geng X (2017) Deep label distribution learning with label ambiguity. IEEE Trans Image Process 26:2825–2838. https://doi.org/10.1109/TIP.2017.2689998
Gavin DG, Oswald WW, Wahl ER, Williams JW (2003) A statistical approach to evaluating distance metrics and analog assignments for pollen records. Quat Res 60:356–367. https://doi.org/10.1016/S0033-5894(03)00088-7
Guillas S, Glover N, Malki-Epshtein L (2014) Bayesian calibration of the constants of the k–ε turbulence model for a CFD model of street canyon flow. Comput Methods Appl Mech Eng 279:536–553. https://doi.org/10.1016/j.cma.2014.06.008
Indira V, Vasanthakumari R, Sakthivel NR, Sugumaran V (2011) A method for calculation of optimum data size and bin size of histogram features in fault diagnosis of mono-block centrifugal pump. Expert Syst Appl 38:7708–7717. https://doi.org/10.1016/j.eswa.2010.12.140
Jung BC, Yoon H, Oh H, Lee G, Yoo M, Youn BD, Huh YC (2016) Hierarchical model calibration for designing piezoelectric energy harvester in the presence of variability in material properties and geometry. Struct Multidiscip Optim 53:161–173. https://doi.org/10.1007/s00158-015-1310-4
Jung JH, Jeon BC, Youn BD, Kim M, Kim D, Kim Y (2017) Omnidirectional regeneration (ODR) of proximity sensor signals for robust diagnosis of journal bearing systems. Mech Syst Signal Process 90:189–207. https://doi.org/10.1016/j.ymssp.2016.12.030
Kennedy MC, O'Hagan A (2001) Bayesian calibration of computer models. J R Stat Soc Ser B Stat Methodol 63:425–464. https://doi.org/10.1111/1467-9868.00294
Kim H-S, Jang S-G, Kim N-H, Choi J-H (2016) Statistical calibration and validation of elasto-plastic insertion analysis in pyrotechnically actuated devices. Struct Multidiscip Optim 54:1573–1585. https://doi.org/10.1007/s00158-016-1545-8
Kim M, Kim Y, Yoo J, Wang J, Kim H (2017) Regularized speaker adaptation of KL-HMM for dysarthric speech recognition. IEEE Trans Neural Syst Rehabil Eng 25:1581–1591. https://doi.org/10.1109/TNSRE.2017.2681691
Kullback S, Leibler RA (1951) On information and sufficiency. Ann Math Stat 22:79–86
Kwon KB, Jung J, Han JS (2018) Abnormal condition analysis and validation of RK4 multi axis rotor systems using finite element analysis. Trans Korean Soc Noise Vib Eng 28:204–213
Lee G, Yi G, Youn BD (2017) A comprehensive study of calibration metric for optimization-based model calibration. Paper presented at the 12th World Congress of Structural and Multidisciplinary Optimization, Braunschweig, Germany, June 5–9
Looman J, Campbell JB (1960) Adaptation of Sorensen’s K (1948) for estimating unit affinities in prairie vegetation. Ecology 41:409–416. https://doi.org/10.2307/1933315
Mares C, Mottershead JE, Friswell MI (2006) Stochastic model updating: part 1—theory and simulated example. Mech Syst Signal Process 20:1674–1695. https://doi.org/10.1016/j.ymssp.2005.06.006
Oh H, Kim J, Son H, Youn BD, Jung BC (2016a) A systematic approach for model refinement considering blind and recognized uncertainties in engineered product development. Struct Multidiscip Optim 54:1527–1541. https://doi.org/10.1007/s00158-016-1493-3
Oh H, Wei HP, Han B, Youn BD (2016b) Probabilistic lifetime prediction of electronic packages using advanced uncertainty propagation analysis and model calibration. IEEE Trans Compon Packag Manuf Technol 6:238–248. https://doi.org/10.1109/TCPMT.2015.2510398
Sahmani S, Fattahi AM (2017) Calibration of developed nonlocal anisotropic shear deformable plate model for uniaxial instability of 3D metallic carbon nanosheets using MD simulations. Comput Methods Appl Mech Eng 322:187–207. https://doi.org/10.1016/j.cma.2017.04.015
Sarin H, Kokkolaras M, Hulbert G, Papalambros P, Barbat S, Yang RJ (2010) Comparing time histories for validation of simulation models: error measures and metrics. J Dyn Syst Meas Control 132:061401–061401-061410. https://doi.org/10.1115/1.4002478
Shannon CE (1948) A mathematical theory of communication SIGMOBILE. Mob Comput Commun Rev 5:3–55. https://doi.org/10.1145/584091.584093
Shin H, Chang S, Yang S, Youn BD, Cho M (2016) Statistical multiscale homogenization approach for analyzing polymer nanocomposites that include model inherent uncertainties of molecular dynamics simulations. Compos Part B 87:120–131. https://doi.org/10.1016/j.compositesb.2015.09.043
Simoen E, De Roeck G, Lombaert G (2015) Dealing with uncertainty in model updating for damage assessment: a review. Mech Syst Signal Process 56:123–149. https://doi.org/10.1016/j.ymssp.2014.11.001
Trucano TG, Swiler LP, Igusa T, Oberkampf WL, Pilch M (2006) Calibration, validation, and sensitivity analysis: What’s what. Reliab Eng Syst Saf 91:1331–1357. https://doi.org/10.1016/j.ress.2005.11.031
Wand MP (1997) Data-based choice of histogram bin width. Am Stat 51:59–64. https://doi.org/10.2307/2684697
Xiong Y, Chen W, Tsui K-L, Apley DW (2009) A better understanding of model updating strategies in validating engineering models. Comput Methods Appl Mech Eng 198:1327–1337. https://doi.org/10.1016/j.cma.2008.11.023
Youn BD, Jung BC, Xi Z, Kim SB, Lee WR (2011) A hierarchical framework for statistical model calibration in engineering product development. Comput Methods Appl Mech Eng 200:1421–1431. https://doi.org/10.1016/j.cma.2010.12.012
Acknowledgments
This work was supported by the R&D project (R17GA08) of Korea Electric Power Corporation (KEPCO) and the Korea Institute of Energy Technology Evaluation and Planning (KETEP) Grant no. 20172010105590 funded by the Korean Ministry of Trade, Industry, & Energy (MOTIE).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Additional information
Responsible Editor: Felipe A. C. Viana
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Oh, H., Choi, H., Jung, J.H. et al. A robust and convex metric for unconstrained optimization in statistical model calibration—probability residual (PR). Struct Multidisc Optim 60, 1171–1187 (2019). https://doi.org/10.1007/s00158-019-02288-6
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00158-019-02288-6