Various uncertainty metrics have been applicable to measure reliability under aleatory uncertainty and epistemic uncertainty, including evidence-theory-based reliability, interval-analysis-based reliability, fuzzy-interval-analysis-based reliability, posbist reliability and belief reliability. Difficulties arise, however, when an attempt is made to solve one specific situation by implementing one of these methods since the evaluating results may be different from each other. It is unconvinced to choose one method merely based on the qualitative analysis. Therefore, this paper proposes an optimal evaluation model to conduct an objective evaluation on these metrics and provide reasonable decision-making proposals. An evaluating index system is established on the feature analysis of these metrics. Cooke classical model has been adopted to weigh experts’ performance and improve the objectivity of the quantification results. Considering both evaluation indexes and requirements from the demanding sides, an optimal model is introduced based on data envelopment analysis. Numerical examples are subsequently conducted to illustrate the evaluating methods. The proposed model was found to outperform alternative methods in terms of objectivity and ability to provide reasonable decision-making suggestions.
Optimal evaluating model Data envelopment analysis Uncertainty metrics Adaptabilities Capabilities
This is a preview of subscription content, log in to check access.
This work was supported by the National Natural Science Foundation of China (Nos. 61573043, 71671009 and 61573041).
Compliance with Ethical Standards
Conflict of interest
The authors declare that there is no conflict of interest regarding the publication of this paper.
This article does not contain any studies with human participants performed by any of the authors.
Aven T, Zio E, Baraldi P, Flage R (2014) Uncertainty in risk assessment: the representation and treatment of uncertainties by probabilistic and non-probabilistic methods. Wiley, New YorkCrossRefGoogle Scholar
Awadallah SKE, Milanovic JV, Jarman PN (2016) Quantification of uncertainty in end-of-life failure models of power transformers for transmission systems reliability structure. IEEE Trans Power Syst 31:4047–4056CrossRefGoogle Scholar
Bedford T, Cooke R (2001) Probabilistic risk analysis: foundations and methods. Cambridge University Press, CambridgeCrossRefMATHGoogle Scholar
Beer M, Ferson S, Kreinovich V (2013) Imprecise probabilities in engineering analyses. Mech Syst Signal Process 37:4–29CrossRefGoogle Scholar
Cai KY, Wen CY, Zhang ML (1993) Fuzzy states as a basis for a theory of fuzzy reliability. Microelectron Reliab 33(15):2253–2263CrossRefGoogle Scholar
Charnes A, Cooper W, Golany B, Seiford L, Stutz J (1985) Foundations of data envelopment analysis for pareto-koopmans efficient empirical production functions. J Econom 30(1):91–107MathSciNetCrossRefMATHGoogle Scholar
Cooke RM (1991) Experts in uncertainty opinion and subjective probability in science. Oxford Unversity Press, LondonGoogle Scholar
Jiang C, Ni B, Han X, Tao Y (2014) Non-probabilistic convex model process: a new method of time-variant uncertainty analysis and its application to structural dynamic reliability problems. Comput Methods Appl Mech Eng 268:656–676MathSciNetCrossRefMATHGoogle Scholar
Kang R, Zhang Q, Zeng Z, Zio E, Li X (2016) Measuring reliability under epistemic uncertainty: review on non-probabilistic reliability metrics. Chin J Aeronaut 29(3):571–579CrossRefGoogle Scholar
Karanki DR, Kushwaha HS, Verma AK, Ajit S (2009) Uncertainty analysis based on probability bounds (p-box) approach in probabilistic safety assessment. Risk Anal 29(5):662–675CrossRefGoogle Scholar
King JM, Grandhi RV, Benanzer TW (2012) Quantification of epistemic uncertainty in re-usable launch vehicle aero-elastic design. Eng Optim 4:489–504CrossRefGoogle Scholar
Li X, Zhou J, Zhao X (2016) Travel itinerary problem. Transp Res Part B: Methodol 91:332–343CrossRefGoogle Scholar
Zeng Z, Kang R, Wen M, Chen Y (2015) Measuring reliability during product development considering aleatory and epistemic uncertainty. In: 2015 Annual Reliability and Maintainability Symposium (RAMS), pp 1–6Google Scholar
Zio E (2009) Reliability engineering: old problems and new challenges. Reliab Eng Syst Safety 94(2):125–141CrossRefGoogle Scholar