Abstract
Probabilistic Safety Assessment (PSA) is concerned with the quantification of the possible damages from hazardous materials releases and of the corresponding probabilities. Although expert judgment is expected to contribute substantially to improving the quality of probability assessments within PSA, it has become clear in recent years that a number of specific problems are associated with the use of expert opinions. Thus, the need exists for formalized procedures for expert opinion use. This paper is based on a research project that deals with the development of such procedures. To this end, three substantially different models for eliciting and combining expert opinions have been formulated: (a) a “classical” model, based on weighted averaging, (b) a Bayesian model, and (c) a psychological scaling model. These models have been made operational and are being tested and evaluated in experiments on real-world problems. The paper presents a discussion of expert opinion use in PSA and of the models mentioned above, and gives a first look at the experiments.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Van der Horst, J., Technical support of safety studies. Report 84-015811, Division of Technology for Society TNO, Apeldoorn, Netherlands, 1984 (in Dutch).
Reactor Safety Study. NUREG 75/014 (WASH-1400), U.S. Nuclear Regulatory Commission, Washington, DC, USA, 1975.
Apostolakis, G., On the use of judgment in probabilistic risk analysis. Nuclear Engineering and Design, 1986, 93, 161–166.
Apostolakis, G., Expert judgment in probabilistic safety assessment. Paper presented at the course “Accelerated life testing and experts’ opinions in reliability”. International School of Physics “Enrico Fermi”, S. Terenzo di Lerici (La Spezia), Italy, 1986.
Okrent, D., A survey of expert opinion on low probability earthquakes. Annals of Nuclear Energy, 1975, 2, 601–614.
Van Steen, J.F.J. and Oortman Gerlings, P.D., Expert opinion in probabilistic safety assessment, Vol. 1: Literature study. Netherlands Organization for Applied Scientific Research TNO/Delft University of Technology, Apeldoorn/Delft, Netherlands, 1988 (in preparation).
Staël von Holstein, C.-A.S., Measurement of subjective probability. Acta Psychologica, 1970, 34, 146–159.
Hampton, J.M., Moore, P.G. and Thomas, H., Subjective probability and its measurement. Journal of the Royal Statistical Society A, 1973, 136, 21–42.
Huber, G.P., Methods for quantifying subjective probabilities and multi-attribute utilities. Decision Sciences, 1974, 5, 430–458.
Hogarth, R.M., Cognitive processes and the assessment of subjective probability distributions. Journal of the American Statistical Association, 1975, 70, 271–289.
Morgan, M.G., Henrion, M. and Morris, S.C., Expert judgments for policy analysis. Brookhaven National Laboratory, Upton, New York, USA, 1979.
Stillwell, W.G., Seaver, D.A. and Schwartz, J.P., Expert estimation of human error probabilities in nuclear power plant operations: A review of probability assessment and scaling. NUREG/CR-2255, U.S. Nuclear Regulatory Commission, Washington, DC, USA, 1982.
Wallsten, T.S. and Budescu, D.V., Encoding subjective probabilities: a psychological and psychometric review. Management Science, 1983, 29, 151–173.
Lichtenstein, S., Fischhoff, B. and Phillips, L.D., Calibration of probabilities: The state of the art to 1980. In (15), pp. 306–334.
Kahneman, D., Slovic, P. and Tversky, A. (eds.). Judgment under Uncertainty: Heuristics and Biases, Cambridge University Press, 1982.
Winkler, R.L. and Murphy, A.H., Experiments in the laboratory and the real world. Organizational Behavior and Human Performance, 1973, 10, 252–270.
Murphy, A.H. and Winkler, R.L., Reliability of subjective probability forecasts of precipitation and temperature. Applied Statistics, 1977, 26, 41–47.
Spetzler, C.S. and Staël von Holstein, C.-A.S., Probability encoding in decision analysis. Management Science, 1975, 22, 340–358.
Ludke, R.L., Stauss, F.F. and Gustafson, D.H., Comparison of five methods for estimating subjective probability distributions. Organizational Behavior and Human Performance, 1977, 19, 162–179.
Seaver, D.A., Von Winterfeldt, D. and Edwards, W., Eliciting subjective probability distributions on continuous variables. Organizational Behavior and Human Performance, 1978, 21, 379–391.
Alpert, M. and Raiffa, H., A progress report on the training of probability assessors. In (15), pp. 294–305.
Schaefer, R.E. and Borcherding, K., The assessment of subjective probability distributions: A training experiment. Acta Psychologica, 1973, 37, 117–129.
Pickhardt, R.C. and Wallace, J.B., A study of the performance of subjective probability assessors. Decision Sciences, 1974, 5, 347–363.
Lichtenstein, S. and Fischhoff, B., Training for calibration. Organizational Behavior and Human Performance, 1980, 26, 149–171.
Genest, C. and Zidek, J.V., Combining probability distributions: A critique and an annotated bibliography. Statistical Science, 1986, 1, 114–148.
Apostolakis, G., Kaplan, S., Garrick, B.J. and Duphily, R.J., Data specialization for plant specific risk studies. Nuclear Engineering and Design, 1980, 56, 321–329.
IEEE guide to the collection and presentation of electrical, electronic and sensing component reliability data for nuclear power generating stations (IEEE Std-500). The Institute of Electrical and Electronic Engineers, 1977.
Minarick, J. and Kukielka, C., Precursors to potential severe core damage accidents; 1969–1979; A status report. NUREG/CR-2497, U.S. Nuclear Regulatory Commission, 1982.
Cooke, R.M., Subjective probability and expert opinion. Lecture notes gg2.3. Delft University of Technology, 1986.
Hofer, E., Javeri, V., Löffler, H. and Struwe, D.F., A survey of expert opinion and its probabilistic evaluation for specific aspects of the SNR-300 risk study. Nuclear Technology, 1985, 68, 180–225.
Amendola, A., Uncertainties in systems reliability modelling: Insight gained through European benchmark exercises. Nuclear Engineering and Design, 1986, 93, 215–225.
Cummings, G.E., The use of data and judgment in determining seismic hazard and fragilities. Nuclear Engineering and Design, 1986, 93, 275–279.
Brune, R.L., Weinstein, M. and Fitzwater, M.E., Peer review study of the draft Handbook for Human Reliability Analysis. SAND82-7056, Sandia National Laboratories, Albuquerque, New Mexico, USA, 1983.
Morgan, M.G., Morris, S.C., Henrion, M., Amaral, D.A.L. and Rish, W.R., Technical uncertainty in quantitative policy analysis — a sulphur air pollution example. Risk Analysis, 1984, 4, 201–216.
Cox, R.A. and Slater, D.H., State-of-the-art of risk assessment of chemical plants in Europe. In Low-Probability/High-Consequence Risk Analysis, eds. R.A. Waller and V.T. Covello, Plenum Press, 1984, pp. 257–283.
Health and Safety Executive, Canvey: An investigation of potential hazards from operations in the Canvey Island/Thurrock area. HM Stationery Office, London, England, 1978.
Health and Safety Executive, Canvey — A second report. HM Stationery Office, London, England, 1981.
Openbaar Lichaam Rijnmond/COVO, Risk analysis of six potentially hazardous industrial objects in the Rijnmond area, a pilot study, Reidel, 1982.
TNO, LPG, A Study; A comparative analysis of the risks inherent in the storage, transshipment, transport and use of LPG and motor spirit, Ministry of Housing, Physical Planning and the Environment, The Hague, Netherlands, 1983.
Singpurwalla, N.D. and Soyer, R., The use of expert opinion in reliability: A survey. Paper presented at the course “Accelerated life testing and experts’ opinions in reliability”. International school of Physics “Enrico Fermi”, Italian Physical Society, S. Terenzo di Lerici (La Spezia), Italy, 1986.
Mosleh, A. and Apostolakis, G., The assessment of probability distributions from expert opinions with an application to seismic fragility curves. Risk Analysis, 1986, 6, 447–461.
Seaver, D.A. and Stillwell, W.G., Procedures for using expert judgment to estimate human error probabilities in nuclear power plant operations. NUREG/CR-2743, U.S. Nuclear Regulatory Commission, Washington, DC, USA, 1983.
Comer, M.K., Seaver, D.A., Stillwell, W.G. and Gaddy, C.D., Generating human reliability estimates using expert judgment. NUREG/CR-3688, U.S. Nuclear Regulatory Commission, Washington, DC, USA, 1984.
Embrey, D.E., Humphreys, P.C., Rosa, E.A., Kirwan, B. and Rea, K., SLIM-MAUD: An approach to assessing human error probabilities using structured expert judgment. NUREG/CR-3518, U.S. Nuclear Regulatory Commission, Washington, DC, USA, 1984.
Cooke, R.M., Mendel, M.B. and Van Steen, J.F.J., Expert opinion in probabilistic safety assessment, Vol. 2: Operational description of basic models. Delft University of Technology/Netherlands Organization for Applied Scientific Research TNO, Delft/Apeldoorn, Netherlands, 1988 (in preparation).
Cooke, R.M., Mendel, M. and Thijs, W., Calibration and information in expert resolution; a classical approach. To appear in Automatica, 1988.
Cooke, R.M., A theory of weights for combining expert opinion. Report 87-25, Faculty of Mathematics and Informatics/Computer Science, Delft University of Technology, Delft, Netherlands, 1987.
Mendel, M.B. and Sheridan, T.B., Optimal combination of information from multiple sources. Department of Mechanical Engineering, Massachusetts Institute of Technology, Cambridge, Massachusetts, USA, 1986.
Stobbelaar, M.F., Paired comparisons. Report 87-137, Division of Technology for Society TNO, Apeldoorn, Netherlands, 1987 (in Dutch).
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1988 Elsevier Applied Science Publishers Ltd
About this chapter
Cite this chapter
Van Steen, J.F.J. (1988). Expert Opinion in Probabilistic Safety Assessment. In: Libberton, G.P. (eds) 10th Advances in Reliability Technology Symposium. Springer, Dordrecht. https://doi.org/10.1007/978-94-009-1355-4_2
Download citation
DOI: https://doi.org/10.1007/978-94-009-1355-4_2
Publisher Name: Springer, Dordrecht
Print ISBN: 978-94-010-7103-1
Online ISBN: 978-94-009-1355-4
eBook Packages: Springer Book Archive