Abstract
Our methodology is based on the premise that expertise does not reside in the stochastic characterisation of the unknown quantity of interest, but rather upon other features of the problem to which an expert can relate her experience. By mapping the quantity of interest to an expert’s experience we can use available empirical data about associated events to support the quantification of uncertainty. Our rationale contrasts with other approaches to elicit subjective probability which ask an expert to map, according to her belief, the outcome of an unknown quantity of interest to the outcome of a lottery for which the randomness is understood and quantifiable. Typically, such a mapping represents the indifference of an expert on making a bet between the quantity of interest and the outcome of the lottery. Instead, we propose to construct a prior distribution with empirical data that is consistent with the subjective judgement of an expert. We develop a general methodology, grounded in the theory of empirical Bayes inference. We motivate the need for such an approach and illustrate its application through industry examples. We articulate our general steps and show how these translate to selected practical contexts. We examine the benefits, as well as the limitations, of our proposed methodology to indicate when it might, or might not be, appropriate.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Arnold S (1990) Mathematical statistics. Prentice-Hall, Englewood Cliffs
Carlin BP, Louis TA (2000) Bayes and empirical Bayes methods for data analysis. Chapman & Hall/CRC, Boca Raton
Cheng EK (2009) A practical solution to the reference class problem. Columbia Law Rev 109(8):2081–2105
Cochran W (1975) Sampling techniques. Wiley, New York
Cooke RM (1996) The design of reliability databases Part 1 - review of basic design concepts. Reliab Eng Syst Saf 51(2):137–146
Efron B (2012) Large-scale inference: empirical Bayes methods for estimation, testing, and prediction, vol 1. Cambridge University Press, Cambridge
Efron B, Morris C (1972) Limiting the risk of Bayes and empirical Bayes estimators - Part II: the empirical Bayes case. J Am Stat Assoc 67(337):130–139
Efron B, Morris C (1973) Stein’s estimation rule and its competitors - an empirical Bayes approach. J Am Stat Assoc 68(341):117–130
Efron B, Morris C (1975) Data analysis using Stein’s estimator and its generalizations. J Am Stat Assoc 70(350):311–319
Efron B, Tibshirani R, Storey JD, Tusher V (2001) Empirical Bayes analysis of a microarray experiment. J Am Stat Assoc 96(456):1151–1160
EFSA (2015) Scientific opinion on the risks for public health related to the presence of chlorates in food. EFSA J 13(6):4135
Fragola JR (1996) Risk management in US manned spacecraft: from Apollo to Alpha and beyond. In: Perry M (ed) Proceedings of the product assurance symposium and software product assurance workshop, EAS SP-377, European Space Agency, pp 83–92
Gallien J, Mersereau AJ, Garro A, Mora AD, Vidal MN (2015) Initial shipment decisions for new products at Zara. Oper Res 63(2):269–286
Good IJ (1965) The estimation of probabilities. Research monograph, vol 30. MIT Press, Cambridge, MA
Good IJ (1976) The Bayesian influence, or how to sweep subjectivism under the carpet. In: Foundations of probability theory, statistical inference, and statistical theories of science, Springer Netherlands, New York, pp 125–174
Greenwood M, Yule GU (1920) An inquiry into the nature of frequency distributions representative of multiple happenings with particular reference to the occurrence of multiple attacks of disease or of repeated accidents. J R Stat Soc 83(2):255–279
Hodge R, Evans M, Marshall J, Quigley J, Walls L (2001) Eliciting engineering knowledge about reliability during design-lessons learnt from implementation. Qual Reliab Eng Int 17(3): 169–179
Johnston W, Quigley J, Walls L (2006) Optimal allocation of reliability tasks to mitigate faults during system development. IMA J Manag Math 17(2):159–169
Kahneman D, Lovallo D (1993) Timid choices and bold forecasts: a cognitive perspective on risk taking. Manag Sci 39(1):17–31
Klugman SA, Panjer HH, Willmot GE (2012) Loss models: from data to decisions. Wiley, New York
Koriat A, Lichtenstein S, Fischhoff B (1980) Reasons for confidence. J Exp Psychol Hum Learn Mem 6(2):107–118
Meeker WQ, Hong Y (2014) Reliability meets big data: opportunities and challenges. Qual Eng 26(1):102–116
Nagurney A, Li D (2016) Competing on supply chain quality. Springer, Berlin
Ng KW, Tian GL, Tang ML (2011) Dirichlet and related distributions: theory, methods and applications, vol 888. Wiley, New York
Pahl G, Beitz W (2013) Engineering design: a systematic approach. Springer, Berlin
Quigley J, Walls L (2011) Mixing Bayes and empirical Bayes inference to anticipate the realization of engineering concerns about variant system designs. Reliab Eng Syst Saf 96(8):933–941
Quigley J, Bedford T, Walls L (2007) Estimating rate of occurrence of rare events with empirical Bayes: a railway application. Reliab Eng Syst Saf 92(5):619–627
Quigley J, Hardman G, Bedford T, Walls L (2011) Merging expert and empirical data for rare event frequency estimation: pool homogenisation for empirical Bayes models. Reliab Eng Syst Saf 96(6):687–695
Quigley J, Walls L, Demirel G, MacCarthy B and Parsa M (2018) Supplier quality improvement: the value of information under uncertainty. Eur J Oper Res 264(3):932–947
Rausand M, Hoyland A (2004) System reliability theory: models, statistical methods and applications. Wiley, New York
Reichenbach H (1971) The theory of probability. University of California Press, Berkley
Robbins H (1955) An empirical Bayes approach to statistics. In: Proceedings of the third Berkley symposium mathematical statistics and probability 1, University of California Press, Berkley, pp 157–164
Slack N, Brandon-Jones A, Johnston R (2016) Operations management, 8th edn. Pearson
Sodhi MS, Tang CS (2012) Managing supply chain risk. Springer, Berlin
Spetzler CS, Stael von Holstein CAS (1975) Exceptional paper-probability encoding in decision analysis. Manag Sci 22(3):340–358
Talluri S, Narasimhan R, Chung W (2010) Manufacturer cooperation in supplier development under risk. Eur J Oper Res 207(1):165–173
von Mises R (1942) On the correct use of Bayes’ formula. Ann Math Stat 13(2):156–165
Walls L, Quigley J (1999) Learning to improve reliability during system development. Eur J Oper Res 119(2):495–509
Walls L, Quigley J (2001) Building prior distributions to support Bayesian reliability growth modelling using expert judgement. Reliab Eng Syst Saf 74(2):117–128
Walls L, Quigley J, Marshall J (2006) Modeling to support reliability enhancement during product development with applications in the UK aerospace industry. IEEE Trans Eng Manag 53(2):263–274
Wilson KJ, Quigley J (2016) Allocation of tasks for reliability growth using multi-attribute utility. Eur J Oper Res 255(1):259–271
Zhu K, Zhang RQ, Tsung F (2007) Pushing quality improvement along supply chains. Pest Manag Sci 53(3):421–436
Acknowledgements
We would like to thank the many engineers and managers from various companies who have been involved in challenging and evaluating our approach in practical decision-making contexts. Their engagement has helped us develop our scientific thinking into an operational process.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG
About this chapter
Cite this chapter
Quigley, J., Walls, L. (2018). A Methodology for Constructing Subjective Probability Distributions with Data. In: Dias, L., Morton, A., Quigley, J. (eds) Elicitation. International Series in Operations Research & Management Science, vol 261. Springer, Cham. https://doi.org/10.1007/978-3-319-65052-4_7
Download citation
DOI: https://doi.org/10.1007/978-3-319-65052-4_7
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-65051-7
Online ISBN: 978-3-319-65052-4
eBook Packages: Business and ManagementBusiness and Management (R0)