Skip to main content

Customized Structural Elicitation

  • Chapter
  • First Online:
Expert Judgement in Risk and Decision Analysis

Abstract

Expert elicitation is a powerful tool when modelling complex problems, especially in the common scenario when current probabilities are unknown and data is unavailable for certain regions of the probability space. Such methods are now widely developed, well understood, and have been used to model systems in a variety of domains including climate change, food insecurity, and nuclear risk assessment Barons et al. (2018), Rougier and Crucifix (2018), Hanea et al. (2006). However, eliciting expert probabilities faithfully has proved to be a sensitive task, particularly in multivariate settings. We argue that first eliciting structure is critical to the accuracy of the model, particularly as conducting a probability elicitation is time and resource-intensive.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Andersson, S. A. (2001). An alternative markov property for chain graphs. Scandinavian Journal of Statistics, 28(1), 33–85.

    Google Scholar 

  • Barclay, L. M., Hutton, J. L., & Smith, J. Q. (2014). Chain event graphs for informed missingness. Bayesian Analysis, 9(1), 53–76.

    Article  Google Scholar 

  • Barclay, L. M., Collazo, R. A., Smith, J. Q., Thwaites, P. A., & Nicholson, A. E. (2015). The dynamic chain event graph. Electronic Journal of Statistics, 9(2), 2130–2169.

    Article  Google Scholar 

  • Barons, M. J., Wright, S. K., & Smith, J. Q. (2018). Eliciting probabilistic judgements for integrating decision support systems. In Elicitation (pp. 445–478). Springer.

    Google Scholar 

  • Bedford, T., & Cooke, R. (2001). Probabilistic risk analysis: Foundations and methods. University of Cambridge Press.

    Google Scholar 

  • Bedford, T., & Cooke, R. M. (2002). Vines—A new graphical model for dependent random variables. Annals of Statistics, 30(4), 1031–1068.

    Article  Google Scholar 

  • Bouckaert, R. R., & Studeny, M. (1995). Chain graphs: Semantics and expressiveness. In European Conference on Symbolic and Quantitative Approaches to Reasoning and Uncertainty (pp. 69–76). Springer.

    Google Scholar 

  • Chilton, M., & Rose, D. (2009). A rights-based approach to food insecurity in the United States. American Journal of Public Health, 99(7), 1203–11.

    Article  Google Scholar 

  • Collazo, A. R., Görgen, C., & Smith, J. Q. (2017). Chain Event Graphs.

    Google Scholar 

  • Cooke, R. M. (1991). Experts in uncertainty: Opinion and subjective probability in science. New York: Oxford University Press.

    Google Scholar 

  • Costa, L., Smith, J., Nichols, T., Cussens, J., Duff, E. P., & Makin, T. R. (2015). Searching multiregression dynamic models of resting-state fMRI networks using Integer programming. Bayesian Analysis, 10(2), 441–478.

    Article  Google Scholar 

  • Cox, D. R. & Wermuth, N. (2014). Multivariate dependencies: Models, analysis and interpretation.

    Google Scholar 

  • Cox, D. R., & Wermuth, N. (1993). Linear Dependencies represented by Chain Graphs. Statistical Science, 8(3), 204–283.

    Article  Google Scholar 

  • Dowler, E. A., & O’Connor, D. (2012). Rights-based approaches to addressing food poverty and food insecurity in Ireland and UK. Social Science & Medicine, 74(1), 44–51.

    Article  Google Scholar 

  • Gundersen, C., Kreider, B., & Pepper, J. (2011). The economics of food insecurity in the United States. Applied Economic Perspectives and Policy, 33(3), 281–303.

    Article  Google Scholar 

  • Hagan, A. O.’, & Oakley, J. (2014). SHELF: the Sheffield elicitation framework.

    Google Scholar 

  • Hanea, A. M., Kurowicka, D., & Cooke, R. M. (2006). Hybrid method for quantifying and analyzing Bayesian Belief Nets. Quality and Reliability Engineering International, 22, 709–729.

    Article  Google Scholar 

  • Hanea, A. M., McBride, M. F., Burgman, M. A., & Wintle, B. C. (2018). Classical meets modern in the IDEA protocol for structured expert judgement. Journal of Risk Research, 21(4), 417–433.

    Article  Google Scholar 

  • Kaye, L., Lee, E., & Chen, Y. Y. (2013). Barriers to Food stamps in New York State: A perspective from the field. Journal of Poverty, 17(1), 13–28.

    Google Scholar 

  • Korb, K. B., & Nicholson, A. E. (2009). Bayesian Artificial Intelligence.

    Google Scholar 

  • Liverani, S., & Smith, J. Q. (2015). Bayesian selection of graphical regulatory models. International Journal of Approximate Reasoning, 77, 87–104.

    Article  Google Scholar 

  • Loveless, T. A. (2010). Food stamp/Supplemental Nutrition Assistance Program (SNAP) Receipt in the Past 12 Months for Households by State: 2010 and 2011 American Community Survey Briefs.

    Google Scholar 

  • Nolen, E., & Krey, K. (2015). The effect of universal-free school breakfast on milk consumption and nutrient intake. Food Studies: An Interdisciplinary Journal, 5(4), 23–33.

    Google Scholar 

  • Pearl, J. (2014). Probabilistic reasoning in intelligent systems: Networks of plausible inference. Elsevier.

    Google Scholar 

  • Pearl, J., & Verma, T. S. (1995). A theory of inferred causation. Studies in Logic and the Foundations of Mathematics, 134, 789—-811.

    Google Scholar 

  • Pearl, J. (2009). Causality (2nd ed.). New York, USA: Cambridge University Press.

    Book  Google Scholar 

  • Queen, C. M., & Albers, C. J. (2009). Intervention and causality: Forecasting traffic flows using a dynamic Bayesian network. Journal of the American Statistical Association, 104(486), 669–681.

    Google Scholar 

  • Richardson, T., & Spirtes, P. (2002). Ancestral graph Markov models. The Annals of Statistics, 30(4), 962–1030.

    Article  Google Scholar 

  • Rougier, J., & Crucifix, M. (2018). Uncertainty in climate science and climate policy. Climate Modelling, 361—-380.

    Google Scholar 

  • Shafer, G. (1996). The Art of causal conjecture. The MIT Press.

    Google Scholar 

  • Smith, J. Q. (1993). Multiregression dynamic models. Journal of the Royal Statistical Society: Series B, 55(4), 849–870.

    Google Scholar 

  • Smith, J. Q. (2010). Bayesian decision analysis: Principles and practice. Cambridge: Cambridge University Press.

    Book  Google Scholar 

  • Smith, J. Q., & Anderson, P. E. (2008). Conditional independence and chain event graphs. Artificial Intelligence, 172(1), 42–68.

    Article  Google Scholar 

  • Smith, J. Q., & Figueroa, L. J. (2007). A causal algebra for dynamic flow networks. Advances in Probabilistic Graphical Models, 213, 39–54.

    Article  Google Scholar 

  • Spirtes, P., & Zhang, K. (2016). Causal discovery and inference: Concepts and recent methodological advances. Applied Informatics, 3(1), 3.

    Article  Google Scholar 

  • Steffen, S. L. (1996). Graphical models. Oxford: Clarendon Press.

    Google Scholar 

  • Thwaites, P. A., & Smith, J. Q. (2015). A new method for tackling asymmetric decision problems. (Id).

    Google Scholar 

  • West, M., & Harrison, J. (1997). Bayesian forecasting and dynamic models, New York.

    Google Scholar 

  • Wilkerson, R. L., & Krey, K. (2015). Associations between neighborhoods and summer meals sites : Measuring access to federal summer meals programs. Journal of Applied Research on Children: Informing Policy for Children at Risk, 6(2).

    Google Scholar 

Download references

Acknowledgements

The authors would like to thank The Alan Turing Institute EPSRC Grant EP/L016710/1 and the Leverhulme Bridges for their support.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Rachel L. Wilkerson .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Wilkerson, R.L., Smith, J.Q. (2021). Customized Structural Elicitation. In: Hanea, A.M., Nane, G.F., Bedford, T., French, S. (eds) Expert Judgement in Risk and Decision Analysis. International Series in Operations Research & Management Science, vol 293. Springer, Cham. https://doi.org/10.1007/978-3-030-46474-5_4

Download citation

Publish with us

Policies and ethics