Skip to main content

Advertisement

Log in

Reducing doubt about uncertainty: Guidance for IPCC’s third assessment

  • Published:
Climatic Change Aims and scope Submit manuscript

Abstract

It is usually necessary to apply incomplete and uncertain information to inform policy and decision making, creating the need to characterize the state of knowledge and identify when more certain information may be available. After all, some information is better than none and conversely, even perfect information is of no use if it is available only after a decision has been made. In scientific assessments for global change, the challenges are particularly acute because of scientific complexity, long time horizons, and large political and economic stakes, among other factors. Moss and Schneider prepared uncertainty guidelines for the Third Assessment Report (TAR) of the Intergovernmental Panel on Climate Change (IPCC) that recommended a process to make expert judgments of levels of confidence and uncertainty more systematic and transparent. The guidance provided calibrated uncertainty terms to improve communication of findings to users and urged preparation of a traceable account of the authors’ assessment of the evidence for each major finding. This article reviews the recommendations and their effectiveness and highlights ensuing critiques and the evolution of uncertainty guidance for subsequent assessment reports. It discusses emerging challenges in providing science for decision making in the era of increasing model resolution and complexity and burgeoning interest in information to inform adaptation and mitigation at regional and finer scales.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

Notes

  1. Approaches to evaluating and communicating uncertainty in expert-judgment based scientific assessments are a small subset of quantitative and qualitative approaches to uncertainty quantification, propagation and characterization applied to evaluating uncertainties in research and analysis. Uncertainty characterization and communication is essential to ensure that a scientific conclusion represents a valid and defensible insight. This article does not address this broader set of approaches for evaluating uncertainty in the science of complex systems.

  2. In the frequentist statistical approach, probability is defined as the relative frequency that something would occur in a limitless number of independent, identical trials. In practice, random sampling or other thought experiments are used since there are relatively few phenomena that can be expected to occur in an infinite, independent, and identical fashion. A Bayesian approach involves a rigorous mathematical methodology for evaluating the probability of an event conditional on the available information, interpreted as degree of belief, which is updated as new evidence becomes available.

References

  • Agrawala S (1998a) Context and early origins of the intergovernmental panel on climate change. Clim Chang 39:605–620

    Article  Google Scholar 

  • Agrawala S (1998b) Structural and process history of the intergovernmental panel on climate change. Clim Chang 39:621–642

    Article  Google Scholar 

  • Allen M, Raper S et al (2001) Uncertainty in the IPCC’s third assessment report. Science 293:430–433

    Article  Google Scholar 

  • Allen MR, Booth BB et al (2004) Observational constraints on future climate: distinguishing robust from model-dependent statements of uncertainty in climate forecasting. IPCC Risk and Uncertainty Workshop, Maynooth, Ireland

    Google Scholar 

  • Budescu DV, Broomell S et al (2009) Improving communication of uncertainty in the reports of the intergovernmental panel on climate change. Psychol Sci 20:299–308

    Article  Google Scholar 

  • CCSP (2009) Best practice approaches for characterizing, communicating, and incorporating scientific uncertainty in decisionmaking. A report by the climate change science program and the subcommittee on global change research. M. G. Morgan, H. Dowlatabadi, M. Henrionet al. Washington, DC, National Oceanic and Atmospheric Administration: 96

  • CIA (1964) Words of estimative probability. Studies in intelligence. Washington, DC, Central Intelligence Agency: 12

  • Dessai S, Hulme M (2004) Does climate adaptation policy need probabilities. Climate Policy 4:107–128

    Google Scholar 

  • Funtowicz SO, Ravetz JR (1990) Uncertainty and quality in science for policy. Kluwer, Dordrecht, 229 pp

    Book  Google Scholar 

  • Giles J (2002) Scientific uncertainty: when doubt is a sure thing. Nature 418:476–478

    Article  Google Scholar 

  • Grubler A, Nakicenovic N (2001) Identifying dangers in an uncertain climate. Nature 412:15–15

    Article  Google Scholar 

  • Ha-Duong M (2003) Imprecise probability bridges scenario-forecast gap. Pittsburgh, PA, 15 pp

  • Hall J, Fu G et al (2007) Imprecise probabilities of climate change: aggregation of fuzzy scenarios and model uncertainties. Clim Chang 81:265–281

    Article  Google Scholar 

  • Hawkins E, Sutton R (2010) The potential to narrow uncertainty in projections of regional precipitation change. Climate Dynamics: 1–12

  • IAC (2010) Climate change assessments: Review of the processes and procedures of the IPCC. InterAcademy Council, Amsterdam

    Google Scholar 

  • IPCC (2001a) Climate change 2001: The scientific basis. Contribution of working group I to the third assessment report of the intergovernmental panel on climate change. Cambridge University Press, Cambridge, England

    Google Scholar 

  • IPCC (2001b) Climate change 2001: Impacts, adaptation, and vulnerability. Contribution of working group II to the third assessment report of the intergovernmental panel on climate change. Cambridge University Press, Cambridge, England

    Google Scholar 

  • IPCC (2001c) Climate change 2001: Mitigation. Contribution of working group III to the third assessment report of the intergovernmental panel on climate change. Cambridge University Press, Cambridge, England

    Google Scholar 

  • IPCC (2001d) Climate change 2001: Synthesis report. Contribution of working group I, II, and III to the third assessment report of the intergovernmental panel on climate change. Cambridge University Press, Cambridge, England

    Google Scholar 

  • IPCC (2005) Guidance notes for lead authors of the IPCC fourth assessment report on addressing uncertainties. Intergovernmental panel on climate change, Geneva

    Google Scholar 

  • IPCC (2007) Contribution of working group I to the fourth assessment report of the intergovernmental panel on climate change. Cambridge University Press, Cambridge United Kingdom and New York, NY, USA

    Google Scholar 

  • Kriegler E, Held H (2005) Utilizing belief functions for the estimation of future climate change. Int J Approx Reason 39:185–209

    Article  Google Scholar 

  • Lempert R, Schlesinger ME (2001) Climate-change strategy needs to be robust. Nature 412:375

    Article  Google Scholar 

  • Manning MR (2003) The difficulty of communicating uncertainty. Clim Chang 61:9–16

    Article  Google Scholar 

  • Manning MR, Petit M (2003) A concept paper for the AR4 cross cutting theme: uncertainties and risk. Geneva, Intergovernmental Panel on Climate Change: 14

  • Mastrandrea MD, Field CB et al (2010) Guidance note for lead authors of the IPCC fifth assessment report on consistent treatment of uncertainties. Intergovernmental Panel on Climate Change, Geneva

    Google Scholar 

  • Min S-K, Simonis D et al (2007) Probabilistic climate change predictions applying Bayesian model averaging. Philosophical Transactions of the Royal Society A: Mathematical. Physical and Engineering Sciences 365:2103–2116

    Google Scholar 

  • Morgan MG (1998) Uncertainty analysis in risk assessment. Human and Ecological Risk Analysis 4(1):25–39

    Google Scholar 

  • Morgan MG, Henrion M (1990) Uncertainty: a guide to dealing with uncertainty in quantitative risk and policy analysis. Cambridge University Press, Cambridge; New York

    Google Scholar 

  • Morgan MG, Keith DW (1995) Subjective judgments by climate experts. Environ Sci Technol 29:468–476

    Article  Google Scholar 

  • Moss RH, Schneider SH (2000) Uncertainties in the IPCC TAR: Recommendations to lead authors for more consistent assessment and reporting. Cross-cutting issues in the IPCC Third assessment report. R. Pachauri, and Taniguchi, T. Tokyo, Global Industrial and Social Progress Research Institute for IPCC,pp 33–52

  • Nature (2010) Validation required. Nature 463:849

  • NDU (1978) Climate change to the year 2000. National Defense University, Washington DC

    Google Scholar 

  • NIC (2007) Iran: nuclear intentions and capabilities. N. I. Council. Washington, DC: 9

  • Nordhaus WD (1994) Expert opinion on climatic change. Am Sci 82:45–51

    Google Scholar 

  • Oppenheimer M, O’Neill BC et al (2007) The limits of consensus. Science 317:1505–1506

    Article  Google Scholar 

  • Patt A (2007) Assessing model-based and conflict-based uncertainty. Glob Environ Chang 17:37–46

    Article  Google Scholar 

  • Patt A, Dessai S (2005) Communicating uncertainty: lessons learned and suggestions for climate change assessment. Comptes Rendus Geosciences 337:425–441

    Article  Google Scholar 

  • Patt AG, Schrag DP (2003) Using specific language to describe risk and probability. Clim Chang 61:17–30

    Article  Google Scholar 

  • Petersen AC (2006) Simulating nature: a philosophical study of computer-simulation uncertainties and their role in climate science and policy advice. Ph.D Dissertation, Vrije Universiteit, 220 pp

    Google Scholar 

  • Pidgeon N, Fischoff B (2011) The role of social and decision sciences in communicating uncertain climate risks. Nature Clim Change 1:35–41

    Article  Google Scholar 

  • Pittock AB, Jones RN et al (2001) Probabilities will help us plan for climate change. Nature 413:249–249

    Article  Google Scholar 

  • Politi MC, Han PKJ, et al (2007) Communicating the uncertainty of harms and benefits of medical interventions. Medical Decision Making (Sep-Oct):681–695

  • Reilly J, Stone PH et al (2001) Uncertainty and climate change assessments. Science 293:430–433

    Article  Google Scholar 

  • Risbey J, Kandlikar M (2007) Expressions of likelihood and confidence in the IPCC uncertainty assessment process. Clim Chang 85:19–31

    Article  Google Scholar 

  • Schneider SH (2001) What is ‘dangerous’ climate change? Nature 411:17–19

    Article  Google Scholar 

  • Swart R, Bernstein L et al (2009) Agreeing to disagree: uncertainty management in assessing climate change, impacts and responses by the IPCC. Clim Chang 92:1–29

    Article  Google Scholar 

  • Titus JG, Narayanan VK (1995) Probability of sea level rise. Environmental Protection Agency, Washington DC, 186 pp

    Google Scholar 

  • USGCRP (2000) US national assessment of the potential consequences of climate cariability and change. US Global Change Research Program, Washington DC

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Richard H. Moss.

Additional information

The author is Senior Staff Scientist at Pacific Northwest National Laboratory’s Joint Global Change Research Institute at the University of Maryland. He dedicates this article to the memory of Stephen H. Schneider, the captain of the “uncertainty cops”. He also acknowledges with gratitude PNNL colleagues Jennie Rice, Michael Scott, and Stephen Unwin, whose knowledge and ideas have given shape to a number of recommendations in this article. He also thanks Elizabeth Malone, Granger Morgan, Nathan Engle, and Caroline Boules for comments on an earlier draft.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Moss, R.H. Reducing doubt about uncertainty: Guidance for IPCC’s third assessment. Climatic Change 108, 641 (2011). https://doi.org/10.1007/s10584-011-0182-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10584-011-0182-x

Keywords

Navigation