Skip to main content
Log in

Assessing Risk in the Absence of Quantifiability

  • Thematic Issue Article: Quality & Quantity
  • Published:
Biological Theory Aims and scope Submit manuscript

Abstract

A substantial literature on risk perception demonstrates the limits of human rationality, especially in the face of catastrophic risks. Human judgment, it seems, is flawed by the tendency to overestimate the magnitude of rare but evocative risks, while underestimating risks associated with commonplace dangers. Such findings are particularly relevant to the problem of crafting responsible public policy in the face of the kinds of threat posed by climate change. If the risk perception of ordinary citizens cannot be trusted, then it would seem logical to base policy decisions on expert judgment. But how rational, how trustworthy, are expert assessments of catastrophic risk? I briefly review the limitations of conventional models of expert risk analysis, especially in dealing with the large uncertainties endemic to the risk of low-probability, high-impact events in the distant future. The challenges such events pose to the underlying assumptions of these analyses are severe enough to question their basic rationality. I argue that a conception of rationality premised on the bounded knowledge of experts and lay citizens alike, based on context-appropriate heuristics, may help us in the search for a more trustworthy basis for decision making.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

Notes

  1. Which is of course not to deny the enormous variability existing among individual responses.

  2. It would of course be implausible to suppose that the actual methods employed in expert analyses are the products of biological evolution; rather, the implication here is that biological evolution endowed us with the capacities for such forms of reasoning.

  3. For example, rational choice theory has been extensively criticized for its focus on self-interest, neglect of values, and for its neglect of the plurality (and often incommensurability) of human goals (see, e.g., Sen 1977; Nussbaum 1997; Nelson 2006); cost–benefit analyses for their failure to take into account the fact that costs and benefits are differentially distributed, with some paying the lion’s share of the costs, and others reaping the lion’s share of the benefits (see, e.g., Broome 2001); for the very effort of putting a dollar value on human welfare (see, e.g., Nussbaum and Sen 1993; Sagoff 2008).

  4. A parallel to recent developments in computer science suggests itself: computer chips that process certain kinds of data (especially visual data) with less precision than existing chips, but with orders of magnitude greater efficiency (see, e.g., Hardesty 2010 ).

  5. One problem that he does not discuss is that efforts to exercise precaution will, if successful, by definition appear in retrospect as having been unnecessary. That is to say, they will be particularly vulnerable to the cognitive bias that comes with hindsight: they will seem not to have been needed just because their effect was to avoid the feared catastrophe. Taleb gives the example of the recommendation that might have been made prior to 9/11, and might even have been taken seriously—namely, to impose locks on cockpit doors. That person, Taleb writes, “gets no statues in public squares, not so much as a quick mention of his contribution in his obituary. ‘Joe Smith, who helped avoid the disaster of 9/11, died of complications of liver disease.’Seeing how superfluous his measure was, and how it squandered resources, the public, with great help from airline pilots, might well boot him out of office. Voxclamantis in deserto.He will retire depressed, with a great sense of failure” (2007, Chap. 1; http://www.nytimes.com/2007/04/22/books/chapters/0422-1st-tale.html?pagewanted=3&_r=1&ei=5070&en=bdae1078f2b4a98c&ex=1178769600, accessed 10 Oct 2009).

  6. Indeed, the confidence with which policy analysts have accepted the application of conventional standards of economic rationality to the particular problems posed by climate change seems something of a puzzle to me, especially given the mounting criticism of these standards that we have begun to see among economists themselves, and especially in comparison with the scrutiny under which the claims of climate scientists have recently been put. Perhaps it is time to put economists to the same kind of scrutiny.

References

  • Bechara A, Damasio AR (2005) The somatic marker hypothesis: a neural theory of economic decision making. Games Econ Behav 52:336–372

    Article  Google Scholar 

  • Broome J (2001) Discounting the future. In: Becker L, Becker C (eds) Encyclopedia of ethics, 2nd edn. Routledge, New York, pp 410–413

    Google Scholar 

  • Broome J (2008) The ethics of climate change. Scientific American, June: 69–73. Reprinted in: Folger T, Kolbert E (eds) The best American science and nature writing 2009. Houghton Mifflin, Boston

  • Broome J (2010) The most important thing about climate change. In: Boston J, Bradstock A, Eng D (eds) Public policy: why ethics matters. ANU E Press, Canberra, pp 101–116

    Google Scholar 

  • Damasio A (1994) Descartes’ error. Putnam, New York

    Google Scholar 

  • Dawkins R (1989) The Selfish Gene, 2nd edn. OUP, Oxford

  • de Sousa R (1987) The rationality of emotion. MIT Press, Cambridge

    Google Scholar 

  • Elster J (1998) Emotions and economic theory. J Econ Lit 36:46–74

    Google Scholar 

  • Elster J (1999) Alchemies of the mind: rationality and the emotions. Cambridge University Press, Cambridge

    Google Scholar 

  • Epstein S (1994) Integration of the cognitive and the psychodynamic unconscious. Am Psychol 49:709–724

    Article  Google Scholar 

  • Gigerenzer G (2007) Gut feelings: the intelligence of the unconscious. Viking Penguin, New York

    Google Scholar 

  • Gigerenzer G (2008) Rationality for mortals. Oxford University Press, Oxford

    Google Scholar 

  • Gigerenzer G, Fiedler K (2003) Minds in environments: the potential of an ecological approach to cognition. http://economics.uchicago.edu/download/MInds_in_Envir.pdf. Accessed 15 Feb 2011

  • Gigerenzer G, Selten R (2001) Rethinking rationality. In: Gigerenzer G, Selten R (eds) Bounded rationality: the adaptive toolbox. MIT Press, Cambridge, pp 1–12

    Google Scholar 

  • Hanoch Y (2002) ‘Neither an angel nor an ant’: emotion as an aid to bounded rationality. J Econ Psychol 23:1–25

    Article  Google Scholar 

  • Hardesty L (2010) The surprising usefulness of sloppy arithmetic. Massachusetts Institute of Technology, MIT News, 3 Jan 2011. http://newsoffice.mit.edu/2010/fuzzy-logic-0103. Accessed 12 Nov 2012

  • Homer-Dixon T (2010) Disaster at the top of the world. NY Times, 22 Aug. http://www.nytimes.com/2010/08/23/opinion/23homer-dixon.html. Accessed 12 Nov 2012

  • Jonas H ([1979]1984) The imperative of responsibility. University of Chicago Press, Chicago

  • Kahan DM, Slovic P, Braman D, Gastil J (2006) Fear of democracy: a cultural evaluation of Sunstein on risk. Harv Law Rev 119:1071–1109

  • Keller EF (2010) Climate science, truth, and democracy (unpublished manuscript)

  • Kluger J (2006) How Americans are living dangerously. Time, 26 Nov. http://content.time.com/time/magazine/article/0,9171,1562978,00.html. Accessed 10 Oct 2011

  • LeDoux JE (1996) The emotional brain. Simon and Schuster, New York

    Google Scholar 

  • Lerner JS, Keltner D (2001) Fear, anger, and risk. J Personal Soc Psychol 81:146–159

    Article  Google Scholar 

  • Lopes LL (1992) Risk perception and the perceived public. In: Bromley DW, Segerson K (eds) The social response to environmental risk. Kluwer Academic Publishers, Boston, pp 57–73

    Chapter  Google Scholar 

  • Nelson J (2006) Economics for humans. University of Chicago Press, Chicago

    Book  Google Scholar 

  • Nordhaus WD (2007) A review of the Stern Review on the economics of climate change. J Econ Lit 45:686–702

    Article  Google Scholar 

  • Nussbaum MC (1997) Flawed foundations: the philosophical critique of (a particular type of) economics. Univ Chic Law Rev 1197:1199–1203

    Google Scholar 

  • Nussbaum MC, Sen AK (eds) (1993) The quality of life. Oxford University Press, New York

    Google Scholar 

  • Obama B (2011) Executive order 13563—improving regulation and regulatory review. The White House, Office of the Press Secretary, 18 Jan. https://www.whitehouse.gov/the-press-office/2011/01/18/improving-regulation-and-regulatory-review-executive-order. Accessed 12 Sep 2012

  • Sagoff M (2008) The economy of the Earth: philosophy, law, and the environment, 2nd edn. Cambridge University Press, New York

    Google Scholar 

  • Selten R, Gigerenzer G (2001) Rethinking rationality. In: Gigerenzer G, Selten R (eds) Bounded rationality: the adaptive toolbox. MIT Press, Cambridge, pp 1–12

  • Sen AK (1977) Rational fools: a critique of the behavioral foundations of economic theory. Philos Public Aff 6:317–344

    Google Scholar 

  • Simon HA (1955) Behavioral model of rational choice. Q J Econ 69:99–118

    Article  Google Scholar 

  • Simon HA (1990) Invariants of human behavior. Annu Rev Psychol 41:1–19

    Article  Google Scholar 

  • Slovic P (1987) Perception of risk. Science 236:280–285

    Article  Google Scholar 

  • Slovic P, Finucane M, Peters E, MacGregor DG (2002) The affect heuristic. In: Gilovich T, Griffin D, Kahneman D (eds) Heuristics and biases: the psychology of intuitive judgment. Cambridge University Press, New York, pp 397–420

    Chapter  Google Scholar 

  • Slovic P, Peters E, Finucane M, MacGregor D (2005) Affect, risk, and decision making. Health Psychol 24:S35–S40

    Article  Google Scholar 

  • Stern N (2007) Findings of the Stern Review on the economics of Climate change. In: Yale symposium on the Stern Review. Yale Center for the Study of Globalization, Yale University, pp 7–39. http://www.ycsg.yale.edu/climate/forms/FullText.pdf. Accessed 20 Feb 2011

  • Sunstein CR (2002) The paralyzing principle. Regulation 25(4):32–37

    Google Scholar 

  • Sunstein CR (2005) Laws of fear: beyond the precautionary principle. Cambridge University Press, New York

    Book  Google Scholar 

  • Sunstein CR (2006) The one percent doctrine. The University of Chicago Law School Faculty Blog, 27 June. http://uchicagolaw.typepad.com/faculty/2006/06/the_one_percent.html. Accessed 12 Sep 2012

  • Swim JK, Clayton S, Doherty T et al (2011) Psychology and global climate change: addressing a multifaceted phenomenon and set of challenges. A report of the American Psychological Association task force on the interface between psychology and global climate change. American Psychological Association. http://www.apa.org/science/about/publications/climate-change.aspx. Accessed 12 Nov 2012

  • Taleb NN (2007) The black swan: the impact of the highly improbable. Random House, New York

    Google Scholar 

  • Tversky A, Kahneman D (1973) Availability: a heuristic for judging frequency and probability. Cogn Psychol 5:207–232

    Article  Google Scholar 

  • Weitzman ML (1998) Why the far-distant future should be discounted at its lowest possible rate. J Environ Econ Manag 36:201–208

    Article  Google Scholar 

  • Weitzman ML (2007) A review of the Stern Review on the economics of climate change. J Econ Lit 45:703–724

    Article  Google Scholar 

  • Weitzman ML (2009) On modeling and interpreting the economics of catastrophic climate change. Rev Econ Stat 91:1–19

    Article  Google Scholar 

  • Wheatley C (2008) Harvard professor says U.S. administration is at fault for public’s skeptical view of science. Chronicle Online. Cornell University, 5 Sep. http://www.news.cornell.edu/stories/Sept08/Jasanoff.cover.cw.html. Accessed 1 Feb 2011

  • Younge G (2010) The war on terror has been about scaring people, not protecting them. Guardian, 3 Jan. http://www.theguardian.com/global/2010/jan/03/yemen-anti-terrorism-rendition-security. Accessed 12 Sep 2012

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Evelyn Fox Keller.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Keller, E.F. Assessing Risk in the Absence of Quantifiability. Biol Theory 10, 228–236 (2015). https://doi.org/10.1007/s13752-015-0211-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13752-015-0211-5

Keywords

Navigation