Dunning–Kruger effects in reasoning: Theoretical implications of the failure to recognize incompetence

  • Gordon Pennycook
  • Robert M. Ross
  • Derek J. Koehler
  • Jonathan A. Fugelsang
Theoretical Review

Abstract

The DunningKruger effect refers to the observation that the incompetent are often ill-suited to recognize their incompetence. Here we investigated potential Dunning–Kruger effects in high-level reasoning and, in particular, focused on the relative effectiveness of metacognitive monitoring among particularly biased reasoners. Participants who made the greatest numbers of errors on the cognitive reflection test (CRT) overestimated their performance on this test by a factor of more than 3. Overestimation decreased as CRT performance increased, and those who scored particularly high underestimated their performance. Evidence for this type of systematic miscalibration was also found on a self-report measure of analytic-thinking disposition. Namely, genuinely nonanalytic participants (on the basis of CRT performance) overreported their “need for cognition” (NC), indicating that they were dispositionally analytic when their objective performance indicated otherwise. Furthermore, estimated CRT performance was just as strong a predictor of NC as was actual CRT performance. Our results provide evidence for Dunning–Kruger effects both in estimated performance on the CRT and in self-reported analytic-thinking disposition. These findings indicate that part of the reason why people are biased is that they are either unaware of or indifferent to their own bias.

Keywords

Decision making High-order cognition Judgment 

Supplementary material

13423_2017_1242_MOESM1_ESM.pdf (283 kb)
ESM 1(PDF 283 kb)

Copyright information

© Psychonomic Society, Inc. 2017

Authors and Affiliations

  • Gordon Pennycook
    • 1
  • Robert M. Ross
    • 2
    • 3
  • Derek J. Koehler
    • 4
  • Jonathan A. Fugelsang
    • 4
  1. 1.Department of PsychologyYale UniversityNew HavenUSA
  2. 2.Department of Psychology, Royal HollowayUniversity of LondonLondonUK
  3. 3.ARC Centre of Excellence in Cognition and its DisordersMacquarie UniversitySydneyAustralia
  4. 4.Department of PsychologyUniversity of WaterlooWaterlooCanada

Personalised recommendations