Background

In 1999 the Institute of Medicine (a division of the US National Academy of Sciences) published a landmark report indicating that from 44,000 to 98,000 deaths per year could be attributed to preventable medical errors (Kohn et al. 1999). Although the majority of errors related to therapy, including medication and surgical errors, the report identified a significant number of diagnostic errors. Until recently, most of the research in patient safety had not addressed these errors. In the last few years there has been increased recognition of the prevalence and severity of diagnostic errors. In 2007 the US Department of Health and Human Services’ Agency for Healthcare Research and Quality (AHRQ) identified diagnostic errors as an area of special emphasis. (http://grants.nih.gov/grants/guide/notice-files/NOT-HS-08-002.html).

There is a background of research that is relevant to this newly recognized domain. Several patient safety and quality improvement researchers have focused on analyzing and characterizing errors and their impact, figuring what went wrong, why, and how can we fix it (Schiff 1994; Schiff et al. 2005; Croskerry 2000a, b, 2002, 2003a, b, c, 2005; Croskerry and Wears 2003; Cosby and Croskerry 2003; Graber et al. 2002; Graber 2004; Graber et al. 2005). In addition to a few patient safety/quality improvement researchers’ interests in diagnostic errors, three other research domains have a longer history than the more recent interest in diagnostic errors within the patient safety arena, addressing fundamental questions about how humans make diagnoses and strategies to improve the process. These research domains are:

  • Medical Problem Solving—Beginning in the 1960s and assuming a dominant focus in medical education research in the 1970s and 1980s, but continuing today, the research on medical problem solving, includes research on expert-novice differences in problem solving, understanding clinical cognition, development of expertise, Problem-Based Learning (PBL), the development of problem solving simulations and other educational approaches to teach and measure medical problem solving. The focus of this research in many cases was to describe how clinicians think about diagnosis, “What is” in regard to diagnosis (Elstein et al. 1978; Berner 1984; Norman and Eva 2003, 2005; Patel et al. 2001, 1991; Neufeld et al. 1981; Norman et al. 1992).

  • Normative decision making—About the same time as the research on medical problem solving began appearing in the literature, there was increasing focus on decision analytic approaches and other normative approaches to rationalize the decision making process of clinicians (“what ought to be”), in part spurred by the heuristics and biases literature indicating that the thinking of clinicians, like other humans, is often suboptimal and that to improve diagnosis (as well as therapeutic decision making) more systematic analytic methods need to be employed (Kahneman et al. 1982; Elstein 1999).

  • Medical Informatics (specifically diagnostic decision support systems)—Also in the period from the 1960s to the 1990s, as medical informatics as a profession was developing and computers were used somewhat more frequently by clinicians, medical informaticians began to address the question, “Can we design computer programs to assist physicians in diagnosis and do they actually work?” (Miller 1994; Berner et al. 1994, 1999; Berner and Maisiak 1999; Friedman et al. 1999, 2005)

There are several commonalities among these three research strains: (1) they all can inform the focus on diagnostic errors that is being emphasized in the patient safety movement; (2) they developed over a similar time period, but comparatively independently; (3) all three have begun to be applied to the area of diagnostic error by patient safety researchers. However, the relative isolation of these four research domains (medical problem solving, normative decision making, clinical diagnostic decision support research, and patient safety research) combined with the increased interest in addressing diagnostic errors highlights the need for more communication among researchers in these areas. The inaugural conference on Diagnostic Error in Medicine in May 2008 addressed that need by creating an environment that encouraged collaboration among those interested in the problem of diagnostic errors. More importantly, it was the first national effort to bring researchers from the disparate research domains together to address this important issue.

Conference on diagnostic error in medicine: May 31–June 1, 2008

Prior to the May conference, the Conference organizing committee met in Naples, Florida to respond to an analysis of diagnostic errors prepared by the conference co-chairs Berner and Graber (Berner and Graber 2008) The meeting and Drs. Berner and Graber’s work, and the special supplement to the American Journal of Medicine that resulted from it (full text of the supplement is available online at http://www.ajmselect.com/issues/contents?issue_key=S0002-9343(08)X0007-5) was funded by the Paul Mongerson Foundation within the Raymond James Charitable Endowment Fund. Mr. Mongerson’s interests in diagnostic errors stems from a personal incident (Mongerson 1995) and he has been active supporter of informatics efforts to reduce diagnostic errors. Mr. Mongerson also spoke at the May conference which was co-sponsored by the Agency for Healthcare Research Quality (AHRQ) and the American Medical Informatics Association (AMIA).

The conference speakers included nationally and internationally recognized experts representing the four research areas. There were also smaller breakout groups where participants interacted with experts in diagnostic errors that occur in specific settings. This supplement includes a selection of the papers presented at the conference.

Keynote addresses: the challenge of diagnostic errors

There were two keynote addresses representing the Patient Safety perspective (Robert M. Wachter, MD) and the other research areas (Arthur S. Elstein, PhD, who over the course of his career has contributed significantly to the medical problem solving, normative decision making, and informatics literature). Dr. Wachter summarized his presentation in his blog (http://community.the-hospitalist.org/blogs/wachters_world/archive/2008/06/02/why-diagnostic-errors-don-t-get-any-respect-and-what-can-be-done-about-it.aspx) and Dr. Elstein’s address is the lead article in this supplement. These authors address the research challenges in studying diagnostic errors and also in getting the patient safety issues related to diagnostic errors the attention they deserve.

Perspectives on clinical decision making

This part of the conference was introduced by Vimla Patel, PhD, who is an experienced cognitive science, medical education and informatics researcher. The papers in this supplement by Robert L. Wears, MD, MS, Patrick Croskerry, MD, PhD, and Geoffrey R. Norman, PhD reflect a variety of perspectives on this topic. At the conference (but not included in this supplement), Mark Roberts, MD, presented how the normative decision making approach applies to diagnostic decision making. This set of articles illustrates that despite decades of work on a variety of models of clinical decision making, there is still controversy as to how to use the research data to improve decision making.

Diagnostic errors: settings and sources

Breakout groups on Errors in Pathology (Steven Raab, MD and Dana Grzybicki, PhD), Emergency Settings (Robert L. Wears, MD and Patrick Croskerry, PhD) and Ambulatory Care (Hardeep Singh, MD and Saul Weingart, MD, PhD), as well as Laboratory Errors (Terry Wahls, MD and Peter Cram, MD) and visual diagnosis were conducted. The summary of the sessions on Laboratory Errors and Errors in Ambulatory Care are included in this supplement. The articles included in this section demonstrate both the issues related to diagnostic errors that transcend settings as well as the unique issues related to studying and improving laboratory errors and errors in ambulatory care settings.

Educational approaches to reducing diagnostic error

Educational interventions are commonly suggested as a primary strategy to reduce diagnostic errors. In the supplement, Mark L. Graber, MD presents a compilation of the educational approaches to reducing diagnostic error. In the second paper in this section, Kevin Eva, PhD, presents results of studies that evaluate the effectiveness of some of these approaches. Despite the variety of educational strategies, in many cases the research shows unexpected outcomes, indicating that additional research is needed to identify truly effective educational interventions.

Reducing diagnostic errors with clinical decision support

A second strategy for reducing diagnostic errors is increasing the use of computer-based clinical decision support. The papers included in this supplement represent a look into the future as well as the history of clinical diagnostic decision support. The introduction to this section by Robert A. Greenes, MD, PhD, provides an interesting perspective on how diagnosis and decision support for diagnosis will be changed in the era of “personalized medicine,” with increased knowledge about the association of genetics and disease. Randolph A. Miller, MD, a pioneer in the development of computer-based clinical diagnostic decision support systems, provides a historical overview of the development of these systems as well as a look into their future. His comprehensive bibliography includes the major work evaluating these diagnostic systems. Conference presentations by Gordon D. Schiff, MD, on the use of clinical documentation for decision support and Charles P. Friedman, MD on evaluation perspectives for decision support are not included in this supplement.

Next steps for research

The last part of the conference was spent in small groups synthesizing the previous sessions and identifying areas for further research. In this supplement, Mark L. Graber, MD summarizes these next steps for further research on reducing diagnostic errors. Dr. Graber illustrates both what we know from previous research and the questions that are unanswered. As will be obvious from Dr. Graber’s synthesis, despite almost a half century of research from four different research traditions, there is still much more to learn about the factors influencing diagnostic errors and the strategies to reduce them.