Advertisement

European Radiology

, Volume 14, Issue 5, pp 915–922 | Cite as

Evidence-based radiology: how to quickly assess the validity and strength of publications in the diagnostic radiology literature

  • Jonathan D. Dodd
  • Peter M. MacEneaney
  • Dermot E. Malone
Health Economy

Abstract

The aim of this study was to show how evidence-based medicine (EBM) techniques can be applied to the appraisal of diagnostic radiology publications. A clinical scenario is described: a gastroenterologist has questioned the diagnostic performance of magnetic resonance cholangiopancreatography (MRCP) in a patient who may have common bile duct (CBD) stones. His opinion was based on an article on MRCP published in “Gut.” The principles of EBM are described and then applied to the critical appraisal of this paper. Another paper on the same subject was obtained from the radiology literature and was also critically appraised using explicit EBM criteria. The principles for assessing the validity and strength of both studies are outlined. All statistical parameters were generated quickly using a spreadsheet in Excel format. The results of EBM assessment of both papers are presented. The calculation and application of confidence intervals (CIs) and likelihood ratios (LRs) for both studies are described. These statistical results are applied to individual patient scenarios using graphs of conditional probability (GCP). Basic EBM principles are described and additional points relevant to radiologists discussed. Online resources for EBR practice are identified. The principles of EBM and their application to radiology are discussed. It is emphasized that sensitivity and specificity are point estimates of the “true” characteristics of a test in clinical practice. A spreadsheet can be used to quickly calculate CIs, LRs and GCPs. These give the radiologist a better understanding of the meaning of diagnostic test results in any patient or population of patients.

Keywords

Bile duct calculi MR imaging Cholangiopancreatography Endoscopic retrograde pancreatography Comparative studies Evidence-based medicine 

References

  1. 1.
    Zidi SH, Prat F, Le Guen O et al. (1999) Use of magnetic resonance cholangiography in the diagnosis of choledocholithiasis: prospective comparison with a reference imaging method. Gut 44:118–122PubMedGoogle Scholar
  2. 2.
    Sackett DL, Straus SE, Richardson WS et al. (2000) Evidence-based medicine, how to practice and teach EBM. Churchill Livingstone, EdinburghGoogle Scholar
  3. 3.
    Becker CD, Grossholz M, Becker M et al. (1997) Choledocholithiasis and bile duct stenosis: diagnostic accuracy of MR cholangiopancreatography. Radiology 205:523–530PubMedGoogle Scholar
  4. 4.
    Black WC (1990) How to evaluate the radiology literature. Am J Roentgenol 154:17–22Google Scholar
  5. 5.
    The Evidence-Based Radiology Working Group (2001) Evidence-based radiology: a new approach to the practice of radiology. Radiology 220:566–575PubMedGoogle Scholar
  6. 6.
    Guyatt GH, Sackett DL, Cook DJ (1993) Users’ guides to the medical literature. II. How to use an article about therapy or prevention. A. Are the results of the study valid? Evidence-Based Medicine Working Group. J Am Med Assoc 270:2598–2601CrossRefGoogle Scholar
  7. 7.
    Sackett DL, Rosenberg WM, Gray JA et al. (1996) Evidence-based medicine: what it is and what it isn’t. Br Med J 312:71–72Google Scholar
  8. 8.
    Jaeschke R, Guyatt G, Sackett DL (1994) Users’ guides to the medical literature. III. How to use an article about a diagnostic test. A. Are the results of the study valid? Evidence-Based Medicine Working Group. J Am Med Assoc 271:389–391CrossRefGoogle Scholar
  9. 9.
    MacEneaney PM, Malone DE (2000) The meaning of diagnostic test results: a spreadsheet for swift data analysis. Clin Radiol 55:227–235CrossRefPubMedGoogle Scholar
  10. 10.
    Jaeschke R, Guyatt GH, Sackett DL (1994) Users’ guides to the medical literature. III. How to use an article about a diagnostic test. B. What are the results and will they help me in caring for my patients? The Evidence-Based Medicine Working Group. J Am Med Assoc 271:703–707CrossRefGoogle Scholar
  11. 11.
    The Centre for Evidence-Based Medicine, Oxford University (England). http://cebm.net/levels_of_evidence.asp#levels
  12. 12.
    The Council of the European Union (1997) Council Directive 97/43/Euratom. J Eur Commun L 180:22–36Google Scholar
  13. 13.
    Fagan TJ (1975) Letter: nomogram for Bayes theorem. N Engl J Med 293:257PubMedGoogle Scholar
  14. 14.
    Chang PJ (1988) Bayesian analysis revisited: a radiologist’s survival guide. Am J Roentgenol 152:721–727Google Scholar
  15. 15.
    Gardner MJ, Altman DG (1986) Confidence intervals rather than P values: estimation rather than hypothesis testing. Br Med J 292:746–750Google Scholar
  16. 16.
    Guyatt GH, Jaeschke RZ, Cook DJ (1995) Applying the findings of clinical trials to individual patients. ACP J Club 122:A12–A13Google Scholar
  17. 17.
    The Evidence-Based Radiology Group (St. Vincent’s University Hospital, Ireland). http://evidencebasedradiology.net
  18. 18.
    Guyatt G, Jaeschke R, Heddle N et al. (1995) Basic statistics for clinicians. 2. Interpreting study results: confidence intervals. CMAJ 152:169–173PubMedGoogle Scholar
  19. 19.
    Lusted LB (1975) Editorial: in the process of solution. N Engl J Med 293:255–256PubMedGoogle Scholar
  20. 20.
    Radack KL, Rouan G, Hedges J (1986) The likelihood ratio: an improved measure for reporting and evaluating diagnostic test results. Arch Pathol Lab Med 110:689–693PubMedGoogle Scholar
  21. 21.
    Trondsen E, Edwin B, Reiertsen O et al. (1998) Prediction of common bile duct stones prior to cholecystectomy: a prospective validation of a discriminant analysis function. Arch Surg 133:162–166CrossRefPubMedGoogle Scholar
  22. 22.
    McMaster University (Hamilton, Ontario, Canada). Health Information Research Unit: evidence-based health informatics. http://hiru.mcmaster.ca/Google Scholar
  23. 23.
    Fryback DG, Thornbury JR (1991) The efficacy of diagnostic imaging. Med Decis Making 11:88–94PubMedGoogle Scholar
  24. 24.
    Mackenzie R, Dixon AK (1995) Measuring the effects of imaging: an evaluative framework. Clin Radiol 50:513–518PubMedGoogle Scholar
  25. 25.
    Hunink MG, Krestin GP (2002) Study design for concurrent development, assessment, and implementation of new diagnostic imaging technology. Radiology 222:604–614PubMedGoogle Scholar
  26. 26.
    The National Library of Medicine. http://certif.nlm.nih.gov:8080/nlm/pubmed/index.html
  27. 27.
    User’s guides to evidence-based practice. www.cche.net/usersguides/main.aspGoogle Scholar
  28. 28.
    Guyatt G, Rennie D (eds) (2002) User’s guide to the medical literature: a manual for evidence-based practice. The Evidence-Based Medicine Working Group, American Medical AssocationGoogle Scholar
  29. 29.
    The Cochrane Collaboration. http://www.cochrane.org
  30. 30.
    Malone DE, Staunton M, Skehan SJ et al. (2003) Evidence-based radiology on the internet: a website for education and practice. Eur Radiol 13 (Suppl 1):435Google Scholar

Copyright information

© Springer-Verlag 2003

Authors and Affiliations

  • Jonathan D. Dodd
    • 1
  • Peter M. MacEneaney
    • 2
  • Dermot E. Malone
    • 1
  1. 1.Department of RadiologySt. Vincent’s University HospitalDublin 4Ireland
  2. 2.Department of RadiologyUniversity of Chicago HospitalsChicago USA

Personalised recommendations