Skip to main content
Log in

Diagnostic accuracy and utility of coronary CT angiography with consideration of unevaluable results: A systematic review and multivariate Bayesian random-effects meta-analysis with intention to diagnose

  • Cardiac
  • Published:
European Radiology Aims and scope Submit manuscript

Abstract

Objectives

To meta-analyze diagnostic accuracy, test yield and utility of coronary computed tomography angiography (CCTA) in coronary artery disease (CAD) by an intention-to-diagnose approach with inclusion of unevaluable results.

Methods

Four databases were searched from 1/2005 to 3/2013 for prospective studies that used 16–320-row or dual-source CTs and provided 3 × 2 patient-level data of CCTA (positive, negative, or unevaluable) versus catheter angiography (positive or negative) for diagnosing ≥50 % coronary stenoses. A Bayesian multivariate 3 × 2 random-effects meta-analysis considered unevaluable CCTAs.

Results

Thirty studies (3422 patients) were included. Compared to 16–40 row CT, test yield and accuracy of CCTA has significantly increased with ≥64-row CT (P < 0.05). In ≥64-row CT, about 2.5 % (95 %-CI, 0.9–4.8 %) of diseased patients and 7.5 % (4.5–11.2 %) of non-diseased patients had unevaluable CCTAs. A positive likelihood ratio of 8.9 (6.1–13.5) indicated moderate suitability for identifying CAD. A negative likelihood ratio of 0.022 (0.01–0.04) indicated excellent suitability for excluding CAD. Unevaluable CCTAs had an equivocal likelihood ratio of 0.42 (0.22–0.71). In the utility analysis, CCTA was useful at intermediate pre-test probabilities (16–70 %).

Conclusions

CCTA is useful at intermediate CAD pre-test probabilities. Positive CCTAs require verification to confirm CAD, unevaluable CCTAs require alternative diagnostics, and negative CCTAs exclude obstructive CAD with high certainty.

Key Points

This 3 × 2 Bayesian meta-analysis included unevaluable CCTAs with intention-to-diagnose.

CCTA is currently useful at intermediate CAD pre-test probabilities.

Unevaluable CCTAs should not, generally, be treated as if they are positive.

Positive CCTAs require verification by other methods to confirm CAD.

Negative CCTAs exclude CAD with high certainty.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

Notes

  1. * In this text “probability for CAD” means a patient’s chance for having at least one ≥50 % coronary stenosis at catheter angiography (the reference standard). “Pre-test probability” is the chance before CCTA (the index test), and “post-test probability” is the chance when knowing the CCTA results.

Abbreviations

CAD:

coronary artery disease

CT:

computed tomography

CCTA:

coronary computed tomography angiography

References

  1. Nabel EG, Braunwald E (2012) A tale of coronary artery disease and myocardial infarction. N Engl J Med 366:54–63

    Article  PubMed  CAS  Google Scholar 

  2. Taylor AJ, Cerqueira M, Hodgson JM et al (2010) ACCF/SCCT/ACR/AHA/ASE/ ASNC/NASCI/SCAI/SCMR 2010 appropriate use criteria for cardiac computed tomography. Circulation 122:e525–e555

    Article  PubMed  Google Scholar 

  3. Menke J, Unterberg-Buchwald C, Staab W, Sohns JM, Seif Amir Hosseini A, Schwarz A (2013) Head-to-head comparison of prospectively triggered versus retrospectively gated coronary CT angiography: meta-analysis of diagnostic accuracy, image quality, and radiation dose. Am Heart J 165:154–163

    Article  PubMed  Google Scholar 

  4. Simel DL, Feussner JR, DeLong ER, Matchar DB (1987) Intermediate, indeterminate, and uninterpretable diagnostic test results. Med Decis Mak 7:107–114

    Article  CAS  Google Scholar 

  5. Pauker SG, Kassirer JP (1980) The threshold approach to clinical decision making. N Engl J Med 302:1109–1117

    Article  PubMed  CAS  Google Scholar 

  6. Menke J (2013) Bivariate random-effects meta-analysis of sensitivity and specificity with the Bayesian SAS PROC MCMC: methodology and empirical evaluation in 50 meta-analyses. Med Decis Mak 33:692–701

    Article  Google Scholar 

  7. Dobson AJ, Barnett AG (2008) An introduction to generalized linear models, 3rd edn. CRC Press, Boca Raton, ISBN 978-1-58488-950-2

    Google Scholar 

  8. SAS/STAT 9.3 User’s guide. PROC MCMC. http://support.sas.com/documentation/cdl/en/statug/63962/HTML/default/viewer.htm#statug_mcmc_sect001.htm. Accessed Mar 11 2012

  9. Bipat S, Zwinderman AH, Bossuyt PM, Stoker J (2007) Multivariate random-effects approach: for meta-analysis of cancer staging studies. Acad Radiol 14:974–984

    Article  PubMed  Google Scholar 

  10. Liberati A, Altman DG, Tetzlaff J et al (2009) The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. Ann Intern Med 151:W65–W94

    Article  PubMed  Google Scholar 

  11. Whiting PF, Rutjes AW, Westwood ME et al (2011) QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med 155:529–536

    Article  PubMed  Google Scholar 

  12. Deeks JJ, Macaskill P, Irwig L (2005) The performance of tests of publication bias and other sample size effects in systematic reviews of diagnostic test accuracy was assessed. J Clin Epidemiol 58:882–893

    Article  PubMed  Google Scholar 

  13. Menke J, Larsen J (2010) Meta-analysis: accuracy of contrast-enhanced magnetic resonance angiography for assessing steno-occlusions in peripheral arterial disease. Ann Intern Med 153:325–334

    Article  PubMed  Google Scholar 

  14. Menke J, Larsen J, Kallenberg K (2011) Diagnosing cerebral aneurysms by computed tomographic angiography: meta-analysis. Ann Neurol 69:646–654

    Article  PubMed  Google Scholar 

  15. Menke J (2010) Bivariate random-effects meta-analysis of sensitivity and specificity with SAS PROC GLIMMIX. Methods Inf Med 49:54–64

    PubMed  CAS  Google Scholar 

  16. Harbord RM, Deeks JJ, Egger M, Whiting P, Sterne JA (2007) A unification of models for meta-analysis of diagnostic accuracy studies. Biostatistics 8:239–251

    Article  PubMed  Google Scholar 

  17. Kardaun JW, Kardaun OJ (1990) Comparative diagnostic performance of three radiological procedures for the detection of lumbar disk herniation. Methods Inf Med 29:12–22

    PubMed  CAS  Google Scholar 

  18. Menke J, Schramm P, Sohns JM, Kallenberg K, Staab W (2014) Diagnosing flow residuals in coiled cerebral aneurysms by MR angiography: meta-analysis. J Neurol 261:655–662

    Article  PubMed  PubMed Central  Google Scholar 

  19. Sung L, Hayden J, Greenberg ML, Koren G, Feldman BM, Tomlinson GA (2005) Seven items were identified for inclusion when reporting a Bayesian analysis of a clinical study. J Clin Epidemiol 58:261–268

    Article  PubMed  Google Scholar 

  20. Patel MR, Peterson ED, Dai D et al (2010) Low diagnostic yield of elective coronary angiography. N Engl J Med 362:886–895

    Article  PubMed  CAS  PubMed Central  Google Scholar 

  21. Goodacre S, Thokala P, Carroll C et al (2013) Systematic review, meta-analysis and economic modelling of diagnostic strategies for suspected acute coronary syndrome (Table 56: cost estimates used in the model). Health Technol Assess 17:1–188

    Article  Google Scholar 

  22. Met R, Bipat S, Legemate DA, Reekers JA, Koelemay MJ (2006) Accuracy of 16-row multidetector computed tomography for the assessment of coronary artery stenosis. JAMA 296:403–411

    Article  Google Scholar 

  23. Meijer AB, O YL, Geleijns J, Kroft LJ (2008) Meta-analysis of 40- and 64-MDCT angiography for assessing coronary artery stenosis. Am J Roentgenol 191:1667–1675

    Article  Google Scholar 

  24. Schuetz GM, Schlattmann P, Dewey M (2012) Use of 3×2 tables with an intention to diagnose approach to assess clinical performance of diagnostic tests: meta-analytical evaluation of coronary CT angiography studies. BMJ 345, e6717

    Article  PubMed  PubMed Central  Google Scholar 

  25. Ko BS, Wong DT, Cameron JD et al (2014) 320-row CT coronary angiography predicts freedom from revascularisation and acts as a gatekeeper to defer invasive angiography in stable coronary artery disease: a fractional flow reserve-correlated study. Eur Radiol 24:738–747

    Article  PubMed  Google Scholar 

  26. Tashakkor AY, Nicolaou S, Leipsic J, Mancini GB (2012) The emerging role of cardiac computed tomography for the assessment of coronary perfusion: a systematic review and meta-analysis. Can J Cardiol 28:413–422

    Article  PubMed  Google Scholar 

  27. Kang EJ, Lee J, Lee KN, Kown H, Ha DH, Kim RB (2013) An initial randomised study assessing free-breathing CCTA using 320-detector CT. Eur Radiol 23:1199–1209

    Article  PubMed  Google Scholar 

Download references

Acknowledgments

The scientific guarantor of this publication is Jan Menke. The authors of this manuscript declare no relationships with any companies whose products or services may be related to the subject matter of the article. The authors state that this work has not received any funding. One of the authors has significant statistical expertise. Institutional review board approval was not required because this is a meta-analysis. Study subjects or cohorts have been previously reported in the primary studies that were meta-analysed. Methodology: meta-analysis of prospective studies.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jan Menke.

Electronic supplementary material

Below is the link to the electronic supplementary material.

ESM 1

(PDF 278 kb)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Menke, J., Kowalski, J. Diagnostic accuracy and utility of coronary CT angiography with consideration of unevaluable results: A systematic review and multivariate Bayesian random-effects meta-analysis with intention to diagnose. Eur Radiol 26, 451–458 (2016). https://doi.org/10.1007/s00330-015-3831-z

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00330-015-3831-z

Keywords

Navigation