Advertisement

Staged testing as a solution to the challenges of testing lower risk patients

  • Venkatesh L. MurthyEmail author
  • Khurram Nasir
Editorial

Introduction

Several groups have published on the decreasing prevalence of reversible perfusion abnormalities in stress SPECT MPI populations, such that ischemia may be present in under 10% of tests among patients without established CAD.1,2 This trend is seen despite strong evidence that many patients with stable CAD can be managed safely and effectively with only medical therapy,3, 4, 5 prompting the question why are we testing lower and lower risk populations over time?

It is likely that many factors contribute including changing demographics, protocol driven care, malpractice concerns, and decreased continuity between inpatient and outpatient encounters. Regardless, the declining prevalence of ischemia is a major challenge for nuclear cardiology labs. Chief among these challenges is a marked decrease in positive predictive value with declining prevalence (Figure 1).
Figure 1

The positive predictive value shown as a function of prevalence of ischemia (panel A) across a range of test specificities. Panel B shows the false positive fraction as a function of all positive tests (1—positive predictive value). In all cases, sensitivity was assumed at 0.90

Review of terms

Although likely familiar to most of the readers of the Journal of Nuclear Cardiology, a brief review of terms is in order. The pre-test risk of the entire population is equivalent to the prevalence in the population (pre-test probability estimates for individuals will vary around this). The sensitivity of a test is the proportion of those patients with disease who will be correctly identified as disease. Physicians worry about this parameter greatly out of concern for missing disease. Perhaps more critical in testing low risk populations is specificity which is defined as the proportion of non-diseased patients whom the test will correctly identified as non-diseased. It therefore follows that the proportion of non-diseased patients who are incorrectly identified as diseased is given by (1-specificity) (false positives).

In practice, the sensitivity and specificity are neither particularly intuitive nor useful for patients and clinicians. More practically useful are the positive predictive value (PPV) and negative predictive value (NPV). The PPV is defined as the proportion of all patients identified as abnormal by the test who are truly abnormal. When prevalence is moderate, PPV is principally affected by specificity with a very minor contribution from sensitivity. However, when prevalence drops, PPV declines precipitously, regardless of specificity (Figure 1A). Consequently, even very specific tests cannot overcome an adverse referral pattern in which low risk patients are referred for testing. Unfortunately, this implies that the proportion of patients with abnormal tests who are truly abnormal may be 50% or lower (false positive fraction = 1 − PPV; Figure 1B). This, consequently, may lead to many unnecessary invasive angiograms.

Analogously to PPV, the NPV is the proportion of all patients identified as non-diseased who are truly non-diseased. Although sensitivity is a contributor to NPV, in modern testing populations, the low prevalence of disease is greater driver of NPV than sensitivity.

What is the solution?

One solution to low PPV is to substitute to tests with greater specificity. Potential options include coronary CT angiography, attenuation corrected SPECT and PET MPI. While each has its partisans, all will fail to deliver high PPV in a low pre-test risk population. In order to maintain PPV > 50% in low pre-test risk populations, specificity of 99% or greater is necessary, a target that is unachievable by any coronary artery disease evaluation modality without severely compromising sensitivity.

The only solution to low pre-test risk is to address the pre-test risk itself. The ultimate solution is to educate referring physicians and to place greater emphasis on appropriate use. However, appropriate use criteria are complex, difficult to consistently interpret and have been challenging to implement on a large scale. An alternative approach is to layer testing so as to increase the pre-test risk population of those who ultimately undergo stress imaging.

In this issue of the Journal Smith and colleagues present the results of a study which supports one approach to layered testing which may improve the PPV of stress SPECT MPI. This work extends prior studies from Bourque6,7 and Duvall8,9 which showed that patients with excellent exercise capacity (≥ 10 METS) without concerning EKG changes or symptoms can safely omit radiotracer injection and imaging. The present work shows that this strategy is probably safe even among older adults ≥ 65 years. While this approach is likely to help limit low-yield testing, it is unlikely to sufficiently increase pre-test risk as to entirely resolve the issue of suboptimal PPV. This is in part due to a concomitant decrease in rate of exercise testing and declining exercise capacity among SPECT-MPI referral populations.

Layered testing is not a bad word

Additional approaches to layered testing which could be helpful include use of calcium scoring together with stress SPECT or PET. Significant CAD is extremely uncommon among patients with no coronary calcium, particularly when symptoms are atypical, EKG changes are absent and risk factor burden is not very severe. This population describes a substantial proportion of patients referred for coronary imaging tests such as MPI and coronary CTA. The use of coronary artery calcium (CAC) as a gatekeeper for coronary CTA has been evaluated favorably in several prior studies.10,11 Similar proposals12,13 to use CAC as a gatekeeper for MPI are supported by large retrospective data sets from several nuclear laboratories showing a very low prevalence of ischemia and events in when CAC = 0.14, 15, 16, 17, 18, 19, 20

In addition to significant value as a gatekeeper application with CAC = 0 used to limiting low-yield downstream testing, abnormal CAC testing provides additional value for a large majority of patients with normal MPI. Although expected to vary across populations, nearly one in four patients with normal MPI will have CAC > 0.21 These patients with normal MPI but coronary calcifications have worse prognosis16, 17, 18 and are likely to benefit from aggressive risk reduction strategies including medical therapy. Furthermore, emerging data suggest CAC scores improve diagnostic accuracy for obstructive CAD and increase diagnostic certainty of borderline or uncertain MPI results.22,23

However, this strategy has only been evaluated retrospectively in the context of trials and observational studies conducted for other purposes. Many had significant exclusion criteria relevant to coronary CTA that limited applicability to other patient populations frequently referred for nuclear testing such as those with renal dysfunction, arrhythmias, established CAD, and elevated heart rates.24 Furthermore, the relative value of a layered testing strategy using CAC compared to wider use of biomarkers of myonecrosis in stable chest pain25 or using improved clinical risk assessment scores to improve patient selection26,27 remains largely unexplored.

Consequently, prospective randomized data evaluating whether layered testing can safely improve patient throughput and lower costs in patients referred for stress MPI is a significant unmet need. Until such data are available, it is likely that adoption of such strategies will remain limited.

Conclusions

Due to declining pre-test probability in nuclear stress testing populations, significant practice changes are needed to optimize resource utilization and maintain positive predictive value. The work by Smith et al. in this issue of the Journal supports not proceeding to tracer injection and imaging in patients with excellent exercise capacity who do not have concerning stress testing features. Although this represents a valuable first step, further measures are necessary to truly optimize resource utilization. Foremost among these is the use of coronary calcium scoring as a gatekeeper, which should be carefully investigated in prospective studies.

Notes

Disclosure

Dr. Murthy is principal investigator and receives salary and research support from Grant R01HL136685 from the National Heart, Lung, and Blood Institute and Grant R01AG059729 from the National Institute on Aging. Dr. Murthy also receives salary and research support from grant from Siemens Medical Imaging and Singulex and research support from INVIA Medical Imaging Solutions. He owns stock in General Electric and Cardinal Health and stock options Ionetix. He has received consulting fees from Ionetix and Jubilant Draximage. Dr. Nasir has no conflicts of interest to disclose.

References

  1. 1.
    Rozanski A, Gransar H, Hayes SW, et al. Temporal trends in the frequency of inducible myocardial ischemia during cardiac stress testing 1991 to 2009. J Am Coll Cardiol. 2013;61:1054-65.  https://doi.org/10.1016/j.jacc.2012.11.056.CrossRefGoogle Scholar
  2. 2.
    Duvall WL, Rai M, Ahlberg AW, et al. A multi-center assessment of the temporal trends in myocardial perfusion imaging. J Nucl Cardiol. 2015;22:539-51.  https://doi.org/10.1007/s12350-014-0051-x.CrossRefGoogle Scholar
  3. 3.
    Stergiopoulos K, Boden WE, Hartigan P, et al. Percutaneous coronary intervention outcomes in patients with stable obstructive coronary artery disease and myocardial ischemia: a collaborative meta-analysis of contemporary randomized clinical trials. JAMA Intern Med. 2014;174:232-40.  https://doi.org/10.1001/jamainternmed.2013.12855.CrossRefGoogle Scholar
  4. 4.
    Boden WE, O’Rourke RA, Teo KK, et al. Optimal medical therapy with or without PCI for stable coronary disease. N Engl J Med. 2007;356:1503-16.  https://doi.org/10.1056/NEJMoa070829.CrossRefGoogle Scholar
  5. 5.
    Al-Lamee R, Thompson D, Dehbi H-M, et al. Percutaneous coronary intervention in stable angina (ORBITA): a double-blind, randomised controlled trial. Lancet. 2018;391:31-40.  https://doi.org/10.1016/S0140-6736(17)32714-9.CrossRefGoogle Scholar
  6. 6.
    Bourque JM, Charlton GT, Holland BH, et al. Prognosis in patients achieving ≥10 METS on exercise stress testing: was SPECT imaging useful? J Nucl Cardiol. 2011;18:230-7.  https://doi.org/10.1007/s12350-010-9323-2.CrossRefGoogle Scholar
  7. 7.
    Bourque JM, Holland BH, Watson DD, Beller GA. Achieving an exercise workload of > or = 10 metabolic equivalents predicts a very low risk of inducible ischemia: does myocardial perfusion imaging have a role? J Am Coll Cardiol. 2009;54:538-45.  https://doi.org/10.1016/j.jacc.2009.04.042.CrossRefGoogle Scholar
  8. 8.
    Duvall WL, Levine EJ, Moonthungal S, et al. A hypothetical protocol for the provisional use of perfusion imaging with exercise stress testing. J Nucl Cardiol. 2013;20:739-47.  https://doi.org/10.1007/s12350-013-9710-6.CrossRefGoogle Scholar
  9. 9.
    Duvall WL, Savino JA, Levine EJ, et al. Prospective evaluation of a new protocol for the provisional use of perfusion imaging with exercise stress testing. Eur J Nucl Med Mol Imaging. 2015;42:305-16.  https://doi.org/10.1007/s00259-014-2864-x.CrossRefGoogle Scholar
  10. 10.
    Villines TC, Hulten EA, Shaw LJ, et al. Prevalence and severity of coronary artery disease and adverse events among symptomatic patients with coronary artery calcification scores of zero undergoing coronary computed tomography angiography: results from the CONFIRM (Coronary CT Angiography Evaluation for Clinical Outcomes: An International Multicenter) registry. J Am Coll Cardiol. 2011;58:2533-40.  https://doi.org/10.1016/j.jacc.2011.10.851.CrossRefGoogle Scholar
  11. 11.
    Hulten E, Bittencourt MS, Ghoshhajra B, et al. Incremental prognostic value of coronary artery calcium score versus CT angiography among symptomatic patients without known coronary artery disease. Atherosclerosis. 2014;233:190-5.  https://doi.org/10.1016/j.atherosclerosis.2013.12.029.CrossRefGoogle Scholar
  12. 12.
    Joshi PH, Blaha MJ, Blumenthal RS, et al. What is the role of calcium scoring in the age of coronary computed tomographic angiography? J Nucl Cardiol. 2012;19:1226-35.  https://doi.org/10.1007/s12350-012-9626-6.CrossRefGoogle Scholar
  13. 13.
    Engbers EM, Timmer JR, Ottervanger JP. Coronary artery calcium score as a gatekeeper in the non-invasive evaluation of suspected coronary artery disease in symptomatic patients. J Nucl Cardiol. 2017;24:826-31.  https://doi.org/10.1007/s12350-017-0792-4.CrossRefGoogle Scholar
  14. 14.
    Nabi F, Chang SM, Pratt CM, et al. Coronary artery calcium scoring in the emergency department: identifying which patients with chest pain can be safely discharged home. Ann Emerg Med. 2010;56:220-9.  https://doi.org/10.1016/j.annemergmed.2010.01.017.CrossRefGoogle Scholar
  15. 15.
    Chang SM, Nabi F, Xu J, et al. Value of CACS compared with ETT and myocardial perfusion imaging for predicting long-term cardiac outcome in asymptomatic and symptomatic patients at low risk for coronary disease: clinical implications in a multimodality imaging world. JACC Cardiovasc Imaging. 2015;8:134-44.  https://doi.org/10.1016/j.jcmg.2014.11.008.CrossRefGoogle Scholar
  16. 16.
    Chang SM, Nabi F, Xu J, et al. The coronary artery calcium score and stress myocardial perfusion imaging provide independent and complementary prediction of cardiac risk. J Am Coll Cardiol. 2009;54:1872-82.  https://doi.org/10.1016/j.jacc.2009.05.071.CrossRefGoogle Scholar
  17. 17.
    Schenker MP, Dorbala S, Hong ECT, et al. Interrelation of coronary calcification, myocardial ischemia, and outcomes in patients with intermediate likelihood of coronary artery disease. Circulation. 2008;117:1693-700.  https://doi.org/10.1161/CIRCULATIONAHA.107.717512.CrossRefGoogle Scholar
  18. 18.
    Naya M, Murthy VL, Foster CR, et al. Prognostic interplay of coronary artery calcification and underlying vascular dysfunction in patients with suspected coronary artery disease. J Am Coll Cardiol. 2013;61:2098-106.  https://doi.org/10.1016/j.jacc.2013.02.029.CrossRefGoogle Scholar
  19. 19.
    Mittal TK, Pottle A, Nicol E, et al. Prevalence of obstructive coronary artery disease and prognosis in patients with stable symptoms and a zero-coronary calcium score. Eur Heart J Cardiovasc Imaging. 2017;18:922-9.  https://doi.org/10.1093/ehjci/jex037.CrossRefGoogle Scholar
  20. 20.
    Engbers EM, Timmer JR, Ottervanger JP, et al. Prognostic value of coronary artery calcium scoring in addition to single-photon emission computed tomographic myocardial perfusion imaging in symptomatic patients. Circ Cardiovasc Imaging. 2016.  https://doi.org/10.1161/CIRCIMAGING.115.003966.Google Scholar
  21. 21.
    Bavishi C, Argulian E, Chatterjee S, Rozanski A. CACS and the frequency of stress-induced myocardial ischemia during MPI: a meta-analysis. JACC Cardiovasc Imaging. 2016;9:580–9.  https://doi.org/10.1016/j.jcmg.2015.11.023.CrossRefGoogle Scholar
  22. 22.
    Brodov Y, Gransar H, Dey D, et al. Combined quantitative assessment of myocardial perfusion and coronary artery calcium score by hybrid 82Rb PET/CT improves detection of coronary artery disease. J Nucl Med. 2015;56:1345-50.  https://doi.org/10.2967/jnumed.114.153429.CrossRefGoogle Scholar
  23. 23.
    Patchett ND, Pawar S, Miller EJ. Visual identification of coronary calcifications on attenuation correction CT improves diagnostic accuracy of SPECT/CT myocardial perfusion imaging. J Nucl Cardiol. 2017;24:711-20.  https://doi.org/10.1007/s12350-016-0395-5.CrossRefGoogle Scholar
  24. 24.
    Nabi F, Kassi M, Muhyieddeen K, et al. Optimizing evaluation of patients with low-to-intermediate-risk acute chest pain: a randomized study comparing stress myocardial perfusion tomography incorporating stress-only imaging versus cardiac CT. J Nucl Med. 2016;57:378-84.  https://doi.org/10.2967/jnumed.115.166595.CrossRefGoogle Scholar
  25. 25.
    Januzzi JL, Suchindran S, Coles A, et al. High-sensitivity troponin I and coronary computed tomography in symptomatic outpatients with suspected coronary artery disease: insights from the PROMISE trial. JACC Cardiovasc Imaging. 2018.  https://doi.org/10.1016/j.jcmg.2018.01.021.Google Scholar
  26. 26.
    Fordyce CB, Douglas PS, Roberts RS, et al. Identification of patients with stable chest pain deriving minimal value from noninvasive testing: the PROMISE minimal-risk tool, a secondary analysis of a randomized clinical trial. JAMA Cardiol. 2017;2:400-8.  https://doi.org/10.1001/jamacardio.2016.5501.CrossRefGoogle Scholar
  27. 27.
    Adamson PD, Fordyce CB, McAllister DA, et al. Identification of patients with stable chest pain deriving minimal value from coronary computed tomography angiography: an external validation of the PROMISE minimal-risk tool. Int J Cardiol. 2018;252:31-4.  https://doi.org/10.1016/j.ijcard.2017.09.033.CrossRefGoogle Scholar

Copyright information

© American Society of Nuclear Cardiology 2018

Authors and Affiliations

  1. 1.Division of Cardiovascular Medicine, Department of Internal MedicineUniversity of MichiganAnn ArborUSA
  2. 2.Division of Cardiovascular Medicine, Center for Outcomes & Research Evaluation (CORE)Yale University School of Medicine & Yale New Haven HealthNew HavenUSA

Personalised recommendations