Skip to main content

Advertisement

SpringerLink
Log in

Anatomy of a meta-analysis: A critical review of “Exercise echocardiography or exercise SPECT imaging? A meta-analysis of diagnostic test performance”

  • Published:
Journal of Nuclear Cardiology Aims and scope

Abstract

Background

Accurate diagnosis of coronary heart disease has the potential to contribute substantially to cost-effective delivery of health services. Recent work by Fleischmann et al (JAMA 1998;280:913-20) represents an effort to summarize the accuracy of exercise echocardiography and exercise single photon emission computed tomography (SPECT).

Methods and Results

A critique of the previous work was constructed, obtaining the 44 articles used. These articles were reviewed and summarized with established techniques for metaanalysis. The studies summarized by Fleischmann et al were found to be significantly heterogeneous (echocardiography and SPECT, both P < .001). In the SPECT cohort, combination of different radioisotopes and reading techniques, and inclusion of reports using experimental techniques, were sources of heterogeneity. In the echocardiography cohort, experimental techniques and an individual series were identified. When the sample was stratified for sources of heterogeneity, it was found that there was no significant difference in diagnostic accuracy between the echocardiography and SPECT techniques used in current clinical practice. Meta-regression with summary receiver operating characteristic curve techniques, after adjustment of the model for multicolinearity and outliers, revealed that there were no significant differences between SPECT as used in current clinical practice and echocardiography.

Conclusion

The report by Fleischmann et al contains serious flaws that limit its validity and generalizability.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. American Heart Association. Cardiovascular disease statistics. Available at: http://www.amhrt.org/catalog/Scientific_catpage70.html. Accessed 1999.

  2. Fleischmann KE, Hunink MG, Kuntz K, Douglas P. Exercise echocardiography or exercise SPECT imaging? A meta-analysis of diagnostic test performance. JAMA 1998;280:913–20.

    Article  PubMed  CAS  Google Scholar 

  3. Petitti DB. Meta-analysis, decision analysis, and cost-effectiveness analysis; New York: Oxford Press; 1994.

    Google Scholar 

  4. Irwig L, Tosteson A, Gatsonis C, Lau J. Guidelines for meta-analyses evaluating diagnostic tests. Ann Intern Med 1994;120:667–76.

    PubMed  CAS  Google Scholar 

  5. Egger M, Schneider M, Smith GD. Meta-analysis: spurious precision? Meta-analysis of observational studies. BMJ 1998;316:140–4.

    PubMed  CAS  Google Scholar 

  6. Bailar JC III. Passive smoking coronary heart disease, and meta-analysis [editorial]. N Engl J Med 1999;340:958–9.

    Article  PubMed  Google Scholar 

  7. Peterson ED, Shaw LJ, Califf RM. Clincal guideline: part II; risk stratification after myocardial infarction. Ann Intern Med 1997;126:561–82.

    PubMed  CAS  Google Scholar 

  8. Kuntz KM, Fleischmann KE, Hunink MGM, Douglas PS. Cost-effectiveness of diagnostic strategies for patients with chest pain. Ann Intern Med 1999;130:709–18.

    PubMed  CAS  Google Scholar 

  9. Hunink MGM, Kuntz KM, Fleischmann KE, Brady TJ. noninvasive imaging for diagnosis of coronary artery disease: focusing the development of new diagnostic technology. Ann Intern Med 1999;131:673–80.

    PubMed  CAS  Google Scholar 

  10. Kymes SM, Shaw LJ, Fletcher JF. Exercise cardiography or exercise SPECT imaging? A meta-analysis of diagnostic test performance [letter]. JAMA 1999;282:1622.

    PubMed  CAS  Google Scholar 

  11. Hecht HS, DeBord L, Shaw R. Supine bicycle stress echocardiography versus tomographic thallium-201 exercise imaging for the detection of coronary artery disease. J Am Soc Echocardiogr 1993;6:177–185.

    PubMed  CAS  Google Scholar 

  12. Hoffmann R, Lethen H, Kleinhans E, Weiss M, Flachskampf FA, Hanrath P. Comparative evaluation of bicycle and dobutamine stress echocardiography with perfusion scintigraphy and bicycle electrocardiogram for identification of coronary artery disease. Am J Cardiol 1993;72:555–9.

    Article  PubMed  CAS  Google Scholar 

  13. Marwick TH, D’Hondt AM, Mairesse GH. Comparative ability of dobutamine and exercise stress in inducing myocardial ischemia in active patients. Br Heart J 1994;72:31–8.

    Article  PubMed  CAS  Google Scholar 

  14. Pozzoli MMA, Fioretti PM, Salustri A, Reijs AE, Roelandt JR. Exercise echocardiography and technetium-99m MIBI single-photon emission computed tomography in the detection of coronary artery disease. Am J Cardiol 1991;67:350–5.

    Article  PubMed  CAS  Google Scholar 

  15. Quinones MA, Verani MS, Haichin RM, Mahmarian JJ, Suarez J, Zoghbi WA. Exercise echocardiography versus 201TI single-photon emission computed tomography in evaluation of coronary artery disease: analysis of 292 patients. Circulation 1992;85:1026–31.

    PubMed  CAS  Google Scholar 

  16. Salustri A, Pozzoli MM, Hermans W, et al. Relationship between exercise echocardiography and perfusion SPECT in patients with singlevessel coronary artery disease. Am Heart J 1992;124:75–83.

    Article  PubMed  CAS  Google Scholar 

  17. Berman DS, Kiat H, Friedman JD. Separate acquisition rest thallium- 201/stress technetium-99m sestamibi dual-isotope myocardial perfusion single-photon emission computer tomography: a clinical validation study. J Am Coll Cardiol 1993;22:1455–64.

    PubMed  CAS  Google Scholar 

  18. Chae SC, Heo J, Iskandrian AS, Wasserleben V, Cave V. Identification of extensive coronary artery disease in women by exercise singlephoton emission computed tomography (SPECT) thallium imaging. J Am Coll Cardiol 1993;21:1305–11.

    PubMed  CAS  Google Scholar 

  19. Christian TF, Miller TD, Bailey KR, Gibbons RJ. Noninvasive identification of severe coronary artery disease using exercise tomographic thallium-201 imaging. Am J Cardiol 1992;70:14–20.

    Article  PubMed  CAS  Google Scholar 

  20. Fleming RM, Kirkeeide RL, Taegtmeyer H. Comparison of technetium- 99m teboroxime tomography with automated quantitative coronary arteriography and thallium-201 tomographic imaging. J Am Coll Cardiol 1991;17:1297–302.

    PubMed  CAS  Google Scholar 

  21. Gupta NC, Esterbrooks DJ, Hilleman DE, Mohiuddin SM. Comparison of adenosine and exercise thallium-201 single-photon emission computed tomography (SPECT) myocardial perfusion imaging. J Am Coll Cardiol 1992;19:248–57.

    PubMed  CAS  Google Scholar 

  22. Hambye AS, Vervaet A, Lieber S, Ranquin R. Diagnostic value and incremental contribution of bicycle exercise, first-pass radionuclide angiography, and 99mTc-labeled sestamibi single-photon emission computed tomography in the identification of coronary artery disease in patients without infarction. J Nucl Cardiol 1996;3:464–74.

    Article  PubMed  CAS  Google Scholar 

  23. Heiba SI, Hayat NJ, Salman HS. Technetium-99-MIBI myocardial SPECT: supine versus right lateral imaging and comparison with coronary arteriography. J Nucl Med 1997;38:1510–4.

    PubMed  CAS  Google Scholar 

  24. Ho YL, Wu CC, Huang PJ. Dobutamine stress echocardiography compared with exercise thallium-201 single-photon emission computed tomography in detecting coronary artery disease-effect of exercise on level of accuracy. Cardiology 1997;88:379–85.

    Article  PubMed  CAS  Google Scholar 

  25. Kiat H, Van Train KF, Maddahi J. Development and prospective application of quantitative 2-day stress-rest Tc-99m methoxy isobutyl isonitrile SPECT for the diagnosis of coronary artery disease. Am Heart J 1990;120:1255–66.

    Article  PubMed  CAS  Google Scholar 

  26. Mahmarian JJ, Boyce TM, Goldberg RK, Cocanougher MK, Roberts R, Verani MS. Quantitative exercise thallium-201 single photon emission computed tomography for the enhanced diagnosis of ischemic heart disease. J Am Coll Cardiol 1990;15:318–29.

    PubMed  CAS  Google Scholar 

  27. Minoves M, Garcia A, Magrina J, Pavia J, Herranz R, Setoain J. Evaluation of myocardial perfusion defects by means of “bulls eye” images. Clin Cardiol 1993;16:16–22.

    Article  PubMed  CAS  Google Scholar 

  28. Nguyen T, Heo J, Ogilby JD, Iskandrian AS. Single photon emission computed tomography with thallium-201 during adenosine-induced coronary hyperemia: correlation with coronary arteriography, exercise thallium imaging and two-dimensional echocardiography. J Am Coll Cardiol 1990;16:1375–83.

    PubMed  CAS  Google Scholar 

  29. Oguzhan A, Kisacik HL, Ozdemir K. Comparison of exercise stress testing with dobutamine stress echocardiography and exercise technetium- 99m isonitrile single photon emission computerized tomography for diagnosis of coronary artery disease. Jpn Heart J 1997;38:333–44.

    PubMed  CAS  Google Scholar 

  30. Palmas W, Friedman JD, Diamond GA, Silber H, Kiat H, Berman DS. Incremental value of simultaneous assessment of myocardial function and perfusion with technetium-99m sestamibi for prediction of extent of coronary artery disease. J Am Coll Cardiol 1995;25:1024–31.

    Article  PubMed  CAS  Google Scholar 

  31. Rubello D, Zanco P, Candelpergher G. Usefulness of 99mTc-MIBI stress myocardial SPECT bull’s-eye quantification in coronary artery disease. Q J Nucl Med 1995;39:111–5.

    PubMed  CAS  Google Scholar 

  32. Solot G, Hermans J, Merlo P. Correlation of 99Tcm-sestamibi SPECT with coronary angiography in general hospital practice. Nucl Med Comm 1993;14:23–9.

    Article  CAS  Google Scholar 

  33. Sylven C, Hagerman I, Ylen M, Nyquist O, Nowak J. Variance ECG detection of coronary artery disease: a comparison with exercise stress test and myocardial scintigraphy. Clin Cardiol 1994;17:132–40.

    Article  PubMed  CAS  Google Scholar 

  34. Taillefer R, DePuey EG, Udelson JE. Comparative diagnostic accuracy of Tl-201 and Tc-99m sestamibi SPECT imaging (perfusion and ECGgated SPECT) in detecting coronary artery disease in women. J Am Coll Cardiol 1997;29:69–77.

    Article  PubMed  CAS  Google Scholar 

  35. VanTrain KF, Garcia EV, Maddahi J. Multicenter trial validation for quantitative analysis of same-day rest-stress technetium-99m-sestamibi myocardial tomograms. J Nucl Med 1994;35:609–18.

    PubMed  Google Scholar 

  36. VanTrain KF, Areeda J, Garcia EV. Quantitative same-day rest-stress technetium-99m-sestamibi SPECT: definition and validation of stress normal limits and criteria for abnormality. J Nucl Med 1993;34: 1494–02.

    PubMed  Google Scholar 

  37. Van Train KF, Maddahi J, Berman DS. Quantitative analysis of tomographic stress thallium-201 myocardial scintigrams: a multicenter trial. J Nucl Med 1990;31:1168–79.

    PubMed  Google Scholar 

  38. Beleslin BD, Ostojic M, Stepanovic J. Stress echocardiography in the detection of myocardial ischemia. Circulation 1994;90:1168–76.

    PubMed  CAS  Google Scholar 

  39. Bjornstad K, Aakhus S, Hatle L. Comparison of digital dipyridamole stress echocardiography and upright bicycle stress echocardiography for identification of coronary artery stenosis. Cardiology 1995;86: 514–20.

    Article  PubMed  CAS  Google Scholar 

  40. Cohen JL, Ottenweller JE, George AK, Duvvuri S. Comparison of dobutamine and exercise echocardiography for detecting coronary artery disease. Am J Cardiol 1993;72:1226–31.

    Article  PubMed  CAS  Google Scholar 

  41. Crouse LJ, Harbrecht JJ, Vacek JL, Rosamond TL, Kramer PH. Exercise echocardiography as a screening test for coronary artery disease and correlation with coronary arteriography. Am J Cardiol 1991;67:1213–8.

    Article  PubMed  CAS  Google Scholar 

  42. Dagianti A, Penco M, Agati L. Stress echocardiography: comparison of exercise, dipyridamole and dobutamine in detecting and predicting the extent of coronary artery disease. J Am Coll Cardiol 1995;26:18–25.

    Article  PubMed  CAS  Google Scholar 

  43. Galanti G, Sciagra R, Comeglio M. Diagnostic accuracy of peak exercise echocardiography in coronary artery disease: comparison with thallium-201 myocardial scintigraphy. Am Heart J 1991;122:1609–16.

    Article  PubMed  CAS  Google Scholar 

  44. Jun T, Guizhen A, Xiaoming W, Jijun C, Jing X. Exercise echocardiography: feasibility and value for detection of coronary artery disease. Chin Med J 1996;109:381–4.

    Google Scholar 

  45. Luohtolati M, Saraste M, Hartiala J. Exercise echocardiography in the diagnosis of coronary artery disease. Ann Med 1996;28:73–7.

    Article  Google Scholar 

  46. Marangelli V, Iliceto S, Piccinni G, De Martino G, Sorgente L, Rizzon P. Detection of coronary artery disease by digital stress echocardiography: comparison of exercise, transesophageal atrial pacing and dipyridamole echocardiography. J Am Coll Cardiol 1994;24:117–24.

    Article  PubMed  CAS  Google Scholar 

  47. Marwick TH, Nemec JJ, Pashkow FJ, Stewart WJ, Salcedo EE. Accuracy and limitations of exercise echocardiography in a routine clinical setting. J Am Coll Cardiol 1992;19:74–81.

    Article  PubMed  CAS  Google Scholar 

  48. Marwick TH, Anderson T, Williams MJ. Exercise echocardiography is an accurate and cost-efficient technique for detection of coronary artery disease in women. J Am Coll Cardiol 1995;26:335–41.

    Article  PubMed  CAS  Google Scholar 

  49. Marwick TH, Torelli J, Harjai K. Influence of left ventricular hypertrophy on detection of coronary artery disease using exercise echocardiography. J Am Coll Cardiol 1995;26:1180–6.

    Article  PubMed  CAS  Google Scholar 

  50. Roger VL, Pellikka PA, Oh JK, Bailey KR, Tajik AJ. Identification of multivessel coronary artery disease by exercise echocardiography. J Am Coll Cardiol 1994;24:109–14.

    PubMed  CAS  Google Scholar 

  51. Roger VL, Pellikka PA, Bell MR. Sex and test verification bias: impact on the diagnostic value of exercise echocardiography. Circulation 1997;95:405–10.

    PubMed  CAS  Google Scholar 

  52. Ryan T, Segar DS, Sawada SG. Detection of coronary artery disease with upright bicycle exercise echocardiography. J Am Soc Echocardiogr 1993;6:186–97.

    PubMed  CAS  Google Scholar 

  53. Tawa CB, Baker WB, Kleiman NS. Comparison of adenosine echocardiography, with and without isometric handgrip, to exercise echocardiography in the detection of ischemia in patients with coronary artery disease. J Am Soc Echocardiogr 1996;9:33–43.

    Article  PubMed  CAS  Google Scholar 

  54. Williams MJ, Marwick TH, O’Gorman D, Foale RA. Comparison of exercise echocardiography with an exercise score to diagnose coronary artery disease in women. Am J Cardiol 1994;74:435–8.

    Article  PubMed  CAS  Google Scholar 

  55. Kent DL, Larson FB. Disease, level of impact, and quality of research methods: three dimensions of clinical efficacy assessment applied to magnetic resonance imaging. Invest Radiol 1992;27:245–54.

    Article  PubMed  CAS  Google Scholar 

  56. Fletcher J, Adams E, Flynn K, Papatheofanis F. Design of prospective clincal trials for assessment of PET. Clinical Positron Imaging 1998;1:201–11.

    Article  PubMed  Google Scholar 

  57. Midgette AS, Stukel TA, Littenberg B. A meta-analytic method for summarizing diagnostic test performance. Med Decis Making, 1993;13:253–7.

    Article  PubMed  CAS  Google Scholar 

  58. Lau J, Ioannidis JPA, Schmid CH. Quantitative Synthesis in Systematic Reviews. Annals of Internal Medicine November 1, 1997;127(9): 820–6.

    CAS  Google Scholar 

  59. Shaw LJ, Peterson ED, Kesler K, Hasselblad, Califf RM. A metaanalysis of predischarge risk stratification after acute myocardial infarction with stress electrocardiographic, myocardial perfusion, and ventricular function imaging. Am J Cardiol 1996;78:1327–37.

    Article  PubMed  CAS  Google Scholar 

  60. Thompson SG. Why sources of heterogeneity in meta-analysis should be investigated. BMJ 1994;309:1351–5.

    PubMed  CAS  Google Scholar 

  61. Moses L, Shapiro D, Littenberg B. Combining independent studies of a diagnostic test into a summary roc curve: data-analystic approaches and some additional considerations. Stat Med 1993; 2:1293–1316.

    Google Scholar 

  62. de Vries S, Hunink M, Polak J. Summary receiver operating characteristic curves as a technique for meta-analysis of the diagnostic performance of duplex ultrasonography in peripheral arterial disease. Acad Radiol 1996;3:361–9.

    Article  PubMed  Google Scholar 

  63. Neter J, Kutner MH, Nachtsheim CJ, Wasserman W, eds. Applied linear regression models. 3rd ed. Chicago: Irwin; 1996.

    Google Scholar 

  64. Littenberg B, Moses L. Estimating diagnostic accuracy from multiple conflicting reports: a new meta-analytic method. Med Decis Making 1993;12:313–21.

    Article  Google Scholar 

  65. Shapiro S. Meta-analysis/shmeta-analysis. Am J Epidemiol 1994;140: 771–8.

    PubMed  CAS  Google Scholar 

  66. Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology 1982;143: 29–36.

    PubMed  CAS  Google Scholar 

  67. Russell MW, Huse DM, Drowns S, Hamel EC, Hartz SC. Derect medical costs of coronary artery disease in the United States. Am J Cardiol 1998;81:1110–5.

    Article  PubMed  CAS  Google Scholar 

  68. Patterson R, Eisner R, Horowitz S. Comparison of cost-effectiveness and utility of exercise ecg, single proton emission computed tomography, positron emission tomography, and coronary angiography for diagnosis of coronary artery disease. Circulation 1995;91:54–65.

    PubMed  CAS  Google Scholar 

  69. Schelbert H, Maddahi J. Clinical cardiac PET: quo vadis? J Nucl Cardiol 1994;1:576–9.

    Article  PubMed  CAS  Google Scholar 

  70. DePuey EG, Rozanski A. Using gated technetium-99-m-sestamibi SPECT to characterize fixed myocardial defects as infarct or artifact. J Nucl Med 1995;36:952–5.

    Google Scholar 

  71. Shaw LJ, Gillam L, Feinstein S. Use of an Intravenous contrast agent (optisontm) to enhance echocardiography: efficacy and cost implications. Am J Managed Care 1998;4:SP169-SP176.

    Google Scholar 

  72. Jacobs M. Review: exercise echo is a more specific and discriminitory test than exercise SPECT for coronary artery disease. ACP Journal Club 1999;130:45.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Saint Louis University School of Medicine, St Louis, Mo

    Steven M. Kymes & James W. Fletcher

  2. School of Public Health, St Louis, Mo

    Kathleen N. Gillespie

  3. Molecular Biosystems, Inc, Mallinckrodt Corporation, San Diego, Calif

    Denise E. Bruns

  4. Emory University School of Medicine, Atlanta, Ga

    Leslee J. Shaw

Authors
  1. Steven M. Kymes
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Denise E. Bruns
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Leslee J. Shaw
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Kathleen N. Gillespie
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. James W. Fletcher
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Steven M. Kymes.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Kymes, S.M., Bruns, D.E., Shaw, L.J. et al. Anatomy of a meta-analysis: A critical review of “Exercise echocardiography or exercise SPECT imaging? A meta-analysis of diagnostic test performance”. J Nucl Cardiol 7, 599–615 (2000). https://doi.org/10.1067/mnc.2000.109027

Download citation

  • Received:

  • Accepted:

  • Issue Date:

  • DOI: https://doi.org/10.1067/mnc.2000.109027

Key Words

Search

Navigation