Meta-Analyses of Clinical Trials Versus Diagnostic Test Accuracy Studies

  • Michail Tsagris
  • Konstantinos C. Fragkos


In the present chapter, we discuss meta-analysis of clinical trials and compare them with meta-analysis of diagnostic accuracy studies. The former is based on the mixed effects model by DerSimonian and Laird (Control Clin Trials 7:177–188, 1986), and the latter is currently based on four main methods, with the most known bivariate model and the hierarchical summary receiver operator curve model. Each type of meta-analysis needs to be investigated for sources of heterogeneity. Specialist software exist to help each type of analysis.


Mixed effects model Bivariate model Trial Diagnostic accuracy Meta-analysis 


  1. 1.
    Tsagris M, Fragkos KC. Umbrella reviews, overviews of reviews, and meta-epidemiologic studies: similarities and differences. In: Biondi-Zoccai G, editor. Umbrella reviews: evidence synthesis with overviews of reviews and meta-epidemiologic studies. Cham: Springer International Publishing; 2016. p. 43–54.CrossRefGoogle Scholar
  2. 2.
    DerSimonian R, Kacker R. Random-effects model for meta-analysis of clinical trials: an update. Contemp Clin Trials. 2007;28:105–14.CrossRefPubMedGoogle Scholar
  3. 3.
    DerSimonian R, Laird N. Meta-analysis in clinical trials. Control Clin Trials. 1986;7:177–88.CrossRefGoogle Scholar
  4. 4.
    DerSimonian R, Laird N. Meta-analysis in clinical trials revisited. Contemp Clin Trials. 2015;45:139–45.CrossRefPubMedPubMedCentralGoogle Scholar
  5. 5.
    Cochran WG. Some methods for strengthening the common χ2 tests. Biometrics. 1954;10:417–51.CrossRefGoogle Scholar
  6. 6.
    Mantel N. Chi-Square tests with one degree of freedom; extensions of the mantel- Haenszel procedure. J Am Stat Assoc. 1963;58:690–700.Google Scholar
  7. 7.
    Mantel N, Haenszel W. Statistical aspects of the analysis of data from retrospective studies of disease. J Natl Cancer Inst. 1959;22:719–48.PubMedGoogle Scholar
  8. 8.
    Paule RC, Mandel J. Consensus values and weighting factors. J Res Natl Bur Stand. 1982;87:377–85.CrossRefGoogle Scholar
  9. 9.
    Fragkos KC, Tsagris M, Frangos CC. Publication Bias in meta-analysis: confidence intervals for Rosenthal’s fail-safe number. Int Sch Res Notices. 2014;2014:17.Google Scholar
  10. 10.
    Fragkos KC, Tsagris M, Frangos CC. Exploring the distribution for the estimator of Rosenthal's ‘fail-safe’ number of unpublished studies in meta-analysis. Commun Stat Theory Methods. 2017;46:5672–84.CrossRefGoogle Scholar
  11. 11.
    Sterne JA, Sutton AJ, Ioannidis JP, Terrin N, Jones DR, Lau J, Carpenter J, Rucker G, Harbord RM, Schmid CH, Tetzlaff J, Deeks JJ, Peters J, Macaskill P, Schwarzer G, Duval S, Altman DG, Moher D, Higgins JP. Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomised controlled trials. BMJ. 2011;343:d4002.CrossRefPubMedGoogle Scholar
  12. 12.
    Sterne JA, Egger M. Funnel plots for detecting bias in meta-analysis: guidelines on choice of axis. J Clin Epidemiol. 2001;54:1046–55.CrossRefPubMedGoogle Scholar
  13. 13.
    Viechtbauer W. Conducting meta-analyses in R with the metafor package. J Stat Softw. 2010;36:1–48.CrossRefGoogle Scholar
  14. 14.
    Frangos CC. An updated bibliography on the jackknife method. Commun Stat Theory Methods. 1987;16:1543–84.CrossRefGoogle Scholar
  15. 15.
    Tsagris M, Elmatzoglou I, Frangos CC. The assessment of performance of correlation estimates in discrete bivariate distributions using bootstrap methodology. Commun Stat Theory Methods. 2012;41:138–52.CrossRefGoogle Scholar
  16. 16.
    Li T, Puhan MA, Vedula SS, Singh S, Dickersin K, Ad Hoc Network Meta-analysis Methods Meeting Working G. Network meta-analysis-highly attractive but more methodological research is needed. BMC Med. 2011;9:79.CrossRefPubMedPubMedCentralGoogle Scholar
  17. 17.
    Rücker G. Network meta-analysis, electrical networks and graph theory. Res Synth Methods. 2012;3:312–24.CrossRefPubMedGoogle Scholar
  18. 18.
    Greco T, Biondi-Zoccai G, Saleh O, Pasin L, Cabrini L, Zangrillo A, Landoni G. The attractiveness of network meta-analysis: a comprehensive systematic and narrative review. Heart Lung Vessel. 2015;7:133–42.PubMedPubMedCentralGoogle Scholar
  19. 19.
    White IR. Network meta-analysis. Stata J. 2015;15:951–85.Google Scholar
  20. 20.
    Elliott WJ, Meyer PM. Incident diabetes in clinical trials of antihypertensive drugs: a network meta-analysis. Lancet. 2007;369:201–7.CrossRefGoogle Scholar
  21. 21.
    Neapolitan RE. Learning Bayesian networks. Harlow: Prentice Hall; 2004.Google Scholar
  22. 22.
    Madden LV, Piepho HP, Paul PA. Statistical models and methods for network meta-analysis. Phytopathology. 2016;106:792–806.CrossRefPubMedGoogle Scholar
  23. 23.
    Glass GV. Primary, secondary, and meta-analysis of research. Educ Res. 1976;5:3–8.CrossRefGoogle Scholar
  24. 24.
    Irwig L, Macaskill P, Glasziou P, Fahey M. Meta-analytic methods for diagnostic test accuracy. J Clin Epidemiol. 1995;48:119–30.CrossRefPubMedGoogle Scholar
  25. 25.
    Virgili G, Conti AA, Murro V, Gensini GF, Gusinu R. Systematic reviews of diagnostic test accuracy and the Cochrane collaboration. Intern Emerg Med. 2009;4:255–8.CrossRefPubMedGoogle Scholar
  26. 26.
    Moreno GG, Pantoja CT. Systematic reviews of studies of diagnostic test accuracy. Rev Med Chil. 2009;137:303–7.CrossRefGoogle Scholar
  27. 27.
    Takwoingi Y, Riley RD, Deeks JJ. Meta-analysis of diagnostic accuracy studies in mental health. Evid Based Ment Health. 2015;18:103–9.CrossRefPubMedPubMedCentralGoogle Scholar
  28. 28.
    Harbord RM, Whiting P, Sterne JA, Egger M, Deeks JJ, Shang A, Bachmann LM. An empirical comparison of methods for meta-analysis of diagnostic accuracy showed hierarchical models are necessary. J Clin Epidemiol. 2008;61:1095–103.CrossRefPubMedGoogle Scholar
  29. 29.
    Harbord RM, Deeks JJ, Egger M, Whiting P, Sterne JA. A unification of models for meta-analysis of diagnostic accuracy studies. Biostatistics. 2007;8:239–51.CrossRefPubMedGoogle Scholar
  30. 30.
    Begg CB. Meta-analysis methods for diagnostic accuracy. J Clin Epidemiol. 2008;61:1081–2.CrossRefPubMedGoogle Scholar
  31. 31.
    Chen Y, Liu Y, Chu H, Ting Lee ML, Schmid CH. A simple and robust method for multivariate meta-analysis of diagnostic test accuracy. Stat Med. 2017;36:105–21.CrossRefPubMedGoogle Scholar
  32. 32.
    Dukic V, Gatsonis C. Meta-analysis of diagnostic test accuracy assessment studies with varying number of thresholds. Biometrics. 2003;59:936–46.CrossRefPubMedGoogle Scholar
  33. 33.
    Leeflang MM. Systematic reviews and meta-analyses of diagnostic test accuracy. Clin Microbiol Infect. 2014;20:105–13.CrossRefPubMedGoogle Scholar
  34. 34.
    Deeks JJ. Systematic reviews of evaluations of diagnostic and screening tests. In: Egger M, Davey Smith G, Altman DG, editors. Systematic reviews in health care. London: BMJ Publishing Group; 2008. pp 248–282.Google Scholar
  35. 35.
    Littenberg B, Moses LE. Estimating diagnostic accuracy from multiple conflicting reports: a new meta-analytic method. Med Decis Mak. 1993;13:313–21.CrossRefGoogle Scholar
  36. 36.
    Moses LE, Shapiro D, Littenberg B. Combining independent studies of a diagnostic test into a summary ROC curve: data-analytic approaches and some additional considerations. Stat Med. 1993;12:1293–316.CrossRefPubMedGoogle Scholar
  37. 37.
    Reitsma JB, Glas AS, Rutjes AW, Scholten RJ, Bossuyt PM, Zwinderman AH. Bivariate analysis of sensitivity and specificity produces informative summary measures in diagnostic reviews. J Clin Epidemiol. 2005;58:982–90.CrossRefPubMedGoogle Scholar
  38. 38.
    Rutter CM, Gatsonis CA. A hierarchical regression approach to meta-analysis of diagnostic test accuracy evaluations. Stat Med. 2001;20:2865–84.CrossRefPubMedGoogle Scholar

Copyright information

© Springer International Publishing AG, part of Springer Nature 2018

Authors and Affiliations

  • Michail Tsagris
    • 1
  • Konstantinos C. Fragkos
    • 2
  1. 1.Department of Computer ScienceUniversity of CreteHeraklionGreece
  2. 2.University College LondonLondonUK

Personalised recommendations