Skip to main content
Log in

Empirical likelihood meta-analysis with publication bias correction under Copas-like selection model

  • Published:
Annals of the Institute of Statistical Mathematics Aims and scope Submit manuscript

Abstract

Meta-analysis is commonly used to synthesize multiple results from individual studies. However, its validation is usually threatened by publication bias and between-study heterogeneity, which can be captured by the Copas selection model. Existing inference methods under this model are all based on conditional likelihood and may not be fully efficient. In this paper, we propose a full likelihood approach to meta-analysis by integrating the conditional likelihood and a marginal semi-parametric empirical likelihood under a Copas-like selection model. We show that the maximum likelihood estimators (MLE) of all the underlying parameters have a jointly normal limiting distribution, and the full likelihood ratio follows an asymptotic central chi-square distribution. Our simulation results indicate that compared with the conditional likelihood method, the proposed MLEs have smaller mean squared errors and the full likelihood ratio confidence intervals have more accurate coverage probabilities. A real data example is analyzed to show the advantages of the full likelihood method over the conditional likelihood method.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  • Almalik, O., Zhan, Z., Van den Heuvel, E. (2020). Copas’ method is sensitive to different mechaisms of publication bias. arXiv:2007.15955.

  • Carpenter, J. R., Schwarzer, G., Rucker, G., Kunstler, R. (2009). Empirical evaluation showed that the Copas selection model provided a useful summary in 80% of meta-analysis. Journal of Clinical Epidemiology, 62, 624–631.

    Article  Google Scholar 

  • Cooper, H., Hedges, L. V., Valentine, J. C. (2009). The handbook of research synthesis and meta-analysis (2nd ed.). New York: Russell Sage Foundation.

    Google Scholar 

  • Copas, J. B. (1999). What works?: Selectivity models and meta-analysis. Journal of the Royal Statistical Society: Series A, 162, 95–109.

    Article  Google Scholar 

  • Copas, J. B., Jackson, D. (2004). A bound for publication bias based on the fraction of unpublished studies. Biometrics, 60(1), 146–153.

    Article  MathSciNet  Google Scholar 

  • Copas, J. B., Li, H. G. (1997). Inference for non-random samples. Journal of the Royal Statistical Society: Series B, 59, 55–95.

    Article  MathSciNet  Google Scholar 

  • Copas, J. B., Shi, J. Q. (2000). Meta-analysis, funnel plots and sensitivity analysis. Biostatistics, 1, 247–262.

    Article  Google Scholar 

  • Copas, J. B., Shi, J. Q. (2001). A sensitivity analysis for publication bias in systematic reviews. Statistical Methods in Medical Research, 10, 251–265.

    Article  Google Scholar 

  • DerSimonian, R., Laird, N. (1986). Meta-analysis in clinical trials. Contrilled Clinical Trials, 7, 177–188.

    Article  Google Scholar 

  • Duval, S., Tweedie, R. (2000a). A nonparametric ‘trim and fill’ method of accounting for publication bias in meta-analysis. Journal of the American Statistical Association, 95, 89–98.

    MathSciNet  MATH  Google Scholar 

  • Duval, S., Tweedie, R. (2000b). Trim and fill: A simple funnel-plot based method of testing and adjusting for publication bias in meta-analysis. Biometrics, 56, 455–463.

    Article  Google Scholar 

  • Egger, M., Smith, G. D., Altman, D. G. (2001). Systematic reviews in health care: Meta-analysis in context (2nd ed.). London: BMJ.

    Book  Google Scholar 

  • Egger, M., Smith, G. D., Schineider, M., Minder, C. (1997). Bias in meta-analysis detected by a simple, graphical test. British Medical Journal, 315, 629–634.

    Article  Google Scholar 

  • Fragkos, K. C., Tsagris, M., Frangos, C. C. (2017). Exploring the distribution for the estimator of Rosenthal’s ‘fail-safe’ number of unpublished studies in meta-analysis. Communications in Statistics-Theory and Methods, 46(11), 5672–5684.

    Article  MathSciNet  Google Scholar 

  • Galbraith, R. (1988). A note on the graphical presentation of estimated odds ratios from several clinical trials. Statistics in Medicine, 7, 889–894.

    Article  Google Scholar 

  • Glass, G. V. (1976). Primary, secondary, and meta-analysis of research. Educational Researcher, 5(10), 3–8.

    Article  Google Scholar 

  • Gleser, L. J., Olkin, I. (1996). Models for estimating the number of unpublished studies. Statistics in Medicine, 15, 2493–2507.

    Article  Google Scholar 

  • Han, P. (2014). Multiply robust estimation in regression analysis with missing data. Journal of the American Statistical Association, 109, 1159–1173.

    Article  MathSciNet  Google Scholar 

  • Jackson, D., Riley, R., White, I. R. (2011). Multivariate meta-analysis: Potential and promise. Statistics in Medicine, 30, 2481–2498.

    Article  MathSciNet  Google Scholar 

  • Jin, Z. C., Zhou, X. H., He, J. (2015). Statistical method for dealing with publication bias in meta-analysis. Statistics in Medicine, 34, 343–360.

    Article  Google Scholar 

  • Koricheva, J., Gurevitch, J., Mengersen, K. (2012). The handbook of meta-analysis in ecology and evolution. Princeton: Princeton University Press.

    Google Scholar 

  • Light, R., Pillemer, D. (1984). Summing up: The science of reviewing research. Cambridge: Harvard University Press.

    Google Scholar 

  • Liu, Y., Li, P., Qin, J. (2017). Maximum empirical likelihood estimation for abundance in a closed population from capture recapture data. Biometrika, 104, 527–543.

    MathSciNet  MATH  Google Scholar 

  • Liu, Y., Liu, Y., Li, P., Qin, J. (2018). Full likelihood inference for abundance from continuous-time capture-recapture data. Journal of the Royal Statistical Society: Series B, 80(5), 995–1014.

    Article  MathSciNet  Google Scholar 

  • Louis, T. A. (1982). Finding the observed information matrix when using the EM algorithm. Journal of the Royal Statistical Society: Series B, 44, 226–233.

    MathSciNet  MATH  Google Scholar 

  • Mavridis, D., Sutton, A., Cipriani, A., Salanti, G. (2013). A fully Bayesian application of the Copas selection model for publication bias extended to network meta-analysis. Statistics in Medicine, 32(1), 51–66.

    Article  MathSciNet  Google Scholar 

  • Ning, J., Chen, Y., Piao, J. (2017). Maximum likelihood estimation and EM algorithm of Copas-like selection model for publication bias correction. Biostatistics, 18(3), 495–504.

    Article  MathSciNet  Google Scholar 

  • Owen, A. B. (1988). Empirical likelihood ratio confidence intervals for a single functional. Biometrika, 75, 237–249.

    Article  MathSciNet  Google Scholar 

  • Owen, A. B. (1990). Empirical likelihood ratio confidence regions. Annals of Statistics, 18, 90–120.

    Article  MathSciNet  Google Scholar 

  • Rosenthal, R. (1979). The “file drawer problem’’ and tolerance for null results. Psychological Bulletin, 86, 638–641.

    Article  Google Scholar 

  • Rothstein, H. R. (2008). Publication bias as a threat to the validity of meta-analytic results. Journal of Experimental Criminology, 4, 61–81.

    Article  Google Scholar 

  • Rothstein, H. R., Sutto, A. J., Borenstein, M. (2006). Publication bias in meta-analysis: Prevention, assessment and adjustments. Sussex: Wiley.

    Google Scholar 

  • Scharzer, G., Carpenter, J., Rucker, G. (2010). Empirical evaluation suggests Copas selection model preferable to trim-and-fill method for selection bias in meta-analysis. Journal of Clinical Epidemiology, 63, 282–288.

    Article  Google Scholar 

  • Sterne, J. A., Gavaghan, D., Egger, M. (2000). Publication and related bias in meta-analysis: Power of statistical tests and prevalence in the literature. Journal Clinical Epidemiology, 53, 1119–1129.

    Article  Google Scholar 

  • Sterne, J. A. C., Egger, M., Smith, G. D. (2001). Systematic reviews in health care: Investigating and dealing with publication and other biases in meta-analysis. British Medical Journal, 323, 101–105.

    Article  Google Scholar 

Download references

Acknowledgements

The authors thank the Editor, the Associate Editor and an anonymous referee for helpful comments and suggestions that have led to significant improvements in the paper. Dr. Liu’s research was supported by the National Natural Science Foundation of China (11771144, 11971300, 11871287), the State Key Program of the National Natural Science Foundation of China (71931004), the Natural Science Foundation of Shanghai (19ZR1420900, 17ZR1409000), the development fund for Shanghai talents , the 111 project (B14019), and the Fundamental Research Funds for the Central Universities. Dr. Li was supported in part by the Natural Sciences and Engineering Research Council of Canada grant number RGPIN-2015-06592.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yukun Liu.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

The online version of this article contains supplementary material.

Supplementary Information

Below is the link to the electronic supplementary material.

Supplementary material 1 (pdf 153 KB)

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Li, M., Liu, Y., Li, P. et al. Empirical likelihood meta-analysis with publication bias correction under Copas-like selection model. Ann Inst Stat Math 74, 93–112 (2022). https://doi.org/10.1007/s10463-021-00793-4

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10463-021-00793-4

Keywords

Navigation