Abstract
Meta-analysis is commonly used to synthesize multiple results from individual studies. However, its validation is usually threatened by publication bias and between-study heterogeneity, which can be captured by the Copas selection model. Existing inference methods under this model are all based on conditional likelihood and may not be fully efficient. In this paper, we propose a full likelihood approach to meta-analysis by integrating the conditional likelihood and a marginal semi-parametric empirical likelihood under a Copas-like selection model. We show that the maximum likelihood estimators (MLE) of all the underlying parameters have a jointly normal limiting distribution, and the full likelihood ratio follows an asymptotic central chi-square distribution. Our simulation results indicate that compared with the conditional likelihood method, the proposed MLEs have smaller mean squared errors and the full likelihood ratio confidence intervals have more accurate coverage probabilities. A real data example is analyzed to show the advantages of the full likelihood method over the conditional likelihood method.
Similar content being viewed by others
References
Almalik, O., Zhan, Z., Van den Heuvel, E. (2020). Copas’ method is sensitive to different mechaisms of publication bias. arXiv:2007.15955.
Carpenter, J. R., Schwarzer, G., Rucker, G., Kunstler, R. (2009). Empirical evaluation showed that the Copas selection model provided a useful summary in 80% of meta-analysis. Journal of Clinical Epidemiology, 62, 624–631.
Cooper, H., Hedges, L. V., Valentine, J. C. (2009). The handbook of research synthesis and meta-analysis (2nd ed.). New York: Russell Sage Foundation.
Copas, J. B. (1999). What works?: Selectivity models and meta-analysis. Journal of the Royal Statistical Society: Series A, 162, 95–109.
Copas, J. B., Jackson, D. (2004). A bound for publication bias based on the fraction of unpublished studies. Biometrics, 60(1), 146–153.
Copas, J. B., Li, H. G. (1997). Inference for non-random samples. Journal of the Royal Statistical Society: Series B, 59, 55–95.
Copas, J. B., Shi, J. Q. (2000). Meta-analysis, funnel plots and sensitivity analysis. Biostatistics, 1, 247–262.
Copas, J. B., Shi, J. Q. (2001). A sensitivity analysis for publication bias in systematic reviews. Statistical Methods in Medical Research, 10, 251–265.
DerSimonian, R., Laird, N. (1986). Meta-analysis in clinical trials. Contrilled Clinical Trials, 7, 177–188.
Duval, S., Tweedie, R. (2000a). A nonparametric ‘trim and fill’ method of accounting for publication bias in meta-analysis. Journal of the American Statistical Association, 95, 89–98.
Duval, S., Tweedie, R. (2000b). Trim and fill: A simple funnel-plot based method of testing and adjusting for publication bias in meta-analysis. Biometrics, 56, 455–463.
Egger, M., Smith, G. D., Altman, D. G. (2001). Systematic reviews in health care: Meta-analysis in context (2nd ed.). London: BMJ.
Egger, M., Smith, G. D., Schineider, M., Minder, C. (1997). Bias in meta-analysis detected by a simple, graphical test. British Medical Journal, 315, 629–634.
Fragkos, K. C., Tsagris, M., Frangos, C. C. (2017). Exploring the distribution for the estimator of Rosenthal’s ‘fail-safe’ number of unpublished studies in meta-analysis. Communications in Statistics-Theory and Methods, 46(11), 5672–5684.
Galbraith, R. (1988). A note on the graphical presentation of estimated odds ratios from several clinical trials. Statistics in Medicine, 7, 889–894.
Glass, G. V. (1976). Primary, secondary, and meta-analysis of research. Educational Researcher, 5(10), 3–8.
Gleser, L. J., Olkin, I. (1996). Models for estimating the number of unpublished studies. Statistics in Medicine, 15, 2493–2507.
Han, P. (2014). Multiply robust estimation in regression analysis with missing data. Journal of the American Statistical Association, 109, 1159–1173.
Jackson, D., Riley, R., White, I. R. (2011). Multivariate meta-analysis: Potential and promise. Statistics in Medicine, 30, 2481–2498.
Jin, Z. C., Zhou, X. H., He, J. (2015). Statistical method for dealing with publication bias in meta-analysis. Statistics in Medicine, 34, 343–360.
Koricheva, J., Gurevitch, J., Mengersen, K. (2012). The handbook of meta-analysis in ecology and evolution. Princeton: Princeton University Press.
Light, R., Pillemer, D. (1984). Summing up: The science of reviewing research. Cambridge: Harvard University Press.
Liu, Y., Li, P., Qin, J. (2017). Maximum empirical likelihood estimation for abundance in a closed population from capture recapture data. Biometrika, 104, 527–543.
Liu, Y., Liu, Y., Li, P., Qin, J. (2018). Full likelihood inference for abundance from continuous-time capture-recapture data. Journal of the Royal Statistical Society: Series B, 80(5), 995–1014.
Louis, T. A. (1982). Finding the observed information matrix when using the EM algorithm. Journal of the Royal Statistical Society: Series B, 44, 226–233.
Mavridis, D., Sutton, A., Cipriani, A., Salanti, G. (2013). A fully Bayesian application of the Copas selection model for publication bias extended to network meta-analysis. Statistics in Medicine, 32(1), 51–66.
Ning, J., Chen, Y., Piao, J. (2017). Maximum likelihood estimation and EM algorithm of Copas-like selection model for publication bias correction. Biostatistics, 18(3), 495–504.
Owen, A. B. (1988). Empirical likelihood ratio confidence intervals for a single functional. Biometrika, 75, 237–249.
Owen, A. B. (1990). Empirical likelihood ratio confidence regions. Annals of Statistics, 18, 90–120.
Rosenthal, R. (1979). The “file drawer problem’’ and tolerance for null results. Psychological Bulletin, 86, 638–641.
Rothstein, H. R. (2008). Publication bias as a threat to the validity of meta-analytic results. Journal of Experimental Criminology, 4, 61–81.
Rothstein, H. R., Sutto, A. J., Borenstein, M. (2006). Publication bias in meta-analysis: Prevention, assessment and adjustments. Sussex: Wiley.
Scharzer, G., Carpenter, J., Rucker, G. (2010). Empirical evaluation suggests Copas selection model preferable to trim-and-fill method for selection bias in meta-analysis. Journal of Clinical Epidemiology, 63, 282–288.
Sterne, J. A., Gavaghan, D., Egger, M. (2000). Publication and related bias in meta-analysis: Power of statistical tests and prevalence in the literature. Journal Clinical Epidemiology, 53, 1119–1129.
Sterne, J. A. C., Egger, M., Smith, G. D. (2001). Systematic reviews in health care: Investigating and dealing with publication and other biases in meta-analysis. British Medical Journal, 323, 101–105.
Acknowledgements
The authors thank the Editor, the Associate Editor and an anonymous referee for helpful comments and suggestions that have led to significant improvements in the paper. Dr. Liu’s research was supported by the National Natural Science Foundation of China (11771144, 11971300, 11871287), the State Key Program of the National Natural Science Foundation of China (71931004), the Natural Science Foundation of Shanghai (19ZR1420900, 17ZR1409000), the development fund for Shanghai talents , the 111 project (B14019), and the Fundamental Research Funds for the Central Universities. Dr. Li was supported in part by the Natural Sciences and Engineering Research Council of Canada grant number RGPIN-2015-06592.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
The online version of this article contains supplementary material.
Supplementary Information
Below is the link to the electronic supplementary material.
About this article
Cite this article
Li, M., Liu, Y., Li, P. et al. Empirical likelihood meta-analysis with publication bias correction under Copas-like selection model. Ann Inst Stat Math 74, 93–112 (2022). https://doi.org/10.1007/s10463-021-00793-4
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10463-021-00793-4