Extending inferences from a randomized trial to a target population
- 188 Downloads
In this issue, Weiss discusses “generalizing” inferences from randomized trials to other populations . However, he does not explicitly define what “generalizing” means, assumes that “generalizing” the results of a randomized trial has a single goal, and reduces generalizability to a binary subjective judgment—findings are either generalizable or not generalizable. A growing literature (e.g., [1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13]) precisely defines the several meanings and goals of extending inferences from randomized trials to another population, and describes analyses whose findings go beyond simple binary judgements. Here, we provide a non-technical overview of this literature. First, we briefly review the main concepts, then we outline the available study designs and statistical approaches.
What do we mean by extending inferences from randomized trials?
We can summarize the goals of extending inferences from randomized trials as learning about counterfactual quantities...
This work was supported in part by Patient-Centered Outcomes Research Institute (PCORI) Methods Research Award ME-1502-27794 (Dahabreh) and National Institutes of Health (NIH) Grant R37 AI102634 (Hernán). Statements in this paper do not necessarily represent the views of the PCORI, its Board of Governors, the PCORI Methodology Committee, or the NIH.
- 12.Dahabreh IJ, Robertson SE, Stuart EA, Hernán MA. Transporting inferences from a randomized trial to a new target population. arXiv preprint arXiv:1805.00550. 2018.
- 13.Chan W. Partially identified treatment effects for generalizability. J. Res. Educ. Effect. 2017;10(3):646–69.Google Scholar
- 14.Dahabreh IJ, Robins JM, Haneuse SJ, Hernán MA. Generalizing causal inferences from randomized trials: counterfactual and graphical identification. 2019 (forthcoming).Google Scholar
- 15.Hernán MA. Discussion of “Perils and potentials of self-selected entry to epidemiological studies and surveys” by N Keiding and TA Louis. J R Stat Soc Ser A Stat Soc. 2016;179(2):346–7.Google Scholar
- 19.Dahabreh IJ, Hernán MA, Robertson SE, Buchanan A, Steingrimsson JA. Generalizing trial findings in nested trial designs with sub-sampling of non-randomized individuals. arXiv preprint arXiv:1902.06080. 2019.
- 20.Dahabreh IJ, Haneuse SJPA, Robins JM, Robertson SE, Buchanan AL, Stuart EA, et al. Study designs for extending causal inferences from a randomized trial to a target population. 2019. arXiv preprint arXiv:1905.07764.
- 21.Kern HL, Stuart EA, Hill J, Green DP. Assessing methods for generalizing experimental impact estimates to target populations. J Res Educ Effect. 2016;9(1):103–27.Google Scholar
- 22.Hernán MA, Robins JM. Causal inference. Boca Raton: Chapman & Hall/CRC; 2019, forthcoming.Google Scholar
- 23.Robins JM, Rotnitzky A, Scharfstein DO. Sensitivity analysis for selection bias and unmeasured confounding in missing data and causal inference models. Statistical models in epidemiology, the environment, and clinical trials: Springer; 2000. p. 1–94.Google Scholar
- 25.Nguyen TQ, Ackerman B, Schmid I, Cole SR, Stuart EA. Sensitivity analyses for effect modifiers not observed in the target population when generalizing treatment effects from a randomized controlled trial: assumptions, models, effect scales, data scenarios, and implementation details. PLoS ONE. 2018;13(12):e0208795. https://doi.org/10.1371/journal.pone.0208795.CrossRefGoogle Scholar
- 26.Dahabreh IJ, Robins JM, Haneuse SJ, et al. Sensitivity analysis using bias functions for studies extending inferences from a randomized trial to a target population. arXiv preprint arXiv:1905.10684. 2019.