# Identification and Sensitivity Analysis for Average Causal Mediation Effects with Time-Varying Treatments and Mediators: Investigating the Underlying Mechanisms of Kindergarten Retention Policy

- 326 Downloads

## Abstract

Considering that causal mechanisms unfold over time, it is important to investigate the mechanisms over time, taking into account the time-varying features of treatments and mediators. However, identification of the average causal mediation effect in the presence of time-varying treatments and mediators is often complicated by time-varying confounding. This article aims to provide a novel approach to uncovering causal mechanisms in time-varying treatments and mediators in the presence of time-varying confounding. We provide different strategies for identification and sensitivity analysis under homogeneous and heterogeneous effects. Homogeneous effects are those in which each individual experiences the same effect, and heterogeneous effects are those in which the effects vary over individuals. Most importantly, we provide an alternative definition of average causal mediation effects that evaluates a partial mediation effect; the effect that is mediated by paths other than through an intermediate confounding variable. We argue that this alternative definition allows us to better assess at least a part of the mediated effect and provides meaningful and unique interpretations. A case study using ECLS-K data that evaluates kindergarten retention policy is offered to illustrate our proposed approach.

## Keywords

causal mediation analysis time-varying treatment and mediator time-varying confounding variable homogeneous effects heterogeneous effects sensitivity analysis## Notes

### Acknowledgements

This research was supported by a grant from the American Educational Research Association which receives funds for its “AERA Grants Program” from the National Science Foundation under Grant #DRL-0941014. Opinions reflect those of the author and do not necessarily reflect those of the granting agencies.

## Supplementary material

## References

- Avin, C., Shpitser, I., & Pearl, J. (2005).
*Identifiability of path-specific effects*. California: Department of Statistics, UCLA.Google Scholar - Bind, M.-A., Vanderweele, T., Coull, B., & Schwartz, J. (2016). Causal mediation analysis for longitudinal data with exogenous exposure.
*Biostatistics*,*17*(1), 122–134.PubMedGoogle Scholar - Daniel, R., De Stavola, B., Cousens, S., & Vansteelandt, S. (2015). Causal mediation analysis with multiple mediators.
*Biometrics*,*71*(1), 1–14.CrossRefPubMedGoogle Scholar - De Stavola, B. L., Daniel, R. M., Ploubidis, G. B., & Micali, N. (2014). Mediation analysis with intermediate confounding: structural equation modeling viewed through the causal inference lens.
*American Journal of Epidemiology*,*181*(1), 64–80.CrossRefPubMedPubMedCentralGoogle Scholar - Didelez, V., Dawid, P. & Geneletti, S. (2012). Direct and indirect effects of sequential treatments. arXiv:1206.6840.
- Fong, C., Ratkovic, M. & Imai, K. (2014). Cbps: R package for covariate balancing propensity score.
*Comprehensive R Archive Network (CRAN)*.Google Scholar - Geneletti, S. (2007). Identifying direct and indirect effects in a non-counterfactual framework.
*Journal of the Royal Statistical Society: Series B (Statistical Methodology)*,*69*(2), 199–215.CrossRefGoogle Scholar - Hong, G., & Raudenbush, S. W. (2005). Effects of kindergarten retention policy on children’s cognitive growth in reading and mathematics.
*Educational Evaluation and Policy Analysis*,*27*(3), 205–224.CrossRefGoogle Scholar - Hong, G., & Raudenbush, S. W. (2006). Evaluating kindergarten retention policy: A case study of causal inference for multilevel observational data.
*Journal of the American Statistical Association*,*101*(475), 901–910.CrossRefGoogle Scholar - Imai, K., & Ratkovic, M. (2015). Robust estimation of inverse probability weights for marginal structural models.
*Journal of the American Statistical Association*,*110*(511), 1013–1023.CrossRefGoogle Scholar - Imai, K., & Yamamoto, T. (2013). Identification and sensitivity analysis for multiple causal mechanisms: Revisiting evidence from framing experiments.
*Political Analysis*,*21*, 141–171.CrossRefGoogle Scholar - Imbens, G. W., & Rubin, D. B. (2015).
*Causal inference in statistics, social, and biomedical sciences*. Cambridge: Cambridge University Press.CrossRefGoogle Scholar - Mayer, A., Thoemmes, F., Rose, N., Steyer, R., & West, S. G. (2014). Theory and analysis of total, direct, and indirect causal effects.
*Multivariate Behavioral Research*,*49*(5), 425–442.CrossRefPubMedGoogle Scholar - Pearl, J. (2009).
*Causality: Models, reasoning, and inference*(2nd ed.). Cambridge: Cambridge University Press.CrossRefGoogle Scholar - Robins, J. M., Hernan, M., & Brumback, B. (2000). Marginal structural models and causal inference in epidemiology.
*Epidemiology*,*11*, 550–560.CrossRefPubMedGoogle Scholar - Rubin, D. B. (1974). Estimating causal effects of treatments in randomized and nonrandomized studies.
*Journal of Educational Psychology*,*66*(5), 688.CrossRefGoogle Scholar - Shpitser, I. (2013). Counterfactual graphical models for longitudinal mediation analysis with unobserved confounding.
*Cognitive Science*,*37*(6), 1011–1035.CrossRefPubMedGoogle Scholar - Steen, J., Loeys, T., Moerkerke, B., & Vansteelandt, S. (2017). Flexible mediation analysis with multiple mediators.
*American Journal of Epidemiology*,*186*, 184–193.CrossRefPubMedGoogle Scholar - Steiner, P. M., Park, S. & Kim, Y. (2016). Identifying causal estimands for time-varying treatments measured with time-varying (age or grade-based) instruments.
*Multivariate Behavioral Research*,*51*, 1–6.Google Scholar - Steyer, R., Mayer, A. & Fiege, C. (2014). Causal inference on total, direct, and indirect effects.
*Encyclopedia of Quality of Life Research*, 606–631.Google Scholar - Tourangeau, K., Nord, C., Lê, T., Sorongon, A. G. & Najarian, M. (2009). Early childhood longitudinal study, kindergarten class of 1998–99 (ecls-k): Combined user’s manual for the ecls-k eighth-grade and k-8 full sample data files and electronic codebooks. nces 2009-004. National Center for Education Statistics.Google Scholar
- Vandecandelaere, M., Vansteelandt, S., De Fraine, B. & Van Damme, J. (2016). Time-varying treatments in observational studies: Marginal structural models of the effects of early grade retention on math achievement.
*Multivariate Behavioral Research*, 1–22.Google Scholar - VanderWeele, T., & Tchetgen Tchetgen, E. (2016). Mediation analysis with time varying exposures and mediators.
*Journal of the Royal Statistical Society: Series B (Statistical Methodology)*,*79*, 917–938.CrossRefGoogle Scholar - VanderWeele, T., & Vansteelandt, S. (2014). Mediation analysis with multiple mediators.
*Epidemiologic Methods*,*2*(1), 95–115.CrossRefPubMedPubMedCentralGoogle Scholar