Skip to main content

The positivity assumption and marginal structural models: the example of warfarin use and risk of bleeding

European Journal of Epidemiology volume 27, pages 77–83 (2012)Cite this article

Abstract

Estimates of the average causal effect (ACE) of warfarin on the risk of bleeding may be confounded by indication as patients at high risk of bleeding are unlikely to be prescribed warfarin. One approach to estimating the ACE is inverse probability of treatment weighting (IPTW). This study was designed to examine the use of IPTW in this setting, and to demonstrate problems with the violation of the positivity assumption. We analyzed a case–control study on 4,028 cases of gastro-intestinal bleeding and 79,239 controls set in the United Kingdom’s General Practice Research Database. Warfarin exposure was defined as a prescription issued in the 90 days before the index date. Secondary analyses were conducted restricted to patients more likely to receive warfarin and with a truncated weight distribution, to exclude subjects highly unlikely to be treated. The estimated association between warfarin use and bleeding was stronger with IPTW [odds ratio (OR): 17.2; 95% confidence interval (CI): 6.5–37.7] than with a standard logistic regression model (OR: 2.1; 95% CI: 1.7–2.5). The presence of large weights (five subjects with stabilized weight >500) indicated a potential violation of the positivity assumption. In the restricted analysis, both IPTW (OR: 2.0; 95% CI: 0.4–9.6) and standard regression (OR: 1.6; 95% CI: 1.3–2.0) were compatible with a meta-analysis of randomized trials inverse probability of treatment weighting is sensitive to the positivity assumption; however, such sensitivity may assist in diagnosing off-support inference.

This is a preview of subscription content, access via your institution.

Access options

Buy single article

Instant access to the full article PDF.

USD 39.95

Price includes VAT (USA)
Tax calculation will be finalised during checkout.

Fig. 1

References

  1. Robins JM, Hernan MA, Brumback B. Marginal structural models and causal inference in epidemiology. Epidemiology. 2000;11(5):550–60.

    PubMed  Article  CAS  Google Scholar 

  2. Hernan MA, Brumback B, Robins JM. Marginal structural models to estimate the causal effect of zidovudine on the survival of HIV-positive men. Epidemiology. 2000;11(5):561–70.

    PubMed  Article  CAS  Google Scholar 

  3. Lefebvre G, Delaney JA, Platt RW. Impact of mis-specification of the treatment model on estimates from a marginal structural model. Stat Med. 2008;27(18):3629–42.

    PubMed  Article  Google Scholar 

  4. Cole SR, Hernan MA, Robins JM, Anastos K, Chmiel J, Detels R, Ervin C, Feldman J, Greenblatt R, Kingsley L, Lai S, Young M, Cohen M, Munoz A. Effect of highly active antiretroviral therapy on time to acquired immunodeficiency syndrome or death using marginal structural models. Am J Epidemiol. 2003;158(7):687–94.

    PubMed  Article  Google Scholar 

  5. Cole SR, Hernán MA. Constructing inverse probability weights for marginal structural models. Am J Epidemiol. 2008;168(6):656–64.

    PubMed  Article  Google Scholar 

  6. Mortimer KM, Neugebauer R, van der Laan M, Tager IB. An application of model-fitting procedures for marginal structural models. Am J Epidemiol. 2005;162(4):382–8.

    PubMed  Article  Google Scholar 

  7. Westreich D, Cole SR. Invited commentary: positivity in practice. Am J Epidemiol. 2010;171(6):674–7.

    PubMed  Article  Google Scholar 

  8. Hernán MA, Hernández-Diaz S, Robins JM. A structural approach to selection bias. Epidemiology. 2004;15:615–25.

    PubMed  Article  Google Scholar 

  9. Robins JM, Wang N. Inference for imputation estimators. Biometrika. 2000;87(1):113–24.

    Article  Google Scholar 

  10. Kang JD, Schafer JL. Demystifying double robustness: a comparison of alternative strategies for estimating a population mean from incomplete data. Stat Sci. 2007;22(4):523–39.

    Article  Google Scholar 

  11. Robins JM, Sued M, Lei-Gomez Q, Rotnitzky A. Performance of double-robust estimators when ‘inverse probability’ weights are highly variable. Stat Sci. 2007;22(4):544–59.

    Article  Google Scholar 

  12. Kurth T, Walker AM, Glynn RJ, Chan KA, Gaziano JM, Berger K, Robins JM. Results of multivariable logistic regression, propensity matching, propensity adjustment, and propensity-based weighting under conditions of nonuniform effect. Am J Epidemiol. 2006;163(3):262–70.

    PubMed  Article  Google Scholar 

  13. Messer LC, Oakes JM, Mason S. Effects of socioeconomic and racial residential segregation on preterm birth: a cautionary tale of structural confounding. Am J Epidemiol. 2010;171(6):664–73.

    PubMed  Article  Google Scholar 

  14. Imai K, King G, Stuart EA. Misunderstandings between experimentalists and observationalists about causal inference. J R Statist Soc A. 2008;171:481–502.

    Article  Google Scholar 

  15. Delaney JA, Opatrny L, Brophy JM, Suissa S. Drug–drug interactions between antithrombotic medications and the risk of gastrointestinal bleeding. CMAJ. 2007;177(4):347–51.

    PubMed  Article  Google Scholar 

  16. Kish L. Weighting for unequal Pi. J Off Stat. 1992;8(2):183–200.

    Google Scholar 

  17. Delaney JA, Moodie EE, Suissa S. Modeling blood pressures changes after drug treatment in the General Practice Research Database. Pharmacoepidemiol Drug Saf. 2008;17(6):535–45.

    PubMed  Article  Google Scholar 

  18. Marston L, Carpenter JR, Walters KR, Morris RW, Nazareth I, Petersen I. Issues in multiple imputation of missing data for large general practice clinical databases. Pharmacoepidemiol Drug Saf. 2010. doi:10.1002/pds.1934 (Epub ahead of print).

  19. Miettinen OS. Estimability and estimation in case-referent studies. Am J Epidemiol. 1976;103(2):226–35.

    PubMed  CAS  Google Scholar 

  20. Newman SC. Causal analysis of case–control data. Epidemiol Perspect Innov. 2006;3:2.

    PubMed  Article  Google Scholar 

  21. Månsson R, Joffe MM, Sun W, Hennessy S. On the estimation and use of propensity scores in case—control and case—cohort studies. Am J Epidemiol. 2007;166(3):332–9.

    PubMed  Article  Google Scholar 

  22. Robins JM. Comment on “Choice as an alternative to control in observational studies” by Paul Rosenbaum. Stat Sci. 1999;14:281–93.

    Google Scholar 

  23. Lip GY, Edwards SJ. Stroke prevention with aspirin, warfarin and ximelagatran in patients with non-valvular atrial fibrillation: a systematic review and meta-analysis. Thromb Res. 2006;118(3):321–33.

    PubMed  Article  CAS  Google Scholar 

  24. Filion KB, Delaney JA, Brophy JM, Ernst P, Suissa S. The impact of over-the-counter simvastatin on the number of statin prescriptions in the United Kingdom: a view from the General Practice Research Database. Pharmacoepidemiol Drug Saf. 2007;16(1):1–4.

    PubMed  Article  Google Scholar 

  25. Ray WA. Evaluating medication effects outside of clinical trials: new-user designs. Am J Epidemiol. 2003;158:915–20.

    PubMed  Article  Google Scholar 

  26. Delaney JA, Platt RW, Suissa S. The impact of unmeasured baseline effect modification on a marginal structural logistic model: a Monte Carlo study. Eur J Epidemiol. 2009;24:343–9.

    PubMed  Article  Google Scholar 

Download references

Acknowledgments

The authors thank Stephen Cole for comments on an earlier version of this work. This study was funded by the Canadian Institutes of Health Research (CIHR) and the Canadian Foundation for Innovation. Robert Platt holds a Chercheur-boursier award from the Fonds de Recherche en Sante du Quebec (FRSQ) and is a member of the Research Institute of the McGill University Health Centre, which receives operating funds from the FRSQ.

Conflict of interest

The authors declare no conflict of interest.

Ethical review

Ethical review for this study was done by the Independent Scientific Advisory Committee for MHRA database research.

Author information

Authors and Affiliations

  1. Department of Epidemiology, Biostatistics and Occupational Health, McGill University, Montreal, QC, Canada

    Robert William Platt & Samy Suissa

  2. Department of Pediatrics, McGill University, Montreal, QC, Canada

    Robert William Platt

  3. Department of Pharmaceutical Outcomes and Policy, College of Pharmacy, University of Florida, Gainesville, FL, USA

    Joseph Austin Christopher Delaney

  4. McGill Pharmacoepidemiology Research Unit, Jewish General Hospital, Montreal, QC, Canada

    Samy Suissa

  5. Department of Medicine, McGill University, Montreal, QC, Canada

    Samy Suissa

  6. Montréal Children’s Hospital Research Institute, 4060 Ste Catherine W #205, Montreal, QC, H3Z 2Z3, Canada

    Robert William Platt

Authors
  1. Robert William Platt
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Joseph Austin Christopher Delaney
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Samy Suissa
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Robert William Platt.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Platt, R.W., Delaney, J.A.C. & Suissa, S. The positivity assumption and marginal structural models: the example of warfarin use and risk of bleeding. Eur J Epidemiol 27, 77–83 (2012). https://doi.org/10.1007/s10654-011-9637-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10654-011-9637-7

Keywords

  • Causal modeling
  • Bias
  • Warfarin
  • Positivity assumption
  • Inverse probability weighting