Skip to main content

A Robust Bayesian Approach for Causal Inference Problems

  • Conference paper
  • First Online:
Symbolic and Quantitative Approaches to Reasoning with Uncertainty (ECSQARU 2023)

Abstract

Causal inference concerns finding the treatment effect on subjects along with causal links between the variables and the outcome. However, the underlying heterogeneity between subjects makes the problem practically unsolvable. Additionally, we often need to find a subset of explanatory variables to understand the treatment effect. Currently, variable selection methods tend to maximise the predictive performance of the underlying model, and unfortunately, under limited data, the predictive performance is hard to assess, leading to harmful consequences. To address these issues, in this paper, we consider a robust Bayesian analysis which accounts for abstention in selecting explanatory variables in the high dimensional regression model. To achieve that, we consider a set of spike and slab priors through prior elicitation to obtain a set of posteriors for both the treatment and outcome model. We are specifically interested in the sensitivity of the treatment effect in high dimensional causal inference as well as identifying confounder variables. However, confounder selection can be deceptive in this setting, especially when a predictor is strongly associated with either the treatment or the outcome. To avoid that we apply a post-hoc selection scheme, attaining a smaller set of confounders as well as separate sets of variables which are only related to treatment or outcome model. Finally, we illustrate our method to show its applicability.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 79.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 99.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Rosenbaum, P.R., Rubin, D.B.: The central role of the propensity score in observational studies for causal effects. Biometrika 70(1), 41–55 (1983)

    Article  MathSciNet  MATH  Google Scholar 

  2. Robins, J.M.: A new approach to causal inference in mortality studies with a sustained exposure period-application to control of the healthy worker survivor effect. Math. Modell. 7, 1393–1512 (1986)

    Article  MathSciNet  MATH  Google Scholar 

  3. Rosenbaum, P.R., Rubin, D.B.: Constructing a control group using multivariate matched sampling methods that incorporate the propensity score. Am. Stat. 39(1), 33–38 (1985)

    Google Scholar 

  4. Winship, C., Morgan, S.L.: The estimation of causal effects from observational data. Ann. Rev. Sociol. 25(1), 659–706 (1999)

    Article  Google Scholar 

  5. Stuart, E.A.: Matching methods for causal inference: a review and a look forward. Stat. Sci. 25(1), 1–21 (2010)

    Article  MathSciNet  MATH  Google Scholar 

  6. Rubin, D.B.: Bayesian inference for causal effects: the role of randomization. Ann. Stat. 6(1), 34–58 (1978)

    Article  MathSciNet  MATH  Google Scholar 

  7. Crainiceanu, C.M., Dominici, F., Parmigiani, G.: Adjustment uncertainty in effect estimation. Biometrika 95(3), 635–651 (2008)

    Article  MathSciNet  MATH  Google Scholar 

  8. Wang, C., Dominici, F., Parmigiani, G., Zigler, C.M.: Accounting for uncertainty in confounder and effect modifier selection when estimating average causal effects in generalized linear models. Biometrics 71(3), 654–665 (2015)

    Article  MathSciNet  MATH  Google Scholar 

  9. Zigler, C.M., Dominici, F.: Uncertainty in propensity score estimation: Bayesian methods for variable selection and model-averaged causal effects. J. Am. Stat. Assoc. 109(505), 95–107 (2014)

    Article  MathSciNet  Google Scholar 

  10. Hahn, P.R., Carvalho, C.M., Puelz, D., He, J.: Regularization and confounding in linear regression for treatment effect estimation. Bayesian Anal. 13(1), 163–182 (2018)

    Article  MathSciNet  MATH  Google Scholar 

  11. Koch, B., Vock, D.M., Wolfson, J., Vock, L.B.: Variable selection and estimation in causal inference using Bayesian spike and slab priors. Stat. Methods Med. Res. 29(9), 2445–2469 (2020)

    Article  MathSciNet  Google Scholar 

  12. Berger, J.O.: Robust Bayesian analysis: sensitivity to the prior. J. Stat. Plann. Infer. 25(3), 303–328 (1990)

    Article  MathSciNet  MATH  Google Scholar 

  13. Raices Cruz, I., Troffaes, M.C.M., Lindström, J., Sahlin, U.: A robust Bayesian bias-adjusted random effects model for consideration of uncertainty about bias terms in evidence synthesis. Stat. Med. 41(17), 3365–3379 (2022)

    Article  MathSciNet  Google Scholar 

  14. Ishwaran, H., Rao, J.S.: Spike and slab variable selection: frequentist and Bayesian strategies. Ann. Statist. 33(2), 730–773 (2005)

    Article  MathSciNet  MATH  Google Scholar 

  15. Xu, X., Ghosh, M.: Bayesian variable selection and estimation for group lasso. Bayesian Anal. 10(4), 909–936 (2015)

    Article  MathSciNet  MATH  Google Scholar 

  16. Hahn, P.R., Carvalho, C.M.: Decoupling shrinkage and selection in Bayesian linear models: a posterior summary perspective. J. Am. Stat. Assoc. 110(509), 435–448 (2015)

    Article  MathSciNet  MATH  Google Scholar 

  17. Heckman, J.J., Robb, R.: Alternative methods for evaluating the impact of interventions: an overview. J. Econometrics 30(1), 239–267 (1985)

    Article  MATH  Google Scholar 

  18. Albert, J.H., Chib, S.: Bayesian analysis of binary and polychotomous response data. J. Am. Stat. Assoc. 88(422), 669–679 (1993)

    Article  MathSciNet  MATH  Google Scholar 

  19. Zou, H.: The adaptive lasso and its oracle properties. J. Am. Stat. Assoc. 101(476), 1418–1429 (2006)

    Article  MathSciNet  MATH  Google Scholar 

  20. Zaffalon, M., Corani, G., Mauá, D.: Evaluating credal classifiers by utility-discounted predictive accuracy. Int. J. Approx. Reason. 53(8), 1282–1301 (2012). Imprecise Probability: Theories and Applications (ISIPTA 2011)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Tathagata Basu .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Basu, T., Troffaes, M.C.M., Einbeck, J. (2024). A Robust Bayesian Approach for Causal Inference Problems. In: Bouraoui, Z., Vesic, S. (eds) Symbolic and Quantitative Approaches to Reasoning with Uncertainty. ECSQARU 2023. Lecture Notes in Computer Science(), vol 14294. Springer, Cham. https://doi.org/10.1007/978-3-031-45608-4_27

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-45608-4_27

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-45607-7

  • Online ISBN: 978-3-031-45608-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics