Abstract
Causal inference concerns finding the treatment effect on subjects along with causal links between the variables and the outcome. However, the underlying heterogeneity between subjects makes the problem practically unsolvable. Additionally, we often need to find a subset of explanatory variables to understand the treatment effect. Currently, variable selection methods tend to maximise the predictive performance of the underlying model, and unfortunately, under limited data, the predictive performance is hard to assess, leading to harmful consequences. To address these issues, in this paper, we consider a robust Bayesian analysis which accounts for abstention in selecting explanatory variables in the high dimensional regression model. To achieve that, we consider a set of spike and slab priors through prior elicitation to obtain a set of posteriors for both the treatment and outcome model. We are specifically interested in the sensitivity of the treatment effect in high dimensional causal inference as well as identifying confounder variables. However, confounder selection can be deceptive in this setting, especially when a predictor is strongly associated with either the treatment or the outcome. To avoid that we apply a post-hoc selection scheme, attaining a smaller set of confounders as well as separate sets of variables which are only related to treatment or outcome model. Finally, we illustrate our method to show its applicability.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Rosenbaum, P.R., Rubin, D.B.: The central role of the propensity score in observational studies for causal effects. Biometrika 70(1), 41–55 (1983)
Robins, J.M.: A new approach to causal inference in mortality studies with a sustained exposure period-application to control of the healthy worker survivor effect. Math. Modell. 7, 1393–1512 (1986)
Rosenbaum, P.R., Rubin, D.B.: Constructing a control group using multivariate matched sampling methods that incorporate the propensity score. Am. Stat. 39(1), 33–38 (1985)
Winship, C., Morgan, S.L.: The estimation of causal effects from observational data. Ann. Rev. Sociol. 25(1), 659–706 (1999)
Stuart, E.A.: Matching methods for causal inference: a review and a look forward. Stat. Sci. 25(1), 1–21 (2010)
Rubin, D.B.: Bayesian inference for causal effects: the role of randomization. Ann. Stat. 6(1), 34–58 (1978)
Crainiceanu, C.M., Dominici, F., Parmigiani, G.: Adjustment uncertainty in effect estimation. Biometrika 95(3), 635–651 (2008)
Wang, C., Dominici, F., Parmigiani, G., Zigler, C.M.: Accounting for uncertainty in confounder and effect modifier selection when estimating average causal effects in generalized linear models. Biometrics 71(3), 654–665 (2015)
Zigler, C.M., Dominici, F.: Uncertainty in propensity score estimation: Bayesian methods for variable selection and model-averaged causal effects. J. Am. Stat. Assoc. 109(505), 95–107 (2014)
Hahn, P.R., Carvalho, C.M., Puelz, D., He, J.: Regularization and confounding in linear regression for treatment effect estimation. Bayesian Anal. 13(1), 163–182 (2018)
Koch, B., Vock, D.M., Wolfson, J., Vock, L.B.: Variable selection and estimation in causal inference using Bayesian spike and slab priors. Stat. Methods Med. Res. 29(9), 2445–2469 (2020)
Berger, J.O.: Robust Bayesian analysis: sensitivity to the prior. J. Stat. Plann. Infer. 25(3), 303–328 (1990)
Raices Cruz, I., Troffaes, M.C.M., Lindström, J., Sahlin, U.: A robust Bayesian bias-adjusted random effects model for consideration of uncertainty about bias terms in evidence synthesis. Stat. Med. 41(17), 3365–3379 (2022)
Ishwaran, H., Rao, J.S.: Spike and slab variable selection: frequentist and Bayesian strategies. Ann. Statist. 33(2), 730–773 (2005)
Xu, X., Ghosh, M.: Bayesian variable selection and estimation for group lasso. Bayesian Anal. 10(4), 909–936 (2015)
Hahn, P.R., Carvalho, C.M.: Decoupling shrinkage and selection in Bayesian linear models: a posterior summary perspective. J. Am. Stat. Assoc. 110(509), 435–448 (2015)
Heckman, J.J., Robb, R.: Alternative methods for evaluating the impact of interventions: an overview. J. Econometrics 30(1), 239–267 (1985)
Albert, J.H., Chib, S.: Bayesian analysis of binary and polychotomous response data. J. Am. Stat. Assoc. 88(422), 669–679 (1993)
Zou, H.: The adaptive lasso and its oracle properties. J. Am. Stat. Assoc. 101(476), 1418–1429 (2006)
Zaffalon, M., Corani, G., Mauá, D.: Evaluating credal classifiers by utility-discounted predictive accuracy. Int. J. Approx. Reason. 53(8), 1282–1301 (2012). Imprecise Probability: Theories and Applications (ISIPTA 2011)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Basu, T., Troffaes, M.C.M., Einbeck, J. (2024). A Robust Bayesian Approach for Causal Inference Problems. In: Bouraoui, Z., Vesic, S. (eds) Symbolic and Quantitative Approaches to Reasoning with Uncertainty. ECSQARU 2023. Lecture Notes in Computer Science(), vol 14294. Springer, Cham. https://doi.org/10.1007/978-3-031-45608-4_27
Download citation
DOI: https://doi.org/10.1007/978-3-031-45608-4_27
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-45607-7
Online ISBN: 978-3-031-45608-4
eBook Packages: Computer ScienceComputer Science (R0)