No Credibility without Plausibility: a Response to Lewis and Lanier
In this commentary I respond to Lewis (2019) and Lanier (2019), building on their critiques and ideas, offering some additional thoughts about the dissemination of the Campbell, Rubin, and Pearl causal frameworks and their potential emergent value to the future of family violence research. I clarify that the central issue to credibility is the plausibility of assumptions, that some widely utilized methods often require researchers to make implausible assumptions, and that there is value to knowing and using all three frameworks.
KeywordsCausal inference Rubin causal framework Potential outcomes Directed acyclic graph DAG Pearl framework Campbell causal framework
The author appreciates the commentary provided by Dr. Paul Lanier, Dr. Michael Lewis, and an anonymous third review to the original article and the helpful comments of Rebecca J. Macy to an earlier draft of this response.
- Guo, S., & Fraser, M. W. (2015). Propensity score analysis: Statistical methods and applications (2nd ed.). Thousand Oaks, CA: Sage Publications.Google Scholar
- How to solve U.S. social problems when most rigorous program evaluations find disappointing effects (part two – A proposed solution). (April 13, 2018). Retrieved from: https://www.straighttalkonevidence.org/2018/04/13/how-to-solve-u-s-social-problems-when-most-rigorous-program-evaluations-find-disappointing-effects-part-two-a-proposed-solution/.
- Lanier, P. (2019). Frameworks of causal inference for improving intervention, prediction, and imagination in family violence research: A commentary on Rose (2019). Journal of Family Violence. Google Scholar
- Lewis, M. E. (2019). TITLE: A commentary on Rose (2019). Journal of Family Violence. Google Scholar
- Morgan, S. L. & Winship, C. (2014). Counterfactuals and causal inference: Methods and principles for social research (2nd ed.). New York: Cambridge University Press.Google Scholar
- Pearl, J. (2009). Causality: Models, reasoning, and inference (2nd ed.). Cambridge, UK: Cambridge University Press.Google Scholar
- Pearl, J., & MacKenzie, D. (2018). The book of why: The new science of cause and effect. NY: Basic Books.Google Scholar
- Rose, R. A. (2019). Frameworks for credible causal inference in observational studies of family violence. Journal of Family Violence. Google Scholar
- Shadish, W. R., Clark, M. H., & Steiner, P. M. (2008). Can nonrandomized experiments yield accurate answers? A randomized experiment comparing random and nonrandom assign- ments. Journal of the American Statistical Association, 103(484), 1353–1356. https://doi.org/10.1198/016214508000000733.CrossRefGoogle Scholar
- Vanderweele, T. (2015). Explanation in causal inference. NY: Oxford University Press.Google Scholar