In a recent issue of the American Journal of Public Health, Hernán and other colleagues strongly plea for causal thinking in scientific research where the research question investigates consequences of decisions and interventions (Ahern 2018; Begg and March 2018; Chiolero 2018; Glymour and Hamad 2018; Hernán 2018a, b; Jones and Schooling 2018). Hernán argues that causal reasoning improves quality of observational research; however, the causal terminology is often loomed by the ‘association is not causation’ argument and is viewed with skepticism (Hernán 2018b). Health services research (HSR) supports decision making by investigating the effect of complex ‘interventions’ or ‘policies’ on different healthcare system outcomes (Glass et al. 2013). Thus, some of the research questions in HSR are inherently causal. Surprisingly, there is no consensus on how to integrate causal inference into tasks of HSR (Dowd 2011; O’Malley 2011; Pearl 2011; Hernán et al. 2019). Typically, tasks in data science are classified into ‘description’, ‘modeling’ and ‘causal inference’ (Hernán et al. 2019). In the present Hints and Kinks, we explain why a solidly principled causal inference framework should be integrated into the tasks of HSR.
Tasks in health services research
Table 1 shows three examples of healthcare system interventions (HSIs). We use those examples to highlight the differences between the ‘core’ tasks in HSR.
The first example in Table 1 mentions the shift from inpatient to outpatient care, which has been successfully implemented in many low- and high-income countries (Yuan et al. 2017; Vogenberg and Santilli 2018; Bhatt and Bathija 2018). Switzerland, for example, published a list of mandatory outpatient treatments and surgeries in 2019 (Swiss Federal Office of Public Health 2019). As outpatient surgeries come with lower (official) reimbursement values, this shift will result automatically in lower reimbursement costs. But it might come with more complications such as surgical site infections which might add downstream costs. Such a HSI requires that involved stakeholders (for example, hospitals and health insurers), policy makers (for example, the government and regulators) and the public (i.e., patients and medical personnel) are informed about the status quo of the current healthcare system–in this example—of selected inpatient and outpatient treatments for a comparison. Obviously, they need a ‘description’ of population outcomes, say, rates of meniscectomy procedures. The ‘description’ of a study population and population outcomes is unquestioned a main task in HSR.
The second example in Table 1 is about task shifting, i.e., the shift of selected healthcare tasks among healthcare professionals. For example, nurses perform certain post-surgical treatments more efficiently than medical doctors. Task shifting has been implemented in low-, middle- and high-income countries worldwide (Ogedegbe et al. 2014; Seidman and Atun 2017; Orkin et al. 2019). Involved aspects of HSR in this HSI include the role of medical personnel and patients in shared decision making processes, hospitals as policy makers which implement work policies, but also authorities for ensuring patient safety and quality of treatments. Besides a ‘description’ of how often healthcare tasks are performed by different medical personnel, it is also of interest which predictors are associated (say, skill-grade) with a specific healthcare outcome (say, length of hospital stay). In brief, ‘description’ summarizes the study setting, whereas ‘modeling’ quantifies associations among a study outcome and certain characteristics to make predictions for other–possibly future—settings (Hernán et al. 2019). There is no doubt that to ‘describe’ and to ‘model’ are important tasks in HSR. But, obviously, answering the questions in the first two columns of Table 1 only in part supports decision making—a process of actions or ‘doing’ (Pearl 2009)—which is ultimately linked to a causal ‘what-if’ question: What is the effect of an intervention when everything happened under a situation, say A, versus when everything happened under a situation B. Let us consider the third example in Table 1, which focuses on hospital mergers, for a better explanation. Over the past years, consolidation efforts between hospitals have been implemented in many countries to optimize patient treatments, quality outcomes and economic outcomes (Kristensen et al. 2010; Hayford 2012; Giancotti et al. 2017). Let us consider in the following the situation that two hospitals merged. A natural question for stakeholders (i.e., a hospital group) and policy makers (i.e., health system authorities and regulators) is then: What would have happened to the outcome of quality indicators (say, hospital readmissions) when the merger would not have been implemented? For a hospital group this is a key question to justify a consolidation effort, whereas for authorities and regulators an answer to this question is needed for health system planning and evaluation, but actually is not available when the decisions need to be taken. Importantly, such a question moves away from ‘observing’ or ‘modeling’ to a situation of ‘understanding’ the effect of an action, i.e., what is the effect of the hospital merger on quality outcomes? This is a causal question and can often not be answered by associational effect summaries from ‘descriptive’ or ‘modeling’ approaches.
The need for a causal inference framework in health services research
Unfortunately, public health decisions on interventions or policies are often only based on ‘descriptive’ and ‘modeled’ results, without the integration of a solidly principled causal inference framework. Despite both, ‘traditional’ and ‘causal inference’, approaches have their proper legitimation in the investigation of specific research questions, many researchers and students in the field of HSR are not trained to the notions of causal inference. Modern causal inference identifies effects of interventions by using the concept of counterfactuals, which are a key component of a causal inference framework (Hernán 2004; Glass et al. 2013; Zwahlen and Salanti 2018). A counterfactual outcome is an outcome which is ‘counter to the fact’, that is, a hypothetical outcome which is actually not observed (Rubin 1974; Hernán 2004). In the example of the above hospital merger, one likes to compare the actual—under the situation of the hospital merger–observed hospital readmissions with hospital readmissions when the hospital merger would not have been implemented, i.e., outcomes which are actually never observed. Counterfactuals allow to mathematically define a causal effect, which is conceptually different from an associational effect. In a follow-up Hint and Kinks, we continue on the introduction of a principled framework for causal inference in HSR (Moser et al. 2020).
As Hernán and others, we believe that causal reasoning plays an important role in HSR to support public health decision making. This can only be done by using an explicit ‘causal inference’ framework, besides the traditional tasks of ‘description’ and ‘modeling’. None of these tasks should be viewed superior to another, but each should be adequately chosen, related to the intended research question (Hernán et al. 2019). Unfortunately, the concept of causal inference is not a regular part in the curriculum of researchers (Dowd 2011; Glass et al. 2013; Begg and March 2018; Chiolero 2018). We plea for an integration of causal concepts in the education of health services researchers, epidemiologists, public health practitioners, and other related professions, to foster future HSR.
Ahern J (2018) Start with the ‘C-Word’ follow the roadmap for causal inference. Am J Public Health 108:621. https://doi.org/10.2105/AJPH.2018.304358
Begg MD, March D (2018) Cause and association: missing the forest for the trees. Am J Public Health 108:620. https://doi.org/10.2105/AJPH.2018.304366
Bhatt J, Bathija P (2018) Ensuring access to quality health care in vulnerable communities. Acad Med 93:1271–1275. https://doi.org/10.1097/ACM.0000000000002254
Chiolero A (2018) Data are not enough-hurray for causality! Am J Public Health 108:622. https://doi.org/10.2105/AJPH.2018.304379
Dowd BE (2011) Separated at birth: statisticians, social scientists, and causality in health services research. Health Serv Res 46:397–420. https://doi.org/10.1111/j.1475-6773.2010.01203.x
Giancotti M, Guglielmo A, Mauro M (2017) Efficiency and optimal size of hospitals: results of a systematic search. PLoS ONE 12:e0174533. https://doi.org/10.1371/journal.pone.0174533
Glass TA, Goodman SN, Hernán MA, Samet JM (2013) Causal inference in public health. Annu Rev Public Health 34:61–75. https://doi.org/10.1146/annurev-publhealth-031811-124606
Glymour MM, Hamad R (2018) Causal thinking as a critical tool for eliminating social inequalities in health. Am J Public Health 108:623. https://doi.org/10.2105/AJPH.2018.304383
Hayford TB (2012) The impact of hospital mergers on treatment intensity and health outcomes. Health Serv Res 47:1008–1029. https://doi.org/10.1111/j.1475-6773.2011.01351.x
Hernán MA (2004) A definition of causal effect for epidemiological research. J Epidemiol Community Health 58:265–271. https://doi.org/10.1136/jech.2002.006361
Hernán M (2018a) The C-word: the more we discuss it, the less dirty it sounds. Am J Public Health 108:625–626. https://doi.org/10.2105/AJPH.2018.304392
Hernán MA (2018b) The C-word: scientific euphemisms do not improve causal inference from observational data. Am J Public Health 108:616–619. https://doi.org/10.2105/AJPH.2018.304337
Hernán MA, Hsu J, Healy B (2019) A second chance to get causal inference right: a classification of data science tasks. Chance 32:42–49. https://doi.org/10.1080/09332480.2019.1579578
Jones HE, Schooling CM (2018) Let’s require the “T-Word”. Am J Public Health 108:624. https://doi.org/10.2105/AJPH.2018.304365
Kristensen T, Bogetoft P, Pedersen KM (2010) Potential gains from hospital mergers in Denmark. Health Care Manag Sci 13:334–345. https://doi.org/10.1007/s10729-010-9133-8
Moser A, Puhan MA, Zwahlen M (2020) The role of causal inference in health services research II: a framework for causal inference. Int J Public Health. https://doi.org/10.1007/s00038-020-01334-1
O’Malley J (2011) Commentary on Bryan Dowd’s Paper ‘“Separated at Birth: statisticians, social scientists, and causality in health services research”. Health Serv Res 46:430–436. https://doi.org/10.1111/j.1475-6773.2010.01203.x
Ogedegbe G, Gyamfi J, Plange-Rhule J et al (2014) Task shifting interventions for cardiovascular risk reduction in low-income and middle-income countries: a systematic review of randomised controlled trials. BMJ Open 4:e005983. https://doi.org/10.1136/bmjopen-2014-005983
Orkin AM, McArthur A, Venugopal J et al (2019) Defining and measuring health equity in research on task shifting in high-income countries: a systematic review. SSM Popul Heal 7:100366. https://doi.org/10.1016/j.ssmph.2019.100366
Pearl J (2009) Causality. Cambridge University Press, Cambridge
Pearl J (2011) Statistics and causality: separated to reunite-commentary on Bryan Dowd’s “separated at Birth”. Health Serv Res 46:421–429. https://doi.org/10.1111/j.1475-6773.2011.01243.x
Rubin DB (1974) Estimating causal effects of treatments in randomized and nonrandomized studies. J Educ Psychol 66:688–701
Seidman G, Atun R (2017) Does task shifting yield cost savings and improve efficiency for health systems? A systematic review of evidence from low-income and middle-income countries. Hum Resour Health 15:29. https://doi.org/10.1186/s12960-017-0200-9
Swiss Federal Office of Public Health (2019) Änderung der Krankenpflege-Leistungsverordnung (KLV) betreffend “Ambulant vor Stationär.” https://www.bag.admin.ch/bag/de/home/themen/versicherungen/krankenversicherung/krankenversicherung-revisionsprojekte/konsultation-ambulant-vor-stationaer.html. Accessed 19 Sep 2019
Vogenberg FR, Santilli J (2018) Healthcare trends for 2018. Am Heal drug Benefits 11:48–54
Yuan B, He L, Meng Q, Jia L (2017) Payment methods for outpatient care facilities. Cochrane Database Syst Rev. https://doi.org/10.1002/14651858.CD011153.pub2
Zwahlen M, Salanti G (2018) Causal inference from experiment and observation. Evid Based Ment Heal 21:34–38. https://doi.org/10.1136/eb-2017-102859
Conflict of interest
The authors declare that they have no conflict of interest.
This article does not contain any studies with human participants performed by any of the authors.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Moser, A., Puhan, M.A. & Zwahlen, M. The role of causal inference in health services research I: tasks in health services research. Int J Public Health (2020). https://doi.org/10.1007/s00038-020-01333-2