Evidence-based policy: what’s to be done about relevance?
How can philosophy of science be of more practical use? One thing we can do is provide practicable advice about how to determine when one empirical claim is relevant to the truth of another; i.e., about evidential relevance. This matters especially for evidence-based policy, where advice is thin—and misleading—about how to tell what counts as evidence for policy effectiveness. This paper argues that good efficacy results (as in randomized controlled trials), which are all the rage now, are only a very small part of the story. To tell what facts are relevant for judging policy effectiveness, we need to construct causal scenarios about will happen when the policy is implemented.
KeywordsEvidence Evidence-based policy Evidential relevance Randomized controlled trials Efficacy Effectiveness
- Achinstein, P. (1983). The nature of explanation. Oxford: Oxford University Press.Google Scholar
- Borhnstedt, G. W., & Stecher, B. M. (Eds.). (2002). What we have learned about class size reduction in California. CA, USA: California Department of Education.Google Scholar
- Cartwright, N. (1989). Nature’s capacities and their measurement. Oxford: Oxford University Press.Google Scholar
- Cartwright, N. (2007). Hunting causes and using them: Approaches in philosophy and economics. Cambridge: Cambridge University Press.Google Scholar
- Cartwright, N. (2009) What is this thing called efficacy. In C. Mantzavinos (Ed.), Philosophy of the social sciences. Philosophical theory and scientific practice. Cambridge: Cambridge University Press (to appear).Google Scholar
- U.S. Department of Education Institute of Education Sciences National Center for Education Evaluation and Regional Assistance (2003). Identifying and implementing educational practices supported by rigorous evidence: A user friendly guide. http://www.ed.gov/rschstat/research/pubs/rigorousevid/rigorousevid.pdf.