, Volume 27, Issue 1, pp 1–13 | Cite as

A Challenge for Evidence-Based Policy

  • Adam La Caze
  • Mark Colyvan
Original Paper


Evidence-based policy has support in many areas of government and in public affairs more generally. In this paper we outline what evidence-based policy is, then we discuss its strengths and weaknesses. In particular, we argue that it faces a serious challenge to provide a plausible, over-arching account of evidence. We contrast evidence-based policy with evidence-based medicine, especially the role of evidence in assessing the effectiveness of medicines. The evidence required for policy decisions does not easily lend itself to randomized controlled trials (the “gold standard” in evidence-based medicine), nor, for that matter, being listed in a single all-purpose hierarchy.


Evidence Evidence-based policy Evidence-based medicine Randomized controlled trials Public policy 



An early version of this paper was presented at the 2009 Sydney-Tilburg Philosophy of Science Conference: ‘Evidence, Science, and Public Policy’ held at The University of Sydney, 26–28 March 2009. We’d like to thank the audience at that conference for fruitful discussion and several very helpful suggestions. We are also grateful to the referees of this journal for helpful suggestions.


  1. Angrist JD, Pischke JS (2010) The credibility revolution in empirical economics: how better research design is taking the con out of econometrics. J Econ Perspect 24(2):3–30CrossRefGoogle Scholar
  2. Bluhm R (2005) From hierarchy to network: a richer view of evidence for evidence-based medicine. Perspect Biol Med 48(4):535–547CrossRefGoogle Scholar
  3. Bohrnstedt GW, Stecher BM (eds) (2002) What we have learned about class size reduction. California Department of Education, SacrementoGoogle Scholar
  4. Bornstein SR, Licinio J (2011) Improving the efficacy of translational medicine by optimally integrating health care, academia and industry. Nat Med 12:1567–1569CrossRefGoogle Scholar
  5. Cartwright N (2007) Are RCTs the gold standard? BioSocieties 2:11–20CrossRefGoogle Scholar
  6. Cartwright N (2009) Evidence-based policy: What’s to be done about relevance? Philos Stud 143(1):127–136CrossRefGoogle Scholar
  7. Cartwright N (2011) Predicting what will happen when we act. What counts for warrant? Prev Med 53(4–5):221–224CrossRefGoogle Scholar
  8. Cartwright N, Hardie J (2012) Evidence-based policy: a practical guide to doing it better. Oxford University Press, OxfordCrossRefGoogle Scholar
  9. Clarke B, Gillies D, Illari P, Russo F, Williamson J (2013) The evidence that evidence-based medicine omits. Prev Med 57:745–747CrossRefGoogle Scholar
  10. Clarke B, Gillies D, Illari P, Russo F, Williamson J (2014) Mechanisms and the evidence hierarchy. Topoi 33(2):339–360CrossRefGoogle Scholar
  11. Colyvan M, Justus J, Regan HM (2011) The conservation game. Biol Conserv 144(4):1246–1253CrossRefGoogle Scholar
  12. Davies HTO, Nutley SM, Smith PC (eds) (2000a) What works?: evidence based policy and practice in public services. Policy Press, BristolGoogle Scholar
  13. Davies HTO, Nutley SM, Tilley N (2000b) Debates on the role of experimentation. In: Davies HTO, Nutley SM, Smith PC (eds) What works?: evidence based policy and practice in public services. Policy Press, Bristol, pp 251–276Google Scholar
  14. Douglas H (2009) Science, policy, and the value-free ideal. University of Pittsburgh Press, PittsburghGoogle Scholar
  15. Druker B, Talpaz M, Resta D et al (2001) Efficacy and safety of a specific inhibitor of the BCR-ABL tyrosine kinase in chronic myeloid leukemia. New Engl J Med 344(14):1031–1037CrossRefGoogle Scholar
  16. Evidence-Based Medicine Working Group (1992) Evidence-based medicine: a new approach to teaching the practice of medicine. J Am Med Assoc 268(17):2420–2425CrossRefGoogle Scholar
  17. Glass GV, Cahen LS, Smith ML, Filby NN (1982) School class size: research and policy. Sage Publications, Beverly HillsGoogle Scholar
  18. Greenhalgh T (2012) Why do we always end up here? Evidence-based medicine’s conceptual cul-de-sacs and some off-road alternative routes. J Prim Health Care 4(2):92–97Google Scholar
  19. Grossman J, Mackenzie FJ (2005) The randomized controlled trial: gold standard, or merely standard? Perspect Biol Med 48(4):516–534CrossRefGoogle Scholar
  20. Head BW (2008) Three lenses of evidence-based policy. Aust J Public Adm 67(1):1–11CrossRefGoogle Scholar
  21. Head BW (2010) Reconsidering evidence-based policy: key issues and challenges. Policy Soc 29(2):77–94CrossRefGoogle Scholar
  22. Hutton J, Smith PC (2000) Non-experimental quantitative methods. In: Davies HTO, Nutley SM, Smith PC (eds) What works?: evidence based policy and practice in public services. Policy Press, Bristol, pp 277–290Google Scholar
  23. La Caze A (2008) Evidence based medicine can’t be…. Soc Epistemol 22(4):353–370CrossRefGoogle Scholar
  24. La Caze A (2009) Evidence based medicine must be …. J Philos Med 34:509–527CrossRefGoogle Scholar
  25. Leamer EE (1983) Let’s take the con out of econometrics. Am Econ Rev 73(1):31–43Google Scholar
  26. Lindenmayer DB, Hulvey KB, Hobbs RJ, Colyvan M, Felton A, Possingham H, Steffen W, Wilson K, Youngentob K, Gibbons P (2012) Avoiding bio-perversity from carbon sequestration solutions. Conserv Lett 5(1):28–36CrossRefGoogle Scholar
  27. Lyseng-Williamson K, Jarvis B (2001) Imatinib. Drugs 61(12):1765–1774CrossRefGoogle Scholar
  28. Macintyre S, Chalmers I, Horton R, Smith R (2001) Using evidence to inform health policy: case study. Br Med J 322(7280):222–225CrossRefGoogle Scholar
  29. Montuschi E (2009) Questions of evidence in evidence-based policy. Axiomathes 19(4):425–439CrossRefGoogle Scholar
  30. Mosteller F (1995) The Tennessee study of class size in the early school grades. Future Child 5(2):113–127CrossRefGoogle Scholar
  31. Nutley SM, Webb J (2000) Evidence and the policy process. In: Davies HTO, Nutley SM, Smith PC (eds) What works?: evidence based policy and practice in public services. Policy Press, Bristol, pp 13–42Google Scholar
  32. O’Brien S, Guilhot F, Larson R, Gathmann I, Baccarani M, Cervantes F et al (2003) Imatinib compared with interferon and low-dose cytarabine for newly diagnosed chronic-phase chronic myeloid leukemia. New Engl J Med 348(11):994–1004CrossRefGoogle Scholar
  33. Osimani B (2014) Hunting side effects and explaining them: Should we reverse evidence hierarchies upside down? Topoi 33(2):295–312CrossRefGoogle Scholar
  34. Rawlins MD (2008) De testimonio: on the use of evidence for decisions about the use of therapeutic interventions. Lancet 372(9656):2152–2161CrossRefGoogle Scholar
  35. Roush S (2009) Randomized controlled trials and the flow of information: comment on Cartwright. Philos Stud 143(1):137–145CrossRefGoogle Scholar
  36. Skyrms B (2004) The stag hunt and the evolution of the social contract. Cambridge University Press, CambridgeGoogle Scholar
  37. Society for Prevention Research (2004) Standards of evidence: criteria for efficacy, effectiveness and dissemination. Accessed 25 Nov 2013
  38. Steel D (2004) Social mechanisms and causal inference. Philos Soc Sci 34(1):55–78CrossRefGoogle Scholar
  39. Walters CJ (1986) Adaptive management of renewable resources. MacMillan, New YorkGoogle Scholar
  40. Worrall J (2002) What evidence in evidence-based medicine? Philos Sci 69:S316–S330CrossRefGoogle Scholar
  41. Worrall J (2007) Evidence in medicine and evidence-based medicine. Philos Compass 2(6):981–1022CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media Dordrecht 2016

Authors and Affiliations

  1. 1.School of PharmacyUniversity of QueenslandBrisbaneAustralia
  2. 2.Sydney Centre for the Foundations of ScienceUniversity of SydneySydneyAustralia

Personalised recommendations