The Consistencies and Vagaries of the Washington State Inventory of Evidence-Based Practice: The Definition of “Evidence-Based” in a Policy Context
As states increasingly establish the importance of evidence-based practice through policy and funding mandates, the definition of evidence-based practice can have a significant impact on investment decisions. Not meeting established criteria can mean a loss of funding for established programs and the implementation disruption of programs without a strong research base. Whether the definition of “evidence-based” is influenced by these high stakes contexts is an interesting question that can inform the larger field about the value and utility of evidence-based practice lists/inventories for disseminating knowledge. In this paper we review the development of the Washington State Inventory of Evidence-Based, Research-Based and Promising Practices as a case study for the process of defining evidence-based practice in a policy context. As part of this study we also present a comparison of other well-known evidence-based practice inventories and examine consistencies and differences in the process of identifying and developing program ratings.
KeywordsEvidence-based practice Inventories Policy
- Aarons, G. A., Fettes, D. L., Hurlburt, M. S., Palinkas, L. A., Gunderson, L., Willging, C. E., & Chaffin, M. J. (2014). Collaboration, negotiation, and coalescence for interagency-collaborative teams to scale-up evidence-based practice. Journal of Clinical Child & Adolescent Psychology, 5, 1–14.Google Scholar
- Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011). Advancing a conceptual model of evidence-based practice implementation in public service sectors. Administration and Policy in Mental Health and Mental Health Services, 38(1), 4–23. doi: http://dx.doi.org/10.1007/s10488-010-0327-7.
- Aos, S., Miller, M., & Drake, E. (2006). Evidence-based public policy options to reduce future prison construction, criminal justice costs, and crime rates. Olympia: Washington State Institute of Public Policy.Google Scholar
- Beidas, R. S., Edmunds, J., Ditty, M., Watkins, J., Walsh, L., Marcus, S., & Kendall, P. (2013). Are inner context factors related to implementation outcomes in cognitive-behavioral therapy for youth anxiety? Administration and Policy in Mental Health and Mental Health Services Research, 2.Google Scholar
- Bumbarger, B., & Campbell, E. (2012). A state agency-university partnership for translational research and the dissemination of evidence-based prevention and intervention. Administration and Policy in Mental Health and Mental Health Services Research, 39(4), 268–277. doi: 10.1007/s10488-011-0372-x.CrossRefPubMedGoogle Scholar
- Chambless, D. L., Sanderson, W. C., Shoham, V., Bennett Johnson, S., & Pope, K. S. (1996). An update on empirically validated therapies. Clinical Psychology, 49(2), 5–18.Google Scholar
- Fixsen, D. L., Naoom, S. F., Blase, K. A., Friedman, R. M., & Wallace, F. (2005). Implementation research: A synthesis of the literature. Tampa, FL: University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network.Google Scholar
- Guyatt, G., Rennie, D., Meade, M., & Cook, D. (2008). Preface to users’ guides to the medical literature. In Essentials of evidence-based clinical practice (2nd ed.). New York: McGraw-Hill. http://jamaevidence.com/resource/preface/520.
- Hawkins, J., & Catalano, F. (1992). Communities that care: Action for drug abuse prevention. San Francisco: Jossey-Bass Publishers.Google Scholar
- Henggeler, S. W., Melton, G. B., Brondino, M. J., Scherer, D. G., & Hanley, J. H. (1997). Multisystemic therapy with violent and chronic juvenile offenders and their families: The role of treatment fidelity in successful dissemination. Journal of Consulting and Clinical Psychology, 65(5), 821–833.CrossRefPubMedGoogle Scholar
- Hoagwood, K. E., Olin, S. S., Horwitz, S., Cleek, A., Gleacher, A., Lewandowski, E., & Hogan, M. (2014). Scaling up evidence-based practices for children and families in New York State: Toward evidence-based policies on implementation for state mental health systems. Journal of Child Clinical and Adolescent Psychology, 43(2), 145–157. doi: 10.1080/15374416.2013.869749.CrossRefGoogle Scholar
- Larios, S. E., Wright, S., Jernstrom, A., Lebron, D., & Sorensen, J. L. (2011). Evidence-based practices, attitudes, and beliefs in substance abuse treatment programs serving American Indians and Alaska Natives: A qualitative study. Journal of Psychoactive Drugs, 43(4), 355–359. doi: 10.1080/02791072.2011.629159.CrossRefPubMedPubMedCentralGoogle Scholar
- Lipsey, M. W., Howell, J. C., Kelly, M. R., Chapman, G., & Carver, D. (2010). Improving the effectiveness of juvenile justice programs: A new perspective on evidence-based practice. Washington, DC: Center for Juvenile Justice Reform, Georgetown University. http://cjjr.georgetown.edu/pdfs/ebp/ebppaper.pdf.Google Scholar
- Lipsey, M. W., Howell, J. C., & Tidd, S. T. (2007). The standardized program evaluation protocol (SPEP): A practical approach to evaluating and improving juvenile justice programs in North Carolina. Final evaluation report. Nashville: Vanderbilt University, Center for Evaluation Research and Methodology.Google Scholar
- Lyon, A. R., Lau, A. S., McCauley, E., Vander Stoep, A., & Chorpita, B. F. (2014). A case for modular design: Implications for implementing evidence-based interventions with culturally diverse youth. Professional Psychology: Research and Practice, 45(1), 57–66. doi: 10.1037/a0035301.CrossRefGoogle Scholar
- Mihalic Sf, F. A. A. A. S. (2008). Implementing the life skills Training drug prevention program: Factors related to implementation fidelity (p. 3). Implementation Science: IS.Google Scholar
- Porter, D. (2013). Aggression replacement training: A comprehensive intervention for aggressive youth. School of Social Work Journal, 37(2), 113–114.Google Scholar
- Powell, B. J., McMillen, J. C., Proctor, E. K., Carpenter, C. R., Griffey, R. T., Bunger, A. C., & York, J. L. (2012). A compilation of strategies for implementing clinical innovations in health and mental health. Medical Care Research and Review, 69(2), 123–157. doi: 10.1177/1077558711430690.CrossRefPubMedGoogle Scholar
- Proctor, E. K., Landsverk, J., Aarons, G., Chambers, D., Glisson, C., & Mittman, B. (2009). Implementation research in mental health services: An emerging science with conceptual, methodological, and training challenges. Administration & Policy in Mental Health & Mental Health Services Research, 36(1), 24–34. doi: 10.1007/s10488-008-0197-4.CrossRefGoogle Scholar
- Rubin, A. (2008). Practitioner’s guide to using research for evidence-based practice. Hoboken, NJ: Wiley.Google Scholar
- Sackett, D. L. (2000). Evidence-based medicine : How to practice and teach EBM. Edinburgh; New York: Churchill Livingstone.Google Scholar
- Schoenwald, S. K., Chapman, J. E., Henry, D. B., & Sheidow, A. J. (2012). Taking effective treatments to scale: Organizational effects on outcomes of multisystemic therapy for youths with co-occurring substance use. Journal of Child & Adolescent Substance Abuse, 21(1), 1–31. doi: 10.1080/1067828X.2012.636684.CrossRefGoogle Scholar
- Wandersman, A., Duffy, J., Flaspohler, P., Noonan, R., Lubell, K., Stillman, L., et al. (2008). Bridging the gap between prevention research and practice: The interactive systems framework for dissemination and implementation. American Journal of Community Psychology, 41(3–4), 3–4.Google Scholar
- Washington State Institue for Public Policy (WSIPP). (2014). Benefit-cost technical documentation. Olympia, WA. http://www.wsipp.wa.gov/TechnicalDocumentation/WsippBenefitCostTechnicalDocumentation.pdf.
- Weisz, J. R., Chorpita, B. F., Palinkas, L. A., Schoenwald, S. K., Miranda, J., Bearman, S. K., & Gibbons, R. D. (2012). Testing standard and modular designs for psychotherapy treating depression, anxiety, and conduct problems in youth: A randomized effectiveness trial. Archives of General Psychiatry, 69(3), 274–282. doi: 10.1001/archgenpsychiatry.2011.147.CrossRefPubMedGoogle Scholar