Skip to main content

Advertisement

SpringerLink
Log in

Increasing Adoption of Comparative Effectiveness Research in Community Behavioral Health: Methodology

  • Published:
The Journal of Behavioral Health Services & Research Aims and scope Submit manuscript

Abstract

Increased efforts in comparative effectiveness research (CER) (comparing various health care intervention and treatment options) are being used to inform health care delivery. While CER research itself is an important step in developing best practices in health care, it is not enough to ensure success. The knowledge must also be successfully disseminated to increase adoption and implementation of practices. To ensure the greatest benefits of successful interventions, it is essential to understand which dissemination strategies are effective and under what conditions. This article provides the background and methodology used in a large-scale, 2-year study aimed at determining how knowledge gained from CER research may be most effectively disseminated to those responsible for delivering behavioral health services. The study takes an important step toward addressing the gaps in dissemination and translation of CER.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Figure 1
Figure 2

Similar content being viewed by others

References

  1. Federal Coordinating Council for Comparative Effectiveness Research. Report to the President and the Congress. Washington, DC: Department of Health and Human Services; 2009.

    Google Scholar 

  2. Orlandi M, Landers C, Weston R, et al. Diffusion of health promotion innovations. In: K Glanz, MF Lewis, BK Rimer, eds. Health Behavior and Health Education: Theory, Research, and Practice. San Francisco, CA: Jossey-Bass; 1990:228–313.

    Google Scholar 

  3. Institute of Medicine. Initial National Priorities for Comparative Effectiveness Research. Washington, DC: The National Academies; 2009.

    Google Scholar 

  4. Rogers EM. Diffusion of Innovations, 5th ed. New York, NY: Free Press; 2003.

    Google Scholar 

  5. Parks JP, Pollack D, Bartels S, et al. Integrating Behavioral Health and Primary Care Services: Opportunities and Challenges for State Mental Health Authorities. National Association of State Mental Health Program Directors: Technical Report; 2005.

  6. Substance Abuse and Mental Health Services Administration. (2013). Understanding Health Reform: Integrated Care and Why You Should Care. Available at: http://www.samhsa.gov/healthReform/docs/ConsumerTipSheet_IntegrationImportance.pdf. Accessed 13 June 2012.

  7. Fixsen DL, Naoom SF, Blase KA, et al. Implementation Research: A Synthesis of the Literature. Tampa, FL: University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network. FMHI Publication No. 231; 2005.

  8. Aarons GA, Hurlburt M, Horwitz SM. Advancing a conceptual model of evidence-based practice implementation in public service sectors. Administration and Policy in Mental Health and Mental Health Services Research 2011;38(1):4–23.

    Article  PubMed Central  PubMed  Google Scholar 

  9. Gallo KP, Barlow DH. Factors involved in clinician adoption and nonadoption of evidence-based interventions in mental health. Clinical Psychology: Science and Practice 2012;19(1):93–106.

    Google Scholar 

  10. Hallfors D, Godette D. Will the “principles of effectiveness” improve prevention practice? Early findings from a diffusion study. Health Education Research 2002;17(4):461–470.

    Article  CAS  PubMed  Google Scholar 

  11. Haug NA, Shopshire M, Tajima B, et al. Adoption of evidence-based practices among substance abuse treatment providers. Journal of Drug Education 2008;38(2):181–192.

    Article  PubMed Central  PubMed  Google Scholar 

  12. McGovern MP, Fox TS, Xie H, et al. A survey of clinical practices and readiness to adopt evidence-based practices: Dissemination research in an addiction treatment system. Journal of Substance Abuse Treatment 2004;26(4):305–312.

    Article  PubMed  Google Scholar 

  13. Parcel GS, O’Hara-Tompkins NM, Harrist RB, et al. Diffusion of an effective tobacco prevention program. Part II: Evaluation of the adoption phase. Health Education Research 1995;10(3):297–307.

    Article  CAS  PubMed  Google Scholar 

  14. Proctor EK. Leverage points for the implementation of evidence-based practice. Brief Treatment and Crisis Intervention 2004;4(3):227–242.

    Article  Google Scholar 

  15. Rogers EM. Lessons for guidelines from the diffusion of innovations. The Joint Commission Journal on Quality Improvement 1995;21(7):324–328.

    CAS  PubMed  Google Scholar 

  16. Schoenwald SK, Hoagwood K. Effectiveness, transportability, and dissemination of interventions: What matters when? Psychiatric Services 2001;52(9):1190–1197.

    Article  CAS  PubMed  Google Scholar 

  17. Taxman FS, Belenko S. Implementing Evidence-Based Practices in Community Corrections and Addiction Treatment. New York, NY: Springer; 2012.

    Book  Google Scholar 

  18. Corrigan PW, Steiner L, McCracken SG, et al. Strategies for disseminating evidence-based practices to staff who treat people with serious mental illness. Psychiatric Services 2001;52(12):1598–1606.

    Article  CAS  PubMed  Google Scholar 

  19. Bero LA, Grilli R, Grimshaw JM, et al. Closing the gap between research and practice: An overview of systematic reviews of interventions to promote the implementation of research findings. The Cochrane Effective Practice and Organization of Care Review Group. British Medical Journal 1998;317(7156):465–468.

    Article  CAS  PubMed Central  PubMed  Google Scholar 

  20. Joyce B, Showers B. Student Achievement Through Staff Development, 3rd. ed. Alexandria, VA: Association for Supervision and Curriculum Development; 2002.

  21. Marriott S, Palmer C, Lelliott P. Disseminating healthcare information: Getting the message across. Quality in Health Care 2000;9:58–62.

    Article  CAS  PubMed Central  PubMed  Google Scholar 

  22. Ellis P, Robinson P, Ciliska D, et al. Diffusion and Dissemination of Evidence-Based Cancer Control Interventions. Evidence Report/Technology Assessment Number 79. Prepared by McMaster University under Contract No. 290-97-0017. AHRQ Publication No. 03-E033. Rockville, MD: Agency for Healthcare Research and Quality; 2003.

  23. Napp, D., Williams, J.R., Amanda, A., Funmilayo, D. DEBI monitoring and evaluation field guides—Critical assessment and template for future guides. Atlanta: Centers for Disease Control and Prevention, Division of HIV/AIDS Prevention, Program Evaluation Branch; 2010.

    Google Scholar 

  24. Smith S. Reviewer's guide to evaluating health information materials; 2008. Available at: http://www.beginningsguides.net/pdfs/articles/Reviewers-Guide.pdf

  25. Doak C, Doak L, Root J. Teaching Patients With Low Literacy Skills, 2nd ed. Philadelphia: Lipincott; 1996.

    Google Scholar 

  26. McGee J. Writing and Designing Print Materials for Beneficiaries: A Guide for State Medicaid Agencies. Pub. Number 10145. Health Care Financing Administration, Department of Health and Human Services; 1999.

  27. Texas Christian University, Institute of Behavioral Research. The Organizational Readiness for Change: Treatment Director Version (TCU ORC-D); 2002. Available at: www.ibr.tcu.edu. Accessed 3 Nov 2010.

  28. Texas Christian University, Institute of Behavioral Research. The Organizational Readiness for Change: Treatment Staff Version (TCU ORC-S); 2005. Available at: www.ibr.tcu.edu. Accessed 3 Nov 2010.

  29. Texas Christian University, Institute of Behavioral Research. Survey of Structure and Operations (TCU SSO); 2006. Available at www.ibr.tcu.edu. Accessed 3 Nov 2010.

  30. Rowan-Szal GA, Greener JM, Joe GW, et al. Assessing program needs and planning change. Journal of Substance Abuse Treatment 2007;33(2):121–129.

    Article  PubMed Central  PubMed  Google Scholar 

  31. Allred C, Markiewicz J, Amaya-Jackson L. et al. The Organizational Readiness and Capacity Assessment; 2005. Durham, NC: UCLA-Duke National Center for Child Traumatic Stress.

    Google Scholar 

  32. Aarons GA. Mental health provider attitudes toward adoption of evidence-based practice: the Evidence-Based Practice Attitude Scale (EBPAS). Mental Health Services Research 2004;6(2): 61–74.

    Article  PubMed Central  PubMed  Google Scholar 

  33. Prochaska JO, DiClemente CC. Stages and processes of self-change of smoking: Toward an integrative model of change. Journal of Consulting and Clinical Psychology 1983;51:390–395.

    Article  CAS  PubMed  Google Scholar 

  34. Boote J, Barber R, Cooper C. Principles and indicators of successful consumer involvement in NHS research: Results of a Delphi study and subgroup analysis. Health Policy 2006;75:280–297.

    Article  PubMed  Google Scholar 

  35. Barber R, Boote JD, Cooper CL. Involving consumers successfully in NHS research: A national survey. Health Expectations 2007;10:380–391.

    Article  PubMed  Google Scholar 

  36. Quinten A, Raaijmakers W. Effectiveness of different missing data treatments in surveys with Likert-type data: Introducing the relative mean substitution approach. Educational and Psychological Measurement 1999;59(5):725–748.

    Article  Google Scholar 

  37. Allison PD. Missing Data. Thousand Oaks, CA: Sage; 2002.

    Google Scholar 

  38. Little RJA, Rubin DB. Statistical Analysis with Missing Data. New York, NY: Wiley; 1987.

    Google Scholar 

  39. Bartko JJ. On various intraclass correlation reliability coefficients. Psychological Bulletin 1976;83:762–765.

    Article  Google Scholar 

  40. James LR, Demaree RG, Wolf G. r wg: An assessment of within-group interrater agreement. Journal of Applied Psychology 1993;78(2):306–309.

    Article  Google Scholar 

  41. Raudenbush SW, Bryk AS. Hierarchical linear models: Applications and data analysis methods, Second Edition. Thousand Oaks, CA: Sage; 2002.

  42. Shrout PE, Fleiss JL. Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin 1979;86:420–428.

    Article  CAS  PubMed  Google Scholar 

  43. Glaser BG, Strauss A. The Discovery of Grounded Theory: Strategies for Qualitative Research. Chicago, IL: Aldine; 1967.

    Google Scholar 

Download references

Acknowledgments

We appreciate the generous support and participation of the community health organization directors and staff who participated in this study and the assistance provided by the National Council for Community Behavioral Healthcare and the National Association of Community Health Centers in recruitment, retention, and advice with overall study design. Special thanks to all study staff from MANILA Consulting Group, Inc., McLean, VA. This study was supported by the Substance Abuse and Mental Health Services Administration (SAMHSA) Contract No. HHSS283200700040I/HHSS28342003T.

Conflicts of Interest

This report was prepared under contract by MANILA Consulting Group, Inc., for SAMHSA. The content of this publication does not necessarily reflect the views or policies of SAMHSA or the US Department of Health and Human Services.

Author information

Authors and Affiliations

  1. University of Miami School of Nursing and Health Studies, P.O. Box 248153, Coral Gables, FL, 33124-3850, USA

    Jessica Roberts Williams PhD, MPH, RN

  2. MANILA Consulting Group, Inc., 1420 Beverly Road, Suite 220, McLean, VA, 22101, USA

    Jessica Roberts Williams PhD, MPH, RN, Stephen J. Tregear DPhil, Tracy Dusablon PhD, Lizbeth E. Caceda-Castro MEd, Kristin J. Miller MSW & Gary Hill PhD

  3. Center for Behavioral Health Statistics and Quality, Substance Abuse and Mental Health Services Administration, One Choke Cherry Road, Room 2-1055, Rockville, MD, 20857, USA

    Kevin D. Hennessy PhD

Authors
  1. Jessica Roberts Williams PhD, MPH, RN
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Stephen J. Tregear DPhil
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Tracy Dusablon PhD
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Lizbeth E. Caceda-Castro MEd
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Kristin J. Miller MSW
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Gary Hill PhD
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Kevin D. Hennessy PhD
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jessica Roberts Williams PhD, MPH, RN.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Williams, J.R., Tregear, S.J., Dusablon, T. et al. Increasing Adoption of Comparative Effectiveness Research in Community Behavioral Health: Methodology. J Behav Health Serv Res 41, 258–275 (2014). https://doi.org/10.1007/s11414-013-9367-6

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11414-013-9367-6

Keywords

Search

Navigation