Skip to main content

Advertisement

SpringerLink
Log in

Evaluation of a Randomized Intervention to Increase Adoption of Comparative Effectiveness Research by Community Health Organizations

  • Published:
The Journal of Behavioral Health Services & Research Aims and scope Submit manuscript

Abstract

This randomized controlled trial examined the influence of two strategies (informational packets alone and in conjunction with Webinars) aimed at increasing the adoption of motivational interviewing (MI), a patient-centered behavioral health practice supported by evidence from comparative effectiveness studies, among community health organizations responsible for delivering mental and behavioral health services. Data were obtained from 311 directors and staff across 92 community organizations. Hierarchical linear modeling was used to examine changes in decision to adopt MI. The mediating effects of multiple contextual variables were also examined. Results showed that both strategies positively influenced the decision to adopt. The positive impact on decision to adopt was significantly greater among individuals that received informational packets in conjunction with Webinars. Baseline attitudes toward evidence-based practices and pressures for change appeared to mediate this effect.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Oldenburg B, Glanz K. Diffusion of innovations. In: Glanz K, Rimer BK, Viswanath K, eds. Health Behavior and Health Education: Theory, Research and Practice, 4th ed. San Francisco, CA: Jossey-Bass; 2008:313–333.

    Google Scholar 

  2. Owen N, Glanz K, Sallis JF, et al. Evidence-based approaches to dissemination and diffusion of physical activity interventions. American Journal of Preventive Medicine. 2006;31:S35–S44.

    Article  PubMed  Google Scholar 

  3. Glasgow RE, Vinson C, Chambers D, et al. National Institutes of Health approaches to dissemination and implementation science: Current and future directions. American Journal of Public Health. 2012;102:1274–1281.

    Article  PubMed  Google Scholar 

  4. Rogers EM. Diffusion of Innovations, 5th ed. New York, NY: The Free Press; 2003.

    Google Scholar 

  5. Dearing, JW. Evolution of diffusion and dissemination theory. Journal of Public Health Management and Practice. 2008;14:99–108.

    Article  PubMed  Google Scholar 

  6. Ducharme LJ, Knudsen HK, Roman PM, et al. Innovation adoption in substance abuse treatment: Exposure, trialability, and the clinical trials network. Journal of Substance Abuse Treatment. 2007;32:321–329.

    Article  PubMed Central  PubMed  Google Scholar 

  7. Kerner J, Rimer B, Emmons K. Dissemination research and research dissemination: How can we close the gap? Health Psychology. 2005;24:443–446.

    Article  PubMed  Google Scholar 

  8. Ellis P, Robinson P, Ciliska D, et al. A systematic review of studies evaluating diffusion and dissemination of selected cancer control interventions. Health Psychology. 2005;24:488–500.

    Article  PubMed  Google Scholar 

  9. Chambers D, Kerner J. Closing the gap between discovery and delivery. In: Dissemination and Implementation Research Workshop: Harnessing Science to Maximize Health. Rockville, MD: National Institutes of Health; 2007.

  10. Bero LA, Jadad AR. How consumers and policymakers can use systematic reviews for decision making. In: Mulrow C, Cook D, eds. Systematic Reviews: Synthesis of Best Evidence for Health Care Decisions. Philadelphia, PA: American College of Physicians; 1998:45–54.

    Google Scholar 

  11. Lewin Group. Factors Influencing Effective Dissemination of Prevention Research Findings by the Department of Health and Human Services. Final Report. Washington, DC: Lewin Group; 2001.

    Google Scholar 

  12. Brink SG, Basen-Engquist KM, O’Hara-Tompkins NM, et al. Diffusion of an effective tobacco prevention program. Part I: Evaluation of the dissemination phase. Health Education Research. 1995;10:283–295.

    Article  CAS  PubMed  Google Scholar 

  13. Gordon JS, Andrews JA, Lichtenstein E, et al. Disseminating a smokeless tobacco cessation intervention model to dental hygienists: A randomized comparison of personalized instruction and self-study methods. Health Psychology. 2005;24:447–455.

    Article  PubMed  Google Scholar 

  14. Lewis E, Mayer JA, Slymen D, et al. Disseminating a Sun Safety Program to Zoological Parks: The Effects of Tailoring. Health Psychology. 2005;24:456–462.

    Article  PubMed  Google Scholar 

  15. Glanz K, Elliott T. Diffusion of an effective skin cancer prevention program: Design, theoretical foundations, and first-year implementation. Health Psychology. 2005;24:477–87.

    Article  PubMed  Google Scholar 

  16. Hall DM, Escoffery C, Nehl E, et al. Spontaneous diffusion of an effective skin cancer prevention program through web-based access to program materials. Preventing Chronic Disease: Public Health Research, Practice, and Policy. 2010;7(6):A125.

    Google Scholar 

  17. Arnold SR, Straus SE. Interventions to improve antibiotic prescribing practices in ambulatory care. Cochrane Database of Systematic Reviews. 2005;4:CD003539.

    PubMed  Google Scholar 

  18. Farmer AP, Légaré F, McAuley LM, et al. Printed educational materials: Effects on professional practice and health care outcomes. Cochrane Database of Systematic Reviews. 2008;3:CD004398.

    PubMed  Google Scholar 

  19. Houts PS, Doak CC, Doak LG, et al. The role of pictures in improving health communication: A review of research on attention, comprehension, recall, and adherence. Patient Education and Counseling. 2006;61(2):173–90.

    Article  PubMed  Google Scholar 

  20. Nilsen ES, Johansen M, Oliver S, et al. Methods of consumer involvement in developing healthcare policy and research, clinical practice guidelines and patient information material. Cochrane Database of Systematic Reviews. 2006;1.

  21. Soumerai SB, McLaughlin TJ, Avorn J. Quality assurance for drug prescribing. Quality Assurance in Health Care. 1990;2(1):37–58.

    Article  CAS  PubMed  Google Scholar 

  22. Thomas LH, McColl E, Cullum N, et al. Clinical guidelines in nursing, midwifery and the therapies: A systematic review. Journal of Advanced Nursing. 1999;30(1):40–50.

    Article  CAS  PubMed  Google Scholar 

  23. Tu K, Davis D. Can we alter physician behavior by educational methods? Lessons learned from studies of the management and follow-up of hypertension. Journal of Continuing Education in the Health Professions. 2002;22(1):11–22.

    Article  PubMed  Google Scholar 

  24. Smith DW, McCormick LK, Steckler AB, et al. Teachers’ use of health curricula: Implementation of Growing Healthy, Project SMART and Teenage Health Teaching Modules. Journal of School Health. 1993;63:349–354.

    Article  CAS  PubMed  Google Scholar 

  25. Parcel GS, O’Hara-Tomkins NM, Harris RB, et al. Diffusion of an effective tobacco prevention program, Part II: Evaluation of the adoption phase. Health Education Research. 1995;10:297–307.

    Article  CAS  PubMed  Google Scholar 

  26. Denis JL, Hebert Y, Langley A, et al. Explaining diffusion patterns for complex healthcare innovations. Health Care Management Review. 2002;27:60–74.

    Article  PubMed  Google Scholar 

  27. Panzano PC, Roth D. The decision to adopt evidence-based and other innovative mental health practices: Risky business? Psychiatric Services. 2006;57(8):1153–1161.

    Article  PubMed  Google Scholar 

  28. Gagnon M, Labarthe J, Legare F, et al. Measuring organizational readiness for knowledge translation in chronic care. Implementation Science. 2011;6(72):1–10.

    Google Scholar 

  29. Meijers JM, Janssen M, Cummings GG, et al. Assessing the relationships between contextual factors and research utilization in nursing: Systematic literature review. Journal of Advanced Nursing. 2006;55(5):622–635.

    Article  PubMed  Google Scholar 

  30. Panzano PC, Seffrin BA, Chaney-Jones S, et al. The innovation diffusion and adoption research project (IDARP): Moving from the diffusion of research results to promoting the adoption of evidence-based innovations in the Ohio mental health system. New Research in Mental Health. 2004;16.

  31. Saldana L, Chapman JE, Henggeler SW, et al. The organizational readiness for change scale in adolescent programs: Criterion validity. Journal of Substance Abuse Treatment. 2007;33:159–169.

    Article  PubMed Central  PubMed  Google Scholar 

  32. Aarons GA. Measuring provider attitudes toward evidence-based practice: Organizational context and individual differences. Child and Adolescent Psychiatric Clinics of North America. 2005;14:255–271.

    Article  PubMed Central  PubMed  Google Scholar 

  33. Aarons GA, Sawitzky AC. Organizational climate partially mediates the effect of culture on work attitudes and staff turnover in mental health services. Administration and Policy in Mental Health. 2006;33(3):289–301.

    Article  PubMed Central  PubMed  Google Scholar 

  34. Taxman FS, Belenko S. Implementing Evidence-Based Practices in Community Corrections and Addiction Treatment. New York, NY: Springer; 2012.

    Book  Google Scholar 

  35. Williams JR, Dusablon T, Williams WO, et al. Characteristics of community health organizations and decisionmakers considering the adoption of comparative-effectiveness research. Journal of Behavioral Health Services and Research. In review.

  36. Haug NA, Shopshire M, Tajima B, et al. Adoption of evidence-based practices among substance abuse treatment providers. Journal of Drug Education. 2008;38(2):181–192.

    Article  PubMed Central  PubMed  Google Scholar 

  37. Gallo KP, Barlow DH. Factors involved in clinician adoption and nonadoption of evidence-based interventions in mental health. Clinical Psychology: Science and Practice. 2012;19(1):93–106.

    Google Scholar 

  38. Rogers EM. Diffusion of preventive innovations. Addictive Behaviors. 2002;27(6):989–993.

    Article  PubMed  Google Scholar 

  39. Aarons GA, Hurlburt M, Horwitz SM. Advancing a conceptual model of evidence-based practice implementation in public service sectors. Administration and Policy in Mental Health and Mental Health Services Research. 2011;38(1):4–23.

    Article  PubMed Central  PubMed  Google Scholar 

  40. Glasgow RE, Emmons KM. How can we increase translation of research into practice? Types of evidence needed. Annual Review of Public Health. 2007;28:413–33.

    Article  PubMed  Google Scholar 

  41. Green L, Ottoson J, Hiatt R, et al. Diffusion, dissemination, and implementation of evidence-based public health. Annual Review of Public Health. 2009;30:151–74.

    Article  PubMed  Google Scholar 

  42. Brownson RC, Fielding JE, Maylahn CM. Evidence-based public health: A fundamental concept for public health practice. Annual Review of Public Health. 2009;30:175–201.

    Article  PubMed  Google Scholar 

  43. McGovern MP, Carroll KM. Evidence-based practices for substance use disorders. Psychiatric Clinics of North America. 2003;26:991–1010.

    Article  PubMed Central  PubMed  Google Scholar 

  44. Damanpour F, Schneider M. Phases of the adoption of innovation in organizations: Effects of environment, organization and top managers. British Journal of Management. 2006;17:215–236.

    Article  Google Scholar 

  45. Brownson RC, Ballew P, Brown KL, et al. The effect of disseminating evidence-based interventions that promote physical activity to health departments. American Journal of Public Health. 2007a;97:1900–1907.

    Article  PubMed Central  PubMed  Google Scholar 

  46. Williams JR, Tregear SJ, Dusablon T, et al. Increasing adoption of comparative effectiveness research in community behavioral health: methodology. Journal of Behavioral Health Services and Research. Accepted.

  47. Prochaska JO, DiClemente CC. Stages and processes of self-change of smoking: Toward an integrative model of change. Journal of Consulting and Clinical Psychology. 1983;51:390–395.

    Article  CAS  PubMed  Google Scholar 

  48. McGovern MP, Fox TS, Xiew H, et al. A survey of clinical practices and readiness to adopt evidence-based practices: Dissemination research in an addiction treatment system. Journal of Substance Abuse Treatment. 2004;26:305–312.

    Article  PubMed  Google Scholar 

  49. Williams JR, Blais MP, Banks D, et al. Predictors of the decision to adopt motivational interviewing in community health settings. Journal of Behavioral Health Services and Research. 2013. doi:10.1007/s11414-013-9357-8.

  50. Cheong YF, Fotiu RP, Raudenbush SW. Efficiency and robustness of alternative estimators for 2- and 3-level models: The case of NAEP. Journal of Educational and Behavioral Statistics. 2001;26:411–429.

    Article  Google Scholar 

  51. Hox JJ, Maas CJM. The accuracy of multilevel structural equation modeling with pseudobalanced groups and small samples. Structural Equation Modeling. 2001;8(2):157–174.

    Article  Google Scholar 

  52. Fixsen DL, Naoom SF, Blase KA, et al. Implementation Research: A Synthesis of the Literature. FMHI Publication No. 231. Tampa, FL: University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network; 2005.

    Google Scholar 

  53. Castro L, Williams JR, Dusablon T, et al. Design, development, and evaluation of printed educational materials on motivational interviewing for community behavioral health providers. Journal of Behavioral Health Services and Research. In review.

  54. Kerner JF, Hall KL. Research dissemination and diffusion: Translation within science and society. Research on Social Work Practice. 2009;19(5):519–530.

    Article  Google Scholar 

  55. Texas Christian University, Institute of Behavioral Research. Survey of Structure and Operations (TCU SSO). 2006. Available at: www.ibr.tcu.edu. Accessed 03 November 2010.

  56. Texas Christian University, Institute of Behavioral Research. The Organizational Readiness for Change: Treatment Director Version (TCU ORC-D). 2002. Available at: www.ibr.tcu.edu. Accessed 03 November 2010.

  57. Texas Christian University, Institute of Behavioral Research. The Organizational Readiness for Change: Treatment Staff Version (TCU ORC-S). 2005. Available at: www.ibr.tcu.edu. Accessed 03 November 2010.

  58. Aarons GA. Mental health provider attitudes toward adoption of evidence-based practice: The Evidence-Based Practice Attitude Scale (EBPAS). Mental Health Services Research. 2004;6(2): 61–74.

    Article  PubMed Central  PubMed  Google Scholar 

Download references

Acknowledgments

This study was supported by SAMHSA Contract No. HHSS283200700040I/HHSS28342003T. We appreciate the generous support and participation of the community health organization directors and staff who participated in this study and the assistance provided by the National Council for Community Behavioral Healthcare and the National Association of Community Health Centers in recruitment, retention, and advice with overall study design. Special thanks to all study staff from MANILA Consulting Group, Inc., McLean, VA.

Disclaimers

This report was prepared under contract by MANILA Consulting Group, Inc., for SAMHSA. The content of this publication does not necessarily reflect the views or policies of SAMHSA or the U.S. Department of Health and Human Services.

Conflicts of Interest

There are no conflicts of interest.

Author information

Authors and Affiliations

  1. University of Miami School of Nursing and Health Studies, P.O. Box 248153, Coral Gables, FL, 33124-3850, USA

    Jessica Roberts Williams PhD, MPH, RN

  2. MANILA Consulting Group, Inc., 1420 Beverly Road, Suite 220, McLean, VA, 22101, USA

    Jessica Roberts Williams PhD, MPH, RN, Weston O. Williams MHS, Tracy Dusablon PhD, Marissa Puckett Blais PhD, Stephen J. Tregear DPhil & Duren Banks PhD

  3. Center for Behavioral Health Statistics and Quality, Substance Abuse and Mental Health Services Administration (SAMHSA), One Choke Cherry Road, Room 2-1055, Rockville, MD, 20857, USA

    Kevin D. Hennessy PhD

Authors
  1. Jessica Roberts Williams PhD, MPH, RN
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Weston O. Williams MHS
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Tracy Dusablon PhD
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Marissa Puckett Blais PhD
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Stephen J. Tregear DPhil
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Duren Banks PhD
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Kevin D. Hennessy PhD
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jessica Roberts Williams PhD, MPH, RN.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Williams, J.R., Williams, W.O., Dusablon, T. et al. Evaluation of a Randomized Intervention to Increase Adoption of Comparative Effectiveness Research by Community Health Organizations. J Behav Health Serv Res 41, 308–323 (2014). https://doi.org/10.1007/s11414-013-9369-4

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11414-013-9369-4

Keywords

Search

Navigation