Relating Coalition Capacity to the Adoption of Science-Based Prevention in Communities: Evidence from a Randomized Trial of Communities That Care

  • Valerie B. Shapiro
  • Sabrina Oesterle
  • J. David Hawkins
Original Article

Abstract

Coalition-based efforts that use a science-based approach to prevention can improve the wellbeing of community youth. This study measured several coalition capacities that are hypothesized to facilitate the adoption of a science-based approach to prevention in communities. Using data from 12 coalitions participating in a community-randomized trial of the prevention strategy Communities That Care (CTC), this paper describes select measurement properties of five salient coalition capacities (member substantive knowledge of prevention, member acquisition of new skills, member attitudes toward CTC, organizational linkages, and influence on organizations), as reported by coalition members, and examines the degree to which these capacities facilitated the community leader reports of the community-wide adoption of a science-based approach to prevention. Findings indicated that the five coalition capacities could be reliably measured using coalition member reports. Meta-regression analyses found that CTC had a greater impact on the adoption of a science-based prevention approach in 12 matched pairs of control and CTC communities where the CTC coalition had greater member (new skill acquisition) and organizational capacities (organizational linkages).

Keywords

Communities that care Prevention Coalition Capacity Adoption Evidence–based practice 

References

  1. Allen, N. E. (2005). A multi-level analysis of community coordinating councils. American Journal of Community Psychology, 35(1–2), 49–63.PubMedCrossRefGoogle Scholar
  2. Allen, N. E., Watt, K. A., & Hess, J. Z. (2008). A qualitative study of the activities and outcomes of domestic violence coordinating councils. American Journal of Community Psychology, 41(1–2), 63–73.PubMedCrossRefGoogle Scholar
  3. Arthur, M. W., Ayers, C. D., Graham, K. A., & Hawkins, J. D. (2003). Mobilizing communities to reduce risks for drug abuse: A comparison of two strategies. In W. J. Bukoski & Z. Sloboda (Eds.), Handbook of drug abuse prevention: Theory, science and practice (pp. 129–144). New York: Kluwer Academic/Plenum.Google Scholar
  4. Arthur, M. W., Briney, J. S., Hawkins, J. D., Abbott, R. D., Brooke-Weiss, B. L., & Catalano, R. F. (2007). Measuring risk and protection in communities using the Communities That Care Youth Survey. Evaluation and Program Planning, 30(2), 197–211.PubMedCrossRefGoogle Scholar
  5. Arthur, M. W., Glaser, R. R., & Hawkins, J. D. (2005). Steps towards community-level resilience: Community adoption of science-based prevention programming. In R. D. Peters, B. Leadbeater, & R. J. McMahon (Eds.), Resilience in children, families, and communities: Linking context to practice and policy (pp. 177–194). New York: Kluwer Academic/Plenum.CrossRefGoogle Scholar
  6. Berkey, C. S., Hoaglin, D. C., Mosteller, F., & Colditz, G. A. (1995). A random-effects regression model for meta-analysis. Statistics in Medicine, 14(4), 395–411.PubMedCrossRefGoogle Scholar
  7. Brown, E. C., Hawkins, J. D., Arthur, M. W., Briney, J. S., & Abbott, R. D. (2007). Effects of Communities That Care on prevention services systems: Outcomes from the Community Youth Development Study at 1.5 years. Prevention Science, 8(3), 180–191.PubMedCrossRefGoogle Scholar
  8. Brown, E. C., Hawkins, J. D., Rhew, I. C., Shapiro, V. B., Abbott, R.D., Arthur, M. W., Briney, J. S., & Catalano, R. F. (2014). Prevention system mediation of Communities That Care effects on youth outcomes. Prevention Science, 15(5), 623–632.Google Scholar
  9. Butterfoss, F. D. (2002). 2001 SOPHE presidential address: The power of partnerships. Health Education and Behavior, 29(2), 162–169.PubMedGoogle Scholar
  10. Butterfoss, F. D., Goodman, R. M., & Wandersman, A. (1993). Community coalitions for prevention and health promotion. Health Education Research, 8(3), 315–330.PubMedCrossRefGoogle Scholar
  11. Butterfoss, F. D., Goodman, R. M., & Wandersman, A. (1996). Community coalitions for prevention and health promotion: Factors predicting satisfaction, participation, and planning. Health Education Quarterly, 23(1), 65–79.PubMedCrossRefGoogle Scholar
  12. Center for the Study and Prevention of Violence. (2011). Blueprints for violence prevention. Retrieved from http://www.colorado.edu/cspv/blueprints.
  13. Chervin, D. D., Philliber, S., Brindis, C. D., Chadwick, A. E., Revels, M. L., Kamin, S. L., et al. (2005). Community capacity building in CDC’s community coalition partnership programs for the prevention of teen pregnancy. Journal of Adolescent Health, 37(3 Suppl.), S11–S19.PubMedCrossRefGoogle Scholar
  14. Higgins, J. P. T., & Green, S. (Eds.). (2011). Cochrane handbook for systematic reviews of interventions Version 5.1.0 (Updated March 2011). The Cochrane Collaboration. Google Scholar
  15. Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16(3), 297–334.CrossRefGoogle Scholar
  16. Crowley, D. M., Greenberg, M. T., Feinberg, M. E., Spoth, R. L., & Redmond, C. R. (2012). The effect of the PROSPER partnership model on cultivating local stakeholder knowledge of evidence-based programs: A five-year longitudinal study of 28 communities. Prevention Science, 13(1), 96–105.PubMedCentralPubMedCrossRefGoogle Scholar
  17. Darnell, A. J., Barile, J. P., Weaver, S. R., Harper, C. R., Kuperminc, G. P., & Emshoff, J. G. (2013). Testing effects of community collaboration on rates of low infant birthweight at the county level. American Journal of Community Psychology, 51(3–4), 398–406.PubMedCrossRefGoogle Scholar
  18. Fagan, A. A., Hanson, K., Hawkins, J. D., & Arthur, M. W. (2008). Bridging science to practice: Achieving prevention program implementation fidelity in the Community Youth Development Study. American Journal of Community Psychology, 41(3–4), 235–249.PubMedCrossRefGoogle Scholar
  19. Feinberg, M. E., Greenberg, M. T., & Osgood, D. (2004). Readiness, functioning, and perceived effectiveness in community prevention coalitions: A study of Communities That Care. American Journal of Community Psychology, 33(3–4), 163–176.PubMedCrossRefGoogle Scholar
  20. Feinberg, M. E., Greenberg, M. T., Osgood, D. W., Anderson, A., & Babinski, L. (2002). The effects of training community leaders in prevention science: Communities That Care in Pennsylvania. Evaluation & Program Planning, 25(3), 245–259.CrossRefGoogle Scholar
  21. Florin, P., Mitchell, R., & Stevenson, J. (1993). Identifying training and technical assistance needs in community coalitions: A developmental approach. Health Education Research, 8(3), 417–432.PubMedCrossRefGoogle Scholar
  22. Florin, P., Mitchell, R., Stevenson, J., & Klein, I. (2000). Predicting intermediate outcomes for prevention coalitions: A developmental perspective. Evaluation and Program Planning, 23(3), 341–346.CrossRefGoogle Scholar
  23. Foster-Fishman, P. G., Berkowitz, S. L., Lounsbury, D. W., Jacobson, S., & Allen, N. A. (2001). Building collaborative capacity in community coalitions: A review and integrative framework. American Journal of Community Psychology, 29(2), 241–261.PubMedCrossRefGoogle Scholar
  24. Glaser, R. R., Van Horn, M. L., Arthur, M. W., Hawkins, J. D., & Catalano, R. F. (2005). Measurement properties of the Communities That Care® Youth Survey across demographic groups. Journal of Quantitative Criminology, 21(1), 73–102.CrossRefGoogle Scholar
  25. Goodman, R. M., Speers, M. A., McLeroy, K., Fawcett, S., Kegler, M., Parker, E., et al. (1998). Identifying and defining the dimensions of community capacity to provide a basis for measurement. Health Education and Behavior, 25(3), 258–278.PubMedCrossRefGoogle Scholar
  26. Goodman, R. M., Wandersman, A., Chinman, M., Imm, P., & Morrissey, E. (1996). An ecological assessment of community-based interventions for prevention and health promotion: Approaches to measuring community coalitions. American Journal of Community Psychology, 24(1), 33–61.PubMedCrossRefGoogle Scholar
  27. Granner, M., & Sharpe, P. (2004). Evaluating community coalition characteristics and functioning: A summary of measurement tools. Health Education Research, 19(5), 514–532.PubMedCrossRefGoogle Scholar
  28. Halgunseth, L. C., Carmack, C., Childs, S. S., Caldwell, L., Craig, A., & Smith, E. P. (2012). Using the interactive systems framework in understanding the relation between general program capacity and implementation in afterschool settings. American Journal of Community Psychology, 50(3–4), 311–320.PubMedCentralPubMedCrossRefGoogle Scholar
  29. Hawkins, J. D., Catalano, R. F., & Arthur, M. W. (2002). Promoting science-based prevention in communities. Addictive Behaviors, 27(6), 951–976.PubMedCrossRefGoogle Scholar
  30. Hawkins, J. D., Catalano, R. F., Arthur, M. W., Egan, E., Brown, E. C., Abbott, R. D., et al. (2008). Testing Communities That Care: The rationale, design and behavioral baseline equivalence of the Community Youth Development Study. Prevention Science, 9(3), 178–190.PubMedCentralPubMedCrossRefGoogle Scholar
  31. Hawkins, J. D., Catalano, R. F., & Associates. (1992). Communities That Care: Action for drug abuse prevention (1st ed.). San Francisco: Jossey-Bass.Google Scholar
  32. Hawkins, J. D., Shapiro, V. B., & Fagan, A. A. (2010). Disseminating effective community prevention practices: Opportunities for social work education. Research on Social Work Practice, 20(5), 518–527.PubMedCentralPubMedGoogle Scholar
  33. Hays, C., Hays, S. P., DeVille, J. O., & Mulhall, P. F. (2000). Capacity for effectiveness: The relationship between coalition structure and community impact. Evaluation and Program Planning, 23(3), 373–379.CrossRefGoogle Scholar
  34. Hedges, L. V. (1981). Distribution theory for Glass’s estimator of effect size and related estimators. Journal of Educational Statistics, 6(2), 107–128.CrossRefGoogle Scholar
  35. Kegler, M. C., Norton, B. L., & Aronson, R. (2007). Skill improvement among coalition members in the California Healthy Cities and Communities Program. Health Education Research, 22(3), 450–457.PubMedCrossRefGoogle Scholar
  36. Kegler, M. C., Steckler, A., McLeroy, K., & Malek, S. H. (1998). Factors that contribute to effective community health promotion coalitions: A study of 10 Project ASSIST coalitions in North Carolina. Health Education and Behavior, 25(3), 338–353.PubMedCrossRefGoogle Scholar
  37. Kegler, M. C., Williams, C. W., Cassell, C. M., Santelli, J., Kegler, S. R., Montgomery, S. B., et al. (2005). Mobilizing communities for teen pregnancy prevention: Associations between coalition characteristics and perceived accomplishments. Journal of Adolescent Health, 37, S31–S41.PubMedCrossRefGoogle Scholar
  38. Kreuter, M. W., Lezin, N. A., & Young, L. A. (2000). Evaluating community-based collaborative mechanisms: Implications for practitioners. Health Promotion Practice, 1(1), 49–63.CrossRefGoogle Scholar
  39. Kumpfer, K. C., Turner, C., Hopkins, R., & Librett, J. (1993). Leadership and team effectiveness in community coalitions for the prevention of alcohol and other drug abuse. Health Education and Research, 8(3), 359–374.CrossRefGoogle Scholar
  40. Lipsey, M. W., & Wilson, D. B. (2001). Practical meta-analysis. Thousand Oaks, CA: Sage.Google Scholar
  41. McMillan, B., Florin, P., Stevenson, J., Kerman, B., & Mitchell, R. E. (1995). Empowerment praxis in community coalitions. American Journal of Community Psychology, 23(5), 699–727.PubMedCrossRefGoogle Scholar
  42. Merzel, C., & D’Afflitti, J. (2003). Reconsidering community-based health promotion: Promise, performance, and potential. American Journal of Public Health, 93(4), 557–574.PubMedCentralPubMedCrossRefGoogle Scholar
  43. Mitchell, R. E., Stevenson, J. F., & Florin, P. (1996). A typology of prevention activities: Applications to community coalitions. The Journal of Primary Prevention, 16(4), 413–436.PubMedCrossRefGoogle Scholar
  44. Mizrahi, T., & Rosenthal, B. B. (2001). Complexities of coalition building: Leaders’ successes, strategies, struggles, and solutions. Social Work, 46(1), 63–77.PubMedCrossRefGoogle Scholar
  45. Monahan, K. C., Hawkins, J. D., & Abbott, R. D. (2013). The application of meta-analysis within a matched-pair randomized control trial: An illustration testing the effects of Communities That Care on delinquent behavior. Prevention Science, 14(1), 1–12.PubMedCrossRefGoogle Scholar
  46. Payne, G. T., Benson, G. S., & Finegold, D. L. (2009). Corporate board attributes, team effectiveness and financial performance. Journal of Management Studies, 46(4), 704–731.CrossRefGoogle Scholar
  47. Quinby, R. K., Fagan, A. A., Hanson, K., Brooke-Weiss, B., Arthur, M. W., & Hawkins, J. D. (2008). Installing the Communities That Care prevention system: Implementation progress and fidelity in a randomized controlled trial. Journal of Community Psychology, 36(3), 313–332.CrossRefGoogle Scholar
  48. Raudenbush, S. W. (1994). Random effects models. In H. Cooper & L. V. Hedges (Eds.), The handbook of research synthesis (pp. 301–321). New York: Russell Sage Foundation.Google Scholar
  49. Riggs, N. R., Feinberg, M. E., & Greenberg, M. T. (2002). Community sector and gender differences in the perception of community-based prevention. Journal of Community Psychology, 30(6), 709–722.CrossRefGoogle Scholar
  50. Rogers, T., Howard-Pitney, B., Feighery, E. C., Altman, D. G., Endres, J. M., & Roeseler, A. G. (1993). Characteristics and participant perceptions of tobacco control coalitions in California. Health Education Research, 8(3), 345–357.CrossRefGoogle Scholar
  51. Roussos, S. T., & Fawcett, S. B. (2000). A review of collaborative partnerships as a strategy for improving community health. Annual Review of Public Health, 21, 369–402.PubMedCrossRefGoogle Scholar
  52. Schmitt, N. (1996). Uses and abuses of coefficient alpha. Psychological Assessment, 8(4), 350–353.CrossRefGoogle Scholar
  53. Shapiro, V. B., Hawkins, J. D., Oesterle, S., Monahan, K. C., Brown, E. C., & Arthur, M. W. (2013b). Variation in the effect of Communities That Care on the adoption of a scientific approach to prevention. Journal of the Society for Social Work and Social Research, 4(3), 154–164.Google Scholar
  54. Shapiro, V. B., Oesterle, S., Abbott, R. D., Arthur, M. W., & Hawkins, J. D. (2013a). Measuring dimensions of coalition functioning for effective and participatory community practice. Social Work Research, 37(4), 349–359.Google Scholar
  55. Spoth, R., Greenberg, M., Bierman, K., & Redmond, C. (2004). PROSPER community-university partnership model for public education systems: Capacity-building for evidence-based, competence-building prevention. Prevention Science, 5(1), 31–39.PubMedCrossRefGoogle Scholar
  56. Spoth, R., Guyll, M., Lillehoj, C. J., Redmond, C., & Greenberg, M. (2007). PROSPER study of evidence-based intervention implementation quality by community-University partnerships. Journal of Community Psychology, 35(8), 981–999.PubMedCentralPubMedCrossRefGoogle Scholar
  57. Spoth, R., Redmond, C., Clair, S., Shin, C., Greenberg, M., & Feinberg, M. (2011). Preventing substance misuse through community-university partnerships: Randomized controlled trial outcomes 4(1/2) years past baseline. American Journal of Preventive Medicine, 40(4), 440–447.PubMedCentralPubMedCrossRefGoogle Scholar
  58. Substance Abuse and Mental Health Services Administration. (2005). Communities That Care prevention strategies guide. Retrieved from http://ncadi.samhsa.gov/features/ctc/resources.aspx.
  59. Wandersman, A., Duffy, J., Flasphohler, P., Noonan, R., Lubell, K., Stillman, L., et al. (2008). Bridging the gap between prevention research and practice: The interactive systems framework for dissemination and implementation. American Journal of Community Psychology, 41(3), 171–181.PubMedCrossRefGoogle Scholar
  60. Wells, R., Feinberg, M., Alexander, J. A., & Ward, A. J. (2009). Factors affecting member perceptions of coalition impact. Nonprofit Management & Leadership, 19(3), 327–348.CrossRefGoogle Scholar
  61. Wilson, D. B. (2005). Meta-analysis macros for SAS, SPSS, and Stata. Retrieved from http://mason.gmu.edu/~dwilsonb/ma.html.
  62. Yin, R. K., & Kaftarian, S. J. (1997). Introduction: Challenges of community-based program outcome evaluations. Evaluation & Program Planning, 20(3), 293–297.CrossRefGoogle Scholar

Copyright information

© Society for Community Research and Action 2014

Authors and Affiliations

  • Valerie B. Shapiro
    • 1
  • Sabrina Oesterle
    • 2
  • J. David Hawkins
    • 2
  1. 1.School of Social WelfareUniversity of California at BerkeleyBerkeleyUSA
  2. 2.Social Development Research Group, School of Social WorkUniversity of WashingtonSeattleUSA

Personalised recommendations