Multilevel Analysis of a Measure of Community Prevention Collaboration

  • Eric C. BrownEmail author
  • J. David Hawkins
  • Michael W. Arthur
  • Robert D. Abbott
  • M. Lee Van Horn
Original Paper


This study assesses a measure of community-wide collaboration on prevention-specific activities (i.e., prevention collaboration) in context of the theory of community change used in the Communities That Care prevention system. Using data from a sample of 599 community leaders across 41 communities, we examined the measure with regard to its factor structure, associations with other concurrent community-level measures, and prediction by individual- and community-level characteristics. Results of multilevel confirmatory factor analysis provide evidence for the construct validity of the measure and indicate significant (p < .05) associations with concurrent validity criteria. Female community leaders reported significantly higher levels of prevention collaboration and community leaders sampled from religious organizations reported lower levels of prevention collaboration than did their respective counterparts. Although no community-level characteristics were associated significantly with prevention collaboration, community clustering accounted for 20–28% of the total variation in the measure. Findings support the use of this measure in assessing the importance of collaboration in community-based prevention initiatives.


Collaboration Prevention Community-based intervention Communities That Care 



This research was supported by two grants: the first from the National Institute on Drug Abuse (DA10768), and the second from the National Institute of Mental Health, National Institute on Child Health and Human Development, National Cancer Institute, National Institute on Drug Abuse, and Substance Abuse and Mental Health Services Administration/Center for Substance Abuse Prevention (DA15183). We gratefully acknowledge contributions made to this article by Mark T. Greenberg, Paul E. Greenbaum, Charles B. Fleming, the anonymous reviewers, and the Community Youth Development Study research team.


  1. Akaike, H. (1970). Statistical predictor identification. Annals of the Institute of Statistical Mathematics, 22, 203–217.CrossRefGoogle Scholar
  2. Allen, N. E. (2005). A multi-level analysis of community coordinating councils. American Journal of Community Psychology, 35, 49–63.PubMedCrossRefGoogle Scholar
  3. Arthur, M. W., Ayers, C. D., Graham, K. A., & Hawkins, J. D. (2003). Mobilizing communities to reduce risks for drug abuse: A comparison of two strategies. In W. J. Bukoski, & Z. Sloboda (Eds.), Handbook of drug abuse prevention. Theory, science and practice (pp. 129–144). New York: Plenum Publishing.Google Scholar
  4. Arthur, M. W., Glaser, R. R., & Hawkins, J. D. (2005). Steps towards community-level resilience: Community adoption of science-based prevention programming. In R. D. V. Peters, B. Leadbeater, & R. J. McMahon (Eds.), Resilience in children, families, and communities: Linking context to practice and policy (pp. 177–194). New York: Kluwer Academic/Plenum.CrossRefGoogle Scholar
  5. Arthur, M. W., Hawkins, J. D., Catalano, R. F., & Olson, J. J. (2002). Community key informant survey. Social Development Research Group, University of Washington.Google Scholar
  6. Barton, W. H., Watkins, M., & Jarjoura, R. (1997). Youths and communities: Toward comprehensive strategies for youth development. Social Work, 42, 483–493.PubMedGoogle Scholar
  7. Bentler, P. M. (1990). Comparative fit indexes in structural models. Psychological Bulletin, 107, 238–246.PubMedCrossRefGoogle Scholar
  8. Browne, M. W., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. A. Bollen, & J. S. Long (Eds.), Testing structural equation models (pp. 136–162). Newbury Park: Sage.Google Scholar
  9. Butterfoss, F. D., Goodman, R. M., & Wandersman, A. (1993). Community coalitions for prevention and health promotion. Health Education Research, 8, 315–330.PubMedCrossRefGoogle Scholar
  10. Catalano, R. F., & Hawkins, J. D. (1996). The social development model: A theory of antisocial behavior. In J. D. Hawkins (Ed.), Delinquency and crime: Current theories (pp. 149–197). New York: Cambridge University Press.Google Scholar
  11. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.Google Scholar
  12. Coie, J. D., Watt, N. F., West, S. G., Hawkins, J. D., Asarnow, J. R., Markman, H. J. et al. (1993). The science of prevention. A conceptual framework and some directions for a national research program. American Psychologist, 48, 1013–1022.PubMedCrossRefGoogle Scholar
  13. Cronbach, L. J., & Meehl, P. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52, 281–302.PubMedCrossRefGoogle Scholar
  14. Dearing, J. W., Rogers, E. M., Meyer, G., Casey, M. K., Rao, N., Campo, S. et al. (1996). Social marketing and diffusion-based strategies for communicating with unique populations: HIV prevention in San Francisco. Journal of Health Communication, 1, 343–363.PubMedCrossRefGoogle Scholar
  15. Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977). Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society. Series B (Methodological), 39, 1–38.Google Scholar
  16. Duncan, T. E., Alpert, A., & Duncan, S. C. (1998). Multilevel covariance structure analysis of sibling antisocial behavior. Structural Equation Modeling, 5, 211–228.Google Scholar
  17. Edwards, R. W., Jumper-Thurman, P., Plested, B. A., Oetting, E. R., & Swanson, L. (2000). Community readiness: Research to practice. Journal of Community Psychology, 28, 291–307.CrossRefGoogle Scholar
  18. Fagan, A. A., Hawkins, J. D., & Catalano, R. F. (in press). Using community epidemiologic data to improve social settings: The Communities That Care prevention system. In M. Shinn, & H. Yoshikawa (Eds.), Toward positive youth development: Transforming schools and community programs. New York: Oxford University Press.Google Scholar
  19. Gabriel, R. M. (2000). Methodological challenges in evaluating community partnerships & coalitions: Still crazy after all these years. Journal of Community Psychology, 28, 339–352.CrossRefGoogle Scholar
  20. Gauvin, R. L., Potvin, L., Denis, J. L., & Kishchuk, N. (2002). Making youth tobacco control programs more ecological: Organizational and professional profiles. American Journal of Health Promotion, 16, 267–279.PubMedGoogle Scholar
  21. Goodman, R. M., Speers, M. A., McLeroy, K., Fawcett, S., Kegler, M., Parker, E. et al. (1998). Identifying and defining the dimensions of community capacity to provide a basis for measurement. Health Education and Behavior, 25, 258–278.PubMedCrossRefGoogle Scholar
  22. Granner, M., & Sharpe, P. (2004). Evaluating community coalition characteristics and functioning: A summary of measurement tools. Health Education Research, 19, 514–532.PubMedCrossRefGoogle Scholar
  23. Gray, B. (1989). Collaboration: Finding common ground for multiparty problems. San Francisco: Jossey-Bass.Google Scholar
  24. Greenbaum, P. E., & Dedrick, R. F. (2007). Multilevel analysis of interagency collaboration of children’s mental health agencies. In C. Newman, C. Liberton, K. Kutash, & R. M. Friedman (Eds.), The 19th Annual Research Conference Proceedings, A System of Care for Children’s Mental Health: Expanding the Research Base, Tampa: University of South Florida, The Louis de la Parte Florida Mental Health Institute, Research and Training Center for Children’s Mental Health.Google Scholar
  25. Grilli, L., & Rampichini, C. (2007). Multilevel factor models for ordinal variables. Structural Equation Modeling, 14, 1–25.CrossRefGoogle Scholar
  26. Hallfors, D., Cho, H., Livert, D., & Kadushin, C. (2002). Fighting back against substance abuse: Are community coalitions winning? American Journal of Preventive Medicine, 23, 237–245.PubMedCrossRefGoogle Scholar
  27. Hawkins, J. D. (1999). Preventing crime and violence through Communities That Care. European Journal on Criminal Policy and Research, 7, 443–458.CrossRefGoogle Scholar
  28. Hawkins, J. D. (2006). Science, social work, prevention: Finding the intersections. Social Work Research, 30, 129–192.Google Scholar
  29. Hawkins, J. D., & Catalano, R. F. (2002). Investing in your community’s youth: An introduction to the Communities That Care system. South Deerfield: Channing Bete Company.Google Scholar
  30. Hawkins, J. D., Catalano, R. F., & Associates. (1992). Communities That Care: Action for drug abuse prevention. A joint publication of the Jossey-Bass social and behavioral science series and the Jossey-Bass education series (1st ed.). San Francisco: Jossey-Bass.Google Scholar
  31. Hawkins, J. D., Catalano, R. F., & Arthur, M. W. (2002). Promoting science-based prevention in communities. Addictive Behaviors, 27, 951–976.PubMedCrossRefGoogle Scholar
  32. Hawkins, J. D., & Weis, J. G. (1985). The social development model: An integrated approach to delinquency prevention. Journal of Primary Prevention, 6, 73–97.CrossRefGoogle Scholar
  33. Heck, R. H. (2001). Multilevel modeling with SEM. In G. A. Marcoulides, & R. E. Schumacker (Eds.), New developments and techniques in structural equation modeling (pp. 89–127). Mahwah, NJ: Lawrence Erlbaum Associates.Google Scholar
  34. Himmelman, A. T. (2001). On coalitions and the transformation of power relations: Collaborative betterment and collaborative empowerment. American Journal of Community Psychology, 29, 277.Google Scholar
  35. Hu, L. t., & Bentler, P. M. (1998). Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecification. Psychological Methods, 3, 424–453.CrossRefGoogle Scholar
  36. Kaplan, D., & Elliott, P. R. (1997). A didactic example of multilevel structural equation modeling applicable to the study of organizations. Structural Equation Modeling, 4, 1–24.CrossRefGoogle Scholar
  37. Kreuter, M. W., Lezin, N. A., & Young, L. A. (2000). Evaluating community-based collaborative mechanisms: Implications for practitioners. Health Promotion Practice, 1, 49–63.CrossRefGoogle Scholar
  38. Lasker, R. D. (2000, April, May). Track 3. Promoting collaborations that improve health. Presented at the Community-Campus Partnerships for Health’s 4th Annual Conference, Washington, DC.Google Scholar
  39. Li, F., Duncan, T. E., Harmer, P., Acock, A., & Stoolmiller, M. (1998). Analyzing measurement models of latent variables through multilevel confirmatory factor analysis and hierarchical linear modeling approaches. Structural Equation Modeling, 5, 294–306.Google Scholar
  40. Little, R. J. A., & Rubin, D. B. (1987). Statistical analysis with missing data. New York: Wiley and Sons.Google Scholar
  41. Merzel, C., & D’Afflitti, J. (2003). Reconsidering community-based health promotion: Promise, performance, and potential. American Journal of Public Health, 93, 557.Google Scholar
  42. Mitchell, R. E., Florin, P., & Stevenson, J. F. (2002). Supporting community-based prevention and health promotion initiatives: Developing effective technical assistance systems. Health Education and Behavior, 29, 620–639.PubMedCrossRefGoogle Scholar
  43. Morrissey, E., Andersman, A., Seybolt, D., Nation, M., Crusto, C., & Davino, K. (1997). Toward a framework for bridging the gap between science and practice in prevention: A focus on evaluator and practitioner perspectives. Evaluation and Program Planning, 20, 367–377.CrossRefGoogle Scholar
  44. Mrazek, P. J., & Haggerty, R. J. (Eds.), Committee on Prevention of Mental Disorders, Institute of Medicine. (1994). Reducing risks for mental disorders: Frontiers for prevention intervention research. Washington, DC: National Academy Press.Google Scholar
  45. Muthén, B. O. (1991). Multilevel factor analysis of class and student achievement components. Journal of Educational Measurement, 28, 338–354.CrossRefGoogle Scholar
  46. Muthén, B. O. (1994). Multilevel covariance structure analysis. Sociological Methods and Research, 22, 376–398.CrossRefGoogle Scholar
  47. Muthén, L. K., & Muthén, B. O. (2004). Mplus user’s guide (3rd ed.). Los Angeles: Muthén & Muthén.Google Scholar
  48. Quinby, R. K., Fagan, A. A., Hanson, K., Brooke-Weiss, B., Arthur, M. W., & Hawkins, J. D. (in press). Installing the communities that care prevention system: Implementation progress and fidelity in a randomized controlled trial. Journal of Community Psychology.Google Scholar
  49. Riggs, N. R., Feinberg, M. E., & Greenberg, M. T. (2002). Community sector and gender differences in the perception of community-based prevention. Journal of Community Psychology, 30, 709–722.CrossRefGoogle Scholar
  50. Rogers, E. (1995). Diffusion of innovations (4th ed.). New York: Free Press.Google Scholar
  51. Roussos, S. T., & Fawcett, S. B. (2000). A review of collaborative partnerships as a strategy for improving community health. Annual Review of Public Health, 21, 369–402.PubMedCrossRefGoogle Scholar
  52. Sampson, R. J., Morenoff, J. D., & Gannon-Rowley, T. (2002). Assessing “neighborhood effects”: Social processes and new directions in research. Annual Review of Sociology, 28, 443–478.CrossRefGoogle Scholar
  53. Sampson, R. J., Raudenbush, S. W., & Earls, F. (1997). Neighborhoods and violent crime: A multilevel study of collective efficacy. Science, 277, 918–924.PubMedCrossRefGoogle Scholar
  54. Schwarz, G. (1978). Estimating the dimension of a model. The Annals of Statistics, 6, 461–464.CrossRefGoogle Scholar
  55. Sclove, S. L. (1987). Application of model-selection criteria to some problems in multivariate analysis. Psychometrika, 52, 333–343.CrossRefGoogle Scholar
  56. Shinn, M. (1990). Mixing and matching: Levels of conceptualization, measurement, and statistical analysis in community research. In P. Tolan, C. Keys, F. Chertok, & L. A. Jason (Eds.), Researching community psychology: Issues of theory and methods (pp. 111–126). Washington, DC: American Psychological Association.CrossRefGoogle Scholar
  57. Steiger, J. H., & Lind, J. C. (1980). Statistically based tests for the number of common factors. Presented at the Annual meeting of the Psychometric Society, Iowa City, IA.Google Scholar
  58. Stevenson, J. F., & Mitchell, R. E. (2003). Community-level collaboration for substance abuse prevention. Journal of Primary Prevention, 23, 371–404.CrossRefGoogle Scholar
  59. Taylor-Powell, E., Rossing, B., & Geran, J. (1998). Evaluating collaboratives: Reaching the potential. University of Wisconsin-Extension, Cooperative Extension, Program Development and Evaluation, Madison, WI. Retrieved April 10, 2005, from
  60. Tucker, L. R., & Lewis, C. (1973). A reliability coefficient for maximum likelihood factor analysis. Psychometrika, 38, 1–10.CrossRefGoogle Scholar
  61. Van Horn, M. L., Hawkins, J. D., Arthur, M. W., & Catalano, R. F. (2007). Assessing community effects on adolescent substance use and delinquency. Journal of Community Psychology, 35, 925–946.CrossRefGoogle Scholar
  62. Wandersman, A. (2003). Community science: Bridging the gap between science and practice with community-centered models. American Journal of Community Psychology, 31, 227–242.PubMedCrossRefGoogle Scholar
  63. Wandersman, A., Valois, R., Ochs, L., de la Cruz, D. S., Adkins, E., & Goodman, R. M. (1996). Toward a social ecology of community coalitions. American Journal of Health Promotion, 10, 299–307.PubMedGoogle Scholar
  64. Yin, R. K., Kaftarian, S. J., Yu, P., & Jansen, M. A. (1997). Outcomes from CSAP’s community partnership program: Findings from the national cross-site evaluation. Evaluation and Program Planning, 20, 345–355.CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC 2007

Authors and Affiliations

  • Eric C. Brown
    • 1
    Email author
  • J. David Hawkins
    • 1
  • Michael W. Arthur
    • 1
  • Robert D. Abbott
    • 2
  • M. Lee Van Horn
    • 3
  1. 1.Social Development Research Group, School of Social WorkUniversity of WashingtonSeattleUSA
  2. 2.College of EducationUniversity of WashingtonSeattleUSA
  3. 3.Department of PsychologyUniversity of South CarolinaColumbiaUSA

Personalised recommendations