Prevention Science

, Volume 4, Issue 1, pp 55–63 | Cite as

Examining the Role of Implementation Quality in School-Based Prevention Using the PATHS Curriculum

  • Chi-Ming Kam
  • Mark T. Greenberg
  • Carla T. Walls
Article

Abstract

In order for empirically validated school-based prevention programs to “go to scale,” it is important to understand the processes underlying program dissemination. Data collected in effectiveness trials, especially those measuring the quality of program implementation and administrative support, are valuable in explicating important factors influencing implementation. This study describes findings regarding quality of implementation in a recent effectiveness trial conducted in a high-risk, American urban community. This delinquency prevention trial is a locally owned intervention, which used the Promoting Alternative THinking Skills Curriculum as its major program component. The intervention involved 350 first graders in 6 inner-city public schools. Three schools implemented the intervention and the other 3 were comparison schools from the same school district. Although intervention effects were not found for all the intervention schools, the intervention was effective in improving children's emotional competence and reducing their aggression in schools which effectively supported the intervention. This study, utilizing data from the 3 intervention schools (13 classrooms and 164 students), suggested that 2 factors contributed to the success of the intervention: (a) adequate support from school principals and (b) high degree of classroom implementation by teachers. These findings are discussed in light of the theory-driven models in program evaluation that emphasized the importance of the multiple factors influencing the implementation of school-based interventions.

school-based prevention principal leadership implementation quality effectiveness trial social–emotional learning 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

REFERENCES

  1. Andrews, R., & Sober, R. (1987). Principal instructional leadership and school achievement. Educational Leadership, 44, 9-11.Google Scholar
  2. Blakely, C. H., Mayer, J. P., Gottschalk, R. G., Schmitt, N., Davidson, W. S., Roitman, D. B., & Emshoff, J. G. (1987). The fidelity-adaptation debate: Implications for the implementation of public sector social programs. American Journal of Community Psychology, 15, 253-268.Google Scholar
  3. Bossert, S., Dwyer, D., Rowan, B., & Lee, G. (1982). The instructional management role of the principal. Educational Administration Quarterly, 18, 34-64.Google Scholar
  4. Botvin, G. J., Baker, E., Dusenbury, L., & Botvin, E. M., & Diaz, T. (1995). Long-term follow-up results of a randomized drug abuse prevention trial in a white middle-class population. JAMA, 273, 1106-1112.Google Scholar
  5. Botvin, G. J., Baker, E., Dusenbury, L., Tortu, S., & Botvin, E. M. (1990). Preventing adolescent drug abuse through a multi-modal cognitive-behavioral approach: Results of a 3-year study. Journal of Consulting and Clinical Psychology, 58, 437-446.Google Scholar
  6. Catalano, R. F., Berglund, M. L., Ryan, J. A. M., Lonczak, H. C., & Hawkins, J. D. (1998). Positive youth development in the United States: Research findings on evaluations of positive youth development programs (NICHD Publication). Washington, DC: U.S. Department of Health and Human Services.Google Scholar
  7. Chen, H. T. (1990). Theory-driven evaluations. Newbury Park, CA: Sage.Google Scholar
  8. Chen, H. T. (1998). Theory-driven evaluations. Advances in Educational Productivity, 7, 15-34.Google Scholar
  9. Conduct Problems Prevention Research Group. (1999). Initial impact of the Fast Track prevention trial for conduct problems: II. Classroom effects. Journal of Consulting and Clinical Psychology, 67, 648-657.Google Scholar
  10. Connell, D. B., Turner, R. R., & Mason, E. F. (1985). Summary of the findings of the School Health Education Evaluation: Health promotion effectiveness, implementation, and costs. Journal of School Health, 55, 316-323.Google Scholar
  11. Cubberley, E. P. (1929). Public school administration. New York: Houghton Mifflin.Google Scholar
  12. Dane, A. V., & Schneider, B. H. (1998). Program integrity in primary and early secondary prevention: Are implementation effects out of control. Clinical Psychology Review, 18, 23-45.Google Scholar
  13. Deal, T. (1986). Effective school principals: Counselors, engineers, pawnbrokers, poets... or instructional leaders? In W. Greenfield (Ed.), Instructional leadership: Concepts, issues and controversies (pp. 230-245). Lexington, MA: Allyn & Bacon.Google Scholar
  14. Domitrovich, C. E., & Greenberg, M. T. (2000). The study of implementation: Current findings from effective programs that prevent mental disorders in school-aged children. Journal of Educational and Psychological Consultation, 11(2), 193-221.Google Scholar
  15. Drug Strategies. (1996). Making the grade: A guide to school drug prevention programs. Washington, DC: Drug Strategies.Google Scholar
  16. Drug Strategies. (1998). Safe schools, safe students: A guide to violence prevention strategies. Washington, DC: Drug Strategies.Google Scholar
  17. Durlak, J. A. (1997). Successful prevention programs for children and adolescents. New York: Plenum.Google Scholar
  18. Durlak, J. A. (1998). Why program implementation is important. Journal of Prevention and Intervention in the Community, 17, 5-18.Google Scholar
  19. Durlak, J. A., & Wells, A. M. (1998). Evaluation of indicated preventive intervention (secondary prevention) mental health programs for children and adolescents. American Journal of Community Psychology, 26, 775-802.Google Scholar
  20. Elias, M. J., Bruene-Butler, L., Blum, L., & Schuyler, T. (2000). Voices from the field: Identifying and overcoming roadblocks to carrying out programs in social and emotional learning/emotional intelligence. Journal of Educational and Psychological Consultation, 11(2), 253-272.Google Scholar
  21. Elliot, D. S. (1998). Blueprints for violence prevention. Center for the Study and Prevention of Violence, University of Colorado at Boulder.Google Scholar
  22. Fullan, M., Miles, M. B., & Taylor, G. (1980). Organizational development in schools: The state of the art. Review of Educational Research, 50, 121-183.Google Scholar
  23. Gottfredson, D. C., Fink, C. M., Skroban, S., & Gottfredson, G. D. (1997). Making prevention work. In R. P. Weissberg, T. P. Gullotta, R. L. Hampton, B. A. Ryan, & G. R. Adams (Vol. Eds.), Issues in children's and families' lives, Vol. 9: Healthy children 2010: Establishing preventive services (pp. 219-252). Thousand Oaks, CA: Sage.Google Scholar
  24. Gottfredson, D. C., & Gottfredson, G. D. (2002). Quality of school-based prevention programs: Results from a national survey. Journal of Research on Crime and Delinquency, 39(1), 3-35.Google Scholar
  25. Greenberg, M. T., Domitrovich, C., & Bumbarger, B. (2001). The Prevention of Mental Disorders in SchoolAged Children: Current State of the Field. Prevention and Treatment., Volume 4, Article 1. Available on the World Wide Web: http://journals.apa.org/prevention/volume4/pre004001a.html.Google Scholar
  26. Greenberg, M. T., Domitrovich, C., Graczyk, P. A., & Zins, J. E. (2000). The study of implementation in school-based prevention research: Theory, research, and practice. Report to the Center for Mental Health Services (SAMHSA). Available on the World Wide Web: http://www.prevention.psu.edu/.Google Scholar
  27. Greenberg, M. T., & Kusché, C. A. (1998). Blueprints for violence prevention: The PATHS Project (Vol. 10). Boulder, CO: Institute of Behavioral Science, Regents of the University of Colorado.Google Scholar
  28. Greenberg, M. T., Kusché, C. A., Cook, E. T., & Quamma, J. P. (1995). Promoting emotional competence in school-aged children: The effects of the PATHS curriculum. Development and Psychopathology, 7, 117-136.Google Scholar
  29. Greenfield, W. (1986). Moral imagination and interpersonal competence: Antecedents to instructional leadership. In W. Greenfield (Ed.), Instructional leadership: Concepts, issues and controversies (pp. 56-76). Lexington, MA: Allyn & Bacon.Google Scholar
  30. Gresham, F. M., Gansle, K. A., Noell, G. H., & Cohen, S. (1993). Treatment integrity of school-based behavioral intervention studies: 1980-1990. School Psychology Review, 22, 254-272.Google Scholar
  31. Hall, G. E., & Hord, S. M. (1987). Change in schools: Facilitating the process. Albany, NY: State University of New York Press.Google Scholar
  32. Hall, G. E., & Loucks, S. F. (1977). A developmental model for determining whether the treatment is actually implemented. American Education Research Journal, 14, 236-276.Google Scholar
  33. Hallinger, P., & Heck, R. H. (1996). Reassessing the principal's role in school effectiveness: A review of empirical research, 1980-1995. Educational Administration Quarterly, 32, 5-44.Google Scholar
  34. Hansen, W. B., Graham, J. W., Wolkenstein, B. H., & Lundy, B. Z. (1989). Differential impact of three alcohol prevention curricula on hypothesized mediating variables. Journal of Drug Education, 18, 143-153.Google Scholar
  35. Heck, R. H., Larsen, T. J., & Marcoulides, G. A. (1990). Instructional leadership and school achievement: Validation of a causal model. Educational Administration Quarterly, 26, 94-125.Google Scholar
  36. Hopkins, D. (1990). Integrating staff development and school improvement: A study of teacher personality and school climate. In B. Joyce (Ed.), Changing school culture through staff development. Alexandria, VA: Association for Supervision and Curriculum Development.Google Scholar
  37. Horsley, D. L., & Horsley-Loucks, S. (1998). CBAM Brings Order to the Tornado of Change. Journal of Staff Development, 19, 17-20.Google Scholar
  38. Hoy, W. K., Tarter C. J., & Kottkamp, R. B. (1991). Open schools/healthy students: Measuring organizational climate. Newbury Park, CA: Sage.Google Scholar
  39. Institute of Medicine. (1994). Reducing risks for mental disorders: Frontiers for preventive intervention research. Washington, DC: National Academy Press.Google Scholar
  40. Kam, C., & Greenberg, M. T. (1998). Technical Measurement Report on the Teacher Social Competence Rating Scale. Unpublished technical report, Prevention Research Center for the Promotion of Human Development, The Pennsylvania State University.Google Scholar
  41. Kusché, C. A., & Greenberg, M. T. (1994). The PATHS curriculum. Seattle, WA: Developmental Research and Programs.Google Scholar
  42. Leithwood, K. A., & Duke, (1999). A century's quest to understand school leadership. In J. Murphy & K. S. Louis (Eds.), Handbook of research on educational administration (2nd ed., pp. 45-72). San Francisco, CA: Jossey-Bass.Google Scholar
  43. McKibbin, M., & Joyce, B. (1980). Psychological states and staff development. Theory Into Practice, 19, 248-255.Google Scholar
  44. Mihalic, S. (2001). The importance of implementation fidelity. Blueprints News, 2(1), 1-2.Google Scholar
  45. Pentz, M. A., & Trebow, E. (1985). Implementation issues in drug abuse prevention research. In C. Leukfeld & J. Ludford (Eds.), Adolescent drug abuse: Analyses of treatment research (DHHS Pub No. [89-125488], pp. 123-139). National Institute of Drug Abuse Monograph 56. Washington, DC: Supt. of Docs., U.S. Govt. Print. Off.Google Scholar
  46. Pentz, M. A., Trebow, E. A., Hansen, W. B., MacKinnon, D. P., Dwyer, J. H., Flay, B. R., Daniels, S., Cormack, C., & Johnson, C. A. (1990). Effects of program implementation on adolescent drug use behavior: The Midwestern Prevention Project. Evaluation Review, 14, 264-289.Google Scholar
  47. Rogers, E. M. (1995). Diffusions of innovations. New York: Free Press.Google Scholar
  48. Rohrbach, L. A., Graham, J. W., & Hansen, W. B. (1993). Diffusion of a school-based substance abuse prevention program: Predictors of program implementation. Preventive Medicine: An International Journal Devoted to Practice and Theory, 22, 237-260.Google Scholar
  49. Rowan, B., & Denk, C. E. (1984). Management succession, school socioeconomic context and basic skills achievement. American Education Research Journal, 21, 517-537.Google Scholar
  50. Sarason, S. B. (1982). The culture of the school and the problem of change (2nd ed.). Boston: Allyn & Bacon.Google Scholar
  51. Taggart, V. S., Bush, P. J., Zuckerman, A. E., & Theiss, P. K. (1990). A process evaluation of the District of Columbia "know your body" project. Journal of School Health, 60, 60-66.Google Scholar
  52. Tierney, J. P., Grossman, J. B., & Resch, N. L. (1995). Making a difference: An impact study of big brothers big sisters. Philadelphia, PA: Public/Private Ventures.Google Scholar
  53. Tricker, R., & Davis, L. G. (1988). Implementing drug education in schools: An analysis of the costs and teacher perceptions. Journal of School Health, 58, 181-185.Google Scholar
  54. Weissberg, R. P., & Elias, M. J. (1993). Enhancing young people's social competence and health behavior: An important challenge for educators, scientists, policy makers, and funders. Applied and preventive psychology: Current scientific perspectives, 3, 179-190.Google Scholar
  55. Zins, J. E., Elias, M. J., Greenberg, M. T., & Pruett, M. K. (2000). Special Issue: Implementation of Prevention Programs. Journal of Educational and Psychological Consultation, 11(1), 1-172.Google Scholar

Copyright information

© Society for Prevention Research 2003

Authors and Affiliations

  • Chi-Ming Kam
    • 1
  • Mark T. Greenberg
    • 1
  • Carla T. Walls
    • 2
  1. 1.Prevention Research Center for the Promotion of Human Development, College of Health and Human DevelopmentPennsylvania State UniversityUniversity Park
  2. 2.Harrisburg Center for Healthy Child DevelopmentPennsylvania State UniversityHarrisburg

Personalised recommendations