Abstract
Organizational climate has been proposed as a factor that might influence a school’s readiness to successfully implement school-wide prevention programs. The aim of this study was to evaluate the influence of teachers’ perceptions of three dimensions of school organizational climate on the dosage and quality of teacher implementation of Positive Action, a social-emotional and character development (SECD) program. The dimensions measured were teachers’ perceptions of (a) the school’s openness to innovation, (b) the extent to which schools utilize participatory decision-making practices, and (c) the existence of supportive relationships among teachers (teacher-teacher affiliation). Data from 46 teachers in seven schools enrolled in the treatment arm of a longitudinal, cluster-randomized, controlled trial were analyzed. Teacher perceptions of a school’s tendency to be innovative was associated with a greater number of lessons taught and self-reported quality of delivery, and teacher-teacher affiliation was associated with a higher use of supplementary activities. The findings suggest that perceptions of a school’s organizational climate impact teachers’ implementation of SECD programs and have implications for school administrators and technical assistance providers as they work to implement and sustain prevention programs in schools.
Similar content being viewed by others
References
Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011). Advancing a conceptual model of evidence-based practice implementation in public service sectors. Administration and Policy in Mental Health, 38, 4–23. doi:10.1007/s10488-010-0327-7.
Abry, T., Rimm-Kaufman, S. E., Larsen, R. A., & Brewer, A. J. (2013). The influence of fidelity of implementation on teacher-student interaction quality in the context of a randomized controlled trial of the Responsive Classroom approach. Journal of School Psychology, 51, 437–453. doi:10.1016/j.jsp.2013.03.001.
Akers, R. L. (1998). Social learning and social structure: A general theory of crime and deviance. Boston, MA: Northeastern University Press.
Bandura, A. (1986). Social foundations of thought and action: A cognitive theory. Englewood Cliffs, NJ: Prentice Hall.
Bavarian, N., Lewis, K. M., DuBois, D. L., Acock, A., Vuchinich, S., Silverthorn, N., & Flay, B. R. (2013). Using social-emotional and character development to improve academic outcomes: A matched-pair, cluster-randomized controlled trial in low-income, urban schools. Journal of School Health, 83, 771–779. doi:10.1111/josh.12093.
Beets, M. W., Flay, B. R., Vuchinich, S., Acock, A. C., Li, K., & Allred, C. (2008). School climate and teachers’ beliefs and attitudes associated with implementation of the positive action program: A diffusion of innovations model. Prevention Science, 9, 264–275. doi:10.1007/s11121-008-0100-2.
Beets, M. W., Flay, B. R., Vuchinich, S., Snyder, F. J., Acock, A., Li, K., Burns, K., & Durlak, J. (2009). Use of a social and character development program to prevent substance use, violent behaviors, and sexual activity among elementary-school students in Hawaii. American Journal of Public Health, 99, 1438–1445. doi:10.2105/AJPH.2008.142919.
Bickman, L., Brown, J. L., Flay, B. R., Li, K., Pelham, W., Massetti, G., & Dupre, D. (2009). Approaches to measuring implementation fidelity in school-based program evaluations. Journal of Research in Character Education, 7, 75–101.
Biggs, B. K., Vernberg, E. M., Twemlow, S. W., Fonagy, P., & Dill, E. J. (2008). Teacher adherence and its relation to teacher attitudes and student outcomes in an elementary school-based violence prevention program. School Psychology Review, 37, 533–549.
Bronfenbrenner, U. (2005). Making human beings human: Bioecological perspectives on human development. Thousand Oaks, CA: Sage Publications.
Coffey, J. H., & Horner, R. H. (2012). The sustainability of schoolwide positive behavior interventions and supports. Exceptional Children, 78, 407–422.
Cook, J. M., O’Donnell, C., Dinnen, S., Coyne, J. C., Ruzek, J. I., & Schnurr, P. P. (2012). Measurement of model of implementation for health care: Toward a testable theory. Implementation Science, 7. doi:10.1186/1748-5908-7-59.
Damanpour, F. (1991). Organizational innovation: A meta-analysis of effects of determinants and moderators. Academy of Management Journal, 34, 555–590.
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009). Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implementation Science, 4. doi:10.1186/1748-5908-4-50.
Domitrovich, C. E., Bradshaw, C. P., Poduska, J. M., Hoagwood, K., Buckley, J. A., Olin, S., & Ialongo, N. S. (2008). Maximizing the implementation quality of evidence-based preventive interventions in schools: A conceptual framework. Advances in School Mental Health Promotion, 1, 6–28. doi:10.1080/1754730X.2008.9715730.
DuBois, D. L., Flay, B. R., & Fagen, M. C. (2009). Self-esteem enhancement theory: An emerging framework for promoting health across the life-span. In R. J. DiClemente, M. C. Kegler, & R. A. Crosby (Eds.), Emerging theories in health promotion practice and research (2nd ed., pp. 97–130). San Francisco, CA: Jossey-Bass.
Durlak, J. A., & DuPre, E. P. (2008). Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41, 327–350. doi:10.1007/s10464-008-9165-0.
Durlak, J. A., Weissberg, R. P., Dymnicki, A. B., Taylor, R. D., & Schellinger, K. B. (2011). The impact of enhancing students’ social and emotional learning: A meta-analysis of school-based universal interventions. Child Development, 82, 405–432. doi:10.1111/j.1467-8624.2010.01564.x.
Ennett, S. T., Ringwalt, C. L., Thorne, J., Rohrbach, L. A., Vincus, A., Simons-Rudolph, A., & Jones, S. (2003). A comparison of current practice in school-based substance use prevention programs with meta-analysis findings. Prevention Science, 4, 1–14.
Ennett, S. T., Haws, S., Ringwalt, C. L., Vincus, A. A., Hanley, S., Bowling, J. M., & Rohrback, L. A. (2011). Evidence-based practice in school substance use prevention: Fidelity of implementation under real-world conditions. Health Education Research, 26, 361–371.
Fisher, D. L., & Fraser, B. J. (1990, April). Validity and use of the school-level environment questionnaire. Paper presented at the Annual Meeting of the American Educational Research Association, Boston, MA. Retrieved from ERIC database. (ED318757).
Fisher, D. L., & Fraser, B. J. (1991). Validity and use of school environment instruments. Journal of Classroom Interaction, 26, 13–18.
Fixsen, D. L., Naoom, S. F., Blase, K. A., Friedman, R. M., & Wallace, F. (2005). Implementation Research: A synthesis of the literature. Tampa, FL: University of South Florida.
Fixsen, D., Blase, K., Metz, A., & Van Dyke, M. (2013). Statewide implementation of evidence-based programs. Exceptional Children, 79, 213–230.
Flaspohler, P., Duffy, J., Wandersman, A., Stillman, L., & Maras, M. A. (2008). Unpacking prevention capacity: An intersection of research-to-practice models and community-centered models. American Journal of Community Psychology, 41, 182–196. doi:10.1007/s10464-008-9162-3.
Flay, B. R., & Allred, C. G. (2003). Long-term effects of the Positive Action program. American Journal of Health Behavior, 27, S6–S21.
Flay, B. R., & Allred, C. G. (2010). The Positive Action program: Improving academics, behavior, and character by teaching comprehensive skills for successful learning and living. In T. Lovat, R. Toomey, & N. Clement (Eds.), International research handbook on values education and student wellbeing (pp. 471–501). Dordrecht: Springer Netherlands.
Flay, B. R., Allred, C. G., & Ordway, N. (2001). Effects of the Positive Action program on achievement and discipline: Two matched-control comparisons. Prevention Science, 2, 71–89.
Flay, B. R., Snyder, F., & Petraitis, J. (2009). The theory of triadic influence. In R. J. DiClemente, M. C. Kegler, & R. A. Crosby (Eds.), Emerging theories in health promotion practice and research (2nd ed., pp. 451–510). New York, NY: Jossey-Bass.
Gottfredson, G. D., Jones, E. M., & Gore, T. W. (2002). Implementation and evaluation of a cognitive–behavioral intervention to prevent problem behavior in a disorganized school. Prevention Science, 3, 43–56.
Greenhalgh, T., Robert, G., Macfarlane, F., Bate, P., & Kyriakidou, O. (2004). Diffusion of innovations in service organizations: Systematic review and recommendations. Milbank Quarterly, 82, 581–629. doi:10.1111/j.0887-378X.2004.00325.x.
Gregory, A., Henry, D. B., & Schoeny, M. E. (2007). School climate and implementation of a preventive intervention. American Journal of Community Psychology, 40, 250–260. doi:10.1007/s10464-007-9142-z.
Hawkins, J. D., & Weis, J. G. (1985). The social development model: An integrated approach to delinquency prevention. Journal of Primary Prevention, 6, 73–97.
Hox, J. (2010). Multilevel analysis: Techniques and applications. Mahwah, NJ: Lawrence Erlbaum.
Johnson, B., & Stevens, J. J. (2001). Exploratory and confirmatory factor analysis of the school level environment questionnaire (SLEQ). Learning Environments Research, 4, 325–344.
Kallestad, J. H., & Olweus, D. (2003). Predicting teachers’ and schools’ implementation of the Olweus Bullying Prevention Program: A multilevel study. Prevention and Treatment, 6. doi:10.1037/1522-3736.6.1.621a.
Lane, K. L., Bocian, K. M., MacMillan, D. L., & Gresham, F. M. (2004). Treatment integrity: An essential—but often forgotten—component of school-based interventions. Preventing School Failure, 48.
Lewis, K. M., DuBois, D. L., Bavarian, N., Acock, A., Silverthorn, N., Day, J., & Flay, B. R. (2013a). Effects of Positive Action on the emotional health of urban youth: A cluster-randomized trial. Journal of Adolescent Health. doi:10.1016/j.jadohealth.2013.06.012.
Lewis, K. M., Schure, M., Bavarian, N., DuBois, D. L., Day, J., Ji, P., & Flay, B. R. (2013b). Problem behavior and urban, low-income youth: A randomized controlled trial of Positive Action in Chicago. American Journal of Preventive Medicine, 44, 622–630. doi:10.1016/j.amepre.2013.01.030.
Li, K., Washburn, I., DuBois, D. L., Vuchinich, S., Ji, P., Brechling, V., & Flay, B. R. (2011). Effects of the Positive Action programme on problem behaviors in elementary school students: A matched-pair, randomized control trial in Chicago. Psychology and Health, 26, 187–204. doi:10.1080/08870446.2011.531574.
Low, S., Van Ryzin, M. J., Brown, E. C., Smith, B. H., & Haggerty, K. P. (2013). Engagement matters: Lessons from assessing classroom implementation of steps to respect: A bullying prevention program over a one-year period. Prevention Science. doi:10.1007/s11121-012-0359-1.
McCormick, L. K., Steckler, A. B., & McLeroy, K. R. (1995). Diffusion of innovations in schools: A study of adoption and implementation of school-based tobacco prevention curricula. American Journal of Health Promotion, 9, 210–219.
Moos, R. H. (1974). The Social Climate Scales. Palo Alto, CA: Consulting Psychologists Press.
Moos, R. H. (1994). The social climate scales: A user’s guide (3rd ed.). Redwood City, CA: Mind Garden, Inc.
Payne, A. A., & Eckert, R. (2010). The relative importance of provider, program, school, and community predictors of the implementation quality of school-based prevention programs. Prevention Science, 11, 126–141. doi:10.1007/s11121-009-0157-6.
Peters, R. D., & McMahon, R. J. (1996). Preventing childhood disorders, substance abuse, and delinquency. Thousand Oaks, CA: Sage Publications, Inc.
Ransford, C. R., Greenberg, M. T., Domitrovich, C. E., Small, M., & Jacobson, L. (2009). The role of teachers’ psychological experiences and perceptions of curriculum supports on the implementation of a social and emotional learning curriculum. School Psychology Review, 38, 510–532.
Rentoul, A. J., & Fraser, B. J. (1983). Development of a school-level environment questionnaire. Journal of Educational Administration, 11, 21–38.
Ringwalt, C. L., Ennett, S., Johnson, R., Rohrbach, L. A., Simons-Rudolph, A., & Vincus, A. (2003). Health Education & Behavior, 30, 375–391. doi:10.1177/1090198103253627.
Snyder, F., Flay, B., Vuchinich, S., Acock, A., Washburn, I., Beets, M. W., & Li, K. (2010). Impact of a social-emotional and character development program on school-level indicators of academic achievement, absenteeism, and disciplinary outcomes: A matched-pair, cluster-randomized, controlled trial. Journal of Research on Educational Effectiveness, 3, 26–55. doi:10.1080/19345740903353436.
Snyder, F. J., Vuchinich, S., Acock, A., Washburn, I. J., & Flay, B. R. (2012). Improving elementary school quality through the use of a social-emotional and character development program: A matched pair, cluster-randomized, controlled trial in Hawai’i. Journal of School Health, 82, 11–20.
Spoth, R., Rohrback, L. A., Greenberg, M., Leaf, P., Brown, C. H., Fagan, A., & Hawkins, J. D. (2013). Addressing core challenges for the next generation of type 2 translation research and systems: The translation science to population impact (TSci Impact) framework. Prevention Science, 14, 319–351. doi:10.1007/s11121-012-0362-6.
Tseng, V., & Seidman, E. (2007). A systems framework for understanding social settings. American Journal of Community Psychology, 39, 217–228.
Wandersman, A., Duffy, J., Flaspohler, P., Noonan, R., Lubell, K., Stillman, L., & Saul, J. (2008). Bridging the gap between prevention research and practice: The interactive systems framework for dissemination and implementation. American Journal of Community Psychology, 41, 171–181. doi:10.1007/s10464-008-9174.
Weiner, B. J. (2009). A theory of organizational readiness for change. Implementation Science, 4. doi:10.1186/1748-5908-4-67
Acknowledgments
This project was funded by grants from the Institute of Education Sciences (IES), U.S. Department of Education: R305L030072, R305L030004, and R305A080253 to the University of Illinois, Chicago (2003–2005) and Oregon State University (2005–2012). The initial phase (R305L030072), a component of the Social and Character Development (SACD) Research Consortium, was a collaboration among IES, the Centers for Disease Control and Prevention’s (CDC) Division of Violence Prevention, Mathematica Policy Research Inc. (MPR), and awardees of SACD cooperative agreements (Children’s Institute, New York University, Oregon State University, University at Buffalo-SUNY, University of Maryland, University of North Carolina-Chapel Hill, and Vanderbilt University). Funding for this project was sponsored in part by NIAAA T32 AA014125. The SACD research program includes multi-program evaluation data collected by MPR and complementary research study data collected by each grantee. The findings reported here are based only on the Chicago portion of the multi-program data and the complementary research data collected by the University of Illinois at Chicago and Oregon State University (Brian Flay, Principal Investigator) under the SACD program. The findings and conclusions in this report are those of the authors and do not necessarily represent the official position of the Institute of Education Sciences, CDC, MPR, or every Consortium member, nor does mention of trade names, commercial products, or organizations imply endorsement by the U.S. Government. Correspondence concerning this article should be addressed to the author. We are extremely grateful to the participating Chicago Public Schools (CPS), their principals, teachers, students, and parents. We thank the CPS Research Review Board and Office of Specialized Services, especially Drs. Renee Grant-Mitchell and Inez Drummond, for their invaluable support of this research.
Conflict of Interest
The research described herein was conducted using the program, the training, and technical support of Positive Action, Inc. in which Brian Flay’s spouse holds a significant financial interest. Issues regarding conflict of interest were reported to the relevant institutions and appropriately managed following the institutional guidelines.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Malloy, M., Acock, A., DuBois, D.L. et al. Teachers’ Perceptions of School Organizational Climate as Predictors of Dosage and Quality of Implementation of a Social-Emotional and Character Development Program. Prev Sci 16, 1086–1095 (2015). https://doi.org/10.1007/s11121-014-0534-7
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11121-014-0534-7