Abstract
Social, emotional, and behavioral interventions are often complicated to implement in school settings. Empirical and practical evidence suggests that educators need support to implement interventions with treatment integrity or as intended. Treatment integrity is comprised of multiple dimensions that capture quantity of the intervention delivered, quality of that delivery, and implementers’ engagement with the intervention procedures. Whereas research in this area often focuses on the integrity with which interventions are delivered to students, treatment integrity can be measured and assessed across the intervention implementation process from training implementers to use an intervention to the actual use of an intervention. In fact, engagement in early intervention implementation processes may be critical for the immediate and sustained success of an intervention, particularly engagement during professional development or trainings designed to teach the skills associated with an intervention. One evidence-based intervention that includes structured training in intervention procedures (e.g., effective classroom management) is the Incredible Years Teacher Classroom Management (IY TCM) program. The purpose of this study was to examine teachers’ engagement in IY TCM training sessions, their sustained intervention implementation, and student behavior over time. Using a sample of 44 teachers implementing IY TCM, we found that teachers’ sustained implementation of intervention skills and students’ disruptive behavior in the classroom differed based on how engaged they reportedly were in the intervention trainings. The findings underscore the importance of assessing and promoting engagement in training sessions.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Copeland, C. (2018). The use of electronic feedback to strength teacher intervention beliefs, knowledge, attitudes, and intentions. Unpublished doctoral dissertation. University of Missouri.
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009). Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implementation Science, 4, 50–65. https://doi.org/10.1186/1748-5908-4-50
Dane, A. V., & Schneider, B. H. (1998). Program integrity in primary and early secondary prevention: Are implementation effects out of control? Clinical Psychology Review, 18, 23–45. https://doi.org/10.1016/S0272-7358(97)00043-3
DeCoster, J., Gallucci, M., & Iselin, A.-M.R. (2011). Best practices for using median splits, artificial categorization, and their continuous alternatives. Journal of Experimental Psychopathology, 2, 197–209. https://doi.org/10.5127/jep.0008319
Duong, M. T., Bruns, E. J., Lee, K., Cox, S., Coifman, J., Mayworm, A., & Lyon, A. R. (2020). Rates of mental health service utilization by children and adolescents in schools and other common service settings: A systematic review and meta-analysis. Administration and Policy in Mental Health and Mental Health Services Research. https://doi.org/10.1007/s10488-020-01080-9
Durlak, J. A. (2016). Programme implementation in social and emotional learning: Basic issues and research findings. Cambridge Journal of Education, 46, 333–345. https://doi.org/10.1080/0305764X.2015.1142504
Ennett, S. T., Ringwalt, C. L., Thorne, J., Rohrbach, L. A., Vincus, A., Simons-Rudolph, A., & Jones, S. (2003). A comparison of current practice in school-based substance use prevention programs with meta-analysis findings. Prevention Science, 4, 1–14. https://doi.org/10.1023/a:1021777109369
Farrington, D., & Loeber, R. (2000). Some benefits of dichotomization in psychiatric and criminological research. Criminal Behaviour and Mental Health, 10, 100–122.
Forman, S. G., Shapiro, E. S., Codding, R. S., Gonzales, J. E., Reddy, L. A., Rosenfield, S. A., Sanetti, L., & Stoiber, K. C. (2013). Implementation science and school psychology. School Psychology Quarterly, 28, 77–100. https://doi.org/10.1037/spq0000019
Hans, S. S., & Weiss, B. (2005). Sustainability of teacher implementation of school-based mental health problems. Journal of Abnormal Child Psychology, 33, 665–579. https://doi.org/10.1007/s10802-005-7646-2
Herlitz, L., MacIntyre, H., Osborn, T., & Bonell, C. (2020). The sustainability of public health interventions in schools: A systematic review. Implementation Science, 15, 4. https://doi.org/10.1186/s13012-019-0961-8
Jaccard, J., Dodge, T., & Dittus, P. (2002). Parent-adolescent communication about sex and birth control: A conceptual framework. In S. Feldman & D. A. Rosenthal (Eds.), Talking sexuality: Parent-adolescent communication. San Francisco: New Directions in Child and Adolescent Development.
Kealey, K. A., Peterson, A. V., Gaul, M. A., & Dinh, K. T. (2000). Teacher training as a behavior change process: Principles and results from a longitudinal study. Health Education & Behavior, 27, 64–81. https://doi.org/10.1177/109019810002700107
Kretlow, A. G., & Bartholomew, C. C. (2010). Using coaching to improve the fidelity of evidence-based practices: A review of studies. Teacher Education and Special Education, 33, 279–299. https://doi.org/10.1177/0888406410371643
Long, A. C. J., Sanetti, L. M. H., Collier-Meek, M. A., Gallucci, J., Altschaefl, M., & Kratochwill, T. R. (2016). An exploratory investigation of teachers’ intervention planning and perceived implementation barriers. Journal of School Psychology, 55, 1–26.
Lyon, A. R., Cook, C. R., Duong, M. T., Nicodimos, S., Pullmann, M. D., Brewer, S. K., & Cox, S. (2019). The influence of a blended, theoretically-informed pre-implementation strategy on school-based clinician implementation of an evidence-based trauma intervention. Implementation Science, 14, 54. https://doi.org/10.1186/s13012-019-0905-3
McIntosh, K., Mercer, S. H., Hume, A. E., Frank, J. L., Turri, M. G., & Matthews, S. (2013). Factors related to sustained implementation of schoolwide positive behavior support. Exceptional Children, 79, 293–311.
Merikangas, K. R., He, J. P., Burstein, M., Swanson, S. A., Avenevoli, S., Cui, L., Benjet, C., Georgiades, K., & Swendsen, J. (2010). Lifetime prevalence of mental disorders in U.S. adolescents: Results from the National Comorbidity Survey Replication-Adolescent Supplement (NCS-A). Journal of the American Academy of Child and Adolescent Psychiatry, 49, 980–989. https://doi.org/10.1016/j.jaac.2010.05.017
Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., Griffey, R., & Hensley, M. (2011). Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda. Administration and Policy in Mental Health, 38, 65–76. https://doi.org/10.1007/s10488-010-0319-7
Reinke, W. M., Herman, K. C., & Dong, N. (2018). The incredible years teacher classroom management program: Findings from a group randomized trial. Prevention Science, 19, 1043–1054. https://doi.org/10.1007/s11121-018-0923-3
Reinke, W. M., Herman, K. C., & Sprick, R. (2011). Motivational interviewing for effective classroom management: The classroom check-up. Guilford Press.
Reinke, W. M., Herman, K. C., Stormont, M., Newcomer, L., & David, K. (2013). Illustrating the multiple facets and levels of fidelity of implementation to a teacher classroom management intervention. Administration and Policy in Mental Health, 40, 494–506. https://doi.org/10.1007/s10488-013-0496-2
Reinke, W. M., Newcomer, L. (2010). Brief Classroom Interaction Observation Revised.
Reinke, W. M., Stormont, M., Herman, K. C., & Newcomer, L. (2014). Using coaching to support teacher implementation of classroom-based interventions. Journal of Behavioral Education, 23, 150–167. https://doi.org/10.1007/s10864-013-9186-0
Ross, J. G., Luepker, R. V., Nelson, G. D., Saavedra, P., & Hubbard, B. M. (1991). Teenage health teaching modules: Impact of teacher training on implementation and student outcomes. Journal of School Health, 61, 31–34. https://doi.org/10.1111/j.1746-1561.1991.tb07856.x
Sanetti, L. M. H., & Collier-Meek, M. A. (2019). Increasing implementation science literacy to address the research-to-practice gap in school psychology. Journal of School Psychology, 76, 33–47. https://doi.org/10.1016/j.jsp.2019.07.008
Shapiro, E. S. (2004). Academic skills problems: Direct assessment and intervention (3rd ed.). Guilford.
Shepard, S., Rivera, M. (2009). Therapist Impressions of Participation [unpublished instrument].
Sheridan, S. M., Rispoli, K., & Holmes, S. R. (2013). Treatment integrity in conjoint behavioral consultation: Conceptualizing active ingredients and potential pathways of influence. In L. Sanetti & T. Kratochwill (Eds.), Treatment integrity: Conceptual, methodological, and applied considerations for practitioners (pp. 255–278). American Psychological Association.
Sugai, G., & Horner, R. (2002). The evolution of discipline practices: School-wide positive behavior supports. Child & Family Behavior Therapy, 24, 23–50. https://doi.org/10.1300/J019v24n01_03
Wanless, S. B., Rimm-Kaufman, S. E., Abry, T., Larson, R. A., & Patton, C. L. (2015). Engagement in training as a mechanism to understanding fidelity of implementation of the responsive classroom approach. Prevention Science, 16, 1107–1116. https://doi.org/10.1007/s11121-014-0519-6
Webster-Stratton, C. (2001). The incredible years: Parents, teachers, and children training series. Residential Treatment for Children & Youth, 18, 31–45. https://doi.org/10.1300/J007v18n03_04
Webster-Stratton, C. (2010). Incredible years teacher workshop evaluation. Seattle, WA: Incredible Years.
Webster-Stratton, C., Reid, M. J., & Hammond, M. (2001). Preventing conduct problems, promoting social competence: A parent and teacher training partnership in head start. Journal of Clinical Child Psychology, 30, 283–302. https://doi.org/10.1207/s15374424jccp3003_2
Webster-Stratton, C., Reid, M. J., & Hammond, M. (2004). Treating children with early-onset conduct problems: Intervention outcomes for parent, child, and teacher training. Journal of Clinical Child and Adolescent Psychology, 33, 105–124. https://doi.org/10.1207/s15374424jccp3301_11
Webster-Stratton, C., Reid, M., & Stoolmiller, M. (2008). Preventing conduct problems and improving school readiness: Evaluation of the incredible years teacher and child training programs in high-risk schools. Journal of Child Psychology and Psychiatry, 49, 471–488. https://doi.org/10.1111/j.1469-7610.2007.01861.x
Wilson, M. S., & Reschly, D. J. (1996). Assessment in school psychology training and practice. School Psychology Review, 25, 9.
Funding
Funding was provided by Institute of Education Sciences (Grant No. R305A100342).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
We have no conflicts of interest to disclose.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Holmes, S.R., Reinke, W.M., Herman, K.C. et al. An Examination of Teacher Engagement in Intervention Training and Sustained Intervention Implementation. School Mental Health 14, 63–72 (2022). https://doi.org/10.1007/s12310-021-09457-3
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12310-021-09457-3