Advertisement

Illustrating the Multiple Facets and Levels of Fidelity of Implementation to a Teacher Classroom Management Intervention

  • Wendy M. Reinke
  • Keith C. Herman
  • Melissa Stormont
  • Lori Newcomer
  • Kimberly David
Original Article

Abstract

Many school-based interventions to promote student mental health rely on teachers as implementers. Thus, understanding the interplay between the multiple domains of fidelity to the intervention and intervention support systems such as coaching and teacher implementation of new skills is an important aspect of implementation science. This study describes a systematic process for assessing multiple domains of fidelity. Data from a larger efficacy trial of the Incredible Years Teacher Classroom Management (IY TCM) program are utilized. Data on fidelity to the IY TCM workshop training sessions and onsite weekly coaching indicate that workshop leaders and the IY TCM coach implemented the training and coaching model with adequate adherence. Further, workshop leaders’ ratings of engagement were associated with teacher implementation of specific praise, following training on this content. Lastly, the IY TCM coach differentiation of teacher exposure to coaching was evaluated and found to be associated with teacher implementation of classroom management practices and student disruptive behavior.

Keywords

Fidelity School-based intervention Implementation Coaching 

Notes

Acknowledgments

The research reported here was supported by the Institute of Educational Sciences, U.S. Department of Education, through Grant R305A100342 to the first author. The opinions expressed are those of the authors and do not represent views of the Institute or the U.S. Department of Education.

References

  1. Aarons, G., Hulburt, M., & Horwitz, S. (2011). Advancing a conceptual model of evidence-based practice implementation in public service sectors. Administration and Policy in Mental Health and Mental Health Services Research, 38, 4–23. doi: 10.1007/s10488-010-0327-7.PubMedCrossRefGoogle Scholar
  2. Bandura, A. (1977). Social learning theory. Oxford England: Prentice-Hall.Google Scholar
  3. Bandura, A. (1982). Self-efficacy mechanism in human agency. American Psychologist, 37, 122–147. doi: 10.1037/0003-066X.37.2.122.CrossRefGoogle Scholar
  4. Dane, A. V., & Schneider, B. H. (1998). Program integrity in primary and early secondary prevention: Are implementation effects out of control? Clinical Psychology Review, 18, 23–45.PubMedCrossRefGoogle Scholar
  5. Domitrovich, C. E., Bradshaw, C. P., Poduska, J. M., Hoagwood, K., Buckley, J. A., Olin, S., et al. (2008). Maximizing the implementation quality of evidence-based preventive interventions in schools: A conceptual framework. Advances in School Mental Health Promotion, 1, 6–28. doi: 10.1080/1754730X.2008.9715730.CrossRefGoogle Scholar
  6. Driscoll, K. C., Wang, L., Mashburn, A. J., & Pianta, R. C. (2011). Fostering supportive teacher–child relationships: Intervention implementation in a state-funded preschool program. Early Education and Development, 22, 593–619. doi: 10.1080/10409289.2010.502015.CrossRefGoogle Scholar
  7. Durlak, J. A., & DuPre, E. P. (2008). Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41, 327–350. doi: 10.1007/s10464-008-9165-0.PubMedCrossRefGoogle Scholar
  8. Dusenbury, L., Brannigan, L., Falco, M., & Hansen, W. B. (2003). A review of research on fidelity of implementation: Implications for drug abuse prevention in school settings. Health Education Research, 18, 237–256.PubMedCrossRefGoogle Scholar
  9. Forman, S. G., Olin, S., Hoagwood, K., Crowe, M., & Saka, N. (2009). Evidence-based intervention in schools: Developers’ views of implementation barriers and facilitators. School Mental Health, 1, 26–36. doi: 10.1007/s12310-008-9002-5.CrossRefGoogle Scholar
  10. Greenwood, C., Kratochwill, T., & Clements, M. (2008). Schoolwide Prevention Models: Lessons Learned in Elementary School. New York, NY: Guilford Press.Google Scholar
  11. Gresham, F. M. (2009). Evolution of the treatment integrity concept: Current status and future directions. School Psychology Review, 38, 533–540.Google Scholar
  12. Gresham, F. M., Gansle, K. A., Noell, G. H., Cohen, S., & Rosenblum, S. (1993). Treatment integrity of school-based behavioral intervention studies: 1980–1990. School Psychology Review, 22, 254–272.Google Scholar
  13. Ialongo, N., Poduska, J., Werthamer, L., & Kellam, S. (2001). The distal impact of two first-grade preventive interventions on conduct problems and disorder in early adolescence. Journal of Emotional and Behavioral Disorders, 9(3), 146–160.CrossRefGoogle Scholar
  14. Kellam, S. G., Ling, X., Merisca, R., Brown, C. H., & Ialongo, N. (1998). The effect of the level of aggression in the first grade classroom on the course and malleability of aggressive behavior into middle school. Development and Psychopathology, 10(2), 165–185.PubMedCrossRefGoogle Scholar
  15. Landsverk, J., Brown, C., Rolls, R. J., Palinkas, L., & Horwitz, S. (2011). Design elements in implementation research: A structured review of child welfare and child mental health studies. Administration and Policy in Mental Health and Mental Health Services Research, 38, 54–63.PubMedCrossRefGoogle Scholar
  16. Leff, S., Hoffman, J., & Gullan, R. (2009). Intervention integrity: New paradigms and applications. School Mental Health, 3, 103–106. doi: 10.1007/s12310-009-9013-x.CrossRefGoogle Scholar
  17. Leflot. G., van Lier, P. A. C., Onghena, P., & Colpin, H. (2010). The role of teacher behavior management in the development of disruptive behaviors: An intervention study with the good behavior game. Journal of Abnormal Child Psychology, 38, 869–882.PubMedCrossRefGoogle Scholar
  18. National Research Council. (2002). Minority students in special and gifted education. Committee on Minority Representation in Special Education. Washington, DC.: National Academy Press.Google Scholar
  19. Noell, G. H., Duhon, G. J., Gatti, S. L., & Connell, J. E. (2002). Consultation, follow-up, and implementation of behavior management interventions in general education. School Psychology Review, 31, 217–234.Google Scholar
  20. Perepletchikova, F. (2011). On the topic of treatment integrity. Clinical Psychology: Science and Practice, 18, 148–153. doi: 10.1111/j.1468-2850.2011.01246.x.CrossRefGoogle Scholar
  21. Perepletchikova, F., & Kazdin, A. E. (2005). Treatment integrity and therapeutic change: Issues and research recommendations. Clinical Psychology: Science and Practice, 12, 365–383. doi: 10.1093/clipsy/bpi045.CrossRefGoogle Scholar
  22. Power, T. J., Blom-Hoffman, J., Clarke, A. T., Riley-Tillman, T., Kelleher, C., & Manz, P. H. (2005). Reconceptualizing intervention integrity: A partnership-based framework for linking research with practice. Psychology in the Schools, 42, 495–507. doi: 10.1002/pits.20087.CrossRefGoogle Scholar
  23. Ransford, C. R., Greenberg, M. T., Domitrovich, C. E., Small, M., & Jacobson, L. (2009). The role of teachers’ psychological experiences and perceptions of curriculum supports on the implementation of a social and emotional learning curriculum. School Psychology Review, 38, 510–532.Google Scholar
  24. Reinke, W. M., Herman, K. C., & Stormont, M. (2013). Classroom level positive behavior supports in schools implementing SW-PBIS: Identifying areas for enhancement. Journal of Positive Behavior Interventions, 15, 51–60.CrossRefGoogle Scholar
  25. Reinke, W. M., & Newcomer, L. (2010). Brief classroom interaction observation revised (BCIO-R). Cambridge: University of Missouri.Google Scholar
  26. Reinke, W. M., Stormont, M., Herman, K. C., Puri, R., & Goel, N. (2011). Supporting children’s mental health in schools: Teacher perceptions of needs, roles, and barriers. School Psychology Quarterly, 26, 1–13. doi: 10.1037/a0022714.CrossRefGoogle Scholar
  27. Reinke, W. M., Stormont, M., Webster-Stratton, C., Newcomer, L., & Herman, K. C. (2012). The incredible years teacher training: Using coaching to support generalization to real world classroom settings. Psychology in the Schools, 49, 416–428.CrossRefGoogle Scholar
  28. Rones, M., & Hoagwood, K. (2000). School-based mental health services: A research review. Clinical Child Family Psychology Review, 3, 223–241.PubMedCrossRefGoogle Scholar
  29. Schoenwald, S. K., & Hoagwood, K. (2001). Effectiveness, transportability, and dissemination of interventions: What matters when? Psychiatric Services, 52, 1190–1197. doi: 10.1176/appi.ps.52.9.1190.PubMedCrossRefGoogle Scholar
  30. Shepard, S. & Rivera, M. (2009). Therapist Impressions of Participation (unpublished).Google Scholar
  31. Shernoff, E., Marinez-Lora, A., Frazier, S., Jakobsons, L., & Atkins, M. (2011). Teacher supporting teachers in urban schools: What iterative research designs can teach us. School Psychology Review, 40, 465–485.PubMedGoogle Scholar
  32. Snyder, J., Low, S., Schultz, T., Barner, S., Moreno, D., Garst, M., et al. (2011). The impact of brief teacher training on classroom management and child behavior in at-risk preschool settings: Mediators and treatment utility. Journal of Applied Developmental Psychology, 32, 336–345. doi: 10.1016/j.appdev.2011.06.001.CrossRefGoogle Scholar
  33. Stormont, M., Reinke, W. M., Newcomer, L., Darney, D., Lewis, C. (2013). Coaching teachers’ use of social behavior interventions to improve children’s outcomes: A review of the literature. (submitted).Google Scholar
  34. Tapp, J. (2004). Multi-option observation system for experimental studies (MOOSES). Retrieved from http://kc.vanderbilt.edu/mooses/mooses.html.
  35. Walter, H. J., Gouze, K., & Lim, K. G. (2006). Teachers’ beliefs about mental health needs of inner city elementary schools. Journal of the American Academy of Child and Adolescent Psychiatry, 45, 61–68. doi: 10.1097/01.chi.0000187243.17824.6c.PubMedCrossRefGoogle Scholar
  36. Webster-Stratton, C. (1994). The incredible years teacher training series. Seattle, WA: Incredible Years Press.Google Scholar
  37. Webster-Stratton, C. (2001). The incredible years: Parents, teachers, and children training series. Residential Treatment for Children & Youth, 18(3), 31–45. doi: 10.1300/J007v18n03_04.CrossRefGoogle Scholar
  38. Webster-Stratton, C. (2010a). Incredible years teacher workshop evaluation. Seattle, WA: Incredible Years.Google Scholar
  39. Webster-Stratton, C. (2010b). Incredible years teacher workshop satisfaction questionnaire. Seattle, WA: Incredible Years.Google Scholar
  40. Webster-Stratton, C., Reid, M., & Hammond, M. (2001). Preventing conduct problems, promoting social competence: A parent and teacher training partnership in head start. Journal of Clinical Child Psychology, 30, 283–302. doi: 10.1207/S15374424JCCP3003_2.PubMedCrossRefGoogle Scholar
  41. Webster-Stratton, C., Reid, M., & Hammond, M. (2004). Treating children with early-onset conduct problems: Intervention outcomes for parent, child, and teacher training. Journal of Clinical Child and Adolescent Psychology, 33, 105–124. doi: 10.1207/S15374424JCCP3301_11.PubMedCrossRefGoogle Scholar
  42. Webster-Stratton, C., Reid, M., & Stoolmiller, M. (2008). Preventing conduct problems and improving school readiness: Evaluation of the incredible years teacher and child training programs in high-risk schools. Journal of Child Psychology and Psychiatry, 49, 471–488. doi: 10.1111/j.1469-7610.2007.01861.x.PubMedCrossRefGoogle Scholar
  43. Wehby, J. H. (2010). Teacher/consultant alliance scale. Nashville, TN: Vanderbilt University.Google Scholar
  44. Weinstein, C. S. (2007). Middle and secondary classroom management: Lessons from research and practice (3rd ed.). New York, NY: McGraw-Hill.Google Scholar
  45. Wenz-Gross, M., & Upshur, C. (2012). Implementing a primary prevention social skills intervention in urban preschools: Factors associated with quality and fidelity. Early Education and Development, 23, 427–450. doi: 10.1080/10409289.2011.589043.PubMedCrossRefGoogle Scholar
  46. World Health Organization. (2004). Prevention of mental disorders: Effective interventions and policy options. Summary report. World Health Organization: Geneva.Google Scholar

Copyright information

© Springer Science+Business Media New York 2013

Authors and Affiliations

  • Wendy M. Reinke
    • 1
  • Keith C. Herman
    • 1
  • Melissa Stormont
    • 2
  • Lori Newcomer
    • 1
  • Kimberly David
    • 1
  1. 1.Department of Educational, School, & Counseling PsychologyUniversity of MissouriColumbiaUSA
  2. 2.Department of Special EducationUniversity of MissouriColumbiaUSA

Personalised recommendations