Change Agent Training in Behavior Analytic Procedures for People with Developmental and Intellectual Disabilities: A Meta-Analysis
This paper reports a meta-analysis to evaluate procedures to train change agents in discrete trial teaching, preference assessment, and mand training. Behavioral skills training packages were the most commonly used and were consistently and highly effective in changing change agent behavior. Procedural variation in training overlapped in effectiveness. Training was slightly less effective for parents than for staff and university students. The effect size for the behavior of the individuals with whom the change agents applied behavioral procedures was slightly smaller than for change agents and was reported in only about one third of papers. Behavioral skills training is a highly effective and robust approach to delivering change agent training for different skills training procedures.
KeywordsChange agent Behavioral skills training Training Developmental disabilities
Thanks are due to Maya Madzharova, Theresa Fiani, Christina Alaimo, and Samantha Dalfen for all of your help with IOA calculations and article screening and coding.
Compliance with Ethical Standards
Conflict of Interest
The first author declares that she has no conflict of interest related to this article. The second author declares that he received speaking and consulting fees related to behavioral skill training which might represent a conflict of interest related to this article.
Human and Animal Rights and Informed Consent
This article does not contain any studies with human participants or animals performed by any of the authors.
References marked with an asterisk indicate studies included in the meta-analysis. The in-text citations to studies selected for meta-analysis are not preceded by asterisks
- *Belfiore, P. J., Fritts, K. M., & Herman, B. C. (2008). The role of procedural integrity: using self-monitoring to enhance discrete trial instruction (DTI). Focus On Autism and other Developmental Disabilities, 23, 95–102.Google Scholar
- *Bishop, M. R., & Kenzer, A. L. (2012). Teaching behavioral therapists to conduct brief preference assessments during therapy sessions. Research in Autism Spectrum Disorders, 6, 450–457. doi: https://doi.org/10.1016/j.rasd.2011.07.005.
- *Bolton, J., & Mayer, M. D. (2008). Promoting the generalization of paraprofessional discrete trial teaching skills. Focus on Autism and other Developmental Disabilities, 23, 103–111.Google Scholar
- Brock, M. E., & Carter, E. W. (2016). A meta-analysis of practitioner training to improve implementation of interventions for students with disabilities. Remedial and Special Education. Advance online publication. doi: https://doi.org/10.1177/0741932516653477.
- Brock, M. E., Cannella-Malone, H. I., Seaman, R. L., Andzik, N. R., Schaefer, J. M., Page, E. J., & … Dueker, S. A. (2017). Findings across practitioner training studies in special education: a comprehensive review and meta-analysis. Exceptional Children, 84, 7–26.
- *Catania, C. N., Almeida, D., Liu-Constant, B., & Reed, F. (2009). Video modeling to train staff to implement discrete-trial instruction. Journal of Applied Behavior Analysis, 42, 387–392.Google Scholar
- Centers for Disease Control and Prevention (CDC). (2004). Economic costs associated with mental retardation, cerebral palsy, hearing loss, and vision impairment--United States, 2003. MMWR Morbidity and Mortality Weekly Report, 53(3), 57–9.Google Scholar
- *Crockett, J. L., Fleming, R. K., Doepke, K. J., & Stevens, J. S. (2007). Parent training: acquisition and generalization of discrete trials teaching skills with parents of children with autism. Research in Developmental Disabilities: A Multidisciplinary Journal, 28, 23–36.Google Scholar
- *Dib, N., & Sturmey, P. (2007). Reducing student stereotypy by improving teachers’ implementation of discrete-trial teaching. Journal of Applied Behavior Analysis, 40, 339–343.Google Scholar
- *Downs, A., Downs, R., & Rau, K. (2008). Effects of training and feedback on discrete trial teaching skills and student performance. Research in Developmental Disabilities: A Multidisciplinary Journal, 29, 235–246.Google Scholar
- *Fazzio, D., Martin, G. L., Arnal, L., & Yu, D. T. (2009). Instructing university students to conduct discrete-trials teaching with children with autism. Research in Autism Spectrum Disorders, 3, 57–66.Google Scholar
- Ganz, J. B., Davis, J. L., Lund, E. M., Goodwyn, F. D., & Simpson, R. L. (2012). Meta-analysis of PECS with individuals with ASD: investigation of targeted versus non-targeted outcomes, participant characteristics, and implementation phase. Research in Developmental Disabilities, 33(2), 406–418. https://doi.org/10.1016/j.ridd.2011.09.023.CrossRefPubMedGoogle Scholar
- *Garland, K., Vasquez, E., & Pearl, C. (2012). Efficacy of individualized clinical coaching in a virtual reality classroom for increasing teachers’ fidelity of implementation of discrete trial teaching. Education and Training in Autism and Developmental Disabilities, 47, 502–515.Google Scholar
- *Graff, R. B., & Karsten, A. M. (2012). Evaluation of a self-instruction package for conducting stimulus preference assessments. Journal of Applied Behavior Analysis, 45, 69–82.Google Scholar
- *Lafasakis, M., & Sturmey, P. (2007). Training parent implementation of discrete-trial teaching: effects on generalization of parent teaching and child correct responding. Journal of Applied Behavior Analysis, 40, 685–689.Google Scholar
- *Lavie, T., & Sturmey, P. (2002). Training staff to conduct a paired-stimulus preference assessment. Journal of Applied Behavior Analysis, 35, 209–211. doi: https://doi.org/10.1901/jaba.2002.35-209.
- *Leblanc, M., Ricciardi, J. N., & Luiselli, J. K. (2005). Improving discrete trial instruction by paraprofessional staff through an abbreviated performance feedback intervention. Education and Treatment of Children, 28, 76–82.Google Scholar
- Maughan, D. R., Christiansen, E., Jenson, W. R., Olympia, D., & Clark, E. (2005). Behavioral parent training as a treatment for externalizing behaviors and disruptive behavior disorders: a meta-analysis. School Psychology Review, 34, 267–286.Google Scholar
- *May, R. J., Austin, J. L., & Dymond, S. (2011). Effects of a stimulus prompt display on therapists’ accuracy, rate, and variation of trial type delivery during discrete trial teaching. Research in Autism Spectrum Disorders, 5, 305–316.Google Scholar
- *McCulloch, E. B., & Noonan, M. (2013). Impact of online training videos on the implementation of mand training by three elementary school paraprofessionals. Education and Training in Autism and Developmental Disabilities, 48, 132–141.Google Scholar
- *Mobayed, K. L., Collins, B. C., Strangis, D. E., Schuster, J. W., & Hemmeter, M. (2000). Teaching parents to employ mand-model procedures to teach their children requesting. Journal of Early Intervention, 23, 165–179. doi: https://doi.org/10.1177/10538151000230030601.
- National Professional Development Center on Autism Spectrum Disorder. (2014). What are evidence-based practices? Retrieved from http://autismpdc.fpg.unc.edu/evidence-based-practices.
- *Nigro-Bruzzi, D., & Sturmey, P. (2010). The effects of behavioral skills training on mand training by staff and unprompted vocal mands by children. Journal of Applied Behavior Analysis, 43, 757–761. doi: https://doi.org/10.1901/jaba.2010.43-757.
- *Nosik, M. R., & Williams, W. (2011). Component evaluation of a computer based format for teaching discrete trial and backward chaining. Research in Developmental Disabilities: A Multidisciplinary Journal, 32, 1694–1702.Google Scholar
- *Nosik, M. R., Williams, W., Garrido, N., & Lee, S. (2013). Comparison of computer based instruction to behavior skills training for teaching staff implementation of discrete-trial instruction with an adult with autism. Research in Developmental Disabilities, 34, 461–468. doi: https://doi.org/10.1016/j.ridd.2012.08.011.
- Parker, R. I., Vannest, K. J., & Brown, L. (2009). The improvement rate difference for single-case research. Exceptional Children, 75(2), 135–150.Google Scholar
- *Pence, S. T., St. Peter, C. C., & Tetreault, A. S. (2012). Increasing accurate preference assessment implementation through pyramidal training. Journal of Applied Behavior Analysis, 45, 345–359. doi: https://doi.org/10.1901/jaba.2012.45-345.
- Reichow, B., & Wolery, M. (2009). Comprehensive synthesis of early intensive behavioral interventions for young children with autism based on the UCLA Young Autism Project model. Journal of Autism and Developmental Disorders, 39, 23–41. https://doi.org/10.1007/s10803-008-0596-0.CrossRefPubMedGoogle Scholar
- *Roscoe, E. M., & Fisher, W. W. (2008). Evaluation of an efficient method for training staff to implement stimulus preference assessments. Journal of Applied Behavior Analysis, 41, 249–254. doi: https://doi.org/10.1901/jaba.2008.41-24o.
- *Roscoe, E. M., Fisher, W. W., Glover, A. C., & Volkert, V. M. (2006). Evaluating the relative effects of feedback and contingent money for staff training of stimulus preference assessments. Journal of Applied Behavior Analysis, 39, 63–77. doi: https://doi.org/10.1901/jaba.2006.7-05.
- *Salem, S., Fazzio, D., Arnal, L., Fregeau, P., Thomson, K., Martin, G. L., & Yu, C. T. (2009). A self-instructional package for teaching university students to conduct discrete-trials teaching with children with autism. Journal on Developmental Disabilities, 15, 21–29.Google Scholar
- *Sarokoff, R. A., & Sturmey, P. (2004). The effects of behavioral skills training on staff implementation of discrete-trial teaching. Journal of Applied Behavior Analysis, 37, 535.Google Scholar
- *Sarokoff, R. A., & Sturmey, P. (2008). The effects of instructions, rehearsal, modeling, and feedback on acquisition and generalization of staff use of discrete trial teaching and student correct responses. Research in Autism Spectrum Disorders, 2, 125–136.Google Scholar
- *Severtson, J. M., & Carr, J. E. (2012). Training novice instructors to implement errorless discrete-trial teaching: a sequential analysis. Behavior Analysis in Practice, 5, 13–23.Google Scholar
- *Thiessen, C., Fazzio, D., Arnal, L., Martin, G. L., Yu, C. T., & Keilback, L. (2009). Evaluation of a self-instructional manual for conducting discrete-trials teaching with children with autism. Behavior Modification, 33, 360–373.Google Scholar
- *Thomson, K. M., Martin, G. L., Fazzio, D., Salem, S., Young, K., & Yu, C. T. (2012). Evaluation of a self-instructional package for teaching tutors to conduct discrete-trials teaching with children with autism. Research in Autism Spectrum Disorders, 6, 1073–1082. doi: https://doi.org/10.1016/j.rasd.2012.02.005.
- Tien, K. (2008). Effectiveness of the picture exchange communication system as a functional communication intervention for individuals with autism spectrum disorders: a practice-based research synthesis. Education and Training in Developmental Disabilities, 43, 61–76.Google Scholar
- Van Oorsouw, W. M. W. J., Embregts, B., & A.M.T., & Jahoda, A. (2009). Training staff serving clients with intellectual disabilitiws: a meta-analysis of aspects determining effectiveness. Research in Developmental Disabilities, 30, 503–511.Google Scholar
- Vanderkerken, L., Heyvaert, M., Maes, B., & Onghena, P. (2013). Psychosocial interventions for reducing vocal challenging behavior in persons with autistic disorder: a multilevel meta analysis of single-case experiments. Research in Developmental Disabilities, 34, 4515–4533. https://doi.org/10.1016/j.ridd.2013.09.030.CrossRefPubMedGoogle Scholar
- *Vladescu, J. C., Carroll, R., Paden, A., & Kodak, T. M. (2012). The effects of video modeling with voiceover instruction on accurate implementation of discrete-trial instruction. Journal of Applied Behavior Analysis, 45, 419–423. doi: https://doi.org/10.1901/jaba.2012.45-419.
- *Ward-Horner, J., & Sturmey, P. (2008). The effects of general-case training and behavioral skills training on the generalization of parents’ use of discrete-trial teaching, child correct responses, and child maladaptive behavior. Behavioral Interventions, 23, 271–284. doi: https://doi.org/10.1002/bin.268.
- *Williams, W., & Gallinat, J. (2011). The effects of evaluating video examples of staffs’ own versus others’ performance on discrete-trial training skills in a human service setting. Journal of Organizational Behavior Management, 31, 97–116.Google Scholar
- Wong, C., Odom, S. L., Hume, K. A., Cox, A. W., Fettig, A., Kucharczyk, S., & ... Schultz, T. R. (2015). Evidence-based practices for children, youth, and young adults with autism spectrum disorder: a comprehensive review. Journal of Autism and Developmental Disorders, 45(7), 1951–1966. doi: https://doi.org/10.1007/s10803-014-2351-z.
- *Young, K. L., Boris, A. L., Thomson, K. M., Martin, G. L., & Yu, C. T. (2012). Evaluation of a self-instructional package on discrete-trials teaching to parents of children with autism. Research in Autism Spectrum Disorders, 6, 1321–1330. doi: https://doi.org/10.1016/j.rasd.2012.05.001.
- Zhang, J., & Wheeler, J. J. (2011). A meta-analysis of peer-mediated interventions for young children with autism spectrum disorders. Education and Training in Autism And Developmental Disabilities, 46, 62–77.Google Scholar