Advertisement

Change Agent Training in Behavior Analytic Procedures for People with Developmental and Intellectual Disabilities: A Meta-Analysis

  • Lindsay Maffei-Almodovar
  • Peter Sturmey
Review Paper

Abstract

This paper reports a meta-analysis to evaluate procedures to train change agents in discrete trial teaching, preference assessment, and mand training. Behavioral skills training packages were the most commonly used and were consistently and highly effective in changing change agent behavior. Procedural variation in training overlapped in effectiveness. Training was slightly less effective for parents than for staff and university students. The effect size for the behavior of the individuals with whom the change agents applied behavioral procedures was slightly smaller than for change agents and was reported in only about one third of papers. Behavioral skills training is a highly effective and robust approach to delivering change agent training for different skills training procedures.

Keywords

Change agent Behavioral skills training Training Developmental disabilities 

Notes

Acknowledgements

Thanks are due to Maya Madzharova, Theresa Fiani, Christina Alaimo, and Samantha Dalfen for all of your help with IOA calculations and article screening and coding.

Compliance with Ethical Standards

Conflict of Interest

The first author declares that she has no conflict of interest related to this article. The second author declares that he received speaking and consulting fees related to behavioral skill training which might represent a conflict of interest related to this article.

Human and Animal Rights and Informed Consent

This article does not contain any studies with human participants or animals performed by any of the authors.

References

References marked with an asterisk indicate studies included in the meta-analysis. The in-text citations to studies selected for meta-analysis are not preceded by asterisks

  1. *Belfiore, P. J., Fritts, K. M., & Herman, B. C. (2008). The role of procedural integrity: using self-monitoring to enhance discrete trial instruction (DTI). Focus On Autism and other Developmental Disabilities, 23, 95–102.Google Scholar
  2. *Bishop, M. R., & Kenzer, A. L. (2012). Teaching behavioral therapists to conduct brief preference assessments during therapy sessions. Research in Autism Spectrum Disorders, 6, 450–457. doi: https://doi.org/10.1016/j.rasd.2011.07.005.
  3. *Bolton, J., & Mayer, M. D. (2008). Promoting the generalization of paraprofessional discrete trial teaching skills. Focus on Autism and other Developmental Disabilities, 23, 103–111.Google Scholar
  4. Brock, M. E., & Carter, E. W. (2016). A meta-analysis of practitioner training to improve implementation of interventions for students with disabilities. Remedial and Special Education. Advance online publication. doi: https://doi.org/10.1177/0741932516653477.
  5. Brock, M. E., Cannella-Malone, H. I., Seaman, R. L., Andzik, N. R., Schaefer, J. M., Page, E. J., & … Dueker, S. A. (2017). Findings across practitioner training studies in special education: a comprehensive review and meta-analysis. Exceptional Children, 84, 7–26.
  6. *Catania, C. N., Almeida, D., Liu-Constant, B., & Reed, F. (2009). Video modeling to train staff to implement discrete-trial instruction. Journal of Applied Behavior Analysis, 42, 387–392.Google Scholar
  7. Centers for Disease Control and Prevention (CDC). (2004). Economic costs associated with mental retardation, cerebral palsy, hearing loss, and vision impairment--United States, 2003. MMWR Morbidity and Mortality Weekly Report, 53(3), 57–9.Google Scholar
  8. Chambless, D. L., & Hollon, S. D. (1998). Defining empirically supported therapies. Journal of Consulting and Clinical Psychology, 66, 7–18.  https://doi.org/10.1037/0022-006X.66.1.7.CrossRefPubMedGoogle Scholar
  9. *Crockett, J. L., Fleming, R. K., Doepke, K. J., & Stevens, J. S. (2007). Parent training: acquisition and generalization of discrete trials teaching skills with parents of children with autism. Research in Developmental Disabilities: A Multidisciplinary Journal, 28, 23–36.Google Scholar
  10. *Dib, N., & Sturmey, P. (2007). Reducing student stereotypy by improving teachers’ implementation of discrete-trial teaching. Journal of Applied Behavior Analysis, 40, 339–343.Google Scholar
  11. *Downs, A., Downs, R., & Rau, K. (2008). Effects of training and feedback on discrete trial teaching skills and student performance. Research in Developmental Disabilities: A Multidisciplinary Journal, 29, 235–246.Google Scholar
  12. Dyches, S., Korth, R., & Mandleco. (2012). Positive parenting of children with developmental disabilities: a meta-analysis. Research in Developmental Disabilities, 33, 2213–2220.CrossRefPubMedGoogle Scholar
  13. *Fazzio, D., Martin, G. L., Arnal, L., & Yu, D. T. (2009). Instructing university students to conduct discrete-trials teaching with children with autism. Research in Autism Spectrum Disorders, 3, 57–66.Google Scholar
  14. Ganz, M. L. (2006). The costs of autism. In S. O. Moldin, J. R. Rubenstein, S. O. Moldin, & J. R. Rubenstein (Eds.), Understanding autism: from basic neuroscience to treatment (pp. 475–502). Boca Raton: CRC Press.  https://doi.org/10.1201/9781420004205.ch20.CrossRefGoogle Scholar
  15. Ganz, J. B., Davis, J. L., Lund, E. M., Goodwyn, F. D., & Simpson, R. L. (2012). Meta-analysis of PECS with individuals with ASD: investigation of targeted versus non-targeted outcomes, participant characteristics, and implementation phase. Research in Developmental Disabilities, 33(2), 406–418.  https://doi.org/10.1016/j.ridd.2011.09.023.CrossRefPubMedGoogle Scholar
  16. *Garland, K., Vasquez, E., & Pearl, C. (2012). Efficacy of individualized clinical coaching in a virtual reality classroom for increasing teachers’ fidelity of implementation of discrete trial teaching. Education and Training in Autism and Developmental Disabilities, 47, 502–515.Google Scholar
  17. *Graff, R. B., & Karsten, A. M. (2012). Evaluation of a self-instruction package for conducting stimulus preference assessments. Journal of Applied Behavior Analysis, 45, 69–82.Google Scholar
  18. Horner, R. H., Carr, E. G., Halle, J., McGee, G., Odom, S., & Wolery, M. (2005). The use of single-subject research to identify evidence-based practice in special education. Exceptional Children, 71, 165–179.CrossRefGoogle Scholar
  19. Järbrink, K., & Knapp, M. (2001). The economic impact of autism in Britain. Autism, 5, 7–22.  https://doi.org/10.1177/1362361301005001002.CrossRefPubMedGoogle Scholar
  20. Kaminski, J., Valle, L., Filene, J. H., & Boyle, C. L. (2008). A meta-analytic review of components associated with parent training program effectiveness. Journal of Abnormal Child Psychology, 36, 567–589.CrossRefPubMedGoogle Scholar
  21. Kokina, A., & Kern, L. (2010). Social story™ interventions for students with autism spectrum disorders: A meta-analysis. Journal of Autism and Developmental Disorders, 40, 812–826.  https://doi.org/10.1007/s10803-009-0931-0.CrossRefPubMedGoogle Scholar
  22. *Lafasakis, M., & Sturmey, P. (2007). Training parent implementation of discrete-trial teaching: effects on generalization of parent teaching and child correct responding. Journal of Applied Behavior Analysis, 40, 685–689.Google Scholar
  23. *Lavie, T., & Sturmey, P. (2002). Training staff to conduct a paired-stimulus preference assessment. Journal of Applied Behavior Analysis, 35, 209–211. doi: https://doi.org/10.1901/jaba.2002.35-209.
  24. *Leblanc, M., Ricciardi, J. N., & Luiselli, J. K. (2005). Improving discrete trial instruction by paraprofessional staff through an abbreviated performance feedback intervention. Education and Treatment of Children, 28, 76–82.Google Scholar
  25. Mason, R. A., Davis, H. S., Boles, M. B., & Goodwyn, F. (2013). Efficacy of point-of-view video modeling: a meta-analysis. Remedial and Special Education, 34, 333–345.  https://doi.org/10.1177/0741932513486298.CrossRefGoogle Scholar
  26. Maughan, D. R., Christiansen, E., Jenson, W. R., Olympia, D., & Clark, E. (2005). Behavioral parent training as a treatment for externalizing behaviors and disruptive behavior disorders: a meta-analysis. School Psychology Review, 34, 267–286.Google Scholar
  27. *May, R. J., Austin, J. L., & Dymond, S. (2011). Effects of a stimulus prompt display on therapists’ accuracy, rate, and variation of trial type delivery during discrete trial teaching. Research in Autism Spectrum Disorders, 5, 305–316.Google Scholar
  28. *McCulloch, E. B., & Noonan, M. (2013). Impact of online training videos on the implementation of mand training by three elementary school paraprofessionals. Education and Training in Autism and Developmental Disabilities, 48, 132–141.Google Scholar
  29. *Mobayed, K. L., Collins, B. C., Strangis, D. E., Schuster, J. W., & Hemmeter, M. (2000). Teaching parents to employ mand-model procedures to teach their children requesting. Journal of Early Intervention, 23, 165–179. doi: https://doi.org/10.1177/10538151000230030601.
  30. National Professional Development Center on Autism Spectrum Disorder. (2014). What are evidence-based practices? Retrieved from http://autismpdc.fpg.unc.edu/evidence-based-practices.
  31. *Nigro-Bruzzi, D., & Sturmey, P. (2010). The effects of behavioral skills training on mand training by staff and unprompted vocal mands by children. Journal of Applied Behavior Analysis, 43, 757–761. doi: https://doi.org/10.1901/jaba.2010.43-757.
  32. *Nosik, M. R., & Williams, W. (2011). Component evaluation of a computer based format for teaching discrete trial and backward chaining. Research in Developmental Disabilities: A Multidisciplinary Journal, 32, 1694–1702.Google Scholar
  33. *Nosik, M. R., Williams, W., Garrido, N., & Lee, S. (2013). Comparison of computer based instruction to behavior skills training for teaching staff implementation of discrete-trial instruction with an adult with autism. Research in Developmental Disabilities, 34, 461–468. doi: https://doi.org/10.1016/j.ridd.2012.08.011.
  34. Parker, R. I., Vannest, K. J., & Brown, L. (2009). The improvement rate difference for single-case research. Exceptional Children, 75(2), 135–150.Google Scholar
  35. Parker, R. I., Vannest, K. J., Davis J. L. (2011). Effect Size in Single-Case Research: A Review of Nine Nonoverlap Techniques. Behavior Modification 35(4), 303–322CrossRefPubMedGoogle Scholar
  36. *Pence, S. T., St. Peter, C. C., & Tetreault, A. S. (2012). Increasing accurate preference assessment implementation through pyramidal training. Journal of Applied Behavior Analysis, 45, 345–359. doi: https://doi.org/10.1901/jaba.2012.45-345.
  37. Reichow, B., & Wolery, M. (2009). Comprehensive synthesis of early intensive behavioral interventions for young children with autism based on the UCLA Young Autism Project model. Journal of Autism and Developmental Disorders, 39, 23–41.  https://doi.org/10.1007/s10803-008-0596-0.CrossRefPubMedGoogle Scholar
  38. Roberts, M. P. (2011). The effectiveness of parent-implemented language interventions: a meta-analysis. American Journal of Speech-Language Pathology, 20, 180–199.CrossRefPubMedGoogle Scholar
  39. *Roscoe, E. M., & Fisher, W. W. (2008). Evaluation of an efficient method for training staff to implement stimulus preference assessments. Journal of Applied Behavior Analysis, 41, 249–254. doi: https://doi.org/10.1901/jaba.2008.41-24o.
  40. *Roscoe, E. M., Fisher, W. W., Glover, A. C., & Volkert, V. M. (2006). Evaluating the relative effects of feedback and contingent money for staff training of stimulus preference assessments. Journal of Applied Behavior Analysis, 39, 63–77. doi: https://doi.org/10.1901/jaba.2006.7-05.
  41. *Salem, S., Fazzio, D., Arnal, L., Fregeau, P., Thomson, K., Martin, G. L., & Yu, C. T. (2009). A self-instructional package for teaching university students to conduct discrete-trials teaching with children with autism. Journal on Developmental Disabilities, 15, 21–29.Google Scholar
  42. *Sarokoff, R. A., & Sturmey, P. (2004). The effects of behavioral skills training on staff implementation of discrete-trial teaching. Journal of Applied Behavior Analysis, 37, 535.Google Scholar
  43. *Sarokoff, R. A., & Sturmey, P. (2008). The effects of instructions, rehearsal, modeling, and feedback on acquisition and generalization of staff use of discrete trial teaching and student correct responses. Research in Autism Spectrum Disorders, 2, 125–136.Google Scholar
  44. Scruggs, T. E., Mastropieri, M. A., & Casto, G. (1987). The quantitative synthesis of single-subject research: methodology and validation. RASE: Remedial & Special Education, 8, 24–33.  https://doi.org/10.1177/074193258700800206.Google Scholar
  45. *Severtson, J. M., & Carr, J. E. (2012). Training novice instructors to implement errorless discrete-trial teaching: a sequential analysis. Behavior Analysis in Practice, 5, 13–23.Google Scholar
  46. *Thiessen, C., Fazzio, D., Arnal, L., Martin, G. L., Yu, C. T., & Keilback, L. (2009). Evaluation of a self-instructional manual for conducting discrete-trials teaching with children with autism. Behavior Modification, 33, 360–373.Google Scholar
  47. *Thomson, K. M., Martin, G. L., Fazzio, D., Salem, S., Young, K., & Yu, C. T. (2012). Evaluation of a self-instructional package for teaching tutors to conduct discrete-trials teaching with children with autism. Research in Autism Spectrum Disorders, 6, 1073–1082. doi: https://doi.org/10.1016/j.rasd.2012.02.005.
  48. Tien, K. (2008). Effectiveness of the picture exchange communication system as a functional communication intervention for individuals with autism spectrum disorders: a practice-based research synthesis. Education and Training in Developmental Disabilities, 43, 61–76.Google Scholar
  49. Van Oorsouw, W. M. W. J., Embregts, B., & A.M.T., & Jahoda, A. (2009). Training staff serving clients with intellectual disabilitiws: a meta-analysis of aspects determining effectiveness. Research in Developmental Disabilities, 30, 503–511.Google Scholar
  50. Vanderkerken, L., Heyvaert, M., Maes, B., & Onghena, P. (2013). Psychosocial interventions for reducing vocal challenging behavior in persons with autistic disorder: a multilevel meta analysis of single-case experiments. Research in Developmental Disabilities, 34, 4515–4533.  https://doi.org/10.1016/j.ridd.2013.09.030.CrossRefPubMedGoogle Scholar
  51. *Vladescu, J. C., Carroll, R., Paden, A., & Kodak, T. M. (2012). The effects of video modeling with voiceover instruction on accurate implementation of discrete-trial instruction. Journal of Applied Behavior Analysis, 45, 419–423. doi: https://doi.org/10.1901/jaba.2012.45-419.
  52. *Ward-Horner, J., & Sturmey, P. (2008). The effects of general-case training and behavioral skills training on the generalization of parents’ use of discrete-trial teaching, child correct responses, and child maladaptive behavior. Behavioral Interventions, 23, 271–284. doi: https://doi.org/10.1002/bin.268.
  53. *Williams, W., & Gallinat, J. (2011). The effects of evaluating video examples of staffs’ own versus others’ performance on discrete-trial training skills in a human service setting. Journal of Organizational Behavior Management, 31, 97–116.Google Scholar
  54. Wong, C., Odom, S. L., Hume, K. A., Cox, A. W., Fettig, A., Kucharczyk, S., & ... Schultz, T. R. (2015). Evidence-based practices for children, youth, and young adults with autism spectrum disorder: a comprehensive review. Journal of Autism and Developmental Disorders, 45(7), 1951–1966. doi: https://doi.org/10.1007/s10803-014-2351-z.
  55. *Young, K. L., Boris, A. L., Thomson, K. M., Martin, G. L., & Yu, C. T. (2012). Evaluation of a self-instructional package on discrete-trials teaching to parents of children with autism. Research in Autism Spectrum Disorders, 6, 1321–1330. doi: https://doi.org/10.1016/j.rasd.2012.05.001.
  56. Zhang, J., & Wheeler, J. J. (2011). A meta-analysis of peer-mediated interventions for young children with autism spectrum disorders. Education and Training in Autism And Developmental Disabilities, 46, 62–77.Google Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2018

Authors and Affiliations

  1. 1.Department of Psychology, The Graduate Center and Queens CollegeCity University of New YorkFlushingUSA

Personalised recommendations