Abstract
Supervisors commonly use feedback to teach staff members to implement behavioral interventions. However, few studies have evaluated methods to teach supervisors to provide effective feedback. We used a multiple-baseline design to evaluate the use of video modeling with voice-over instruction to train 4 supervisors to provide performance feedback to a confederate therapist implementing a guided-compliance procedure. We assessed supervisors’ accuracy with implementing 8 feedback component skills during scripted role-plays before and after video modeling. We also assessed the extent to which supervisors’ skills generalized when providing feedback to a confederate therapist implementing novel behavioral procedures (i.e., discrete-trial training and mand training) and an actual therapist implementing the guided-compliance procedure with a child with autism. All supervisors mastered the feedback component skills following video modeling. Overall, the results of the current study suggest that video modeling may be an efficacious and efficient method to train supervisors.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Behavior Analyst Certification Board. (2012). Supervisor training curriculum outline. Retrieved from https://www.bacb.com/wp-content/uploads/2017/09/supervisor_curriculum.pdf
Carroll, R. A., Kodak, T., & Fisher, W. W. (2013). An evaluation of programmed treatment-integrity errors during discrete-trial instruction. Journal of Applied Behavior Analysis, 46, 379–394. https://doi.org/10.1002/jaba.49.
DiGennaro Reed, F. D., & Henley, A. J. (2015). A survey of staff training and performance management practices: The good, the bad. and the ugly. Behavior Analysis in Practice, 8, 16–26. https://doi.org/10.1007/s40617-015-0044-5.
Durgin, A., Mahoney, A., Cox, C., Wheetjens, B. J., & Poling, A. (2014). Using task clarification and feedback to improve staff performance in a nongovernmental organization. Journal of Organizational Behavior Management, 34, 122–143. https://doi.org/10.1080/01608061.2014.914007.
Gil, P. J., & Carter, S. L. (2016). Graphic feedback, performance feedback, and goal setting increased staff compliance with a data collection task at a large residential facility. Journal of Organizational Behavior Management, 36, 56–70. https://doi.org/10.1080/01608061.2016.1152207.
Green, C. W., Rollyson, J. H., Passante, S. C., & Reid, D. H. (2002). Maintaining proficient supervisor performance with direct support personnel: An analysis of two management approaches. Journal of Applied Behavior Analysis, 35, 205–208. https://doi.org/10.1901/jaba.2002.35-205.
Higgins, W. J., Luczynski, K. C., Carroll, R. A., Fisher, W. W., & Mudford, O. C. (2017). Evaluation of a telehealth training package to remotely train staff to conduct a preference assessment. Journal of Applied Behavior Analysis, 50, 238–251. https://doi.org/10.1002/jaba.370.
Hirst, J. M., DiGennaro Reed, F. D., & Reed, D. D. (2013). Effects of varying feedback accuracy on task acquisition: A computerized translational study. Journal of Behavioral Education, 22, 1–15. https://doi.org/10.1007/s10864-012-9162-0.
Jensen, J., Parsons, M., & Reid, D. (1998). Supervisory training for teachers: Multiple, long-term effects in an education program for adults with severe disabilities. Research in Developmental Disabilities, 19, 449–463. https://doi.org/10.1016/s0891-4222(98)00017-1.
Jerome, J., Kaplan, H., & Sturmey, P. (2014). The effects of in-service training alone and in-service training with feedback on data collection accuracy for direct-care staff working with individuals with intellectual disabilities. Research in Developmental Disabilities, 35, 529–536. https://doi.org/10.1016/j.ridd.2013.11.009.
Lipschultz, J. L., Vladescu, J. C., Reeve, K. F., Reeve, S. A., & Dipsey, C. R. (2015). Using video modeling with voiceover instruction to train staff to conduct stimulus preference assessments. Journal of Developmental and Physical Disabilities, 27, 505–532. https://doi.org/10.1007/s10882-015-9434-4.
Parsons, M. B., & Reid, D. H. (1995). Training residential supervisors to provide feedback for maintaining staff teaching skills with people who have severe disabilities. Journal of Applied Behavior Analysis, 28, 317–322. https://doi.org/10.1901/jaba.1995.28-317.
Pence, S. T., Peter, S., & C, C. (2015). Evaluation of treatment integrity errors on mand acquisition. Journal of Applied Behavior Analysis, 48, 575–589. https://doi.org/10.1002/jaba.238.
Peterson, L., Homer, A. L., & Wonderlich, S. A. (1982). The integrity of independent variables in behavior analysis. Journal of Applied Behavior Analysis, 15, 477–492. https://doi.org/10.1901/jaba.1982.15-477.
Reid, D. H., Parsons, M. B., & Green, C. W. (2012). The supervisor’s guidebook: Evidence-based strategies for promoting work quality and enjoyment among human services staff. Morganton, NC: Habilitative Management Consultants.
Reimers, T. M., Wacker, D. P., Cooper, L. J., & de Raad, A. O. (1992). Acceptability of behavioral treatments for children: Analog and naturalistic evaluations by parents. School Psychology Review, 21, 628–643.
Vladescu, J. C., Carroll, R., Paden, A., & Kodak, T. M. (2012). The effects of video modeling with voiceover instruction on accurate implementation of discrete-trial instruction. Journal of Applied Behavior Analysis, 45, 419–423. https://doi.org/10.1901/jaba.2012.45-419.
Ward-Horner, J., & Sturmey, P. (2012). Component analysis of behavior skills training in functional analysis. Behavioral Interventions, 27, 75–92. https://doi.org/10.1002/bin.1339.
Wilder, D. A., & Atwell, J. (2006). Evaluation of a guided-compliance procedure to reduce noncompliance among preschool children. Behavioral Interventions, 21, 265–272. https://doi.org/10.1002/bin.222.
Wilder, D. A., Atwell, J., & Wine, B. (2006). The effects of varying levels of treatment integrity on child compliance during treatment with a three-step prompting procedure. Journal of Applied Behavior Analysis, 39, 369–373. https://doi.org/10.1901/jaba.2006.144-05.
Author Note
Natalie Shuler, Department of Psychology, West Virginia University; Regina A. Carroll, Department of Psychology, University of Nebraska Medical Center’s Munroe-Meyer Institute.
We would like to thank Jennifer Owsiany and Victoria DiSciullo for their assistance with creating videos for this study. This study was based on a master’s thesis submitted by the first author, under the supervision of the second author, to the graduate school at West Virginia University in partial fulfillment for the requirements of a MS in psychology.
Funding
The authors received no financial support for the research, authorship, and/or publication of this article.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
The authors declare that they have no conflicts of interest.
Ethical Approval
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Research Highlights
• Video modeling with voice-over instruction led to improvements in supervisors’ accuracy with implementing eight component skills of a performance feedback procedure.
• Video modeling with voice-over instructions may be an efficient alternative to multicomponent interventions that have been used in previous studies to teach supervisors to provide performance feedback.
• Assessing mastery of a supervisor’s skills during scripted role-plays with confederates may be predictive of a supervisor’s performance with an actual therapist.
• Additional training may be required for some supervisors to implement component skills of performance feedback at mastery level when providing feedback to a therapist implementing novel behavioral procedures.
Rights and permissions
About this article
Cite this article
Shuler, N., Carroll, R.A. Training Supervisors to Provide Performance Feedback Using Video Modeling with Voiceover Instructions. Behav Analysis Practice 12, 576–591 (2019). https://doi.org/10.1007/s40617-018-00314-5
Published:
Issue Date:
DOI: https://doi.org/10.1007/s40617-018-00314-5