Evidence-Based Performance Management: Applying Behavioral Science to Support Practitioners
- 26 Downloads
Abstract
The science of behavior has effectively addressed many areas of social importance, including the performance management of staff working in human-service settings. Evidence-based performance management entails initial preservice training and ongoing staff support. Initial training reflects a critical first training component and is necessary for staff to work independently within an organization. However, investment in staff must not end once preservice training is complete. Ongoing staff support should follow preservice training and involves continued coaching and feedback. The purpose of this article is to bridge the research-to-practice gap by outlining research-supported initial training and ongoing staff support procedures within human-serving settings, presenting practice guidelines, and sharing information about easy-to-implement ways practitioners may stay abreast of current research.
Keywords
Performance management Staff training SupervisionNotes
References
- Abernathy, W. B. (1996). The sin of wages. Atlanta, GA: Performance Management.Google Scholar
- Abernathy, W. B. (2014). Beyond the Skinner box: The design and management of organization-wide performance systems. Journal of Organizational Behavior Management, 34, 235–254. https://doi.org/10.1080/01608061.2014.973631.CrossRefGoogle Scholar
- Alvero, A. M., Bucklin, B. R., & Austin, J. (2001). An objective review of the effectiveness and essential characteristics of performance feedback in organizational settings. Journal of Organizational Behavior Management, 21(1), 3–29. https://doi.org/10.1300/J075v21n01_02.CrossRefGoogle Scholar
- Balcazar, F. E., Hopkins, B. L., & Suarez, Y. (1985). A critical, objective review of performance feedback. Journal of Organizational Behavior Management, 7(3–4), 65–89. https://doi.org/10.1300/J075v07n03_05.CrossRefGoogle Scholar
- Behavior Analyst Certification Board. (2014). Professional and ethical compliance code for behavior analysts. Littleton, CO: Author. Retrieved from https://www.bacb.com/ethics/ethics-code/. Accessed 19 Aug 2016
- Berkman, S. J., Roscoe, E. M., & Bourret, J. C. (2019). Comparing self-directed methods for training staff to create graphs using GraphPad Prism. Journal of Applied Behavior Analysis, 52, 188–204. https://doi.org/10.1002/jaba.522.CrossRefPubMedGoogle Scholar
- Bowe, M., & Sellers, T. P. (2018). Evaluating the Performance Diagnostic Checklist–Human Services to assess incorrect error-correction procedures by preschool paraprofessionals. Journal of Applied Behavior Analysis, 51, 166–176. https://doi.org/10.1002/jaba.428.CrossRefPubMedGoogle Scholar
- Brand, D., Henley, A. J., DiGennaro Reed, F. D., Gray, E., & Crabbs, B. (2019). A review of published studies involving parametric manipulations of treatment integrity. Journal of Behavioral Education, 28, 1–26. https://doi.org/10.1007/s10864-018-09311-8.CrossRefGoogle Scholar
- Carr, J. E., & Briggs, A. M. (2010). Strategies for making regular contact with the scholarly literature. Behavior Analysis in Practice, 3, 13–18. https://doi.org/10.1007/BF03391760.CrossRefPubMedPubMedCentralGoogle Scholar
- Carr, J. E., & Wilder, D. A. (2016). The Performance Diagnostic Checklist–Human Services: A correction. Behavior Analysis in Practice, 9, 63–63. https://doi.org/10.1007/s40617-015-0099-3.CrossRefPubMedGoogle Scholar
- Carr, J. E., Wilder, D. A., Majdalany, L., Mathisen, D., & Strain, L. A. (2013). An assessment-based solution to a human-service employee performance problem. Behavior Analysis in Practice, 6, 16–32. https://doi.org/10.1007/BF03391789.CrossRefPubMedPubMedCentralGoogle Scholar
- Cook, T., & Dixon, M. R. (2006). Performance feedback and probabilistic bonus contingencies among employees in a human service organization. Journal of Organizational Behavior Management, 25(3), 45–63. https://doi.org/10.1300/J075v25n03_04.CrossRefGoogle Scholar
- Daniels, A. C., & Bailey, J. S. (2014). Performance management: Changing behavior that drives organizational performance (5th ed.). Atlanta, GA: Performance Management Publications.Google Scholar
- Daniels, A. C., & Lattal, A. D. (2017). Life’s a PIC/NIC . . . when you understand behavior. Cornwall on Hudson, NY: Sloan Publishing.Google Scholar
- Delli Bovi, G. M., Vladescu, J. C., DeBar, R. M., Carroll, R. A., & Sarokoff, R. A. (2017). Using video modeling with voice-over instruction to train public school staff to implement a preference assessment. Behavior Analysis in Practice, 10, 72–76. https://doi.org/10.1007/s40617-016-0135-y.CrossRefGoogle Scholar
- Dickinson, A. M., & Gillette, K. L. (1994). A comparison of the effects of two individual monetary incentive systems on productivity: Piece rate pay versus base pay plus incentives. Journal of Organizational Behavior Management, 14(1), 3–82. https://doi.org/10.1300/J075v14n01_02.CrossRefGoogle Scholar
- DiGennaro Reed, F. D. (2016, November). ABCs of staff support: Evidence-based performance management. Presentation for the Iowa Association for Behavior Analysis Annual Conference, Des Moines, IA.Google Scholar
- DiGennaro Reed, F. D. (2017, May). Evidence-based performance management: Applying behavioral science to support practitioners. Presentation for the OBM in Health and Human Services Conference, Denver, CO.Google Scholar
- DiGennaro Reed, F. D. (2018, May). Using behavioral science to support educators during consultation. Presentation for the annual meeting of the Association for Behavior Analysis International, San Diego, CA.Google Scholar
- DiGennaro Reed, F. D. (2019, April). Performance management in ABA service settings. Presentation for the annual meeting of the Association for Professional Behavior Analysts, Atlanta, GA.Google Scholar
- DiGennaro Reed, F. D., Blackman, A. L., Erath, T. G., Brand, D., & Novak, M. D. (2018). Guidelines for using behavioral skills training to provide teacher support. Teaching Exceptional Children, 50, 373–380. https://doi.org/10.1177/0040059918777241.CrossRefGoogle Scholar
- DiGennaro Reed, F. D., Codding, R., Catania, C. N., & Maguire, H. (2010). Effects of video modeling on treatment integrity of behavioral interventions. Journal of Applied Behavior Analysis, 43, 291–295. https://doi.org/10.1901/jaba.2010.43-291.CrossRefPubMedPubMedCentralGoogle Scholar
- DiGennaro Reed, F. D., Erath, T. G., Brand, D., & Novak, M. D. (2019). Video modeling during coaching and performance feedback. In A. Fischer, E. Dart, T. Collins, & K. Radley (Eds.), Technology applications in school consultation, supervision, and school psychology training. New York, NY: Routledge.Google Scholar
- DiGennaro Reed, F. D., & Henley, A. J. (2015). A survey of staff training and performance management practices: The good, the bad, and the ugly. Behavior Analysis in Practice, 8, 16–26. https://doi.org/10.1007/s40617-015-0044-5.CrossRefGoogle Scholar
- Ducharme, J. M., & Feldman, M. A. (1992). Comparison of staff training strategies to promote generalized teaching skills. Journal of Applied Behavior Analysis, 25, 165–179. https://doi.org/10.1901/jaba.1992.25-165.CrossRefPubMedPubMedCentralGoogle Scholar
- Erbas, D., Tekin-Iftar, E., & Yucesoy, S. (2006). Teaching special education teachers how to conduct functional analysis in natural settings. Education and Training in Developmental Disabilities, 41, 28–36.Google Scholar
- Fair Labor Standards Act of 1938. (n.d.). 29 U.S.C. §201 et seq.Google Scholar
- Fisher, W., Piazza, C. C., Bowman, L. G., Hagopian, L. P., Owens, J. C., & Slevin, I. (1992). A comparison of two approaches for identifying reinforcers for persons with severe and profound disabilities. Journal of Applied Behavior Analysis, 25, 491–498. https://doi.org/10.1901/jaba.1992.25-491.CrossRefPubMedPubMedCentralGoogle Scholar
- Freedman, D. H. (2016). Improving public perception of behavior analysis. The Behavior Analyst, 39, 89–95. https://doi.org/10.1007/s40614-015-0045-2.CrossRefPubMedGoogle Scholar
- Ganster, D. C., Kiersch, C. E., Marsh, R. E., & Bowen, A. (2011). Performance-based rewards and work stress. Journal of Organizational Behavior Management, 31, 221–235. https://doi.org/10.1080/01608061.2011.619388.CrossRefGoogle Scholar
- Giannakakos, A. R., Vladescu, J. C., Kisamore, A. N., & Reeve, S. A. (2016). Using video modeling with voiceover instruction plus feedback to train staff to implement direct teaching procedures. Behavior Analysis in Practice, 9, 126–134. https://doi.org/10.1007/s40617-015-0097-5.CrossRefPubMedGoogle Scholar
- Goodman, J. I., Brady, M. P., Duffy, M. L., Scott, J., & Pollard, N. E. (2008). The effects of “bug-in-ear” supervision on special education teachers’ delivery of learn units. Focus on Autism and Other Developmental Disabilities, 23, 207–216. https://doi.org/10.1177/1088357608324713.CrossRefGoogle Scholar
- Graff, R. B., & Karsten, A. M. (2012). Evaluation of a self-instruction package for conducting stimulus preference assessments. Journal of Applied Behavior Analysis, 45, 69–82. https://doi.org/10.1901/jaba.2012.45-69.CrossRefPubMedPubMedCentralGoogle Scholar
- Henley, A. J. (2018). Empirical foundations and practical applications of behavioral skills training. Invited presentation and workshop for Behavior Services of Western Massachusetts, Springfield, MA.Google Scholar
- Henley, A. J. (2019). Supervising like a boss: Healthy behavioral practices for promoting effective supervision. Invited presentation for the Massachusetts Association of 766 Approved Private Schools, Marlborough, MA.Google Scholar
- Henley, A. J., & DiGennaro Reed, F. D. (2015). Should you order the feedback sandwich? Efficacy of feedback sequence and timing. Journal of Organizational Behavior Management, 35, 321–335. https://doi.org/10.1080/01608061.2015.1093057.CrossRefGoogle Scholar
- Henley, A. J., DiGennaro Reed, F. D., Reed, D. D., & Kaplan, B. A. (2016). A crowdsourced nickel-and-dime approach to analog OBM research: A behavioral economic framework for understanding workforce attrition. Journal of the Experimental Analysis of Behavior, 106, 134–144. https://doi.org/10.1002/jeab.220.CrossRefPubMedGoogle Scholar
- Henley, A. J., Hirst, J. M., DiGennaro Reed, F. D., Becirevic, A., & Reed, D. D. (2017). Function-altering effects of rule phrasing in the modulation of instructional control. The Analysis of Verbal Behavior, 33, 24–40. https://doi.org/10.1007/s40616-016-0063-5.CrossRefPubMedGoogle Scholar
- Higgins, S. T., Silverman, K., & Heil, S. H. (Eds.). (2007). Contingency management in substance abuse treatment. New York, NY: Guilford Press.Google Scholar
- Iwata, B. A., Bailey, J. S., Brown, K. M., Foshee, T. J., & Alpern, M. (1976). A performance-based lottery to improve residential care and training by institutional staff. Journal of Applied Behavior Analysis, 9, 417–431. https://doi.org/10.1901/jaba.1976.9-417.CrossRefPubMedPubMedCentralGoogle Scholar
- Iwata, B. A., Wallace, M. D., Kahng, S., Lindberg, J. S., Roscoe, E. M., Conners, J., et al. (2000). Skill acquisition in the implementation of functional analysis methodology. Journal of Applied Behavior Analysis, 33, 181–194. https://doi.org/10.1901/jaba.2000.33-181.CrossRefPubMedPubMedCentralGoogle Scholar
- Jarmolowicz, D. P., Kahng, S., Ingvarsson, E. T., Goysovich, R., Heggemeyer, R., & Gregory, M. K. (2008). Effects of conversational versus technical language on treatment preference and integrity. Intellectual & Developmental Disabilities, 46, 190–199. https://doi.org/10.1352/2008.46:190-199.CrossRefGoogle Scholar
- Jenkins, S. R., & DiGennaro Reed, F. D. (2016). A parametric analysis of rehearsal opportunities on procedural integrity. Journal of Organizational Behavior Management, 36, 255–281. https://doi.org/10.1080/01608061.2016.1236057.CrossRefGoogle Scholar
- Johnson, D. A., Casella, S. E., McGee, H., & Lee, S. C. (2014). The use and validation of pre-intervention diagnostic tools in Organizational Behavior Management. Journal of Organizational Behavior Management, 34, 104–121. https://doi.org/10.1080/01608061.2014.914009.CrossRefGoogle Scholar
- Kazemi, E., Shapiro, M., & Kavner, A. (2015). Predictors of intention to turnover in behavior technicians working with individuals with autism spectrum disorder. Research in Autism Spectrum Disorders, 17, 106–115. https://doi.org/10.1016/j.rasd.2015.06.012.CrossRefGoogle Scholar
- Leon, Y., Wilder, D. A., Majdalany, L., Myers, K., & Saini, V. (2014). Errors of omission and commission during alternative reinforcement of compliance: The effects of varying levels of treatment integrity. Journal of Behavioral Education, 23, 19–33. https://doi.org/10.1007/s10864-013-9181-5.CrossRefGoogle Scholar
- Lindgren, S., Wacker, D., Suess, A., Schieltz, K., Pelzel, K., Kopelman, T., et al. (2016). Telehealth and autism: Treating challenging behavior at lower cost. Pediatrics, 137, S167–S175. https://doi.org/10.1542/peds.2015-2851O.CrossRefPubMedPubMedCentralGoogle Scholar
- Lord, C., & McGee, J. P. (Eds.). (2001). Educating children with autism. Washington, DC: National Academy Press, Committee on Educational Interventions for Children with Autism, Division of Behavioral and Social Sciences and Education, National Research Council.Google Scholar
- Mager, R., & Pipe, P. (1984). Analyzing performance problems (2nd ed.). Belmont, CA: Lake.Google Scholar
- McGee, H. M., & Diener, L. H. (2010). Behavioral systems analysis in health and human services. Behavior Modification, 34, 415–442. https://doi.org/10.1177/0145445510383527.CrossRefPubMedGoogle Scholar
- McGimsey, J. F., Greene, B. F., & Lutzker, J. R. (1995). Competence in aspects of behavioral treatment and consultation: Implications for service delivery and graduate training. Journal of Applied Behavior Analysis, 28, 301–315. https://doi.org/10.1901/jaba.1995.28-301.CrossRefPubMedPubMedCentralGoogle Scholar
- Merritt, T. A., DiGennaro Reed, F. D., & Martinez, C. E. (in press). Using the Performance Diagnostic Checklist–Human Services to identify an indicated intervention to decrease employee tardiness. Journal of Applied Behavior Analysis, 52, 1034–1048. https://doi.org/10.1002/jaba.643.
- Miltenberger, R. G. (2016). Behavior modification: Principles and procedures (6th ed.). Boston, MA: Cengage Learning.Google Scholar
- Moore, J. W., & Fisher, W. W. (2007). The effects of videotape modeling on staff acquisition of functional analysis methodology. Journal of Applied Behavior Analysis, 40, 197–202. https://doi.org/10.1901/jaba.2007.24-06.CrossRefPubMedPubMedCentralGoogle Scholar
- National Autism Center. (2009). National Standards Project: Findings and conclusions. Randolph, MA: Author.Google Scholar
- National Autism Center. (2015). National Standards Project, Phase 2: Findings and conclusions. Addressing the need for evidence-based practice guidelines for autism spectrum disorder. Randolph, MA: Author.Google Scholar
- Nigro-Bruzzi, D., & Sturmey, P. (2010). The effects of behavioral skills training on mand training by staff and unprompted vocal mands by children. Journal of Applied Behavior Analysis, 43, 757–761. https://doi.org/10.1901/jaba.2010.43-757.CrossRefPubMedPubMedCentralGoogle Scholar
- Palmen, A., Didden, R., & Korzilius, H. (2010). Effectiveness of behavioral skills training on staff performance in a job training setting for high-functioning adolescence with autism spectrum disorder. Research in Autism Spectrum Disorders, 4, 731–740. https://doi.org/10.1016/j.rasd.2010.01.012.CrossRefGoogle Scholar
- Parsons, M. B., Rollyson, J. H., & Reid, D. H. (2012). Evidence-based staff training: A guide for practitioners. Behavior Analysis in Practice, 5, 2–11. https://doi.org/10.1007/BF03391819.CrossRefPubMedPubMedCentralGoogle Scholar
- Peterson, L., Homer, A. L., & Wonderlich, S. A. (1982). The integrity of independent variables in behavior analysis. Journal of Applied Behavior Analysis, 15, 477–492. https://doi.org/10.1901/jaba.1982.15-477.CrossRefPubMedPubMedCentralGoogle Scholar
- Phaneuf, L., & McIntyre, L. L. (2007). Effects of individualized video feedback combined with group parent training on inappropriate maternal behavior. Journal of Applied Behavior Analysis, 40, 737–741. https://doi.org/10.1901/jaba.2007.737-741.CrossRefPubMedPubMedCentralGoogle Scholar
- Phillips, K. J., & Mudford, O. C. (2008). Functional analysis training for residential caregivers. Behavioral Interventions, 23, 1–12. https://doi.org/10.1002/bin.252.CrossRefGoogle Scholar
- Piazza, C. C., Milnes, S. M., & Shalev, R. A. (2015). A behavior-analytic approach to the assessment and treatment of pediatric feeding disorders. In H. S. Roane, J. E. Ringdahl, & T. S. Falcomata (Eds.), Clinical and organizational applications of applied behavior analysis (pp. 69–94). Cambridge, MA: Academic Press. https://doi.org/10.1016/B978-0-12-420249-8.00004-6.CrossRefGoogle Scholar
- Poling, A., Dickinson, A. M., Austin, J., & Normand, M. P. (2000). Basic behavioral research and organizational behavior management. In J. Austin & J. E. Carr (Eds.), Handbook of applied behavior analysis (pp. 295–320). Reno, CA: Context Press.Google Scholar
- Prue, D. M., & Fairbank, J. A. (1981). Performance feedback in organizational behavior management: A review. Journal of Organizational Behavior Management, 3(1), 1–16. https://doi.org/10.1300/J075v03n01_01.CrossRefGoogle Scholar
- Reid, D. H., & Parsons, M. B. (1996). A comparison of staff acceptability of immediate versus delayed verbal feedback in staff training. Journal of Organizational Behavior Management, 16(2), 35–47. https://doi.org/10.1300/J075v16n02_03.CrossRefGoogle Scholar
- Reid, D. H., & Parsons, M. B. (2002). Working with staff to overcome challenging behavior among people who have severe disabilities: A guide for getting support plans carried out. Morganton, NC: Habilitative Management Consultants.Google Scholar
- Reid, D. H., Parsons, M. B., & Green, C. W. (2011). Evidence-based ways to promote work quality and enjoyment among support staff: Trainee guide. Washington, DC: American Association of on Intellectual and Developmental Disabilities.Google Scholar
- Ricciardi, J. N. (2005). Achieving human service outcomes through competency-based training: A guide for managers. Behavior Modification, 29, 488–507. https://doi.org/10.1177/0145445504273281.CrossRefPubMedGoogle Scholar
- Sarokoff, R. A., & Sturmey, P. (2004). The effects of behavioral skills training on staff implementation of discrete-trial teaching. Journal of Applied Behavior Analysis, 37, 535–538. https://doi.org/10.1901/jaba.2004.37-535.CrossRefPubMedPubMedCentralGoogle Scholar
- Shapiro, M., & Kazemi, E. (2017). A review of training strategies to teach individuals implementation of behavioral interventions. Journal of Organizational Behavior Management, 37, 32–62. https://doi.org/10.1080/01608061.2016.1267066.CrossRefGoogle Scholar
- Shapiro, M., Kazemi, E., Pogosjana, M., Rios, D., & Mendoza, M. (2016). Preference assessment training via self-instruction: A replication and extension. Journal of Applied Behavior Analysis, 49, 794–808. https://doi.org/10.1002/jaba.339.CrossRefPubMedGoogle Scholar
- Sigurdsson, S. O., & McGee, H. M. (2015). Organizational behavior management: Systems analysis. In H. S. Roane, J. E. Ringdahl, & T. S. Falcomata (Eds.), Clinical and organizational applications of applied behavior analysis (pp. 627–647). Cambridge, MA: Academic Press. https://doi.org/10.1016/B978-0-12-420249-8.00025-3.CrossRefGoogle Scholar
- Slowiak, J. M., & Lakowske, A. M. (2017). The influence of feedback statement sequence and goals on task performance. Behavior Analysis: Research & Practice, 17, 357–380. https://doi.org/10.1037/bar0000084.CrossRefGoogle Scholar
- Strock, M. (2007). Autism spectrum disorders (pervasive developmental disorders). Bethesda, MD: National Institute of Mental Health. Retrieved from https://eric.ed.gov/?id=ED495219. Accessed 19 Aug 2019.
- Sulzer-Azaroff, B., & Gillat, A. (1990). Trends in behavior analysis in education. Journal of Applied Behavior Analysis, 23, 491–495. https://doi.org/10.1901/jaba.1990.23-491.CrossRefPubMedPubMedCentralGoogle Scholar
- Sundberg, D. B. (2016) Why people quit your company and how behavior analysis can slow the revolving door at ABA service providers. Retrieved from https://bsci21.org/why-people-quit-your-company-and-how-behavior-analysis-can-slow-the-revolving-door-at-aba-service-providers/. Accessed 2 Nov 2016.
- U.S. Department of Health & Human Services. (1999). Mental health: A report of the Surgeon General. Rockville, MD: U.S. Department of Health & Human Services, Substance Abuse and Mental Health Services Administration, Center for Mental Health Services, National Institutes of Health, National Institute of Mental Health.Google Scholar
- Van Houten, R., Nau, P., & Marini, Z. (1980). An analysis of public posting in reducing speeding behavior on an urban highway. Journal of Applied Behavior Analysis, 13, 383–395. https://doi.org/10.1901/jaba.1980.13-383.CrossRefPubMedPubMedCentralGoogle Scholar
- Waldvogel, J. M., & Dixon, M. R. (2008). Exploring the utility of preference assessments in organizational behavior management. Journal of Organizational Behavior Management, 28, 76–87. https://doi.org/10.1080/01608060802006831.CrossRefGoogle Scholar
- Wallace, M. D., Doney, J. K., Mintz-Resudek, C. M., & Tarbox, R. S. (2004). Training educators to implement functional analyses. Journal of Applied Behavior Analysis, 37, 89–92. https://doi.org/10.1901/jaba.2004.37-89.CrossRefPubMedPubMedCentralGoogle Scholar
- Ward-Horner, J., & Sturmey, P. (2012). Component analysis of behavior skills training in functional analysis. Behavioral Interventions, 27, 75–92. https://doi.org/10.1002/bin.1339.CrossRefGoogle Scholar
- Wilder, D. A., Harris, C., Casella, S., Wine, B., & Postma, N. (2011). Further evaluation of the accuracy of managerial prediction of employee preference. Journal of Organizational Behavior Management, 31, 130–139. https://doi.org/10.1080/01608061.2011.569202.CrossRefGoogle Scholar
- Wilder, D. A., Rost, K., & McMahon, M. (2007). The accuracy of managerial prediction of employee preference: A brief report. Journal of Organizational Behavior Management, 27(2), 1–14. https://doi.org/10.1300/J075v27n02_01.CrossRefGoogle Scholar
- Wine, B., Gilroy, S., & Hantula, D. A. (2012). Temporal (in)stability of employee preferences for rewards. Journal of Organizational Behavior Management, 32, 58–64. https://doi.org/10.1080/01608061.2012.646854.CrossRefGoogle Scholar
- Wine, B., Reis, M., & Hantula, D. A. (2014). An evaluation of stimulus preference assessment methodology in organizational behavior management. Journal of Organizational Behavior Management, 34, 7–15. https://doi.org/10.1080/01608061.2013.873379.CrossRefGoogle Scholar
- Wine, B., & Wilder, D. A. (2009). The effects of varied versus constant high-, medium-, and low-preference stimuli on performance. Journal of Applied Behavior Analysis, 42, 321–326. https://doi.org/10.1901/jaba.2009.42-321.CrossRefPubMedPubMedCentralGoogle Scholar
- Yeaton, W. H., & Bailey, J. S. (1978). Teaching pedestrian safety skills to young children: An analysis and one-year follow-up. Journal of Applied Behavior Analysis, 11, 315–329. https://doi.org/10.1901/jaba.1978.11-315.CrossRefPubMedPubMedCentralGoogle Scholar