Effects of Fidelity-Focused Consultation on Clinicians’ Implementation: An Exploratory Multiple Baseline Design
Identification of effective consultation models could inform implementation efforts. This study examined the effects of a fidelity-focused consultation model among community-based clinicians implementing Attachment and Biobehavioral Catch-up. Fidelity data from 1217 sessions from 7 clinicians were examined in a multiple baseline design. In fidelity-focused consultation, clinicians received feedback from consultants’ fidelity coding, and also coded their own fidelity. Clinicians’ fidelity increased after fidelity-focused consultation began, but did not increase during other training periods. Fidelity was sustained for 30 months after consultation ended. Findings suggest that consultation procedures involving fidelity coding feedback and self-monitoring of fidelity may promote implementation outcomes.
KeywordsImplementation Fidelity Consultation Self-monitoring
We would like to thank the parent coaches and ABC fidelity coders and consultants who participated in this study. We also thank Patria Weston-Lee and the Consuelo Foundation for leading the implementation effort in Hawaii.
This study was supported by the National Institutes of Health under Grants R01 MH052135, R01 MH074374, and R01 MH084135.
Compliance with Ethical Standards
Conflict of interest
EB Caron declares that she has no conflict of interest. Mary Dozier declares that she has no conflict of interest.
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards. For this type of study formal consent is not required.
- Bernard, K., Hostinar, C. E., & Dozier, M. (2015a). Intervention effects on diurnal cortisol rhythms of child protective services-referred infants in early childhood: Preschool follow-up results of a randomized clinical trial. JAMA Pediatrics, 169, 112–119. https://doi.org/10.1001/jamapediatrics.2014.2369.CrossRefGoogle Scholar
- Cicchetti, D. V., & Sparrow, S. A. (1981). Developing criteria for establishing interrater reliability of specific items: Applications to assessment of adaptive behavior. American Journal of Mental Deficiency, 86, 127–137.Google Scholar
- Darnell, D., Dunn, C., Atkins, D., Ingraham, L., & Zatzick, D. (2016). A randomized evaluation of motivational interviewing training for mandated implementation of alcohol screening and brief intervention in trauma centers. Journal of Substance Abuse Treatment, 60, 36–44. https://doi.org/10.1016/j.jsat.2015.05.010.CrossRefGoogle Scholar
- Dunn, C., Darnell, D., Atkins, D. C., Hallgren, K. A., Imel, Z. E., Bumgardner, K., et al. (2016). Within-provider variability in motivational interviewing integrity for three years after MI training: Does time heal? Journal of Substance Abuse Treatment, 65, 74–82. https://doi.org/10.1016/j.jsat.2016.02.008.CrossRefGoogle Scholar
- Eiraldi, R., Mautone, J. A., Khanna, M. S., Power, T. J., Orapallo, A., Cacia, J., et al. (2018). Group CBT for externalizing disorders in urban schools: Effect of training strategy on treatment fidelity and child outcomes. Behavior Therapy, 49, 538–550. https://doi.org/10.1016/j.beth.2018.01.001.CrossRefGoogle Scholar
- Fixsen, D. L., Naoom, S. F., Blase, K. A., Friedman, R. M., & Wallace, F. (2005). Implementation research: A synthesis of the literature. FMHI Publication No. 231. Tampa, FL: University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network. https://nirn.fpg.unc.edu/resources/implementation-research-synthesis-literature.
- Funderburk, B., Chaffin, M., Bard, E., Shanley, J., Bard, D., & Berliner, L. (2015). Comparing client outcomes for two evidence-based treatment consultation strategies. Journal of Clinical Child and Adolescent Psychology, 44, 730–741. https://doi.org/10.1080/15374416.2014.910790.CrossRefGoogle Scholar
- Garcia, I., James, R. W., Bischof, P., & Baroffio, A. (2017). Self-observation and peer feedback as a faculty development approach for problem-based learning tutors: A program evaluation. Teaching and Learning in Medicine, 29, 313–325. https://doi.org/10.1080/10401334.2017.1279056.CrossRefGoogle Scholar
- Henggeler, S. W., Chapman, J. E., Rowland, M. D., Halliday-Boykins, C. A., Randall, J., Shackelford, J., & Schoenwald, S. K. (2008). Statewide adoption and initial implementation of contingency management for substance-abusing adolescents. Journal of Consulting and Clinical Psychology, 76, 556–567. https://doi.org/10.1037/0022-006X.76.4.556.CrossRefGoogle Scholar
- Jamtvedt, G., Young, J. M., Kristoffersen, D. T., O’Brien, M. A., & Oxman, A. D. (2006). Does telling people what they have been doing change what they do? A systematic review of the effects of audit and feedback. BMJ Quality and Safety, 15, 433–436. https://doi.org/10.1136/qshc.2006.018549.CrossRefGoogle Scholar
- Lyon, A. R., Pullmann, M. D., Whitaker, K., Ludwig, K., Wasse, J. K., & McCauley, E. (2017). A digital feedback system to support implementation of measurement-based care by school-based mental health clinicians. Journal of Clinical Child and Adolescent Psychology. https://doi.org/10.1080/15374416.2017.1280808.Google Scholar
- Nadeem, E., Gleacher, A., & Beidas, R. S. (2013). Consultation as an implementation strategy for evidence-based practices across multiple contexts: Unpacking the black box. Administration and Policy in Mental Health and Mental Health Services Research, 40, 439–450. https://doi.org/10.1007/s10488-013-0502-8.CrossRefGoogle Scholar
- National Advisory Mental Health Council. (2001). Blueprint for change: Research on child and adolescent mental health. A report by the National Advisory Mental Health Council’s Workgroup on Child and Adolescent Mental Health Intervention Development and Deployment. Bethesda, MD: National Institutes of Health, National Institute of Mental Health. https://www.nimh.nih.gov/about/advisory-boards-and-groups/namhc/reports/blueprint-for-change-research-on-child-and-adolescent-mental-health.shtml.
- Persson, J. E., Bohman, B., Forsberg, L., Beckman, M., Tynelius, P., Rasmussen, F., & Ghaderi, A. (2016). Proficiency in motivational interviewing among nurses in child health services following workshop and supervision with systematic feedback. PLoS ONE, 11, e0163624. https://doi.org/10.1371/journal.pone.0163624.CrossRefGoogle Scholar
- Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical linear models: Applications and data analysis methods. Thousand Oaks, CA: Sage.Google Scholar
- Schoenwald, S. K., Sheidow, A. J., & Letourneau, E. J. (2004). Toward effective quality assurance in evidence-based practice: Links between expert consultation, therapist fidelity, and child outcomes. Journal of Clinical Child and Adolescent Psychology, 33, 94–104. https://doi.org/10.1207/S15374424JCCP3301_10.CrossRefGoogle Scholar
- Snijders, T. A. B. (2005). Fixed and random effects. In B. S. Everitt & D. C. Howell (Eds.), Encyclopedia of statistics in behavioral science (pp. 664–665). Chichester: Wiley.Google Scholar
- Warren, J. S., Nelson, P. L., Mondragon, S. A., Baldwin, S. A., & Burlingame, G. M. (2010). Youth psychotherapy change trajectories and outcomes in usual care: Community mental health versus managed care settings. Journal of Consulting and Clinical Psychology, 78, 144–155. https://doi.org/10.1037/a0018544.CrossRefGoogle Scholar