Abstract
Disruptive behavior disorders (DBD) are the most common behavioral health problems in young American children. When not well-managed in early childhood, DBD can progress to lifetime mental health problems with personal, economic, as well as societal impacts. The evidence-based intervention of choice for DBD is outpatient parent-directed behavioral therapy (PDT). However, little is known about clinicians’ perspectives on the factors influencing PDT’s effectiveness in routine care. The current study directly assesses clinicians’ perspectives on factors they believe impact PDT’s success for disruptive behavior problems, in particular tantrums, at two outpatient behavioral therapy clinics specializing in PDT. In-depth interviews with 19 clinicians across three experience levels (doctoral intern, post-doctoral, licensed staff psychologist) were conducted and analyzed using qualitative methods. Two major themes were identified as enabling and limiting treatment success: (1) appointment attendance, (2) primary caregiver buy-in to treatment approach. Additional identified factors include caregiver’s familial and social support, caregiver’s physical and emotional capacities, complexity of the child’s behavior problems, the extent to which the home environment can support positive changes, competing family/home demands, and care coordination among hospital programs. The primary factors identified by clinicians highlight the importance of fostering appointment attendance and parental psychoeducation that can be addressed by implementing multi-level administrative, training, and clinical initiatives to improve PDT’s real-world effectiveness for DBD.
Similar content being viewed by others
References
American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Author.
Boardman, W. K. (1962). Rusty: A brief behavior disorder. Journal of Consulting Psychology, 26, 293–297.
Bombard, Y., Baker, G. R., Orlando, E., Fancott, C., Bhatia, P., Casalino, S., Onate, K., Denis, J.-L., & Pomey, M. P. (2018). Engaging patients to improve quality of care: A systematic review. Implementation Science, 13(1), 98. https://doi.org/10.1186/s13012-018-0784-z
Braun, V., & Clarke, V. (2006) Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77–101. https://doi.org/10.1191/1478088706qp063oa
Brookman-Frazee, L., Haine, R. A., & Garland, A. F. (2008). Predicting frequency of treatment visits in community-based youth psychotherapy. Psychological Services, 5(2), 126–138. https://doi.org/10.1037/1541-1559.5.2.126
Brookman-Frazee, L., Garland, A. F., Taylor, R., & Zoffness, R. (2009). Therapists’ attitudes towards psychotherapeutic strategies in community-based psychotherapy with children with disruptive behavior problems. Administration and Policy in Mental Health Services Research, 36, 1–12. https://doi.org/10.1007/s10488-008-0195-6
Brookman-Frazee, L., Stadnick, N., Roesch, S., Regan, J., Barnett, M., Bando, L., Innes-Gomberg, D., & Lau, A. (2016). Measuring sustainment of multiple practices fiscally mandated in children’s mental health services. Administration and Policy in Mental Health and Mental Health Services Research, 43(6), 1009–1022. https://doi.org/10.1007/s10488-016-0731-8
Chorpita, B., Daleiden, E., Ebesutani, C., Young, J., Becker, K., Nakamura, B., Phillips, L., Ward, A., Lynch, R., Trent, L., Smith, R., Okamura, K., & Starace, N. (2011). Evidence-based treatments for children and adolescents: An updated review of indicators of efficacy and effectiveness. Clinical Psychology (New York, NY), 18(2), 154–172. https://doi.org/10.1111/j.1468-2850.2011.01247.x
Dishion, T. J., Stormshak, E. A., & Kavanagh, K. (2011). Everyday parenting: A professional’s guide to building family management skills (1st ed.). Research Press.
Dretzke, J., Davenport, C., Frew, E., Barlow, J., Stewart-Brown, S., Bayliss, S., & Hyde, C. (2009). The clinical effectiveness of different parenting programmes for children with conduct problems: A systematic review of randomized control trials. Child and Adolescent Psychiatry and Mental Health, 3(7), 1–10. https://doi.org/10.1186/1753-2000-3-7
Eyberg, S., Nelson, M., & Boggs, S. (2008). Evidence-based psychosocial treatments for children and adolescents with disruptive behavior. Journal of Clinical Child and Adolescent Psychology, 37(1), 215–237. https://doi.org/10.1080/15374410701820117
Eyberg, S. M. (2013). Treating the behaviorally disordered child. In G. P. Koocher, J. C. Norcross & B. Greene (Eds.), Psychologists’ desk reference (3rd ed., pp. 411–414). Oxford University Press.
Forehand, R., Jones, D. J., & Parent, J. (2013). Behavioral parenting interventions for child disruptive behaviors and anxiety: What’s different and what’s the same. Clinical Psychology Review, 33(1), 133–145. https://doi.org/10.1016/j.cpr.2012.10.010
Garland, A. F., Haine-Schlagel, R., Brookman-Frazee, L., Baker-Ericzen, M. J., Trask, E. V., & Fawley-King, K. (2013). Improving community-based mental health care for children: Translating knowledge into action. Administration and Policy in Mental Health and Mental Health Services, 40, 6–22. https://doi.org/10.1007/s10488-012-0450-8
Garvey, C., Julion, W., Fogg, L., Kratovil, A., & Gross, D. (2006). Measuring participation in a prevention trial with parents of young children. Research in Nursing and Health, 29(3), 212–222. https://doi.org/10.1002/nur.20127
Gopalan, G., Goldstein, L., Klingenstein, K., Sicher, C., Blake, C., & McKay, M. M. (2010). Engaging families into child mental health treatment: Updates and special considerations. Journal of the Canadian Academy of Child and Adolescent Psychiatry, 19(3), 182–196.
Haine-Schlagel, R., & Walsh, N. E. (2015). A review of parent participation engagement in child and family mental health treatment. Clinical Child and Family Psychology Review, 18(2), 133–150. https://doi.org/10.1007/s10567-015-0182-x
Herschell, A. D., McNeill, C. B., & McNeill, D. W. (2004). Clinical child psychology’s progress in disseminating empirically supported treatments. Clinical Psychology: Science and Practice, 11(3), 267–288. https://doi.org/10.1093/clipsy.bph082
Hsieh, H. F., & Shannon, S. E. (2005). Three approaches to qualitative content analysis. Qualitative Health Research, 15, 1277–1288. https://doi.org/10.1177/1049732305276687
Johnson, C. A., & Katz, R. C. (1973). Using parents as change agents for their children: A review. Journal of Child Psychology and Psychiatry, and Allied Disciplines, 14(3), 181–200. https://doi.org/10.1111/j.1469-7610.1973.tb01186.x
Joseph, H. M., Farmer, C., Kipp, H., Kolko, D., Aman, M., McGinley, J., Arnold, L. E., Gadow, K. D., Findling, R. L., & Molina, B. (2019). Attendance and engagement in parent training predict child behavioral outcomes in children pharmacologically treated for attention-deficit/hyperactivity disorder and severe aggression. Journal of Child and Adolescent Psychopharmacology, 29(2), 90–99. https://doi.org/10.1089/cap.2018.0119
Kazdin, A. E. (2013). Evidence-based treatments and usual care. Cautions and qualifications. JAMA Psychiatry, 70, 666–667. https://doi.org/10.1001/jamapsychiatry.2013.2112
Lavigne, J. V., Bryant, F. B., & Hopkins, J. (2014). Dimensions of oppositional defiant disorder in young children: Model comparisons, gender and longitudinal invariance. Journal of Abnormal Child Psychology, 43, 423–439. https://doi.org/10.1007/s10802-014-9919-0
Lochman, J. E., Boxmeyer, C., Powell, N., Dillon, C., Powe, C., & Kassing, F. (2017). Disruptive behavior disorders. In C. A. Flessner & J. C. Piacentini (Eds.), Clinical handbook of psychological disorders in children and adolescents: A step-by-step treatment manual. http://ebookcentral.proquest.com.
Marshall, C., & Rossman, G. B. (2010). Designing qualitative research (5th ed.). Sage Publications, Inc.
Miles, M. B., & Huberman, A. M. (1994). Qualitative data analysis: An expanded sourcebook. SAGE Publications, Inc.
Michelson, D., Davenport, C., Dretzke, J., Barlow, J., & Day, C. (2013). Do evidence-based interventions work when tested in the “real world?” A systematic review and meta-analysis of parent management training for the treatment of child disruptive behavior. Clinical Child and Family Psychology Review, 16(1), 18–34. https://doi.org/10.1007/s10567-013-0128-0
Mueller, C. W., Tolman, R., Higa-McMillan, C. K., & Daleiden, E. L. (2010). Longitudinal predictors of youth functional improvement in a public mental health system. The Journal of Behavior Health Services and Research, 37(3), 350–362. https://doi.org/10.1007/s11414-009-9172-4
Nix, R. L., Bierman, K. L., McMahon, R. J., & Conduct Problems Prevention Research Group. (2009). How attendance and quality of participation affect treatment response to parent management training. Journal of Consulting and Clinical Psychology, 77(3), 429–438. https://doi.org/10.1037/a0015028
Patton, M. Q. (2002). Qualitative research and evaluation methods (3rd ed.). Sage Publications, Inc.
Post, R. M., Rowe, M., Kaplan, D., & Findling, R. (2017). The child network for parents to track their child’s mood and behavior. Journal of Child and Adolescent Psychopharmacology, 27(9), 840–843. https://doi.org/10.1089/cap.2017.0002
Reyno, S. M., & McGrath, P. J. (2006). Predictors of parent training efficacy for child externalizing behavior problems—A meta-analytic review. Journal of Child Psychology and Psychiatry, 47(1), 99–111. https://doi.org/10.1111/j.1469-7610.2005.01544.x
Riley, A. W., Yu-Lefler, H. F., Kazi, Z., & Lindauer, S. (in prep). Maternal executive function: Influence on families’ adherence to treatment and children’s behavior problem outcomes.
Steiner, H., & Remsing, L. (2007). Practice parameter for the assessment and treatment of children and adolescents with oppositional defiant disorder. Journal of the American Academy of Child and Adolescent Psychiatry, 46(1), 126–141. https://doi.org/10.1097/01.chi.0000246060.62706.af
Van Aar, J., Leijten, P., Orobio de Castro, B., & Overbeek, G. (2017). Sustained, fade-out or sleeper effects? A systematic review and meta-analysis of parenting interventions for disruptive child behavior. Clinical Psychology Review, 51, 153–163. https://doi.org/10.1016/j.cpr.2016.11.006
Weisz, J. R., & Gray, J. S. (2008). Evidence-based psychotherapy for children and adolescents: Data from the present and a model for the future. Child and Adolescent Mental Health, 13(2), 54–65. https://doi.org/10.1111/j.1475-3588.2007.00475.x
Wertz, J., Agnew-Blais, J., Caspi, A., Danese, A., Fisher, H. L., Goldman-Mellor, S., Moffitt, T. E., & Arseneault, L. (2018). From childhood conduct problems to poor functioning at age 18 years: Examining explanations in a longitudinal cohort study. Journal of the American Academy of Child and Adolescent Psychiatry, 57(1), 54-60.e4. https://doi.org/10.1016/j.jaac.2017.09.437
Wilkie, D. P., Cicero, D. C., & Mueller, C. W. (2018). Disruptive behavior treatment progress as a function of therapy focus and youth diagnosis in a community mental health setting. Administration and Policy in Mental Health and Mental Health Services Research, 45, 484–494. https://doi.org/10.1007/s10488-017-0840-z
Whittingham, K., Sofronoff, K., Sheffield, J., & Sanders, M. R. (2009). Stepping stones triple P: An RCT of a parenting program with parents of a child diagnosed with an autism spectrum disorder. Journal of Abnormal Child Psychology, 37(4), 469–480. https://doi.org/10.1007/s10802-008-9285-x
Yu-Lefler, H. F., Becraft, J. L., DeLeon, I. G., Lindauer, S., Bullock, C., Richman, G., & Cataldo, M. F. (under review). Parents report data more consistently via text messages than other formats. Journal of Applied Behavior Analysis.
Acknowledgements
We thank the clinicians and clinical leadership at two outpatient behavioral therapy clinics at the Kennedy Krieger Institute for their commitment to treatment quality and participating as key informants in this study. We acknowledge the foundational efforts of the Director of the Department of Behavioral Psychology, Dr. Michael Cataldo, PhD, who supported and initially guided the investments to create the treatment accountability infrastructure within the outpatient behavioral psychology clinics. We also acknowledge Brittany Comunale and Leslie Wang, graduate students from the Johns Hopkins Bloomberg School of Public Health, who assisted in literature reviews.
Funding
The research outlined here was supported by the Kennedy Krieger Institute’s Department of Behavioral Psychology as part of routine treatment accountability practices in their outpatient programs.
Author information
Authors and Affiliations
Contributions
All authors contributed to the study conception and design. Material preparation, data collection and initial coding were performed by HY-L. SL and AWR reviewed the raw data and coding and assisted in finalizing the results. The first draft of the manuscript was written by HY-L and all authors contributed to subsequent versions of the manuscript, and read and approved the final manuscript.
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Ethical Approval
This is a qualitative study using key informants. The Johns Hopkins Bloomberg School of Public Health Institutional Review Board determined the study as Not Human Subjects Research and exempt from review. All procedures involving human participants were in accordance with the ethical standards of the Kennedy Krieger Institute, Johns Hopkins Bloomberg School of Public Health and the 1964 Helsinki Declaration and its later amendments or comparable ethical standards.
Informed Consent
Informed consent was obtained from all individual participants included in the study.
Standards of Reporting
This manuscript was prepared using the EQUATOR Network’s SRQR guidelines for qualitative research.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendices
Appendix: Semi-structured Interview Sheet
Clinician-Identified Factors Influencing Treatment Effectiveness for Tantrums
Semi-Structured Interview Sheet
Target Patient Population: Patient cases in Clinic 1 and Clinic 2 who have tantrums as their primary (or one of their primary treatment targets), attended at least an initial evaluation (IE) + 1 follow-up appointment prior to inactivity/discharge.
Directions: Conduct a 30-min interview with Clinic 1 and Clinic 2 clinicians who had at least 1 year of clinical experience with patient cases with tantrums. Ideally, interviews ought to be conducted with 3 interns, 3 post-docs, and 3 licensed psychologists. On the network, the interviewer should pull up an electronic copy of this interview sheet saved under the clinician’s name and the Header section filled out with the clinician’s information. Please also audio-record on Voice Recorder and save to same folder on network as the interview sheet. During the interview, the interviewer will type in freestyle answers provided by the clinician under the respective questions below. If the clinician has trouble answering the questions, the interview may use some of the factor categories to help promote discussion.
Introduction: Thank you for speaking with me today. One of the things the Clinical Outcomes team is helping to do is identify factors impacting treatment success for patients with tantrums. I need your help to identify these factors. What I will do today is ask you some questions, and to write down your responses. Your answers will be kept confidential and will aid in a qualitative analysis on common factors impacting treatment for tantrums.
Questions: Think back to the patient cases you’ve had over your time in Clinic 1/Clinic 2.
-
1.
For cases that had successful treatment of tantrums, what were aspects of the case and/or of the family that made treatment successful? <Type in freestyle what the clinician says>
-
2.
Please think about a very recent parent and child who had successful treatment for tantrums. Can you tell me what factors you think contributed to this outcome?
-
3.
For cases that weren’t so successful in treating tantrums, what were aspects of the case and/or of the family that limited treatment success? <Type in freestyle what the clinician says>
-
4.
Please think about a very recent parent and child who didn’t have successful treatment for tantrums.
-
How much progress do you think was made?
-
Can you tell me what factors you think contributed to this outcome?
-
Thank you so much for all your assistance! If you have any questions or think of anything to add, feel free to contact me at [HY-L email].
Factor categories
Child/Family Attributes | Factors Influencing Appointment Attendance | Factors Influencing Family/Child’s Engagement in Treatment | Factors Influencing Treatment Effectiveness before Inactivity/Discharge | Factors Influencing Treatment Effectiveness after Inactivity/Discharge |
---|---|---|---|---|
(examples below) – Child age – Child diagnosis – Function of tantrums (and/or any other associated behavior) – Level/Severity of behavior problem prior to therapy – Level of parent education – Number of other children in household – Etc… | (examples below) – Distance – Overall cost of OBP services to family (with or without insurance) – Change/lapse in healthcare insurance to cover for behavioral therapy – Scheduling conflicts – Other family life events that take precedence over behavioral therapy (sickness, changing jobs/schools, relocation) – Parent ability to keep a schedule – Etc… | (examples below) – Commitment from primary caregiver(s) and child to get behavioral therapy – Prior experience with therapy – Support/agreement from other family members for child to get behavioral therapy – School/teacher support/agreement for child to get behavioral therapy – Rapport between clinician and child/caregivers – Etc… | (examples below) – Accurate understanding by caregiver(s) of development for child – Reasonable expectations for treatment – Treatment plan accurately diagnoses function behind behavior problem, and provides adequate strategies to reduce the problem – Caregiver skill acquisition – Child receives concurrent care from other developmental and/or mental healthcare professionals – Etc… | (examples below) – Continual usage of treatment strategies by caregiver(s) and/or child – Child has other problems that arise’ – Child receives care from other developmental and/or mental healthcare professionals after inactivity/discharge – Etc… |
Rights and permissions
About this article
Cite this article
Yu-Lefler, H.F., Lindauer, S. & Riley, A.W. Clinician-Identified Factors in Success of Parent-Directed Behavioral Therapy for Children’s Tantrums. Adm Policy Ment Health 49, 168–181 (2022). https://doi.org/10.1007/s10488-021-01155-1
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10488-021-01155-1