Abstract
Despite common use of the Therapy Attitude Inventory (TAI) to measure satisfaction with parenting interventions, psychometric support has only been demonstrated in predominantly White caregivers of typically developing children following clinic-based treatments. Additionally, the reliability and validity of the Spanish version of the TAI have not been assessed. The present study examined the reliability and validity of the English and Spanish versions of the TAI among mostly Hispanic/Latinx caregivers of children with developmental delay (DD; n = 65) following Internet-delivered Parent-Child Interaction Therapy (iPCIT). Internal consistency was excellent for both versions. Convergent validity was demonstrated by a strong correlation with the Client Satisfaction Questionnaire-8. Satisfaction was predicted by improvements in child behavior and parenting skills, as well as reductions in caregivers’ negative feelings about parenting, following treatment. These findings support use of the TAI with Spanish-speaking families, families from minoritized backgrounds and with children with DD, and following telehealth interventions.
Similar content being viewed by others
Data Availability
The data presented here represent a secondary data analysis from a larger project led by Drs. Bagner and Comer (R01HD084497). Materials and analysis code for this study are not available. However, further information about the larger project can be found at the ClinicalTrials.gov Identifier: NCT03260816, where the study is registered.
References
Achenbach, T. M., Dumenci, L., & Rescorla, L. A. (2001). Ratings of relations between DSM-IV diagnostic categories and items of the CBCL/6–18, TRF, and YSR (pp. 1–9). University of Vermont.
Attkisson, C. C., & Zwick, R. (1982). The client satisfaction questionnaire: Psychometric properties and correlations with service utilization and psychotherapy outcome. Evaluation and Program Planning, 5(3), 233–237.
Bagner, D. M., & Eyberg, S. M. (2007). Parent–child interaction therapy for disruptive behavior in children with mental retardation: A randomized controlled trial. Journal of Clinical Child and Adolescent Psychology, 36(3), 418–429.
Bagner, D. M., Sheinkopf, S. J., Vohr, B. R., & Lester, B. M. (2010). Parenting intervention for externalizing behavior problems in children born premature: An initial examination. Journal of Developmental and Behavioral Pediatrics: JDBP, 31(3), 209.
Bagner, D. M., Coxe, S., Hungerford, G. M., Garcia, D., Barroso, N. E., Hernandez, J., & Rosa-Olivares, J. (2016). Behavioral parent training in infancy: A window of opportunity for high-risk families. Journal of Abnormal Child Psychology, 44, 901–912.
Bagner, D. M., Berkovits, M. D., Coxe, S., Frech, N., Garcia, D., Golik, A., & Comer, J. S. (2023). Telehealth Treatment of Behavior Problems in Young Children With Developmental Delay: A Randomized Clinical Trial. JAMA pediatrics.
Bailey, D. B. Jr., Skinner, D., Rodriguez, P., Gut, D., & Correa, V. (1999). Awareness, use, and satisfaction with services for latino parents of young children with disabilities. Exceptional Children, 65(3), 367–381.
Borrego, J. Jr., Anhalt, K., Terao, S. Y., Vargas, E. C., & Urquiza, A. J. (2006). Parent-child interaction therapy with a spanish-speaking family. Cognitive and Behavioral Practice, 13(2), 121–133.
Brestan, E. V., Jacobs, J. R., Rayfield, A. D., & Eyberg, S. M. (1999). A consumer satisfaction measure for parent-child treatments and its relation to measures of child behavior change. Behavior Therapy, 30(1), 17–30.
Butler, A. M., Brestan, E. V., & Eyberg, S. M. (2008). Examination of the Eyberg child behavior inventory discrepancy hypothesis. Child & Family Behavior Therapy, 30(3), 257–262.
Cantor, J., McBain, R. K., Kofner, A., Hanson, R., Stein, B. D., & Yu, H. (2022). Telehealth adoption by mental health and substance use disorder treatment facilities in the COVID-19 pandemic. Psychiatric Services, 73(4), 411–417.
Comer, J. S. (2021). Rebooting mental health care delivery for the COVID-19 pandemic (and beyond): Guiding cautions as telehealth enters the clinical mainstream. Cognitive and Behavioral Practice, 28(4), 743–748.
Comer, J. S., Chow, C., Chan, P. T., Cooper-Vince, C., & Wilson, L. A. (2013). Psychosocial treatment efficacy for disruptive behavior problems in very young children: A meta-analytic examination. Journal of the American Academy of Child & Adolescent Psychiatry, 52(1), 26–36.
Comer, J. S., Furr, J. M., Cooper-Vince, C., Madigan, R. J., Chow, C., Chan, P. T., & Eyberg, S. M. (2015). Rationale and considerations for the internet-based delivery of parent–child interaction therapy. Cognitive and Behavioral Practice, 22(3), 302–316.
Comer, J. S., Furr, J. M., Miguel, E. M., Cooper-Vince, C. E., Carpenter, A. L., Elkins, R. M., & Chase, R. (2017). Remotely delivering real-time parent training to the home: An initial randomized trial of internet-delivered parent–child interaction therapy (I-PCIT). Journal of Consulting and Clinical Psychology, 85(9), 909.
Comer, J. S., Furr, J. M., Busto, D., Silva, C., Hong, K., Poznanski, N., & Puliafico, B., A (2021). Therapist-led, internet-delivered treatment for early child social anxiety: A waitlist-controlled evaluation of the iCALM telehealth program. Behavior Therapy, 52(5), 1171–1187.
Constantino, J. N., & Gruber, C. P. (2012). Social responsiveness scale: SRS-2. Western Psychological Services Torrance.
Copeland, V. C., Koeske, G., & Greeno, C. G. (2004). Child and mother client satisfaction questionnaire scores regarding mental health services: Race, age, and gender correlates. Research on Social Work Practice, 14(6), 434–442.
Donenberg, G., & Baker, B. L. (1993). The impact of young children with externalizing behaviors on their families. Journal of Abnormal Child Psychology, 21, 179–198.
Eyberg, S. M. (1993). Consumer satisfaction measures for assessing parent training programs. In L. VandeCreek, S. Knapp, & T. L. Jackson (Eds.), Innovations in clinical practice: A source book (Vol. 12). Professional Resource Press.
Eyberg, S. M., & Johnson, S. M. (1974). Multiple assessment of behavior modification with families: Effects of contingency contracting and order of treated problems. Journal of Consulting and Clinical Psychology, 42, 594–606.
Eyberg, S. M., & Pincus, D. (1999). Eyberg Child Behavior Inventory and Sutter Eyberg Student Behavior Inventory: Professional manual. Psychological Assessment Resources.
Eyberg, S. M., Nelson, M. M., Duke, M., & Boggs, S. R. (2004). Manual for the dyadic parent-child interaction coding system third edition.
Eyberg, S. M., Nelson, M. M., Ginn, N. C., Bhuiyan, N., & Boggs, S. R. (2013). Dyadic parent–child Interaction Coding System (DPICS) Comprehensive manual for research and training (4.). PCIT International. Gainesville, FL.
Foote, R., Eyberg, S., & Schuhmann, E. (1998). Parent-child interaction approaches to the treatment of child behavior problems. Advances in Clinical Child Psychology: Volume, 20, 125–151.
Griffith, A. K. (2010). The Use of a behavioral parent training program for parents of adolescents. Journal of At-Risk Issues, 15(2), 1–8.
Gurwitch, R. H., Salem, H., Nelson, M. M., & Comer, J. S. (2020). Leveraging parent–child interaction therapy and telehealth capacities to address the unique needs of young children during the COVID-19 public health crisis. Psychological Trauma: Theory Research Practice and Policy, 12(S1), S82.
Harkey, L. C., Jung, S. M., Newton, E. R., & Patterson, A. (2020). Patient satisfaction with telehealth in rural settings: A systematic review. International Journal of Telerehabilitation, 12(2), 53.
Hasler, G., Moergeli, H., Bachmann, R., Lambreva, E., Buddeberg, C., & Schnyder, U. (2004). Client satisfaction with outclient psychiatric treatment: The role of diagnosis, pharmacotherapy, and perceived therapeutic change. The Canadian Journal of Psychiatry, 49(5), 315–321.
IBM Corp. Released 2021. IBM SPSS statistics for Windows, Version 28.0. Armonk, NY: IBM Corp.
Kaminski, J. W., & Claussen, A. H. (2017). Evidence base update for psychosocial treatments for disruptive behaviors in children. Journal of Clinical Child & Adolescent Psychology, 46(4), 477–499.
Lebow, J. (1982). Consumer satisfaction with mental health treatment. Psychological Bulletin, 91(2), 244.
Matos, M., Torres, R., Santiago, R., Jurado, M., & Rodríguez, I. X. A. (2006). Adaptation of parent–child interaction therapy for Puerto Rican families: A preliminary study. Family Process, 45(2), 205–222.
McCabe, K., Yeh, M., Lau, A., & Argote, C. B. (2012). Parent-child interaction therapy for Mexican americans: Results of a pilot randomized clinical trial at follow-up. Behavior Therapy, 43(3), 606–618.
Moore, K. E., & Kenning, M. (1996). Assessing client satisfaction in a psychology training clinic. The Journal of Mental Health Administration, 23, 180–189.
Morgan, P. L., Farkas, G., Hillemeier, M. M., & Maczuga, S. (2012). Are minoritized children disproportionately represented in early intervention and early childhood special education? Educational Researcher, 41(9), 339–351.
Neece, C. L., Green, S. A., & Baker, B. L. (2012). Parenting stress and child behavior problems: A transactional relationship across time. American Journal on Intellectual and Developmental Disabilities, 117(1), 48–66.
Nguyen, T. D., Attkisson, C. C., & Stegner, B. L. (1983). Assessment of client satisfaction: Development and refinement of a service evaluation questionnaire. Evaluation and Program Planning, 6(3–4), 299–313.
O’Reilly, A., Donnelly, A., Rogers, J., Maloney, O., O’Brien, G., & Doyle, E. (2021). Measuring parent satisfaction in youth mental health services. Mental Health Review Journal, 26(3), 213–225.
Petrenko, C. L. (2013). A review of intervention programs to prevent and treat behavioral problems in young children with developmental disabilities. Journal of Developmental and Physical Disabilities, 25, 651–679.
Pons, J. I., Matías-Carrelo, L., Rodríguez, M., Rodríguez, J. M., Herrans, L. L., Jiménez, M. E., & Yang, J. (2008). Estudios De validez de la Escala De Inteligencia Wechsler para Adultos Versión III, Puerto Rico (EIWA-III). Revista Puertorriqueña De Psicología, 19, 75–111.
Qi, C. H., & Kaiser, A. P. (2003). Behavior problems of preschool children from low income families: Review of the literature. Topics in Early Childhood Special Education, 23.
Ramos, G., Blizzard, A. M., Barroso, N. E., & Bagner, D. M. (2018). Parent training and skill acquisition and utilization among spanish-and English-speaking latino families. Journal of Child and Family Studies, 27, 268–279.
Rey, J. M., O’brien, M., & Walter, G. (2002). Is the satisfied customer one who also ‘does well’? The relationship between outcome and parent satisfaction in a child and adolescent mental health service. Australasian Psychiatry, 10(3), 1–4.
Roberts, R. E., & Attkisson, C. C. (1983). Assessing client satisfaction among hispanics. Evaluation and Program Planning, 6(3–4), 401–413.
Roberts, R. E., Attkisson, C. C., & Stegner, B. L. (1983). A client satisfaction scale suitable for use with hispanics? Hispanic Journal of Behavioral Sciences, 5(4), 461–475.
Roberts, R. E., Atrkisson, C. C., & Mendias, R. M. (1984). Assessing the client satisfaction questionnaire in English and Spanish. Hispanic Journal of Behavioral Sciences, 6(4), 385–396.
Rosenberg, S. A., Zhang, D., & Robinson, C. C. (2008). Prevalence of developmental delays and participation in early intervention services for young children. Pediatrics, 121(6).
Ryan, C. L. (2013). Language use in the United States: 2011.
Schulte, S. J., Meier, P. S., & Stirling, J. (2011). Dual diagnosis clients’ treatment satisfaction-a systematic review. BMC Psychiatry, 11(1), 1–12.
Shapiro, J. P., Welker, C. J., & Jacobson, B. J. (1997). The youth client satisfaction questionnaire: Development, construct validation, and factor structure. Journal of Clinical Child Psychology, 26(1), 87–98.
Stewart, C. D., Quinn, A., Plever, S., & Emmerson, B. (2009). Comparing cognitive behavior therapy, problem solving therapy, and treatment as usual in a high risk population. Suicide and Life-Threatening Behavior, 39(5), 538–547.
Suhr, D. D. (2006). Exploratory or confirmatory factor analysis?.
Sullivan, A. D., Forehand, R., Acosta, J., Parent, J., Comer, J. S., Loiselle, R., & Jones, D. J. (2021). COVID-19 and the acceleration of behavioral parent training telehealth: Current status and future directions. Cognitive and Behavioral Practice, 28(4), 618–629.
United States Department of Health and Human Services. Poverty guidelines computations.
Webster-Stratton, C. (2001). The incredible years: Parents, teachers, and children training series. Residential Treatment for Children & Youth, 18(3), 31–45.
Webster-Stratton, C., Reid, M. J., & Hammond, M. (2001). Preventing conduct problems, promoting social competence: A parent and teacher training partnership in Head Start. Journal of Clinical Child Psychology, 30(3), 283–302.
Wechsler, D. (1999). Wechsler Abbreviated Scale of Intelligence (WASI). Psychological Corp.
Acknowledgements
This work was supported by a research project grant from the National Institute of Child Health and Human Development (NICHD) to the third and fourth authors (R01HD084497). We thank all the families who participated in this research.
Funding
This work was supported by a research project grant from the National Institute of Child Health and Human Development (NICHD) to Drs. Comer and Bagner (R01HD084497).
Author information
Authors and Affiliations
Contributions
Conceptualization: Keara J. Neuman, Timothy Hayes, Jonathan S. Comer, Daniel M. Bagner; Methodology: Keara J. Neuman, Timothy Hayes, Jonathan S. Comer, Daniel M. Bagner; Formal analysis and investigation: Keara J. Neuman, Timothy Hayes; Writing – original draft preparation: Keara J. Neuman; Writing – review and editing: Keara J. Neuman, Timothy Hayes, Jonathan S. Comer, Daniel M. Bagner; Funding acquisition: Jonathan S. Comer, Daniel M. Bagner; Resources: Jonathan S. Comer, Daniel M. Bagner; Supervision: Daniel M. Bagner
Corresponding author
Ethics declarations
Ethics Approval and Consent to Participate
This study was performed in line with the principles of the Declaration of Helsinki. Approval was obtained from the Institutional Review Board (IRB) of Florida International University.
Consent to Participate
Informed consent, which was approved by the IRB, was obtained from all caregivers prior to screening.
Competing Interests
Dr. Bagner reported receiving grants from the National Institutes of Health and personal fees from PCIT International to train clinicians in PCIT supported by a grant from the Florida Department of Children and Families outside the submitted work. Dr. Comer reported receiving grants from the National Institutes of Health; personal fees from Macmillan Learning for textbook royalties; and personal fees from Association for Behavioral and Cognitive Therapies for an editorial stipend outside the submitted work. No other disclosures were reported.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
The data presented in this manuscript come from a research project grant (R01HD084497) entitled “Advancing Child Competencies by Extending Supported Services (ACCESS) for Families Program” which was provided to Drs. Bagner and Comer by the National Institute of Child Health and Human Development (NICHD). The data presented here represent a secondary data analysis from this project. Materials and analysis code for this study are not available. However, further information about the larger project can be found at the ClinicalTrials.gov Identifier: NCT03260816, where the study is registered. Portions of the data in this manuscript have been accepted for presentation at the Association for Behavioral and Cognitive Therapies Annual Convention in November 2023.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Neuman, K.J., Hayes, T., Comer, J.S. et al. Reliability and Validity of the Therapy Attitude Inventory in Caregivers Receiving Internet-Delivered Parent Child Interaction Therapy for Young Children with Developmental Delay. J Psychopathol Behav Assess 46, 25–34 (2024). https://doi.org/10.1007/s10862-023-10104-1
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10862-023-10104-1