Advertisement

Prevention Science

, Volume 19, Issue 7, pp 894–903 | Cite as

Novel Methods for Screening: Contributions from Attachment and Biobehavioral Catch-up

  • EB Caron
  • Caroline K. P. Roben
  • Heather A. Yarger
  • Mary Dozier
Article

Abstract

Preventative interventions are needed across the lifespan, including for children who have experienced maltreatment. However, interventions’ effect sizes are typically smaller in real-world settings than in clinical trials. Identifying providers who are likely to implement interventions with fidelity could promote implementation outcomes through targeted allocation of training resources. This study tested two pre-training screening measures as predictors of provider fidelity to Attachment and Biobehavioral Catch-up (ABC), a preventative intervention for maltreated infants. One measure assessed valuing of attachment/openness, and the other used vignettes to assess initial skill in a key intervention component. In a sample of 42 providers across 197 sessions, both screening measures predicted future ABC fidelity, even when controlling for experience and education. These results support the development of screening measures for other interventions, suggesting approaches that target specific qualities and behaviors are likely to predict implementation fidelity.

Keywords

Provider characteristics Screening interviews Fidelity Training Implementation science 

Notes

Acknowledgments

We would like to thank the parent coaches and ABC fidelity consultants who participated in this study. We would also like to thank Amanda Costello and Fabianne Blake for their coding of screening interviews and Chase Stovall-McClough and Lori Potter for their ABC consultation with the parent coaches in this sample.

Funding

This research was supported by the National Institutes of Health Grants R01 MH052135, R01 MH074374, and R01 MH084135 to the fourth author.

Compliance with Ethical Standards

Conflict of Interest

The authors declare that they have no conflict of interest.

Ethical Approval

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.

Informed Consent

For this type of study, formal consent is not required.

References

  1. Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011). Advancing a conceptual model of evidence-based practice implementation in public service sectors. Administration and Policy in Mental Health and Mental Health Services Research, 38, 4–23.  https://doi.org/10.1007/s10488-010-0327-7.CrossRefPubMedGoogle Scholar
  2. Baer, J. S., Rosengren, D. B., Dunn, C. W., Wells, E. A., Ogle, R. L., & Hartzler, B. (2004). An evaluation of workshop training in motivational interviewing for addiction and mental health clinicians. Drug and Alcohol Dependence, 73, 99–106.CrossRefGoogle Scholar
  3. Baer, J. S., Carpenter, K. M., Beadnell, B., Stoner, S. A., Ingalsbe, M. H., Hartzler, B., ... & Drager, Z. (2012). Computer assessment of simulated patient interviews (CASPI): Psychometric properties of a web-based system for the assessment of motivational interviewing skills. Journal of Studies on Alcohol and Drugs, 73, 154.CrossRefGoogle Scholar
  4. Barth, R. P., Landsverk, J., Chamberlain, P., Reid, J. B., Rolls, J. A., Hurlburt, M. S., et al. (2005). Parent-training programs in child welfare services: Planning for a more evidence-based approach to serving biological parents. Research on Social Work Practice, 15, 353–371.  https://doi.org/10.1177/1049731505276321.CrossRefGoogle Scholar
  5. Beidas, R. S., & Kendall, P. C. (2010). Training therapists in evidence-based practice: A critical review of studies from a systems-contextual perspective. Clinical Psychology: Science and Practice, 17, 1–30.  https://doi.org/10.1111/j.1468-2850.2009.01187.x.CrossRefGoogle Scholar
  6. Bernard, K., Butzin-Dozier, Z., Rittenhouse, J., & Dozier, M. (2010). Cortisol production patterns in young children living with birth parents vs children placed in foster care following involvement of Child Protective Services. Archives of Pediatrics & Adolescent Medicine, 164, 438–443.  https://doi.org/10.1001/archpediatrics.2010.54.CrossRefGoogle Scholar
  7. Bernard, K., Dozier, M., Bick, J., Lewis-Morrarty, E., Lindhiem, O., & Carlson, E. (2012). Enhancing attachment organization among maltreated children: Results of a randomized clinical trial. Child Development, 83, 623–636.  https://doi.org/10.1111/j.1467-8624.2011.01712.x.CrossRefPubMedPubMedCentralGoogle Scholar
  8. Bernard, K., Hostinar, C. E., & Dozier, M. (2015). Intervention effects on diurnal cortisol rhythms of child protective services-referred infants in early childhood: Preschool follow-up results of a randomized clinical trial. JAMA Pediatrics, 169, 112–119.  https://doi.org/10.1001/jamapediatrics.2014.2369.CrossRefPubMedPubMedCentralGoogle Scholar
  9. Bowlby, J. (1988). A secure base: Parent-child attachment and healthy human development. New York: Basic Books.Google Scholar
  10. Campbell, B. K., Buti, A., Fussell, H. E., Srikanth, P., McCarty, D., & Guydish, J. R. (2013). Therapist predictors of treatment delivery fidelity in a community-based trial of 12-step facilitation. The American Journal of Drug and Alcohol Abuse, 39, 304–311.  https://doi.org/10.3109/00952990.2013.799175.CrossRefPubMedPubMedCentralGoogle Scholar
  11. Caron, E. (2017). Effects and processes of fidelity-focused consultation (dissertation). University of Delaware, Newark.Google Scholar
  12. Caron, E., Bernard, K., & Dozier, M. (2016). In vivo feedback predicts parent behavior change in the Attachment and Biobehavioral Catch-up intervention. Journal of Clinical Child & Adolescent Psychology. Advance online publication. doi: https://doi.org/10.1080/15374416.2016.1141359.
  13. Carpenter, K. M., Cheng, W. Y., Smith, J. L., Brooks, A. C., Amrhein, P. C., Wain, R. M., & Nunes, E. V. (2012). “Old dogs” and new skills: How clinician characteristics relate to motivational interviewing skills before, during, and after training. Journal of Consulting and Clinical Psychology, 80, 560–573.  https://doi.org/10.1037/a0028362.CrossRefPubMedPubMedCentralGoogle Scholar
  14. Crowell, J. A., & Feldman, S. S. (1991). Mothers’ working models of attachment relationships and mother and child behavior during separation and reunion. Developmental Psychology, 27, 597–605.  https://doi.org/10.1037/0012-1649.27.4.597.CrossRefGoogle Scholar
  15. Damschroder, L. J., & Hagedorn, H. J. (2011). A guiding framework and approach for implementation research in substance use disorders treatment. Psychology of Addictive Behaviors, 25, 194.  https://doi.org/10.1037/a0022284.CrossRefPubMedGoogle Scholar
  16. Durlak, J. A., & Dupre, E. P. (2008). Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41, 327–350.CrossRefGoogle Scholar
  17. Edmunds, J. M., Beidas, R. S., & Kendall, P. C. (2013). Dissemination and implementation of evidence-based practices: Training and consultation as implementation strategies. Clinical Psychology: Science and Practice, 20, 152–165.  https://doi.org/10.1111/cpsp.12031.CrossRefGoogle Scholar
  18. Fixsen, D. L., Naoom, S. F., Blase, K. A., Friedman, R. M. & Wallace, F. (2005). Implementation research: A synthesis of the literature. Tampa: University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network (FMHI Publication #231).Google Scholar
  19. Frost, A., Jelinek, C., Bernard, K., Lind, T., & Dozier, M. (2017). Longitudinal associations between low morning cortisol in infancy and anger dysregulation in early childhood in a CPS-referred sample. Developmental Science.  https://doi.org/10.1111/desc.12573.CrossRefGoogle Scholar
  20. George, C., Kaplan, N., & Main, M. (1985). Adult attachment interview.Google Scholar
  21. Hesse, E. (2008). The adult attachment interview: Protocol, method of analysis, and empirical studies. In J. Cassidy & P. R. Shaver (Eds.), Handbook of attachment: Theory, research, and clinical applications (2nd ed., pp. 552–598). New York: Guilford Press.Google Scholar
  22. Hulleman, C. S., & Cordray, D. S. (2009). Moving from the lab to the field: The role of fidelity and achieved relative intervention strength. Journal of Research on Educational Effectiveness, 2, 88–110.  https://doi.org/10.1080/19345740802539325.CrossRefGoogle Scholar
  23. van Ijzendoorn, M. (1995). Adult attachment representations, parental responsiveness, and infant attachment: A meta-analysis on the predictive validity of the adult attachment interview. Psychological Bulletin, 117, 387–403.  https://doi.org/10.1037/0033-2909.117.3.387.CrossRefPubMedGoogle Scholar
  24. van Ijzendoorn, M. H., Schuengel, C., & Bakermans-Kranenburg, M. J. (1999). Disorganized attachment in early childhood: Meta-analysis of precursors, concomitants, and sequelae. Development and Psychopathology, 11, 225–249.  https://doi.org/10.1017/S0954579499002035.CrossRefPubMedGoogle Scholar
  25. Johnson, J. (2000). A heuristic method for estimating the relative weight of predictor variables in multiple regression. Multivariate Behavioral Research, 35, 1–19.  https://doi.org/10.1207/S15327906MBR3501_1.CrossRefPubMedGoogle Scholar
  26. Kallestad, J. H., & Olweus, D. (2003). Predicting teachers’ and schools’ implementation of the Olweus bullying prevention program: A multilevel study. Prevention & Treatment, 6. doi: https://doi.org/10.1037/1522-3736.6.1.621a.
  27. Klimes-Dougan, B., August, G. J., Lee, C. Y. S., Realmuto, G. M., Bloomquist, M. L., Horowitz, J. L., & Eisenberg, T. L. (2009). Practitioner and site characteristics that relate to fidelity of implementation: The early risers prevention program in a going-to-scale intervention trial. Professional Psychology: Research and Practice, 40, 467–475.  https://doi.org/10.1037/a0014623.CrossRefGoogle Scholar
  28. Letendre, M. L., & Reed, M. B. (2017). The effect of adverse childhood experience on clinical diagnosis of a substance use disorder: Results of a nationally representative study. Substance Use & Misuse, 52, 689–697.  https://doi.org/10.1080/10826084.2016.1253746.CrossRefGoogle Scholar
  29. Lewis-Morrarty, E., Dozier, M., Bernard, K., Terracciano, S. M., & Moore, S. V. (2012). Cognitive flexibility and theory of mind outcomes among foster children: Preschool follow-up results of a randomized clinical trial. Journal of Adolescent Health, 51, S17–S22.  https://doi.org/10.1016/j.jadohealth.2012.05.005.CrossRefPubMedGoogle Scholar
  30. Lievens, F., & Sackett, P. R. (2006). Video-based versus written situational judgment tests: A comparison in terms of predictive validity. Journal of Applied Psychology, 91, 1181–1188.  https://doi.org/10.1037/0021-9010.91.5.1181.CrossRefPubMedGoogle Scholar
  31. Lundby, K. M., & Johnson, J. W. (2006). Relative weights of predictors: What is important when many forces are operating. In A. I. Kraut (Ed.), Getting action from organizational surveys: New concepts, technologies, and applications. San Francisco: Jossey-Bass.Google Scholar
  32. Main, M., & Goldwyn, A. (1998) Adult attachment interview scoring and classification manual. Unpublished manual. Berkley: University of California, Department of Psychology.Google Scholar
  33. Martino, S., Ball, S., Nich, C., Frankforter, T. L., & Carroll, K. M. (2009). Correspondence of motivational enhancement treatment integrity ratings among therapists, supervisors, and observers. Psychotherapy Research, 19, 181–193.  https://doi.org/10.1080/10503300802688460.CrossRefPubMedPubMedCentralGoogle Scholar
  34. Meade, E., Blackwell, M., Roben, C.K.P., & Dozier, M. (2013). Using screening interviews to predict therapist performance in the Attachment and Biobehavioral Catch-up intervention. Poster presented at the biennial meeting of the Society for Research on Child Development (SRCD), Seattle, WA.Google Scholar
  35. Miller, W. R., Hedrick, K. E., & Orlofsky, D. R. (1991). The helpful responses questionnaire: A procedure for measuring therapeutic empathy. Journal of Clinical Psychology, 47, 444–448.CrossRefGoogle Scholar
  36. Miller, G. E., Chen, E., & Parker, K. J. (2011). Psychological stress in childhood and susceptibility to the chronic diseases of aging: Moving toward a model of behavioral and biological mechanisms. Psychological Bulletin, 137, 959–997.  https://doi.org/10.1037/a0024768.CrossRefPubMedPubMedCentralGoogle Scholar
  37. Project MATCH Research Group. (1998). Therapist effects in three treatments for alcohol problems. Psychotherapy Research, 8, 455–474.  https://doi.org/10.1093/ptr/8.4.455.CrossRefGoogle Scholar
  38. Riem, M. M. E., Bakermans-Kranenburg, M., van Ijzendoorn, M. H., Out, D., & Rombouts, S. A. R. B. (2012). Attachment in the brain: Adult attachment representations predict amygdala and behavioral responses to infant crying. Attachment & Human Development, 14, 533–551.  https://doi.org/10.1080/14616734.2012.727252.CrossRefGoogle Scholar
  39. Roben, C. K., Dozier, M., Caron, E., & Bernard, K. (2017). Moving an evidence-based parenting program into the community. Child Development, 88, 1447–1452.  https://doi.org/10.1111/cdev.12898.CrossRefPubMedPubMedCentralGoogle Scholar
  40. Rosengren, D. B., Baer, J. S., Hartzler, B., Dunn, C. W., & Wells, E. A. (2005). The video assessment of simulated encounters (VASE): Development and validation of a group-administered method for evaluating clinician skills in motivational interviewing. Drug and Alcohol Dependence, 79, 321–330.  https://doi.org/10.1016/j.drugalcdep.2005.02.004.CrossRefPubMedGoogle Scholar
  41. Stein, L. A. R., Clair, M., Soenksen-Bassett, S., Martin, R. A., & Clarke, J. G. (2015). Studying process and proximal outcomes of supervision for motivational interviewing. Training and Education in Professional Psychology, 9, 175–182.  https://doi.org/10.1037/tep0000073.CrossRefPubMedPubMedCentralGoogle Scholar
  42. Tabak, R. G., Khoong, E. C., Chambers, D. A., & Brownson, R. C. (2012). Bridging research and practice: Models for dissemination and implementation research. American Journal of Preventive Medicine, 43, 337–350.  https://doi.org/10.1016/j.amepre.2012.05.024.CrossRefPubMedPubMedCentralGoogle Scholar
  43. Taylor, W. D., Asgary-Eden, V., Lee, C. M., & Laroche, K. J. (2015). Service providers’ adherence to an evidence-based parenting program: What are they missing and why? Journal of Child and Family Studies, 24, 50–56.  https://doi.org/10.1007/s10826-013-9812-4.CrossRefGoogle Scholar
  44. Tyrrell, C., Dozier, M., Teague, G. B., & Fallot, R. D. (1999). Effective treatment relationships for persons with serious psychiatric disorders: The importance of attachment states of mind. Journal of Consulting and Clinical Psychology, 67, 725–733.CrossRefGoogle Scholar
  45. U.S. Department of Health & Human Services, Administration for Children and Families, Administration on Children, Youth and Families, Children’s Bureau. (2018). Child maltreatment 2016. Available from https://www.acf.hhs.gov/sites/default/files/cb/cm2016.pdf.
  46. Wittenborn, A. K. (2012). Exploring the influence of the attachment organizations of novice therapists on their delivery of emotionally focused therapy for couples. Journal of Marital and Family Therapy, 38, 50–62.  https://doi.org/10.1111/j.1752-0606.2012.00290.x.CrossRefPubMedGoogle Scholar

Copyright information

© Society for Prevention Research 2018
corrected publication April/2018

Authors and Affiliations

  • EB Caron
    • 1
  • Caroline K. P. Roben
    • 2
  • Heather A. Yarger
    • 2
  • Mary Dozier
    • 2
  1. 1.Department of PsychiatryUniversity of Connecticut Health CenterFarmingtonUSA
  2. 2.Department of Psychological and Brain SciencesUniversity of DelawareNewarkUSA

Personalised recommendations