Are Inner Context Factors Related to Implementation Outcomes in Cognitive-Behavioral Therapy for Youth Anxiety?

  • Rinad S. Beidas
  • Julie Edmunds
  • Matthew Ditty
  • Jessica Watkins
  • Lucia Walsh
  • Steven Marcus
  • Philip Kendall
Original Article


Among the challenges facing the mental health field are the dissemination and implementation of evidence-based practices. The present study investigated the relationships between inner context variables (i.e., adopter characteristics and individual perceptions of intra-organizational factors) and two implementation outcomes—independently rated therapist fidelity on a performance-based role-play (i.e., adherence and skill) and self-reported penetration of cognitive behavioral therapy for youth anxiety following training. A significant relationship was found between inner context variables and fidelity. Specifically, adopter characteristics were associated with adherence and skill; individual perceptions of intra-organizational factors were associated with adherence. Inner context variables were not associated with penetration. Future directions are discussed.


Evidence-based practice Inner context Implementation outcomes 


  1. Aarons, G. A. (2004). Mental health provider attitudes toward adoption of evidence-based practice: The Evidence-Based Practice Attitude Scale (EBPAS). Mental Health Services Research, 6(2), 61–74.PubMedCrossRefPubMedCentralGoogle Scholar
  2. Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011). Advancing a conceptual model of evidence-based practice implementation in public service sectors. Administration and Policy in Mental Health and Mental Health Services Research, 38(1), 4–23. doi:10.1007/s10488-010-0327-7.PubMedCrossRefPubMedCentralGoogle Scholar
  3. Aarons, G. A., & Sawitzky, A. C. (2006). Organizational culture and climate and mental health provider attitudes towards evidence-based practice. Psychological Services, 3(1), 61–72. doi:10.1037/1541-1559.3.1.61.PubMedCrossRefPubMedCentralGoogle Scholar
  4. Addis, M. E., & Krasnow, A. D. (2000). A national survey of practicing psychologists’ attitudes toward psychotherapy treatment manuals. Journal of Consulting and Clinical Psychology, 68(2), 331–339. doi:10.1037/0022-006X.68.2.331.PubMedCrossRefGoogle Scholar
  5. American Psychological Association. (2006). Evidence-based practice in psychology. American Psychologist, 61, 271–285.CrossRefGoogle Scholar
  6. Barwick, M. A., Schachter, H. M., Bennett, L. M., McGowan, J., Ly, M., Wilson, A., et al. (2012). Knowledge translation efforts in child and youth mental health: A systematic review. Journal of Evidence-Based Social Work, 9(4), 369–395. doi:10.1080/15433714.2012.663667.PubMedCrossRefPubMedCentralGoogle Scholar
  7. Beidas, R. S., Barmish, A. J., & Kendall, P. C. (2009). Training as usual: Can therapist behavior change after reading a manual and attending a brief workshop on cognitive behavioral therapy for youth anxiety? The Behavior Therapist, 32, 97–101.Google Scholar
  8. Beidas, R. S., Cross, W., & Dorsey, S. (2013). Show me, don’t tell me: Behavioral rehearsal as a training and analogue fidelity tool. Cognitive and Behavioral Practice. doi:10.1016/j.cbpra.2013.04.002.
  9. Beidas, R. S., Edmunds, J. M., Marcus, S. C., & Kendall, P. C. (2012a). Training and consultation to promote implementation of an empirically supported treatment: A randomized trial. Psychiatric Services, 63(7), 660–665. doi:10.1176/ Scholar
  10. Beidas, R. S., & Kendall, P. C. (2010). Training therapists in evidence-based practice: A critical review of studies from a systems-contextual perspective. Clinical Psychology: Science and Practice, 17(1), 1–30. doi:10.1111/j.1468-2850.2009.01187.x.Google Scholar
  11. Beidas, R. S., Suarez, L., Simpson, D., Read, K., Wei, C., Connolly, S., et al. (2012b). Contextual factors and anxiety in minority and European American youth presenting for treatment across two urban university clinics. Journal of Anxiety Disorders, 26, 544–554. doi:10.1016/j.janxdis.2012.02.008.PubMedCrossRefPubMedCentralGoogle Scholar
  12. Benjamin, C. L., Beidas, R. S., Edmunds, J. M., Cohen, J., & Kendall, P. (2010). Identification and treatment of anxious youth. Unpublished instrument. Department of Psychology, Temple University, Philadelphia, PA.Google Scholar
  13. Carpenter, K. M., Cheng, W. Y., Smith, J. L., Brooks, A. C., Amrhein, P. C., Wain, R. M., et al. (2012). “Old dogs” and new skills: How clinician characteristics relate to motivational interviewing skills before, during, and after training. Journal of Consulting and Clinical Psychology, 80(4), 560–573. doi:10.1037/a0028362.PubMedCrossRefPubMedCentralGoogle Scholar
  14. Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009). Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implementation Science, 4(1), 50. doi:10.1186/1748-5908-4-50.PubMedCrossRefPubMedCentralGoogle Scholar
  15. Dimeff, L. A., Koerner, K., Woodcock, E. A., Beadnell, B., Brown, M. Z., Skutch, J. M., et al. (2009). Which training method works best? A randomized controlled trial comparing three methods of training clinicians in dialectical behavior therapy skills. Behaviour Research and Therapy, 47(11), 921–930. doi:10.1016/j.brat.2009.07.011.PubMedCrossRefGoogle Scholar
  16. Edmunds, J. M., Beidas, R. S., & Kendall, P. C. (2013a). Dissemination and implementation of evidence-based practices: Training and consultation as implementation strategies. Clinical Psychology: Science and Practice, 20(2), 152–165. doi:10.1111/cpsp.12031.Google Scholar
  17. Edmunds, J. M., Kendall, P. C., Ringle, V., Read, K., Brodman, D. M., Pimentel, S. S., et al. (2013b). An examination of behavioral rehearsal during consultation as a predictor of training outcomes. Administration and Policy in Mental Health and Mental Health Services Research, 40, 456–466.PubMedCrossRefGoogle Scholar
  18. Ehrenreich-May, J., Southam-Gerow, M. A., Hourigan, S. E., Wright, L. R., Pincus, D. B., & Weisz, J. R. (2010). Characteristics of anxious and depressed youth seen in two different clinical contexts. Administration and Policy in Mental Health and Mental Health Services Research. doi:10.1007/s10488-010-0328-6.Google Scholar
  19. Farmer, A. P., Légaré, F., Turcot, L., Grimshaw, J., Harvey, E., McGowan, J. L., et al. (2008). Printed educational materials: Effects on professional practice and healthcare outcomes. Cochrane Database of Systematic Reviews, 3, CD004938. doi:10.1002/14651858.CD004398.Google Scholar
  20. Fixsen, D. L., Naoom, S. F., Blase, K. A., Friedman, R. M., & Wallace, F. (2005). Implementation research: A synthesis of the literature. University of South Florida, Tampa, FL.Google Scholar
  21. Garland, A. F., Brookman-Frazee, L., Hurlburt, M. S., Accurso, E. C., Zoffness, R. J., Haine-Schlagel, R., et al. (2010). Mental health care for children with disruptive behavior problems: A view inside therapists’ offices. Psychiatric Services, 61(8), 788–795. doi:10.1176/ Scholar
  22. Garner, B. R., Hunter, B. D., Godley, S. H., & Godley, M. D. (2012). Training and retaining staff to competently deliver an evidence-based practice: The role of staff attributes and perceptions of organizational functioning. Journal of Substance Abuse Treatment, 42(2), 191–200. doi:10.1016/j.jsat.2011.10.016.PubMedCrossRefPubMedCentralGoogle Scholar
  23. Glisson, C. (2002). The organizational context of children’s mental health services. Clinical Child and Family Psychology Review, 5(4), 233–253.PubMedCrossRefGoogle Scholar
  24. Glisson, C., & Green, P. (2011). Organizational climate, services, and outcomes in child welfare systems. Child Abuse & Neglect, 35(8), 582–591. doi:10.1016/j.chiabu.2011.04.009.CrossRefGoogle Scholar
  25. Glisson, C., Schoenwald, S. K., Hemmelgarn, A., Green, P., Dukes, D., Amstrong, K. S., et al. (2010). Randomized trial of MST and ARC in a two-level evidence-based treatment implementation strategy. Journal of Consulting and Clinical Psychology, 78(4), 537–550. doi:10.1037/a0019160.PubMedCrossRefPubMedCentralGoogle Scholar
  26. Harned, M. S., Dimeff, L. A., Woodcock, E. A., & Contreras, I. (2013). Predicting adoption of exposure therapy in a randomized controlled dissemination trial. Journal of Anxiety Disorders. doi:10.1016/j.janxdis.2013.02.006.
  27. Hawkins, K. A., & Sinha, R. (1998). Can line clinicians master the conceptual complexities of dialectical behavior therapy? An evaluation of a State Department of Mental Health training program. Journal of Psychiatric Research, 32(6), 379–384. doi:10.1016/S0022-3956(98)00030-2.PubMedCrossRefGoogle Scholar
  28. Henggeler, S. W. (2004). Decreasing effect sizes for effectiveness studies—Implications for the transport of evidence-based treatments: Comment on Curtis, Ronan, and Borduin (2004). Journal of Family Psychology, 18(3), 420–423. doi:10.1037/0893-3200.18.3.420.PubMedCrossRefGoogle Scholar
  29. Henggeler, S. W., Melton, G. B., Brondino, M. J., Scherer, D. G., & Hanley, J. H. (1997). Multisystemic therapy with violent and chronic juvenile offenders and their families: The role of treatment fidelity in successful dissemination. Journal of Consulting and Clinical Psychology, 65(5), 821–833. doi:10.1037/0022-006X.65.5.821.PubMedCrossRefGoogle Scholar
  30. Herschell, A. D., McNeil, C. B., & McNeil, D. W. (2004). Clinical child psychology’s progress in disseminating empirically supported treatments. Clinical Psychology: Science and Practice, 11(3), 267–288. doi:10.1093/clipsy.bph082.Google Scholar
  31. Hurlburt, M. S., Garland, A. F., Nguyen, K., & Brookman-Frazee, L. (2010). Child and family therapy process: Concordance of therapist and observational perspectives. Administration and Policy in Mental Health and Mental Health Services Research, 37, 230–244.PubMedCrossRefPubMedCentralGoogle Scholar
  32. Kendall, P. C., Hudson, J., Gosch, E., Flannery-Schroeder, E., & Suveg, C. (2008). Cognitive-behavioral therapy for anxiety disordered youth: A randomized clinical trial evaluating child and family modalities. Journal of Consulting and Clinical Psychology, 76, 282–297.PubMedCrossRefGoogle Scholar
  33. Klein, K. J., Conn, A. B., & Sorra, J. S. (2001). Implementing computerized technology: An organizational analysis. Journal of Applied Psychology, 86(5), 811–824. doi:10.1037//0021-9010.86.5.811.PubMedCrossRefGoogle Scholar
  34. Lehman, W. E., Greener, J. M., & Simpson, D. (2002). Assessing organizational readiness for change. Journal of Substance Abuse Treatment, 22(4), 197–209.PubMedCrossRefGoogle Scholar
  35. Lewis, C. C., & Simons, A. D. (2011). A pilot study disseminating cognitive behavioral therapy for depression: Therapist factors and perceptions of barriers to implementation. Administration and Policy in Mental Health and Mental Health Services Research, 38(4), 324–334. doi:10.1007/s10488-011-0348-x.PubMedCrossRefGoogle Scholar
  36. Lim, A., Nakamura, B. J., Higa-McMillan, C. K., Shimabukuro, S., & Slavin, L. (2012). Effects of workshop trainings on evidence-based practice knowledge and attitudes among youth community mental health providers. Behaviour Research and Therapy, 50(6), 397–406. doi:10.1016/j.brat.2012.03.008.PubMedCrossRefGoogle Scholar
  37. Martino, S., Canning-Ball, M., Carroll, K., & Rounsaville, B. (2011). A criterion-based stepwise approach for trianing counselors in motivational interviewing. Journal of Substance Abuse Treatment, 40, 357–365. doi:10.1016/jsat.2010.12.004.PubMedCrossRefPubMedCentralGoogle Scholar
  38. Miller, W. R., Yahne, C. E., Moyers, T. B., Martinez, J., & Pirritano, M. (2004). A randomized trial of methods to help clinicians learn motivational interviewing. Journal of Consulting and Clinical Psychology, 72(6), 1050–1062. doi:10.1037/0022-006X.72.6.1050.PubMedCrossRefGoogle Scholar
  39. Nadeem, E., Gleacher, A., & Beidas, R. S. (2013). Consultation as an implementation strategy for evidence-based practices across multiple contexts: Unpacking the black box. Administration and Policy in Mental Health and Mental Health Services, 40, 439–450.CrossRefGoogle Scholar
  40. Perepletchikova, F., & Kazdin, A. E. (2005). Treatment integrity and therapeutic change: Issues and research recommendations. Clinical Psychology: Science and Practice, 12(4), 365–383. doi:10.1093/clipsy/bpi045.Google Scholar
  41. Perepletchikova, F., Treat, T. A., & Kazdin, A. E. (2007). Treatment integrity in psychotherapy research: Analysis of the studies and examination of the associated factors. Journal of Consulting and Clinical Psychology, 75(6), 829–841. doi:10.1037/0022-006X.75.6.829.PubMedCrossRefGoogle Scholar
  42. Powell, B. J., McMillen, J. C., Proctor, E. K., Carpenter, C. R., Griffey, R. T., Bunger, A. C., et al. (2011). A compilation of strategies for implementing clinical innovations in health and mental health. Medical Care Research and Review, 69(2), 123–157. doi:10.1177/1077558711430690.PubMedCrossRefPubMedCentralGoogle Scholar
  43. President’s New Freedom Commission on Mental Health. (2003). Report of the President’s New Freedom Commission on Mental Health. Washington, DC.Google Scholar
  44. Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., et al. (2011). Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda. Administration and Policy in Mental Health and Mental Health Services Research, 38(2), 65–76. doi:10.1007/s10488-010-0319-7.PubMedCrossRefPubMedCentralGoogle Scholar
  45. Rakovshik, S. G., & McManus, F. (2010). Establishing evidence-based training in cognitive behavioral therapy: A review of current empirical findings and theoretical guidance. Clinical Psychology Review, 30(5), 496–516. doi:10.1016/j.cpr.2010.03.004.PubMedCrossRefGoogle Scholar
  46. Saldana, L., & Chamberlain, P. (2012). Supporting implementation: The role of community development teams to build infrastructure. American Journal of Community Psychology, 50, 334–346.PubMedCrossRefPubMedCentralGoogle Scholar
  47. Saldana, L., Chapman, J. E., Henggeler, S. W., & Rowland, M. D. (2007). The organizational readiness for change scale in adolescent programs: Criterion validity. Journal of Substance Abuse Treatment, 33(2), 159–169. doi:10.1016/j.jsat.2006.12.029.PubMedCrossRefPubMedCentralGoogle Scholar
  48. Sanders, M. R., Prinz, R. J., & Shapiro, C. J. (2009). Predicting utilization of evidence-based parenting interventions with organizational, service-provider and client variables. Administration and Policy in Mental Health and Mental Health Services Research, 36(2), 133–143. doi:10.1007/s10488-009-0205-3.PubMedCrossRefGoogle Scholar
  49. Sanders, M. R., & Turner, K. M. T. (2005). Reflections of the challenges of effective dissemination of behavioural family intervention: Our experience with the Triple P-Positive Parenting Program. Child and Adolescent Mental Health, 10(4), 158–169. doi:10.1111/j.1475-3588.2005.00367.x.CrossRefGoogle Scholar
  50. Schoenwald, S. K., Chapman, J. E., & Garland, A. F. (in press). Capturing fidelity. In R. S. Beidas & P. C. Kendall (Eds.), Child and adolescent therapy: Dissemination and implementation of empirically supported treatments (1st ed.). New York: Oxford University Press.Google Scholar
  51. Schoenwald, S. K., Chapman, J. E., Sheidow, A. J., & Carter, R. E. (2009). Long-term youth criminal outcomes in MST transport: The impact of therapist adherence and organizational climate and structure. Journal of Clinical Child and Adolescent Psychology, 38(1), 91–105. doi:10.1080/15374410802575388.PubMedCrossRefPubMedCentralGoogle Scholar
  52. Shafran, R., Clark, D. M., Fairburn, C. G., Arntz, A., Barlow, D. H., Ehlers, A., et al. (2009). Mind the gap: Improving the dissemination of CBT. Behaviour Research and Therapy, 47(11), 902–909. doi:10.1016/j.brat.2009.07.003.PubMedCrossRefGoogle Scholar
  53. Sholomskas, D. E., Syracuse-Siewert, G., Rounsaville, B. J., Ball, S. A., Nuro, K. F., & Carroll, K. M. (2005). We don’t train in vain: A dissemination trial of three strategies of training clinicians in cognitive-behavioral therapy. Journal of Consulting and Clinical Psychology, 73(1), 106–115. doi:10.1037/0022-006X.73.1.106.PubMedCrossRefPubMedCentralGoogle Scholar
  54. Southam-Gerow, M. A., Silverman, W. K., & Kendall, P. C. (2006). Client similarities and differences in two childhood anxiety disorders research clinics. Journal of Clinical Child & Adolescent Psychology, 35, 528–538. doi:10.1207/s15374424jccp35044.CrossRefGoogle Scholar
  55. Stirman, S. W., Kimberly, J., Cook, N., Calloway, A., Castro, F., & Charns, M. (2012). The sustainability of new programs and innovations: A review of the empirical literature and recommendations for future research. Implementation Science: IS, 7, 17. doi:10.1186/1748-5908-7-17.CrossRefGoogle Scholar
  56. Taxman, F. S., & Belenko, S. (2012). Implementing evidence-based practices in community corrections and addiction treatment. New York: Springer Verlag GMBH.CrossRefGoogle Scholar
  57. Turner, K. M. T., & Sanders, M. R. (2006). Dissemination of evidence-based parenting and family support strategies: Learning from the Triple-P-Positive Parenting Program system approach. Aggression and Violent Behavior, 11(2), 176–193. doi:10.1016/j.avb.2005.07.005.CrossRefGoogle Scholar
  58. Walkup, J. T., Albano, A. M., Piacentini, J., Birmaher, B., Compton, S. N., Sherrill, J. T., et al. (2008). Cognitive behavioral therapy, sertraline, or a combination in childhood anxiety. New England Journal of Medicine, 359(26), 2753–2766. doi:10.1056/NEJMoa0804633.PubMedCrossRefPubMedCentralGoogle Scholar
  59. Waltz, J., Addis, M. E., Koerner, K., & Jacobson, N. S. (1993). Testing the integrity of a psychotherapy protocol: Assessment of adherence and competence. Journal of Consulting and Clinical Psychology, 61(4), 620–630. doi:10.1037/0022-006X.61.4.620.PubMedCrossRefGoogle Scholar
  60. Weingardt, K. R., Cucciare, M. A., Bellotti, C., & Lai, W. P., (2009). A randomized trial comparing two models of web-based training in cognitive-behavioral therapy for substance abuse counselors. Journal of Substance Abuse Treatment, 37(3), 219–227. doi:10.1016/j.jsat.2009.01.002.PubMedCrossRefPubMedCentralGoogle Scholar
  61. Weisz, J. R., Sandler, I. N., Durlak, J. A., & Anton, B. S. (2005). Promoting and protecting youth mental health through evidence-based prevention and treatment. American Psychologist, 60(6), 628–648. doi:10.1037/0003-066X.60.6.628.PubMedCrossRefGoogle Scholar
  62. Williams, C., Martinez, R., Dafters, R., Ronald, L., & Garland, A. (2011). Training the wider workforce in cognitive behavioural self-help: The SPIRIT (Structured Psychosocial InteRventions in Teams) training course. Behavioural and Cognitive Psychotherapy, 39(2), 139–149. doi:10.1017/S1352465810000445.PubMedCrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2013

Authors and Affiliations

  • Rinad S. Beidas
    • 1
  • Julie Edmunds
    • 2
  • Matthew Ditty
    • 3
  • Jessica Watkins
    • 4
  • Lucia Walsh
    • 1
  • Steven Marcus
    • 3
    • 5
  • Philip Kendall
    • 6
  1. 1.Department of Psychiatry, Perelman School of MedicineUniversity of PennsylvaniaPhiladelphiaUSA
  2. 2.Center for Effective Child TherapyJudge Baker Children’s CenterBostonUSA
  3. 3.School of Social Policy and PracticeUniversity of PennsylvaniaPhiladelphiaUSA
  4. 4.Bryn Mawr CollegeBryn MawrUSA
  5. 5.Center for Health Equity Research and PromotionPhiladelphia Veterans Affairs Medical CenterPhiladelphiaUSA
  6. 6.Department of PsychologyTemple UniversityPhiladelphiaUSA

Personalised recommendations