Training Research: Practical Recommendations for Maximum Impact

  • Rinad S. Beidas
  • Kelly Koerner
  • Kenneth R. Weingardt
  • Philip C. Kendall
Original Paper
First Online:

Abstract

This review offers practical recommendations regarding research on training in evidence-based practices for mental health and substance abuse treatment. When designing training research, we recommend: (a) aligning with the larger dissemination and implementation literature to consider contextual variables and clearly defining terminology, (b) critically examining the implicit assumptions underlying the stage model of psychotherapy development, (c) incorporating research methods from other disciplines that embrace the principles of formative evaluation and iterative review, and (d) thinking about how technology can be used to take training to scale throughout all stages of a training research project. An example demonstrates the implementation of these recommendations.

Keywords

Training Dissemination and implementation Technology Evidence based practice Innovation 
This is a preview of subscription content, log in to check access.

Notes

Acknowledgments

This work was facilitated by NIH grant MH083333 (Ms. Beidas) and MH64484 (Dr. Kendall). Ms. Beidas and Dr. Koerner contributed equally to this manuscript.

References

  1. Ajzen, I. (1988). Attitudes, personality and behavior. Milton Keynes, England: Open University PressGoogle Scholar
  2. Ajzen, I. (1991). The theory of planned behavior. Organizational Behavior and Human Decision Processes, 50, 179–211. doi: 10.1016/0749-5978(91)90020-T.CrossRefGoogle Scholar
  3. American Academy of Child and Adolescent Psychiatry. (2006). American academy of child and adolescent psychiatry policy statement on evidence-based practice in psychiatry. Retrieved from http://www.aacap.org/cs/root/policy_statements/evidence_based_practice
  4. American Psychological Association. (2005). American psychological association policy statement on evidence-based practice in psychology. Retrieved from http://www.apa.org/practice/ebpreport.pdf
  5. Atkins, M., Frazier, S., & Cappella, E. (2006). Hybrid research models. Natural opportunities for examining mental health in context. Clinical Psychology: Science and Practice, 13, 105–107. doi: 10.1111/j.1468-2850.2006.00012.x.CrossRefGoogle Scholar
  6. Atkins, M., Frazier, S., Leathers, S., Graczyk, P., Talbott, E., Jakobsons, L., et al. (2008). Teacher key opinion leaders and mental health consultation in low-income urban schools. Journal of Consulting and Clinical Psychology, 76, 905–908. doi: 10.1037/a0013036.PubMedCrossRefGoogle Scholar
  7. Beck, A., Rush, A., Shaw, B., & Emory, G. (1987). Cognitive therapy of depression. New York: Guilford Press.Google Scholar
  8. Beidas, R., Barmish, A., & Kendall, P. (2009). Training as usual: Can clinician behavior change following reading a manual and attending a brief workshop on cognitive behavioral therapy for youth anxiety? The Behavior Clinician, 32(5), 97–101.Google Scholar
  9. Beidas, R. S., Edmunds, J., & Kendall, P. (2010, June). A comparison of training methods for dissemination. In S. Stirman (Chair), Therapist and client outcomes of community-based training programs in evidence-based treatments. Symposium conducted at the meeting of the World Congress of Behavioral and Cognitive Therapies, Boston, Massachusetts.Google Scholar
  10. Beidas, R. S., & Kendall, P. C. (2010). Training clinicians in evidence-based practice: A critical review of studies from a systems-contextual perspective. Clinical Psychology: Science & Practice, 17, 1–30. doi: 10.1111/j.1468-2850.2009.01187.x.CrossRefGoogle Scholar
  11. Bennett-Levy, J., Richards, D., Farrand, P., Christensen, H., Griffiths, K., Kavanagh, D., et al. (Eds.). (2010). Oxford guide to low intensity CBT interventions. London, England: Oxford University Press.Google Scholar
  12. Bondi, A. (2000). Characteristics of scalability and their impact on performance. Proceedings of the 2nd international workshop on Software and performance, Ottawa, Ontario, Canada.Google Scholar
  13. Borntrager, C., Chorpita, B., Higa-McMillan, C., & Weisz, J. (2009). Provider attitudes toward evidence-based practices: Are the concerns with the evidence or with the manuals? Psychiatric Services, 60, 677–681. doi: 10.1176/appi.ps.60.5.677.PubMedCrossRefGoogle Scholar
  14. Bradach, J. (2010). Scaling impact: How to get100X the results with 2X the organization. Stanford Social Innovation Review, Summer, 27–28. Retrieved from http://www.ssireview.org/articles/entry/scaling_impact/
  15. Bradley, E., Curry, L., Ramandhan, S., Rowe, L., Nembhard, I., & Krumholz, H. (2009). Research in action: Using positive deviance to improve quality of health care. Implementation Science, 4, 25. doi: 10.1186/1748-5908-4-25.PubMedCrossRefGoogle Scholar
  16. Bray, J., Mills, M., Bray, L., Lennox, R., McRee, B., Goehner, D., et al. (2009). Evaluating web-based training for employee assistance program counselors on the use of screening and brief intervention for at-risk alcohol use. Journal of Workplace Behavioral Health, 24, 307–319. doi: 10.1080/15555240903176146.CrossRefGoogle Scholar
  17. Carroll, K., & Rounsaville, B. (2003). Bridging the gap: A hybrid model to link efficacy and effectiveness research in substance abuse treatment. Psychiatric Services, 54, 333–339. doi: 10.1176/appi.ps.54.3.333.PubMedCrossRefGoogle Scholar
  18. Caspar, E. (2007). The theory of planned behavior applied to continuing education for mental health professionals. Psychiatric Services, 58, 1324–1329. doi: 10.1176/appi.ps.58.10.1324.CrossRefGoogle Scholar
  19. Chambless, D., & Hollon, S. (1998). Defining empirically supported therapies. Journal of Consulting and Clinical Psychology, 66, 7–18. doi: 10.1037//0022-006X.66.1.7.PubMedCrossRefGoogle Scholar
  20. Chorpita, B., Becker, K., & Daleiden, E. (2008). Understanding the common elements of evidence-based practice: Misconceptions and clinical examples. Journal of the American Academy of Child and Adolescent Psychiatry, 46, 647–652. doi: 10.1097/chi.0b013e318033ff71.CrossRefGoogle Scholar
  21. Chorpita, B., & Daleiden, E. (2009). Matching evidence-based treatments for children and adolescents: Application of the distillation and matching model to 615 treatments from 322 randomized trials. Journal of Consulting and Clinical Psychology, 77, 566–579. doi: 10.1037/a0014565.PubMedCrossRefGoogle Scholar
  22. Chorpita, B., & Mueller, C. (2008). Toward new models for research, community, and consumer partnerships: Some guiding principles and an illustration. Clinical Psychology: Science and Practice, 15, 144–148. doi: 10.1111/j.1468-2850.2008.00123.x.CrossRefGoogle Scholar
  23. Cook, D. A., Levinson, A. J., Garside, S., Dupras, D. M., Erwin, P. J., & Montori, V. M. (2008). Internet-based learning in the health professions: A meta-analysis. JAMA, 300, 1181–1196. doi: 10.1001/jama.300.10.1181.PubMedCrossRefGoogle Scholar
  24. Cottam, H & Leadbeater, C. (2004). Health: Co-creating services. London: Design Council. Retrieved from http://www.designcouncil.info/RED/health/REDPaper01.pdf
  25. Crawford, C., & Di Benedetto, A. (2010). New products management (9th ed.). Burr Ridge, IL: Irwin-McGraw Hill.Google Scholar
  26. Cross, W., Matthieu, M., Cerel, J., & Knox, K. (2007). Proximate outcomes of gatekeeper training for suicide prevention in the workplace. Suicide and Life-Threatening Behavior, 37, 659–670. doi: 10.1521/suli.2007.37.6.659.PubMedCrossRefGoogle Scholar
  27. Crossouard, B. (2008). Developing alternative models of doctoral supervision with online formative assessment. Studies in Continuing Education, 30, 51–67. doi: 10.1080/01580370701841549.CrossRefGoogle Scholar
  28. Cucciare, M., Weingardt, K., & Villafranca, S. (2008). Using blended learning to implement evidence-based psychotherapies. Clinical Psychology: Science and Practice, 15, 299–307. doi: 10.1111/j.1468-2850.2008.00141.x.CrossRefGoogle Scholar
  29. Curran, G., Bauer, M., Mittman, B., Stetler, C., Pyne, J., Fortney, J., et al. (2010). A new ‘Hybrid’? Combining elements of clinical effectiveness and implementation research trials. Poster presented at the VA HSR&D field-based meeting on mental health and substance use disorders, Little Rock, AR.Google Scholar
  30. Damschroder, L., Aron, D., Keith, R., Kirsh, S., Alexander, J., & Lowery, J. (2009). Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implementation Science, 4, 50. doi: 10.1186/1748-5908-4-50.PubMedCrossRefGoogle Scholar
  31. Darken, R. (2009). Identifying the limits of training system effectiveness through taxonomies of human performance. Theoretical Issues in Ergonomics Science, 10, 231–243. doi: 10.1080/14639220802151625.CrossRefGoogle Scholar
  32. Davies, P., Walker, A., & Grimshaw, J. (2010). A systemic review of the use of theory in the design of guideline dissemination and implementation strategies and interpretation of the results of rigorous evaluations. Implementation Science, 5. doi: 10.1186/1748-5908-5-14.
  33. DeAngelis, T. (2010, June). Closing the gap between research and practice. Monitor on Psychology, 41(6). Retrieved from http://www.apa.org/monitor
  34. Dimeff, L., Koerner, K., Woodcock, E., Beadnell, B., Brown, M., Skutch, J., et al. (2009). Which training method works best? A randomized controlled trial comparing three methods of training clinicians in dialectical behavior therapy skills. Behavior Research and Therapy, 47, 921–930. doi: 10.1016/j.brat.2009.07.011.CrossRefGoogle Scholar
  35. Donabedian, A. (1981). Criteria, norms, and standard of quality: What do they mean? American Journal of Public Health, 71, 409–412. Retrieved from ajph.aphapublications.org/cgi/reprint/71/4/409.pdf.
  36. Donovant, B. (2009). To Internet or Not? Assessing the efficacy or online police training. American Journal for Criminal Justice, 34, 224–237. doi: 10.1007/s12103-009-9061-7.CrossRefGoogle Scholar
  37. Doumit, G., Gattellari, M., Grimshaw, J., & O’Brien, M. (2007). Local opinion leaders: Effects on professional practice and health care outcomes. Cochrane Database of Systematic Reviews, 1. Retrieved from www.cochrane.org/reviews/en/ab000125.html, doi: 10.1007/s12103-009-9061-7.
  38. Eccles, R., & Graham, I. (Eds.). (2009). Special issue on United States Department of Veteran Affairs Quality Enhancement Research Initiative (QUERI). Implementation Science, 4, entire issue. Retrieved from http://www.implementationscience.com/
  39. Ericsson, K., & Charness, N. (1994). Expert performance: Its structure and acquisition. The American Psychologist, 49, 725–747. doi: 10.1037/0003-066X.49.8.725.CrossRefGoogle Scholar
  40. Farmer, A., Legare, F., Turcot, L., Grimshaw, J., Harvey, E., McGowan, J. et al. (2008). Printed educational materials: Effects on professional practice and health care outcomes. Cochrane Database of Systematic Reviews, 3. Retrieved from http://www2.cochrane.org/reviews/en/ab004398.html
  41. Fixsen, D. L., Naoom, S. F., Blasé, K. A., Friedman, R. M., &Wallace, F. (2005). Implementation research: A synthesis of the literature. Tampa, FL: University of South Florida, The Louis de la Parte Florida Mental Health Institute. Department of Child & Family Studies. Retrieved from http://nirn.fmhi.usf.edu
  42. Follette, W., & Callaghan, G. (1995). Do as I do, not as I say: A behavior-analytic approach to supervision. Professional Psychology: Research and Practice, 26, 413–421. doi: 10.1037/0735-7028.26.4.413.CrossRefGoogle Scholar
  43. Forman, S., Olin, S., Hoagwood, K., Crowe, M., & Saka, N. (2009). Evidence-based interventions in schools: Developers’ views of implementation barriers and facilitators. School Mental Health, 1, 26–36. doi: 10.1007/s12310-008-9002-5.CrossRefGoogle Scholar
  44. Fouad, N., Grus, C., Hatcher, R., Kaslow, N., Hutchings, P., Madson, M., et al. (2009). Competency benchmarks: A model for understanding and measuring competence in professional psychology across training levels. Training and Education in Professional Psychology, 3, S5–S26. doi: 10.1037/a0015832.CrossRefGoogle Scholar
  45. Francis, J., Eccles, M., Johnston, M., Walker, A., Grimshaw, J., Foy, R. et al. (2004). Constructing questionnaires based on the theory of planned behavior: A manual for health services researchers. United Kingdom: Center for Health Services Research. Retrieved from www.people.umass.edu/…/Francis%20etal.TPB%20research%20manual.pdf
  46. Garland, A., Brookman-Frazee, L., Hurlburt, M., Accurso, A., Zoffness, R., Haine-Schlagel, R., et al. (2010). Mental health care for children with disruptive behavior problems: A view inside therapists’ offices. Psychiatric Services, 61, 788–795. doi: 10.1176/appi.ps.61.8.788.PubMedCrossRefGoogle Scholar
  47. Glasgow, R., Vogt, T., & Boles, S. (1999). Evaluating the public health impact of health promotion interventions: The RE-AIM framework. American Journal of Public Health, 89, 1322–1327. doi: 10.2105/AJPH.89.9.1322.PubMedCrossRefGoogle Scholar
  48. Graham, I., Logan, J., Harrison, M., Straus, S., Tetroe, J., Caswell, W., et al. (2006). Lost in knowledge translation: Time for a map? The Journal of Continuing Education in the Health Professions, 26, 13–24. doi: 10.1002/chp.47.PubMedCrossRefGoogle Scholar
  49. Greenberg, L., & Pinsoff, W. (Eds.). (1986). The psychotherapeutic process: A research handbook. New York: Guilford Press.Google Scholar
  50. Greenhalgh, T., Robert, G., Macfarlane, F., Bate, P., & Kyriakidou, O. (2004). Diffusion of innovations in service organizations: Systemic review and recommendations. Milbank Quarterly, 82, 581–629. doi: 10.1111/j.0887-378X.2004.00325.x.PubMedCrossRefGoogle Scholar
  51. Grol, R., Bosch, M., Hulscher, M., Eccles, M., & Wensing, M. (2007). Planning and studying improvement in patient care: The use of theoretical perspectives. The Milbank Quarterly, 85, 93–138. doi: 10.1111/j.1468-0009.2007.00478.x.PubMedCrossRefGoogle Scholar
  52. Hansen, S., & Avital, M. (2005). Share and share alike: The social and technological influences on knowledge sharing behavior. Sprouts: Working Papers on Information Systems, 5, 5–13. Retrieved from http://sprouts.aisnet.org/5-13/
  53. Hopko, D. R., Lejuez, C. W., Ruggiero, K. J., & Eifert, G. H. (2003). Contemporary behavioral activation treatments for depression: Procedures, principles, and progress. Clinical Psychology Review, 23, 699–717. doi: 10.1016/S0272-7358(03)00070-9.PubMedCrossRefGoogle Scholar
  54. Improving Access to Psychological Therapies. (2008). Improving access to psychological therapies implementation plan: Curriculum for high-intensity therapies workers. Retrieved from http://www.dh.gov.uk/en/Publicationsandstatistics/Publications/PublicationsPolicyandGuidance/DH_083150
  55. Institute of Health Economics. (2008). Effective dissemination of findings from research. Retrieved from http://www.ihe.ca/publications/library/2008/effective-dissemination-of-findings-from-research
  56. Jacobson, N. S., Dobson, K. S., Truax, P. A., Addis, M. E., Koerner, K., Gollan, J., et al. (1996). A component analysis of cognitive-behavioral treatment for depression. Journal of Consulting and Clinical Psychology, 64, 295–304. doi: 10.1037/0022-006X.64.2.295.PubMedCrossRefGoogle Scholar
  57. Kahn, K. (2004). The PDMA handbook of new product development. Hoboken, NJ: Wiley.CrossRefGoogle Scholar
  58. Kanter, J. W., Manos, R. C., Bowe, W. M., Baruch, D. E., Busch, A. M., & Rusch, L. R. (2010). What is behavioral activation: A review of the empirical literature. Clinical Psychology Review, 30, 608–620. doi: 10.1016/j.cpr.2010.04.001.PubMedCrossRefGoogle Scholar
  59. Kaslow, N., Grus, C., Campbell, L., Fouad, N., Hatcher, N., & Rodolfo, E. (2009). Competency assessment toolkit for professional psychology. Training and Education in Professional Psychology, 3, S27–S45.CrossRefGoogle Scholar
  60. Kendall, P. C., & Beidas, R. S. (2007). Smoothing the trail for dissemination of evidence-based practices for youth: Flexibility within fidelity. Professional Psychology: Research and Practice, 38, 13–19. doi: 10.1037/0735-7028.38.1.13.CrossRefGoogle Scholar
  61. Kendall, P. C., & Comer, J. S. (2011). Research methods in clinical psychology. In D. Barlow (Ed.), Oxford handbook of clinical psychology. New York: Oxford University Press.Google Scholar
  62. Kendall, P. C., Gosch, E., Furr, J., & Sood, E. (2008). Flexibility within fidelity. Journal of the American Academy of Child and Adolescent Psychiatry, 47, 987–993. doi: 10.1097/CHI.0b013e31817eed2f.PubMedCrossRefGoogle Scholar
  63. Kendall, P. C., & Hedtke, K. A. (2006). Cognitive-behavioral therapy for anxious children: Clinician manual (3rd ed.). Ardmore, PA: Workbook Publishing.Google Scholar
  64. Kendall, P. C., & Khanna, M. S. (2008). CBT4CBT: Computer-based training to become a cognitive-behavioral therapist…for anxious youth. Ardmore, PA: Workbook Publishing Inc.Google Scholar
  65. Kitson, A., Rycroft-Malone, J., Harvey, G., McCormack, B., Seers, K., & Titchen, A. (2008). Evaluating the successful implementation of evidence into practice using the PARiHS framework: Theoretical and practical challenges. Implementation Science, 3. doi: 10.1186/1748-5908-3-1.
  66. Koerner, K., Dimeff, L., & Swenson, C. (2007). Adopt or adapt? Fidelity matters. In L. Dimeff & K. Koerner (Eds.), Dialectical behavioral therapy in clinical practice. New York: Guildford Press.Google Scholar
  67. Kroll, P., & Kruchten, P. (2003). The rational unified process made easy: A clinician’s guide to the RUP. Addison-Wesley Professional. Google Scholar
  68. Kulier, R., Hadley, J., Weinbrenner, S., Meyerrose, B., Decsi, T., Horvath, A., et al. (2008). Harmonizing evidence-based medicine teaching: a study of the outcomes of e-learning in five European Countries. BMC Medical Education, 8, 27–37. doi: 10.1186/1472-6920-8-27.PubMedCrossRefGoogle Scholar
  69. Linehan, M. (1993a). Skills training manual for treating borderline personality disorder. New York: Guilford Press.Google Scholar
  70. Linehan, M. (1993b). Cognitive-behavioral treatment of borderline personality disorder. New York: Guilford Press.Google Scholar
  71. Luoma, J., Hayes, S., & Walser, R. (2007). Learning ACT: An acceptance and commitment therapy skills training manual for therapists. California: New Harbinger Press.Google Scholar
  72. March, J., Silva, S., Compton, S., Shapiro, M., Califf, R., & Krishnan, R. (2005). The case for practical clinical trials in psychiatry. American Journal of Psychiatry, 162, 836–846. doi: 10.1176/appi.ajp.162.5.836.PubMedCrossRefGoogle Scholar
  73. Markiewicz, J., Ebert, L., Ling., D., Amaya-Jackson, L., & Kisiel, C. (2006). Learning collaborative toolkit. Los Angeles, CA and Durham, NC: National Center for Child Traumatic Stress.Google Scholar
  74. McGaghie, W., Siddal, V., Masmanian, P., & Myers, J. (2009). Lessons for continuing medical education from simulation research in undergraduate and graduate medical education. Chest, 135S, 62–68. doi: 10.1378/chest.08-2521.CrossRefGoogle Scholar
  75. McHugh, R. K., & Barlow, D. (2010). The dissemination and implementation of evidence-based psychological treatments: A review of current efforts. The American Psychologist, 65, 73–84. doi: 10.1037/a0018121.PubMedCrossRefGoogle Scholar
  76. Miller, W., Sorensen, J., Selzer, J., & Brigham, G. (2006). Disseminating evidence- based practices in substance abuse treatment: A review with suggestions. Journal of Substance Abuse Treatment, 31, 25–39. doi: 10.1016/j.jsat.2006.03.005.PubMedCrossRefGoogle Scholar
  77. Moore, J. L., & Marra, R. M. (2005). A comparative analysis of online discussion participation protocols. Journal of Research on Technology in Education, 38, 191–212. Retrieved from http://www.iste.org/
  78. Morgenstern, J., & McKay, J. R. (2007). Rethinking the paradigms that inform behavioral treatment research for substance use disorders. Addiction, 102, 1377–1389. doi: 10.1111/j.1360-0443.2007.01882.x.PubMedCrossRefGoogle Scholar
  79. Moyers, T., Martin, T., Catley, D., Harris, K., & Ahluwalia, J. (2003). Assessing the integrity of motivational interviewing interventions: Reliability of the motivational interviewing skills code. Behavioral and Cognitive Psychotherapy, 31, 177–184. doi: 10.1017/S1352465803002054.CrossRefGoogle Scholar
  80. National Crime Victims Research & Treatment Center. (2007). TF-CBT Web: First Year Report. Charleston, SC: Medical University of South Carolina. Retrieved from http://tfcbt.musc.edu/
  81. Onken, L. S., Blaine, J. D., & Battjes, R. (1996). Behavioral therapy research: A conceptualization of a process. In S. W. Henggeler & A. B. Santos (Eds.), Innovative approaches for difficult-to-treat populations. Washington, DC: American Psychiatric Press.Google Scholar
  82. Orvis, K., Fisher, S., & Wasserman, M. (2009). Power to the people: Using learner control to improve trainee reactions and learning in web-based instructional environments. Journal of Applied Psychology, 94, 960–971. doi: 10.1037/a0014977.PubMedCrossRefGoogle Scholar
  83. Ottoson, J. (1997). Beyond transfer of training: Using multiple lenses to assess community education programs. New Directions for Adult and Continuing Education, 75, 87–96. doi: 10.1002/ace.7508.CrossRefGoogle Scholar
  84. Perpepletchikova, F., & Kazdin, A. (2005). Treatment integrity and therapeutic change: Issues and research recommendations. Clinical Psychology: Science and Practice, 12, 365–383. doi: 10.1093/clipsy/bpi045.CrossRefGoogle Scholar
  85. President’s New Freedom Commission on Mental Health. (2004). Report of the President’s New Freedom Commission on Mental Health. Retrieved from http://www.mentalhealthcommission.gov/reports/FinalReport/toc.html
  86. Rakovshik, S., & McManus, F. (2010). Establishing evidence-based in training in cognitive behavioral therapy: A review of current empirical findings and theoretical guidance. Clinical Psychology Review, 30, 496–516. doi: 10.1016/j.cpr.2010.03.004.PubMedCrossRefGoogle Scholar
  87. Rashiq, S., Barton, P., Harstall, C., Schopflocher, D., Taenzer, P., & Alberta Ambassador Program Team. (2006). The Alberta ambassador program: Delivering health technology assessment results to rural clinicians. BMC Medical Education, 31, 6–21. doi: 10.1186/1472-6920-6-21.Google Scholar
  88. Ricciardi, J. (2005). Achieving human service outcomes through competency-based training: A guide for managers. Behavior Modification, 29, 488–507. doi: 10.1177/0145445504273281.PubMedCrossRefGoogle Scholar
  89. Roth, A., & Pilling, S. (2008). Using an evidence-based methodology to identify the ompetences required to deliver effective cognitive and behavioral therapy for depression and anxiety disorders. Behavioral and Cognitive Psychotherapy, 36, 129–147. doi: 10.1017/S1352465808004141.CrossRefGoogle Scholar
  90. Rounsaville, B. J., Carroll, K. M., & Onken, L. S. (2001). A stage model of behavioral therapies research: Getting started and moving on from Stage I. Clinical Psychology: Science and Practice, 8, 133–142. doi: 10.1093/clipsy/8.2.133.CrossRefGoogle Scholar
  91. Rourke, L., & Anderson, T. (2002). Using peer teams to lead online discussions. Journal of Interactive Media in Education, 1, 1–21. Retrieved from http://www-jime.open.ac.uk/
  92. Scherl, C., & Haley, J. (2000). Computer monitor supervision: A clinical note. The American Journal of family Therapy, 28, 275–282. doi: 10.1080/01926180050081702.CrossRefGoogle Scholar
  93. Schoenwald, S., Sheidow, A., & Letourneau, E. (2004). Toward effective quality assurance in evidence-based practice: Links between expert consultation, clinician fidelity, and child outcomes. Journal of Clinical Child and Adolescent Psychology, 33, 94–104. doi: 10.1207/S15374424JCCP3301_10.PubMedCrossRefGoogle Scholar
  94. Shostack, L. G. (1982). How to design a service. European Journal of Marketing, 16, 49–63. doi: 10.1108/EUM0000000004799.CrossRefGoogle Scholar
  95. Shostack, L. G. (1984). Design services that deliver. Harvard Business Review, 84115, 133–139. Retrieved from http://hbr.org/1984/01/designing-services-that-deliver/ar/1
  96. Sitzmann, T., Bell, B., Kraiger, K., & Kanar, A. (2009). A multilevel analysis of the effect of prompting self-regulation in technology-delivered instruction. Personnel Psychology, 62, 697–734. doi: 10.1111/j.1744-6570.2009.01155.x.CrossRefGoogle Scholar
  97. Stetler, C., Legro, M., Wallace, C., Bowman, C., Guihan, M., Hagedorn, H., et al. (2006). The role of formative evaluation in implementation research and the QUERI experience. Journal of General Internal Medicine, 21, S1–S8. doi: 10.1007/s11606-006-0267-9.PubMedCrossRefGoogle Scholar
  98. Tunis, S., Stryer, D., & Clancy, C. (2003). Practical clinical trials: Increasing the value of clinical research for decision making in clinical and health policy. JAMA, 290, 1624–1632. doi: 10.1001/jama.290.12.1624.PubMedCrossRefGoogle Scholar
  99. Turner, K., & Sanders, M. (2005). Dissemination of evidence-based parenting and family support strategies: Learning from the Triple P—Positive parenting program system approach. Aggression and Violent Behavior, 11, 176–193. doi: 10.1016/j.avb.2005.07.005.CrossRefGoogle Scholar
  100. Twigg, C. (2001). Innovations in online learning: Moving beyond no significant difference. The Pew Learning and Technology Program. Retrieved from http://www.thencat.org/Monographs/Innovations.html
  101. von Hippel, E. (2005). Democritizing innovation. Cambridge, MA: The MIT Press.Google Scholar
  102. Webb, C., DeRubeis, R., & Barber, J. (2010). Clinician adherence/competence and treatment outcome: A meta-analytic review. Journal of Consulting and Clinical Psychology, 78, 200–211. doi: 10.1037/a0018912.PubMedCrossRefGoogle Scholar
  103. Weingardt, K. (2004). The role of instructional design and technology in the dissemination of empirically supported, manual based therapies. Clinical Psychology: Science & Practice, 11, 313–331. doi: 10.1093/clipsy/bph087.CrossRefGoogle Scholar
  104. Weingardt, K., Cucciare, M., Bellotti, C., & Lai, W. (2009). A randomized trial comparing two models of web based training in cognitive-behavioral therapy for substance abuse counselors. Journal of Substance Abuse Treatment, 37, 219–227. doi: 10.1016/j.jsat.2009.01.002.PubMedCrossRefGoogle Scholar
  105. Weingardt, K., Villafranca, S., & Levin, C. (2006). Technology-based training in cognitive behavioral therapy for substance abuse counselors. Substance Abuse, 27, 19–25. doi: 10.1300/J465v27n03_04.PubMedCrossRefGoogle Scholar
  106. Weisz, J., & Chorpita, B. (in press). Mod squad for youth psychotherapy: Restructuring evidence-based treatment for clinical practice. In P. C. Kendall (Ed.), Child and adolescent therapy: Cognitive-behavioral procedures (4th ed.). New York: Guilford Press.Google Scholar
  107. Williams, C., & Martinez, R. (2008). Increasing access to CBT: Stepped care and CBT self-help models in practice. Behavioral and Cognitive Psychotherapy, 36, 675–683. doi: 10.1017/S1352465808004864.CrossRefGoogle Scholar
  108. Young, J., & Beck, A. (1980). The development of the Cognitive Therapy Scale. Unpublished manuscript, University of Pennsylvania, Philadelphia, PA.Google Scholar

Copyright information

© Springer Science+Business Media, LLC 2011

Authors and Affiliations

  • Rinad S. Beidas
    • 1
    • 2
  • Kelly Koerner
    • 3
  • Kenneth R. Weingardt
    • 4
  • Philip C. Kendall
    • 5
  1. 1.Department of PsychologyTemple UniversityPhiladelphiaUSA
  2. 2.Department of PsychiatryUniversity of Illinois at ChicagoChicagoUSA
  3. 3.Evidence-Based Practice InstituteSeattleUSA
  4. 4.Center for Health Care EvaluationVA Palo Alto Health Care System and Stanford University School of MedicinePalo AltoUSA
  5. 5.Division of PsychologyTemple UniversityPhiladelphiaUSA

Personalised recommendations