We’re sorry, something doesn't seem to be working properly.

Please try refreshing the page. If that doesn't work, please contact support so we can address the problem.

Training Research: Practical Recommendations for Maximum Impact | SpringerLink

Training Research: Practical Recommendations for Maximum Impact

Abstract

This review offers practical recommendations regarding research on training in evidence-based practices for mental health and substance abuse treatment. When designing training research, we recommend: (a) aligning with the larger dissemination and implementation literature to consider contextual variables and clearly defining terminology, (b) critically examining the implicit assumptions underlying the stage model of psychotherapy development, (c) incorporating research methods from other disciplines that embrace the principles of formative evaluation and iterative review, and (d) thinking about how technology can be used to take training to scale throughout all stages of a training research project. An example demonstrates the implementation of these recommendations.

This is a preview of subscription content, access via your institution.

Notes

  1. 1.

    We will use competence going forward as this is the more widely used term.

References

  1. Ajzen, I. (1988). Attitudes, personality and behavior. Milton Keynes, England: Open University Press

  2. Ajzen, I. (1991). The theory of planned behavior. Organizational Behavior and Human Decision Processes, 50, 179–211. doi:10.1016/0749-5978(91)90020-T.

    Article  Google Scholar 

  3. American Academy of Child and Adolescent Psychiatry. (2006). American academy of child and adolescent psychiatry policy statement on evidence-based practice in psychiatry. Retrieved from http://www.aacap.org/cs/root/policy_statements/evidence_based_practice

  4. American Psychological Association. (2005). American psychological association policy statement on evidence-based practice in psychology. Retrieved from http://www.apa.org/practice/ebpreport.pdf

  5. Atkins, M., Frazier, S., & Cappella, E. (2006). Hybrid research models. Natural opportunities for examining mental health in context. Clinical Psychology: Science and Practice, 13, 105–107. doi:10.1111/j.1468-2850.2006.00012.x.

    Article  Google Scholar 

  6. Atkins, M., Frazier, S., Leathers, S., Graczyk, P., Talbott, E., Jakobsons, L., et al. (2008). Teacher key opinion leaders and mental health consultation in low-income urban schools. Journal of Consulting and Clinical Psychology, 76, 905–908. doi:10.1037/a0013036.

    PubMed  Article  Google Scholar 

  7. Beck, A., Rush, A., Shaw, B., & Emory, G. (1987). Cognitive therapy of depression. New York: Guilford Press.

    Google Scholar 

  8. Beidas, R., Barmish, A., & Kendall, P. (2009). Training as usual: Can clinician behavior change following reading a manual and attending a brief workshop on cognitive behavioral therapy for youth anxiety? The Behavior Clinician, 32(5), 97–101.

    Google Scholar 

  9. Beidas, R. S., Edmunds, J., & Kendall, P. (2010, June). A comparison of training methods for dissemination. In S. Stirman (Chair), Therapist and client outcomes of community-based training programs in evidence-based treatments. Symposium conducted at the meeting of the World Congress of Behavioral and Cognitive Therapies, Boston, Massachusetts.

  10. Beidas, R. S., & Kendall, P. C. (2010). Training clinicians in evidence-based practice: A critical review of studies from a systems-contextual perspective. Clinical Psychology: Science & Practice, 17, 1–30. doi:10.1111/j.1468-2850.2009.01187.x.

    Article  Google Scholar 

  11. Bennett-Levy, J., Richards, D., Farrand, P., Christensen, H., Griffiths, K., Kavanagh, D., et al. (Eds.). (2010). Oxford guide to low intensity CBT interventions. London, England: Oxford University Press.

    Google Scholar 

  12. Bondi, A. (2000). Characteristics of scalability and their impact on performance. Proceedings of the 2nd international workshop on Software and performance, Ottawa, Ontario, Canada.

  13. Borntrager, C., Chorpita, B., Higa-McMillan, C., & Weisz, J. (2009). Provider attitudes toward evidence-based practices: Are the concerns with the evidence or with the manuals? Psychiatric Services, 60, 677–681. doi:10.1176/appi.ps.60.5.677.

    PubMed  Article  Google Scholar 

  14. Bradach, J. (2010). Scaling impact: How to get100X the results with 2X the organization. Stanford Social Innovation Review, Summer, 27–28. Retrieved from http://www.ssireview.org/articles/entry/scaling_impact/

  15. Bradley, E., Curry, L., Ramandhan, S., Rowe, L., Nembhard, I., & Krumholz, H. (2009). Research in action: Using positive deviance to improve quality of health care. Implementation Science, 4, 25. doi:10.1186/1748-5908-4-25.

    PubMed  Article  Google Scholar 

  16. Bray, J., Mills, M., Bray, L., Lennox, R., McRee, B., Goehner, D., et al. (2009). Evaluating web-based training for employee assistance program counselors on the use of screening and brief intervention for at-risk alcohol use. Journal of Workplace Behavioral Health, 24, 307–319. doi:10.1080/15555240903176146.

    Article  Google Scholar 

  17. Carroll, K., & Rounsaville, B. (2003). Bridging the gap: A hybrid model to link efficacy and effectiveness research in substance abuse treatment. Psychiatric Services, 54, 333–339. doi:10.1176/appi.ps.54.3.333.

    PubMed  Article  Google Scholar 

  18. Caspar, E. (2007). The theory of planned behavior applied to continuing education for mental health professionals. Psychiatric Services, 58, 1324–1329. doi:10.1176/appi.ps.58.10.1324.

    Article  Google Scholar 

  19. Chambless, D., & Hollon, S. (1998). Defining empirically supported therapies. Journal of Consulting and Clinical Psychology, 66, 7–18. doi:10.1037//0022-006X.66.1.7.

    PubMed  Article  CAS  Google Scholar 

  20. Chorpita, B., Becker, K., & Daleiden, E. (2008). Understanding the common elements of evidence-based practice: Misconceptions and clinical examples. Journal of the American Academy of Child and Adolescent Psychiatry, 46, 647–652. doi:10.1097/chi.0b013e318033ff71.

    Article  Google Scholar 

  21. Chorpita, B., & Daleiden, E. (2009). Matching evidence-based treatments for children and adolescents: Application of the distillation and matching model to 615 treatments from 322 randomized trials. Journal of Consulting and Clinical Psychology, 77, 566–579. doi:10.1037/a0014565.

    PubMed  Article  Google Scholar 

  22. Chorpita, B., & Mueller, C. (2008). Toward new models for research, community, and consumer partnerships: Some guiding principles and an illustration. Clinical Psychology: Science and Practice, 15, 144–148. doi:10.1111/j.1468-2850.2008.00123.x.

    Article  Google Scholar 

  23. Cook, D. A., Levinson, A. J., Garside, S., Dupras, D. M., Erwin, P. J., & Montori, V. M. (2008). Internet-based learning in the health professions: A meta-analysis. JAMA, 300, 1181–1196. doi:10.1001/jama.300.10.1181.

    PubMed  Article  CAS  Google Scholar 

  24. Cottam, H & Leadbeater, C. (2004). Health: Co-creating services. London: Design Council. Retrieved from http://www.designcouncil.info/RED/health/REDPaper01.pdf

  25. Crawford, C., & Di Benedetto, A. (2010). New products management (9th ed.). Burr Ridge, IL: Irwin-McGraw Hill.

    Google Scholar 

  26. Cross, W., Matthieu, M., Cerel, J., & Knox, K. (2007). Proximate outcomes of gatekeeper training for suicide prevention in the workplace. Suicide and Life-Threatening Behavior, 37, 659–670. doi:10.1521/suli.2007.37.6.659.

    PubMed  Article  Google Scholar 

  27. Crossouard, B. (2008). Developing alternative models of doctoral supervision with online formative assessment. Studies in Continuing Education, 30, 51–67. doi:10.1080/01580370701841549.

    Article  Google Scholar 

  28. Cucciare, M., Weingardt, K., & Villafranca, S. (2008). Using blended learning to implement evidence-based psychotherapies. Clinical Psychology: Science and Practice, 15, 299–307. doi:10.1111/j.1468-2850.2008.00141.x.

    Article  Google Scholar 

  29. Curran, G., Bauer, M., Mittman, B., Stetler, C., Pyne, J., Fortney, J., et al. (2010). A new ‘Hybrid’? Combining elements of clinical effectiveness and implementation research trials. Poster presented at the VA HSR&D field-based meeting on mental health and substance use disorders, Little Rock, AR.

  30. Damschroder, L., Aron, D., Keith, R., Kirsh, S., Alexander, J., & Lowery, J. (2009). Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implementation Science, 4, 50. doi:10.1186/1748-5908-4-50.

    PubMed  Article  Google Scholar 

  31. Darken, R. (2009). Identifying the limits of training system effectiveness through taxonomies of human performance. Theoretical Issues in Ergonomics Science, 10, 231–243. doi:10.1080/14639220802151625.

    Article  Google Scholar 

  32. Davies, P., Walker, A., & Grimshaw, J. (2010). A systemic review of the use of theory in the design of guideline dissemination and implementation strategies and interpretation of the results of rigorous evaluations. Implementation Science, 5. doi:10.1186/1748-5908-5-14.

  33. DeAngelis, T. (2010, June). Closing the gap between research and practice. Monitor on Psychology, 41(6). Retrieved from http://www.apa.org/monitor

  34. Dimeff, L., Koerner, K., Woodcock, E., Beadnell, B., Brown, M., Skutch, J., et al. (2009). Which training method works best? A randomized controlled trial comparing three methods of training clinicians in dialectical behavior therapy skills. Behavior Research and Therapy, 47, 921–930. doi:10.1016/j.brat.2009.07.011.

    Article  Google Scholar 

  35. Donabedian, A. (1981). Criteria, norms, and standard of quality: What do they mean? American Journal of Public Health, 71, 409–412. Retrieved from ajph.aphapublications.org/cgi/reprint/71/4/409.pdf.

  36. Donovant, B. (2009). To Internet or Not? Assessing the efficacy or online police training. American Journal for Criminal Justice, 34, 224–237. doi:10.1007/s12103-009-9061-7.

    Article  Google Scholar 

  37. Doumit, G., Gattellari, M., Grimshaw, J., & O’Brien, M. (2007). Local opinion leaders: Effects on professional practice and health care outcomes. Cochrane Database of Systematic Reviews, 1. Retrieved from www.cochrane.org/reviews/en/ab000125.html, doi:10.1007/s12103-009-9061-7.

  38. Eccles, R., & Graham, I. (Eds.). (2009). Special issue on United States Department of Veteran Affairs Quality Enhancement Research Initiative (QUERI). Implementation Science, 4, entire issue. Retrieved from http://www.implementationscience.com/

  39. Ericsson, K., & Charness, N. (1994). Expert performance: Its structure and acquisition. The American Psychologist, 49, 725–747. doi:10.1037/0003-066X.49.8.725.

    Article  Google Scholar 

  40. Farmer, A., Legare, F., Turcot, L., Grimshaw, J., Harvey, E., McGowan, J. et al. (2008). Printed educational materials: Effects on professional practice and health care outcomes. Cochrane Database of Systematic Reviews, 3. Retrieved from http://www2.cochrane.org/reviews/en/ab004398.html

  41. Fixsen, D. L., Naoom, S. F., Blasé, K. A., Friedman, R. M., &Wallace, F. (2005). Implementation research: A synthesis of the literature. Tampa, FL: University of South Florida, The Louis de la Parte Florida Mental Health Institute. Department of Child & Family Studies. Retrieved from http://nirn.fmhi.usf.edu

  42. Follette, W., & Callaghan, G. (1995). Do as I do, not as I say: A behavior-analytic approach to supervision. Professional Psychology: Research and Practice, 26, 413–421. doi:10.1037/0735-7028.26.4.413.

    Article  Google Scholar 

  43. Forman, S., Olin, S., Hoagwood, K., Crowe, M., & Saka, N. (2009). Evidence-based interventions in schools: Developers’ views of implementation barriers and facilitators. School Mental Health, 1, 26–36. doi:10.1007/s12310-008-9002-5.

    Article  Google Scholar 

  44. Fouad, N., Grus, C., Hatcher, R., Kaslow, N., Hutchings, P., Madson, M., et al. (2009). Competency benchmarks: A model for understanding and measuring competence in professional psychology across training levels. Training and Education in Professional Psychology, 3, S5–S26. doi:10.1037/a0015832.

    Article  Google Scholar 

  45. Francis, J., Eccles, M., Johnston, M., Walker, A., Grimshaw, J., Foy, R. et al. (2004). Constructing questionnaires based on the theory of planned behavior: A manual for health services researchers. United Kingdom: Center for Health Services Research. Retrieved from www.people.umass.edu/…/Francis%20etal.TPB%20research%20manual.pdf

  46. Garland, A., Brookman-Frazee, L., Hurlburt, M., Accurso, A., Zoffness, R., Haine-Schlagel, R., et al. (2010). Mental health care for children with disruptive behavior problems: A view inside therapists’ offices. Psychiatric Services, 61, 788–795. doi:10.1176/appi.ps.61.8.788.

    PubMed  Article  Google Scholar 

  47. Glasgow, R., Vogt, T., & Boles, S. (1999). Evaluating the public health impact of health promotion interventions: The RE-AIM framework. American Journal of Public Health, 89, 1322–1327. doi:10.2105/AJPH.89.9.1322.

    PubMed  Article  CAS  Google Scholar 

  48. Graham, I., Logan, J., Harrison, M., Straus, S., Tetroe, J., Caswell, W., et al. (2006). Lost in knowledge translation: Time for a map? The Journal of Continuing Education in the Health Professions, 26, 13–24. doi:10.1002/chp.47.

    PubMed  Article  Google Scholar 

  49. Greenberg, L., & Pinsoff, W. (Eds.). (1986). The psychotherapeutic process: A research handbook. New York: Guilford Press.

    Google Scholar 

  50. Greenhalgh, T., Robert, G., Macfarlane, F., Bate, P., & Kyriakidou, O. (2004). Diffusion of innovations in service organizations: Systemic review and recommendations. Milbank Quarterly, 82, 581–629. doi:10.1111/j.0887-378X.2004.00325.x.

    PubMed  Article  Google Scholar 

  51. Grol, R., Bosch, M., Hulscher, M., Eccles, M., & Wensing, M. (2007). Planning and studying improvement in patient care: The use of theoretical perspectives. The Milbank Quarterly, 85, 93–138. doi:10.1111/j.1468-0009.2007.00478.x.

    PubMed  Article  Google Scholar 

  52. Hansen, S., & Avital, M. (2005). Share and share alike: The social and technological influences on knowledge sharing behavior. Sprouts: Working Papers on Information Systems, 5, 5–13. Retrieved from http://sprouts.aisnet.org/5-13/

  53. Hopko, D. R., Lejuez, C. W., Ruggiero, K. J., & Eifert, G. H. (2003). Contemporary behavioral activation treatments for depression: Procedures, principles, and progress. Clinical Psychology Review, 23, 699–717. doi:10.1016/S0272-7358(03)00070-9.

    PubMed  Article  Google Scholar 

  54. Improving Access to Psychological Therapies. (2008). Improving access to psychological therapies implementation plan: Curriculum for high-intensity therapies workers. Retrieved from http://www.dh.gov.uk/en/Publicationsandstatistics/Publications/PublicationsPolicyandGuidance/DH_083150

  55. Institute of Health Economics. (2008). Effective dissemination of findings from research. Retrieved from http://www.ihe.ca/publications/library/2008/effective-dissemination-of-findings-from-research

  56. Jacobson, N. S., Dobson, K. S., Truax, P. A., Addis, M. E., Koerner, K., Gollan, J., et al. (1996). A component analysis of cognitive-behavioral treatment for depression. Journal of Consulting and Clinical Psychology, 64, 295–304. doi:10.1037/0022-006X.64.2.295.

    PubMed  Article  CAS  Google Scholar 

  57. Kahn, K. (2004). The PDMA handbook of new product development. Hoboken, NJ: Wiley.

    Book  Google Scholar 

  58. Kanter, J. W., Manos, R. C., Bowe, W. M., Baruch, D. E., Busch, A. M., & Rusch, L. R. (2010). What is behavioral activation: A review of the empirical literature. Clinical Psychology Review, 30, 608–620. doi:10.1016/j.cpr.2010.04.001.

    PubMed  Article  Google Scholar 

  59. Kaslow, N., Grus, C., Campbell, L., Fouad, N., Hatcher, N., & Rodolfo, E. (2009). Competency assessment toolkit for professional psychology. Training and Education in Professional Psychology, 3, S27–S45.

    Article  Google Scholar 

  60. Kendall, P. C., & Beidas, R. S. (2007). Smoothing the trail for dissemination of evidence-based practices for youth: Flexibility within fidelity. Professional Psychology: Research and Practice, 38, 13–19. doi:10.1037/0735-7028.38.1.13.

    Article  Google Scholar 

  61. Kendall, P. C., & Comer, J. S. (2011). Research methods in clinical psychology. In D. Barlow (Ed.), Oxford handbook of clinical psychology. New York: Oxford University Press.

    Google Scholar 

  62. Kendall, P. C., Gosch, E., Furr, J., & Sood, E. (2008). Flexibility within fidelity. Journal of the American Academy of Child and Adolescent Psychiatry, 47, 987–993. doi:10.1097/CHI.0b013e31817eed2f.

    PubMed  Article  Google Scholar 

  63. Kendall, P. C., & Hedtke, K. A. (2006). Cognitive-behavioral therapy for anxious children: Clinician manual (3rd ed.). Ardmore, PA: Workbook Publishing.

    Google Scholar 

  64. Kendall, P. C., & Khanna, M. S. (2008). CBT4CBT: Computer-based training to become a cognitive-behavioral therapist…for anxious youth. Ardmore, PA: Workbook Publishing Inc.

    Google Scholar 

  65. Kitson, A., Rycroft-Malone, J., Harvey, G., McCormack, B., Seers, K., & Titchen, A. (2008). Evaluating the successful implementation of evidence into practice using the PARiHS framework: Theoretical and practical challenges. Implementation Science, 3. doi:10.1186/1748-5908-3-1.

  66. Koerner, K., Dimeff, L., & Swenson, C. (2007). Adopt or adapt? Fidelity matters. In L. Dimeff & K. Koerner (Eds.), Dialectical behavioral therapy in clinical practice. New York: Guildford Press.

    Google Scholar 

  67. Kroll, P., & Kruchten, P. (2003). The rational unified process made easy: A clinician’s guide to the RUP. Addison-Wesley Professional.

  68. Kulier, R., Hadley, J., Weinbrenner, S., Meyerrose, B., Decsi, T., Horvath, A., et al. (2008). Harmonizing evidence-based medicine teaching: a study of the outcomes of e-learning in five European Countries. BMC Medical Education, 8, 27–37. doi:10.1186/1472-6920-8-27.

    PubMed  Article  Google Scholar 

  69. Linehan, M. (1993a). Skills training manual for treating borderline personality disorder. New York: Guilford Press.

    Google Scholar 

  70. Linehan, M. (1993b). Cognitive-behavioral treatment of borderline personality disorder. New York: Guilford Press.

    Google Scholar 

  71. Luoma, J., Hayes, S., & Walser, R. (2007). Learning ACT: An acceptance and commitment therapy skills training manual for therapists. California: New Harbinger Press.

    Google Scholar 

  72. March, J., Silva, S., Compton, S., Shapiro, M., Califf, R., & Krishnan, R. (2005). The case for practical clinical trials in psychiatry. American Journal of Psychiatry, 162, 836–846. doi:10.1176/appi.ajp.162.5.836.

    PubMed  Article  Google Scholar 

  73. Markiewicz, J., Ebert, L., Ling., D., Amaya-Jackson, L., & Kisiel, C. (2006). Learning collaborative toolkit. Los Angeles, CA and Durham, NC: National Center for Child Traumatic Stress.

  74. McGaghie, W., Siddal, V., Masmanian, P., & Myers, J. (2009). Lessons for continuing medical education from simulation research in undergraduate and graduate medical education. Chest, 135S, 62–68. doi:10.1378/chest.08-2521.

    Article  Google Scholar 

  75. McHugh, R. K., & Barlow, D. (2010). The dissemination and implementation of evidence-based psychological treatments: A review of current efforts. The American Psychologist, 65, 73–84. doi:10.1037/a0018121.

    PubMed  Article  Google Scholar 

  76. Miller, W., Sorensen, J., Selzer, J., & Brigham, G. (2006). Disseminating evidence- based practices in substance abuse treatment: A review with suggestions. Journal of Substance Abuse Treatment, 31, 25–39. doi:10.1016/j.jsat.2006.03.005.

    PubMed  Article  Google Scholar 

  77. Moore, J. L., & Marra, R. M. (2005). A comparative analysis of online discussion participation protocols. Journal of Research on Technology in Education, 38, 191–212. Retrieved from http://www.iste.org/

  78. Morgenstern, J., & McKay, J. R. (2007). Rethinking the paradigms that inform behavioral treatment research for substance use disorders. Addiction, 102, 1377–1389. doi:10.1111/j.1360-0443.2007.01882.x.

    PubMed  Article  Google Scholar 

  79. Moyers, T., Martin, T., Catley, D., Harris, K., & Ahluwalia, J. (2003). Assessing the integrity of motivational interviewing interventions: Reliability of the motivational interviewing skills code. Behavioral and Cognitive Psychotherapy, 31, 177–184. doi:10.1017/S1352465803002054.

    Article  Google Scholar 

  80. National Crime Victims Research & Treatment Center. (2007). TF-CBT Web: First Year Report. Charleston, SC: Medical University of South Carolina. Retrieved from http://tfcbt.musc.edu/

  81. Onken, L. S., Blaine, J. D., & Battjes, R. (1996). Behavioral therapy research: A conceptualization of a process. In S. W. Henggeler & A. B. Santos (Eds.), Innovative approaches for difficult-to-treat populations. Washington, DC: American Psychiatric Press.

    Google Scholar 

  82. Orvis, K., Fisher, S., & Wasserman, M. (2009). Power to the people: Using learner control to improve trainee reactions and learning in web-based instructional environments. Journal of Applied Psychology, 94, 960–971. doi:10.1037/a0014977.

    PubMed  Article  Google Scholar 

  83. Ottoson, J. (1997). Beyond transfer of training: Using multiple lenses to assess community education programs. New Directions for Adult and Continuing Education, 75, 87–96. doi:10.1002/ace.7508.

    Article  Google Scholar 

  84. Perpepletchikova, F., & Kazdin, A. (2005). Treatment integrity and therapeutic change: Issues and research recommendations. Clinical Psychology: Science and Practice, 12, 365–383. doi:10.1093/clipsy/bpi045.

    Article  Google Scholar 

  85. President’s New Freedom Commission on Mental Health. (2004). Report of the President’s New Freedom Commission on Mental Health. Retrieved from http://www.mentalhealthcommission.gov/reports/FinalReport/toc.html

  86. Rakovshik, S., & McManus, F. (2010). Establishing evidence-based in training in cognitive behavioral therapy: A review of current empirical findings and theoretical guidance. Clinical Psychology Review, 30, 496–516. doi:10.1016/j.cpr.2010.03.004.

    PubMed  Article  Google Scholar 

  87. Rashiq, S., Barton, P., Harstall, C., Schopflocher, D., Taenzer, P., & Alberta Ambassador Program Team. (2006). The Alberta ambassador program: Delivering health technology assessment results to rural clinicians. BMC Medical Education, 31, 6–21. doi:10.1186/1472-6920-6-21.

    Google Scholar 

  88. Ricciardi, J. (2005). Achieving human service outcomes through competency-based training: A guide for managers. Behavior Modification, 29, 488–507. doi:10.1177/0145445504273281.

    PubMed  Article  Google Scholar 

  89. Roth, A., & Pilling, S. (2008). Using an evidence-based methodology to identify the ompetences required to deliver effective cognitive and behavioral therapy for depression and anxiety disorders. Behavioral and Cognitive Psychotherapy, 36, 129–147. doi:10.1017/S1352465808004141.

    Article  Google Scholar 

  90. Rounsaville, B. J., Carroll, K. M., & Onken, L. S. (2001). A stage model of behavioral therapies research: Getting started and moving on from Stage I. Clinical Psychology: Science and Practice, 8, 133–142. doi:10.1093/clipsy/8.2.133.

    Article  Google Scholar 

  91. Rourke, L., & Anderson, T. (2002). Using peer teams to lead online discussions. Journal of Interactive Media in Education, 1, 1–21. Retrieved from http://www-jime.open.ac.uk/

  92. Scherl, C., & Haley, J. (2000). Computer monitor supervision: A clinical note. The American Journal of family Therapy, 28, 275–282. doi:10.1080/01926180050081702.

    Article  Google Scholar 

  93. Schoenwald, S., Sheidow, A., & Letourneau, E. (2004). Toward effective quality assurance in evidence-based practice: Links between expert consultation, clinician fidelity, and child outcomes. Journal of Clinical Child and Adolescent Psychology, 33, 94–104. doi:10.1207/S15374424JCCP3301_10.

    PubMed  Article  Google Scholar 

  94. Shostack, L. G. (1982). How to design a service. European Journal of Marketing, 16, 49–63. doi:10.1108/EUM0000000004799.

    Article  Google Scholar 

  95. Shostack, L. G. (1984). Design services that deliver. Harvard Business Review, 84115, 133–139. Retrieved from http://hbr.org/1984/01/designing-services-that-deliver/ar/1

  96. Sitzmann, T., Bell, B., Kraiger, K., & Kanar, A. (2009). A multilevel analysis of the effect of prompting self-regulation in technology-delivered instruction. Personnel Psychology, 62, 697–734. doi:10.1111/j.1744-6570.2009.01155.x.

    Article  Google Scholar 

  97. Stetler, C., Legro, M., Wallace, C., Bowman, C., Guihan, M., Hagedorn, H., et al. (2006). The role of formative evaluation in implementation research and the QUERI experience. Journal of General Internal Medicine, 21, S1–S8. doi:10.1007/s11606-006-0267-9.

    PubMed  Article  Google Scholar 

  98. Tunis, S., Stryer, D., & Clancy, C. (2003). Practical clinical trials: Increasing the value of clinical research for decision making in clinical and health policy. JAMA, 290, 1624–1632. doi:10.1001/jama.290.12.1624.

    PubMed  Article  CAS  Google Scholar 

  99. Turner, K., & Sanders, M. (2005). Dissemination of evidence-based parenting and family support strategies: Learning from the Triple P—Positive parenting program system approach. Aggression and Violent Behavior, 11, 176–193. doi:10.1016/j.avb.2005.07.005.

    Article  Google Scholar 

  100. Twigg, C. (2001). Innovations in online learning: Moving beyond no significant difference. The Pew Learning and Technology Program. Retrieved from http://www.thencat.org/Monographs/Innovations.html

  101. von Hippel, E. (2005). Democritizing innovation. Cambridge, MA: The MIT Press.

    Google Scholar 

  102. Webb, C., DeRubeis, R., & Barber, J. (2010). Clinician adherence/competence and treatment outcome: A meta-analytic review. Journal of Consulting and Clinical Psychology, 78, 200–211. doi:10.1037/a0018912.

    PubMed  Article  Google Scholar 

  103. Weingardt, K. (2004). The role of instructional design and technology in the dissemination of empirically supported, manual based therapies. Clinical Psychology: Science & Practice, 11, 313–331. doi:10.1093/clipsy/bph087.

    Article  Google Scholar 

  104. Weingardt, K., Cucciare, M., Bellotti, C., & Lai, W. (2009). A randomized trial comparing two models of web based training in cognitive-behavioral therapy for substance abuse counselors. Journal of Substance Abuse Treatment, 37, 219–227. doi:10.1016/j.jsat.2009.01.002.

    PubMed  Article  Google Scholar 

  105. Weingardt, K., Villafranca, S., & Levin, C. (2006). Technology-based training in cognitive behavioral therapy for substance abuse counselors. Substance Abuse, 27, 19–25. doi:10.1300/J465v27n03_04.

    PubMed  Article  Google Scholar 

  106. Weisz, J., & Chorpita, B. (in press). Mod squad for youth psychotherapy: Restructuring evidence-based treatment for clinical practice. In P. C. Kendall (Ed.), Child and adolescent therapy: Cognitive-behavioral procedures (4th ed.). New York: Guilford Press.

  107. Williams, C., & Martinez, R. (2008). Increasing access to CBT: Stepped care and CBT self-help models in practice. Behavioral and Cognitive Psychotherapy, 36, 675–683. doi:10.1017/S1352465808004864.

    Article  Google Scholar 

  108. Young, J., & Beck, A. (1980). The development of the Cognitive Therapy Scale. Unpublished manuscript, University of Pennsylvania, Philadelphia, PA.

Download references

Acknowledgments

This work was facilitated by NIH grant MH083333 (Ms. Beidas) and MH64484 (Dr. Kendall). Ms. Beidas and Dr. Koerner contributed equally to this manuscript.

Author information

Affiliations

Authors

Corresponding author

Correspondence to Rinad S. Beidas.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Beidas, R.S., Koerner, K., Weingardt, K.R. et al. Training Research: Practical Recommendations for Maximum Impact. Adm Policy Ment Health 38, 223–237 (2011). https://doi.org/10.1007/s10488-011-0338-z

Download citation

Keywords

  • Training
  • Dissemination and implementation
  • Technology
  • Evidence based practice
  • Innovation