Abstract
There has been an increase in the use of web-based training methods to train behavioral health providers in evidence-based practices. This systematic review focuses solely on the efficacy of web-based training methods for training behavioral health providers. A literature search yielded 45 articles meeting inclusion criteria. Results indicated that the serial instruction training method was the most commonly studied web-based training method. While the current review has several notable limitations, findings indicate that participating in a web-based training may result in greater post-training knowledge and skill, in comparison to baseline scores. Implications and recommendations for future research on web-based training methods are discussed.
Similar content being viewed by others
References
American Psychological Association. (1993). Task force on promotion and dissemination of psychological procedures. In The meeting of the American Psychological Association.
APA Presidential Task Force on Evidence-Based Practice. (2006). Evidence-based practice in psychology. American Psychologist, 61(4), 271–285. https://doi.org/10.1037/0003-066X.61.4.271.
Arthur, W. Jr., Bennett, W. Jr., Edens, P. S., & Bell, S. T. (2003). Effectiveness of training in organizations: A meta-analysis of design and evaluation features. Journal of Applied Psychology, 88(2), 234–245. https://doi.org/10.1037/0021-9010.88.2.234.
Ayers, C. R., Sorrell, J. T., Thorp, S. R., & Wetherell, J. L. (2007). Evidence-based psychological treatments for late-life anxiety. Psychology and Aging, 22(1), 8–17. https://doi.org/10.1037/0882-7974.22.1.8.
Beidas, R. S., & Kendall, P. C. (2010). Training therapists in evidence-based practice: A critical review of studies from a systems-contextual perspective. Clinical Psychology: Science and Practice, 17(1), 1–30. https://doi.org/10.1111/j.1468-2850.2009.01187.x.
Bennett-Levy, J., Hawkins, R., Perry, H., Cromarty, P., & Mills, J. (2012). Online cognitive behavioural therapy training for therapists: Outcomes, acceptability, and impact of support. Australian Psychologist, 47(3), 174–182. https://doi.org/10.1111/j.1742-9544.2012.00089.x.
Borenstein, M., & Cooper, H. (2009). Effect sizes for continuous data. The Handbook of Research Synthesis and Meta-Analysis, 2, 221–235.
Bray, J. W., Bray, L. M., Lennox, R., Mills, M. J., McRee, B., Goehner, D., & Higgins-Biddle, J. C. (2009). Evaluating web-based training for employee assistance program counselors on the use of screening and brief intervention for at-risk alcohol use. Journal of Workplace Behavioral Health, 24(3), 307–319.
Brose, L. S., West, R., Michie, S., Kenyon, J. A. M., McEwen, A. (2012). Effectiveness of an online knowledge training and assessment program for stop smoking practitioners. Nicotine and Tobacco Research, 14(7), 794–800. https://doi.org/10.1093/ntr/ntr286.
Brownlow, R. S., Maguire, S., O’Dell, A., Dias-da-Costa, C., Touyz, S., & Russell, J. (2015). Evaluation of an online training program in eating disorders for health professionals in Australia. Journal of Eating Disorders, 3(1), 37. https://doi.org/10.1186/s40337-015-0078-7.
Bruns, E. J., Kerns, S. E. U., Pullmann, M. D., & Hensley, S. (2015). Research, data, and evidence-based treatment use in state behavioral health systems, 2001–2012. Psychiatric Services, 67(5), 496–503.
Calder, R., Ainscough, T., Kimergård, A., Witton, J., & Dyer, K. R. (2017). Online training for substance misuse workers: A systematic review. Drugs: Education, Prevention and Policy, 24, 1–13.
Chorpita, B. F., Daleiden, E. L., Ebesutani, C., Young, J., Becker, K. D., Nakamura, B. J., … Starace, N. (2011). Evidence-based treatment of children and adolescents: An updated review of indicators of efficacy and effectiveness. Clinical Psychology: Science and Practice, 18(2), 154–172.
Chu, B. C., Carpenter, A. L., Wyszynski, C. M., Conklin, P. H., & Comer, J. S. (2017). Scalable options for extended skill building following didactic training in cognitive-behavioral therapy for anxious youth: A pilot randomized trial. Journal of Clinical Child and Adolescent Psychology, 46(3), 401–410. https://doi.org/10.1080/15374416.2015.1038825.
Cohen, J. A., Mannarino, A. P., Jankowski, K., Rosenberg, S., Kodya, S., & Wolford, G. L. (2016). A randomized implementation study of trauma-focused cognitive behavioral therapy for adjudicated teens in residential treatment facilities. Child Maltreatment, 21(2), 156–167. https://doi.org/10.1177/1077559515624775.
Cook, D. A., Levinson, A. J., Garside, S., Dupras, D. M., Erwin, P. J., & Montori, V. M. (2008). Internet-based learning in the health professions: A meta-analysis. JAMA, 300(10), 1181–1196.
Crawford, A. M., & Curran, J. H. (2015). Disseminating behavioural activation for depression via online training: Preliminary steps. Behavioural and Cognitive Psychotherapy, 43, 224–238. https://doi.org/10.1177/0192513X12437708.
Dimeff, L. A., Harned, M. S., Woodcock, E. A., Skutch, J. M., Koerner, K., & Linehan, M. M. (2015). Investigating bang for your training buck: A randomized controlled trial comparing three methods of training clinicians in two core strategies of dialectical behavior therapy. Behavior Therapy, 46(3), 283–295. https://doi.org/10.1016/j.beth.2015.01.001.
Dimeff, L. A., Koerner, K., Woodcock, E. A., Beadnell, B., Brown, M. Z., Skutch, J. M., … Harned, M. S. (2009). Which training method works best? A randomized controlled trial comparing three methods of training clinicians in dialectical behavior therapy skills. Behaviour Research and Therapy, 47(11), 921–930. https://doi.org/10.1016/j.brat.2009.07.011.
Dimeff, L. A., Woodcock, E. A., & Harned, M. S. (2011). Can dialectical behavior therapy be learned in highly structured learning environments results from a randomized controlled dissemination trial. Behavior Therapy, 42(2), 263–275. https://doi.org/10.1016/j.beth.2010.06.004.
Fairburn, C. G., Allen, E., Bailey-Straebler, S., O’Connor, M. E., & Cooper, Z. (2017). Scaling up psychological treatments: A countrywide test of the online training of therapists. Journal of Medical Internet Research, 19(6), 319–324.
Fixsen, D. L., Naoom, S. F., Blase, K. A., Friedman, R. M., & Wallace, F. (2005). Implementation research: A synthesis of the literature. Tampa, FL: University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network (FMHI Publication #231).
German, R. E., Adler, A., Frankel, S. A., Stirman, S. W., Pinedo, P., Evans, A. C., … Creed, T. A. (2017). Testing a web-based, trained-peer model to build capacity for evidence-based practices in community mental health systems. Psychiatric Services. https://doi.org/10.1176/appi.ps.201700029.
Ghoncheh, R., Gould, M. S., Twisk, J. W., Kerkhof, A. J., & Koot, H. M. (2016). Efficacy of adolescent suicide prevention e-learning modules for gatekeepers: A randomized controlled trial. JMIR Mental Health, 3(1), e8. https://doi.org/10.2196/mental.4614.
Gough, D., Oliver, S., & Thomas, J. (Eds.). (2017). An introduction to systematic reviews. Los Angeles: Sage.
Gryglewicz, K., Chen, J. I., Romero, G. D., Karver, M. S., & Witmeier, M. (2017). Online suicide risk assessment and management training: Pilot evidence for acceptability and training effects. Crisis: The Journal of Crisis Intervention and Suicide Prevention, 38(3), 186–194. https://doi.org/10.1027/0227-5910/a000421.
Han, C., Voils, C. I., & Williams, J. W. J. (2013). Uptake of web-based clinical resources from the MacArthur Initiative on Depression and Primary Care. Community Mental Health Journal, 49(2), 166–171. https://doi.org/10.1007/s10597-011-9461-2.
Harned, M. S., Dimeff, L. A., Woodcock, E. A., Kelly, T., Zavertnik, J., Contreras, I., & Danner, S. M. (2014). Exposing clinicians to exposure: A randomized controlled dissemination trial of exposure therapy for anxiety disorders. Behavior Therapy, 45(6), 731–744. https://doi.org/10.1016/j.beth.2014.04.005.
Harned, M. S., Dimeff, L. A., Woodcock, E. A., Skutch, J. M. (2011). Overcoming barriers to disseminating exposure therapies for anxiety disorders: A pilot randomized controlled trial of training methods. Journal of Anxiety Disorders, 25(2), 155–163. https://doi.org/10.1016/j.janxdis.2010.08.015.
Heck, N. C., Saunders, B. E., & Smith, D. W. (2015). Web-based training for an evidence-supported treatment: Training completion and knowledge acquisition in a global sample of learners. Child Maltreatment, 20(3), 183–192. https://doi.org/10.1177/1077559515586569.
Herschell, A. D., Kolko, D. J., Baumann, B. L., & Davis, A. C. (2010). The role of therapist training in the implementation of psychosocial treatments: A review and critique with recommendations. Clinical Psychology Review, 30(4), 448–466. https://doi.org/10.1016/j.cpr.2010.02.005.
Kanter, J. W., Tsai, M., Holman, G., & Koerner, K. (2013). Preliminary data from a randomized pilot study of web-based functional analytic psychotherapy therapist training. Psychotherapy, 50(2), 248–255. https://doi.org/10.1037/a0029814.
Kobak, K. A., Craske, M. G., Rose, R. D., & Wolitsky-Taylor, K. (2013). Web-based therapist training on cognitive behavior therapy for anxiety disorders: A pilot study. Psychotherapy, 50(2), 235–247. https://doi.org/10.1037/a0030568.
Kobak, K. A., Lipsitz, J. D., Markowitz, J. C., & Bleiberg, K. L. (2017). Web-based therapist training in interpersonal psychotherapy for depression: Pilot study. Journal of Medical Internet Research, 19(7), 306–317. https://doi.org/10.2196/jmir.7966.
Kobak, K. A., Wolitsky-Taylor, K., Craske, M. G., & Rose, R. D. (2017). Therapist training on cognitive behavior therapy for anxiety disorders using internet-based technologies. Cognitive Therapy and Research, 41(2), 252–265. https://doi.org/10.1007/s10608-016-9819-4.
Larson, M. J., Amodeo, M., Locastro, J. S., Muroff, J., Smith, L., & Gerstenberger, E. (2013). Randomized trial of web-based training to promote counselor use of cognitive behavioral therapy skills in client sessions. Substance Abuse, 34(2), 179–187. https://doi.org/10.1080/08897077.2012.746255.
Larson, M. J., Amodeo, M., Storti, S. A., Steketee, G., Blitzman, G., & Smith, L. (2009). A novel CBT web course for the substance abuse workforce: Community counselors’ perceptions. Substance Abuse, 30(1), 26–39.
Leykin, Y., Cucciare, M. A., & Weingardt, K. R. (2011). Differential effects of online training on job-related burnout among substance abuse counsellors. Journal of Substance Use, 16(2), 127–135. https://doi.org/10.3109/14659891.2010.526168.
Marshall, E., York, J., Magruder, K., Yeager, D., Knapp, R., Santis, M. L., … Jobes, D. A. (2014). Implementation of online suicide-specific training for VA providers. Academic Psychiatry, 38(5), 566–574. https://doi.org/10.1007/s40596-014-0039-5.
Martinez, R. G., Lewis, C. C., & Weiner, B. J. (2014). Instrumentation issues in implementation science. Implementation Science, 9, 118. https://doi.org/10.1186/s13012-014-0118-8.
Martino, S., Canning-Ball, M., Carroll, K. M., & Rounsaville, B. J. (2011). A criterion-based stepwise approach for training counselors in motivational interviewing. Journal of Substance Abuse Treatment, 40(4), 357–365. https://doi.org/10.1016/j.jsat.2010.12.004.
McHugh, R. K., & Barlow, D. H. (2010). The dissemination and implementation of evidence-based psychological treatments. A review of current efforts. The American Psychologist, 65(2), 73–84. https://doi.org/10.1037/a0018121.
McMillen, J. C., Hawley, K. M., & Proctor, E. K. (2015). Mental health clinicians’ participation in web-based training for an evidence supported intervention: Signs of encouragement and trouble ahead. Administration and Policy in Mental Health and Mental Health Services Research, 43(4), 592–603. https://doi.org/10.1007/s10488-015-0645-x.
McPherson, T. L., Cook, R. F., Back, A. S., Hersch, R. K., & Hendrickson, A. (2006). A field test of a web-based substance abuse prevention training program for health promotion professionals. American Journal of Health Promotion, 20(6), 396–400. https://doi.org/10.4278/0890-1171-20.6.396.
Mignogna, J., Hundt, N. E., Kauth, M. R., Kunik, M. E., Sorocco, K. H., Naik, A. D., … Cully, J. A. (2014). Implementing brief cognitive behavioral therapy in primary care: A pilot study. Translational Behavioral Medicine, 4(2), 175–183. https://doi.org/10.1007/s13142-013-0248-6.
Miller, W. R., & Mount, K. A. (2001). A small study of training in motivational interviewing: Does one workshop change clinician and client behavior? Behavioural and Cognitive Psychotherapy, 29(04), 457–471.
Miller, W. R., Yahne, C. E., Moyers, T. B., Martinez, J., & Pirritano, M. (2004). A randomized trial of methods to help clinicians learn motivational interviewing. Journal of Consulting and Clinical Psychology, 72(6), 1050.
Morris, Z. S., Wooding, S., & Grant, J. (2011). The answer is 17 years, what is the question: Understanding time lags in translational research. Journal of the Royal Society of Medicine, 104(12), 510–520. https://doi.org/10.1258/jrsm.2011.110180.
Myles, P. J., Latham, M., & Ricketts, T. (2003). The contributions of an expert panel in the development of a new measure of knowledge for the evaluation of training in cognitive behavioural therapy. Paper presented at the British Association of Behavioural and Cognitive Psychotherapies Annual Conference, York.
Nadeem, E., Gleacher, A., & Beidas, R. S. (2013). Consultation as an implementation strategy for evidence-based practices across multiple contexts: Unpacking the black box. Administration and Policy in Mental Health and Mental Health Services Research, 40(6), 439–450. https://doi.org/10.1007/s10488-013-0502-8.
Nathan, P. E., & Gorman, J. M. (2002). A guide to treatments that work (2nd ed.). London: Oxford University Press.
National Institute of Mental Health. (1998). Bridging science and service: A report by the National Advisory Mental Health Council’s Clinical Treatment and Services Work Group. Rockville, MD.
Ozer, E. M., Adams, S. H., Gardner, L. R., Mailloux, D. E., Wibbelsman, C. J., & Irwin, C. E. Jr. (2004). Provider self-efficacy and the screening of adolescents for risky health behaviors. Journal of Adolescent Health, 35, 101–107.
Powell, B. J., McMillen, J. C., Hawley, K. M., & Proctor, E. K. (2013). Mental health clinicians’ motivation to invest in training: Results from a practice-based research network survey. Psychiatric Services, 64(8), 816–818.
Powell, B. J., Waltz, T. J., Chinman, M. J., Damschroder, L. J., Smith, J. L., Matthieu, M. M., … Kirchner, J. E. (2015). A refined compilation of implementation strategies: Results from the Expert Recommendations for Implementing Change (ERIC) project. Implementation Science, 10(1), 21. https://doi.org/10.1186/s13012-015-0209-1.
Puspitasari, A., Kanter, J. W., Murphy, J., Crowe, A., & Koerner, K. (2013). Developing an online, modular, active learning training program for behavioral activation. Psychotherapy, 50(2), 256–265. https://doi.org/10.1037/a0030058.
Rakovshik, S. G., McManus, F., Vazquez-Montes, M., Muse, K., & Ougrin, D. (2016). Is supervision necessary? Examining the effects of internet-based CBT training with and without supervision. Journal of Consulting and Clinical Psychology, 84(3), 191–199. https://doi.org/10.1037/ccp0000079.
Rawson, R. A., Rataemane, S., Rataemane, L., Ntlhe, N., Fox, R. S., McCuller, J., & Brecht, M.-L. (2013). Dissemination and implementation of cognitive behavioral therapy for stimulant dependence: A randomized trial comparison of 3 approaches. Substance Abuse, 34(2), 108–117. https://doi.org/10.1080/08897077.2012.691445.
Rees, C. S., & Gillam, D. (2001). Training in cognitive-behavioural therapy for mental health professionals: A pilot study of videoconferencing. Journal of Telemedicine and Telecare, 7(5), 300–303. https://doi.org/10.1258/1357633011936561.
Rees, C. S., Krabbe, M., & Monaghan, B. J. (2009). Education in cognitive-behavioural therapy for mental health professionals. Journal of Telemedicine and Telecare, 15(2), 59–63. https://doi.org/10.1258/jtt.2008.008005.
Reid, W. M., Ruzycki, S., Haney, M. L., Brown, L. M., Baggerly, J., Mescia, N., & Hyer, K. (2005). Disaster mental health training in Florida and the response to the 2004 hurricanes. Journal of Public Health Management and Practice: JPHMP. https://doi.org/10.1097/00124784-200511001-00010.
Rheingold, A. A., Zajac, K., & Patton, M. (2012). Feasibility and acceptability of a child sexual abuse prevention program for childcare professionals: Comparison of a web-based and in-person training. Journal of Child Sexual Abuse, 21(4), 422–436. https://doi.org/10.1080/10538712.2012.675422.
Roh, K. H., & Park, H. (2010). A meta-analysis on the effectiveness of computer-based education in nursing. Healthcare Informatics Research, 16(3), 149–157.
Rones, M., & Hoagwood, K. (2000). School-based mental health services: A research review. Clinical Child and Family Psychology Review, 3(4), 223–241. https://doi.org/10.1023/A:1026425104386.
Ruzek, J. I., Rosen, R. C., Garvert, D. W., Smith, L. D., Sears, K. C., Marceau, L., … Stoddard, A. M. (2014). Online self-administered training of PTSD treatment providers in cognitive–behavioral intervention skills: Results of a randomized controlled trial. Journal of Traumatic Stress, 27(6), 703–711. https://doi.org/10.1002/jts.21977.
Samuelson, K. W., Koenig, C. J., McCamish, N., Choucroun, G., Tarasovsky, G., Bertenthal, D., & Seal, K. H. (2014). Web-based PTSD training for primary care providers: A pilot study. Psychological Services, 11(2), 153–161. https://doi.org/10.1037/a0034855.
Schoenwald, S. K., Chapman, J. E., Sheidow, A. J., & Carter, R. E. (2009). Long-term youth criminal outcomes in MST transport: The impact of therapist adherence and organizational climate and structure. Journal of Clinical Child and Adolescent Psychology, 38(1), 91–105. https://doi.org/10.1080/15374410802575388.
Scogin, F., Welsh, D., Hanson, A., Stump, J., & Coates, A. (2005). Evidence-based psychotherapies for depression in older adults. Clinical Psychology: Science and Practice, 12(3), 222–237. https://doi.org/10.1093/clipsy/bpi033.
Shafer, M. S., Rhode, R., & Chong, J. (2004). Using distance education to promote the transfer of motivational interviewing skills among behavioral health professionals. Journal of Substance Abuse Treatment, 26(2), 141–148. https://doi.org/10.1016/S0740-5472(03)00167-3.
Shapiro, H. L. (2001). The future of continuing medical education on the web. In B. Khan (Ed.), Web-based training (pp. 427–433). Engelwood Cliffs: Educational Technology Publications, Inc.
Sholomskas, D. E., Syracuse-Siewert, G., Rounsaville, B. J., Ball, S., Nuro, K. F., & Carroll, K. M. (2005). We don’t train in vain: A dissemination trial of three strategies of training clinicians in cognitive-behavioral therapy. Journal of Consulting and Clinical Psychology, 73(1), 106–115. https://doi.org/10.1037/0022-006X.73.1.106.
Silverman, W. K., Pina, A. A., & Viswesvaran, C. (2008). Evidence-based psychosocial treatments for phobic and anxiety disorders in children and adolescents. Journal of Clinical Child & Adolescent Psychology, 37(1), 105–130.
Sitzmann, T., Kraiger, K., Stewart, D., & Wisher, R. (2006). The comparative effectiveness of web-based and classroom instruction: A meta‐analysis. Personnel Psychology, 59(3), 623–664.
Southam-Gerow, M. A., Rodríguez, A., Chorpita, B. F., & Daleiden, E. L. (2012). Dissemination and implementation of evidence based treatments for youth: Challenges and recommendations. Professional Psychology: Research and Practice, 43(5), 527–534. https://doi.org/10.1037/a0029101.
Stein, B. D., Celedonia, K. L., Swartz, H. A., DeRosier, M. E., Sorbero, M. J., Brindley, R. A., … Frank, E. (2015). Implementing a web-based intervention to train community clinicians in an evidence-based psychotherapy: A pilot study. Psychiatric Services, 66(9), 988–991. https://doi.org/10.1176/appi.ps.201400318.
Stone, D. M., Barber, C. W., & Potter, L. (2005). Public health training online: The National Center for Suicide Prevention Training. American Journal of Preventive Medicine, 29(5), 247–251. https://doi.org/10.1016/j.amepre.2005.08.019.
Stuart, G. W., Tondora, J., & Hoge, M. A. (2004). Evidence-based teaching practice: Implications for behavioral health. Administration and Policy in Mental Health, 32(2), 107–131.
Substance Abuse and Mental Health Services Administration. (2014, October 30). National behavioral health quality framework. Retrieved from https://www.samhsa.gov/data/national-behavioral-health-qualityframework.
US Department of Health and Human Services. (2003). President’s New Freedom Commission on Mental Health. Achieving the Promise: Transforming Mental Health Care in America: Executive Summary.
Vismara, L. A., Young, G. S., Stahmer, A. C., Griffith, E. M. M., & Rogers, S. J. (2009). Dissemination of evidence-based practice: Can we train therapists from a distance? Journal of Autism and Developmental Disorders, 39(12), 1636–1651. https://doi.org/10.1007/s10803-009-0796-2.
Waldron, H. B., & Turner, C. W. (2008). Evidence-based psychosocial treatments for adolescent substance abuse. Journal of Clinical Child & Adolescent Psychology, 37(1), 238–261. https://doi.org/10.1080/15374410701820133.
Weingardt, K. R., Cucciare, M. A., Bellotti, C., Lai, W. P. (2009). A randomized trial comparing two models of web-based training in cognitive-behavioral therapy for substance abuse counselors. Journal of Substance Abuse Treatment, 37(3), 219–227. https://doi.org/10.1016/j.jsat.2009.01.002.
Weingardt, K. R., Villafranca, S. W., Levin, C. (2006). Technology-based training in cognitive behavioral therapy for substance abuse counselors. Substance Abuse, 27(3), 19–25. https://doi.org/10.1300/J465v27n03_04.
Zhao, Y., Lei, J., Yan, B., Lai, C., & Tan, H. S. (2005). What makes the difference? A practical analysis of research on the effectiveness of distance education. Teachers College Record, 107(8), 1836–1884. https://doi.org/10.1111/j.1467-9620.2005.00544.x.
Funding
This research was funded by a grant from the National Institute of Mental Health (NIMH; R01 MH095750; A Statewide Trial to Compare Three Training Models for Implementing an EBT; PI: Herschell).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
All authors declare that they have no conflict of interest.
Ethical Approval
This article does not contain any studies with human participants performed by any of the authors.
Rights and permissions
About this article
Cite this article
Jackson, C.B., Quetsch, L.B., Brabson, L.A. et al. Web-Based Training Methods for Behavioral Health Providers: A Systematic Review. Adm Policy Ment Health 45, 587–610 (2018). https://doi.org/10.1007/s10488-018-0847-0
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10488-018-0847-0