Abstract
Evidence-based program resources (EBPR) websites evaluate behavioral health programs, practices or policies (i.e., interventions) according to a predetermined set of research criteria and standards, usually resulting in a summary rating of the strength of an intervention’s evidence base. This study is a mixed-methods analysis of the peer-reviewed academic literature relating to the influence of EBPRs on clinical practice and policy in the behavioral health field. Using an existing framework for a scoping review, we searched for research articles in PubMed, Web of Science, SCOPUS, and ProQuest that were published between January 2002 and March 2022, referenced an EBPR or multiple EBPRs, and presented data showing the influence of one or more EBPRs on behavioral health. A total of 210 articles met the inclusion criteria and were classified into five distinct categories of influence, the most important of which was showing the direct impact of one or more EBPRs on behavioral health (8.1% of articles), defined as documenting observable changes in interventions or organizations that are at least partly due to information obtained from EBPR(s). These included impacts at the state legislative and policy-making level, at the community intervention level, provider agency level, and individual practitioner level. The majority of influences identified in the study were indirect demonstrations of how EBPRs are used in various ways. However, more studies are needed to learn about the direct impact of information from EBPRs on the behavioral health field, including impact on clinician practice and treatment outcomes for consumers.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Acri, M., Morrissey, M., Peth-Pierce, R., Seibel, L., Seag, D., Hamovitch, E. K., & Hoagwood, K. E. (2021). An equine-assisted therapy for youth with mild to moderate anxiety: Manual development and fidelity. Journal of Child and Family Studies, 30(10), 2461–2467. https://doi.org/10.1007/s10826-021-02011-4
Ake, G. S., & Sullivan, K. M. (2017). Working with resource parents for trauma-informed foster care. Trauma responsive child welfare systems (pp. 165–179). Springer.
Arksey, H., & O’Malley, L. (2005). Scoping studies: Towards a methodological framework. International Journal of Social Research Methodology: Theory and Practice, 8(1), 19–32. https://doi.org/10.1080/1364557032000119616
Axford, N., Morpeth, L., Bjornstad, G., Hobbs, T., & Berry, V. (2022). “What works” registries of interventions to improve child and youth psychosocial outcomes: A critical appraisal. Children and Youth Services Review, 137, 106469.
Barth, R. P., & Liggett-Creel, K. (2014). Common components of parenting programs for children birth to eight years of age involved with child welfare services. Children and Youth Services Review, 40, 6–12. https://doi.org/10.1016/j.childyouth.2014.02.004
Buckley, P. R., Fagan, A. A., Pampel, F. C., & Hill, K. G. (2020). Making evidence-based interventions relevant for users: A comparison of requirements for dissemination readiness across program registries. Evaluation Review, 44(1), 51–83. https://doi.org/10.1177/0193841X20933776
Burkhardt, J. T., Schröter, D. C., Magura, S., Means, S. N., & Coryn, C. L. S. (2015). An overview of evidence-based program registers (EBPRs) for behavioral health. Evaluation and Program Planning, 48, 92–99. https://doi.org/10.1016/j.evalprogplan.2014.09.006
Dopp, A. R., Borduin, C. M., Willroth, E. C., & Sorg, A. A. (2017). Long-term economic benefits of psychological interventions for criminality: Comparing and integrating estimation methods. Psychology, Public Policy, and Law, 23(3), 312–323. https://doi.org/10.1037/law0000134
Drake, E. K. (2018). The monetary benefits and costs of community supervision. Journal of Contemporary Criminal Justice, 34(1), 47–68. https://doi.org/10.1177/1043986217750425
Duncan, B. L., & Reese, R. J. (2015). The Partners for Change Outcome Management System (PCOMS) Revisiting the client’s frame of reference. Psychotherapy, 52(4), 391–401. https://doi.org/10.1037/pst0000026
Elliott, S. N., Davies, M. D., Frey, J. R., Gresham, F., & Cooper, G. (2018). Development and initial validation of a social emotional learning assessment for universal screening. Journal of Applied Developmental Psychology, 55, 39–51. https://doi.org/10.1016/j.appdev.2017.06.002
Fagan, A. A., Bumbarger, B. K., Barth, R. P., Bradshaw, C. P., Cooper, B. R., Supplee, L. H., & Walker, D. K. (2019). Scaling up evidence-based interventions in US public systems to prevent behavioral health problems: Challenges and opportunities. Prevention Science, 20(8), 1147–1168. https://doi.org/10.1007/s11121-019-01048-8
Frye, K. E., Boss, D. L., Anthony, C. J., Du, H., & Xing, W. (2022). Content analysis of the CASEL framework using K–12 state SEL standards. School Psychology Review. https://doi.org/10.1080/2372966X.2022.2030193
Gigengack, M. R., Hein, I. M., Lindeboom, R., & Lindauer, R. J. L. (2019). Increasing resource parents’ sensitivity towards child posttraumatic stress symptoms: A descriptive study on a trauma-informed resource parent training. Journal of Child and Adolescent Trauma, 12(1), 23–29. https://doi.org/10.1007/s40653-017-0162-z
Gillen, A. C., Elefantis, A. B., Hodgson, A. B., & Hennessy, K. D. (2013). The international reach of SAMHSA’s national registry of evidence-based programs and practices. International Journal of Mental Health, 42(4), 78–94. https://doi.org/10.2753/IMH0020-7411420404
Green-Hennessy, S. (2018). Suspension of the national registry of evidence-based programs and practices: The importance of adhering to the evidence. Substance Abuse Treatment, Prevention and Policy, 13(1), 26. https://doi.org/10.1186/s13011-018-0162-5
Gregory, R. J., & Sachdeva, S. (2016). Naturalistic outcomes of evidence-based therapies for borderline personality disorder at a medical university clinic. American Journal of Psychotherapy, 70(2), 167–184.
Hallfors, D. D., Pankratz, M., & Hartman, S. (2007). Does federal policy support the use of scientific evidence in school-based prevention programs? Prevention Science, 8(1), 75–81. https://doi.org/10.1007/s11121-006-0058-x
Horne, C. S. (2017). Assessing and strengthening evidence-based program registries’ usefulness for social service program replication and adaptation. Evaluation Review, 41(5), 407–435. https://doi.org/10.1177/0193841X15625014
Horne, C. S., Brock, J. K., Freeman, J. K., & Odell, H. S. (2021). Conceptualizing and measuring the promotion of nonprofit organizations’ evidence use by U.S. social service funding programs. Journal of Public and Nonprofit Affairs, 7(2), 240–263. https://doi.org/10.20899/jpna.7.2.240-263
Kingston, B. E., Mihalic, S. F., & Sigel, E. J. (2016). Building an evidence-based multitiered system of supports for high-risk youth and communities. American Journal of Orthopsychiatry, 86(2), 132–143. https://doi.org/10.1037/ort0000110
Koenig, L. J., Lyles, C. M., Higa, D., Mullins, M. M., & Sipe, T. A. (2022). Research synthesis, HIV prevention response, and public health: CDC’s HIV/AIDS prevention research synthesis project. Public Health Reports. SAGE Publications Ltd. https://doi.org/10.1177/0033354920988871
Leathers, S. J., & Strand, T. C. (2013). Increasing access to evidence-based practices and knowledge and attitudes. Research on Social Work Practice, 23(6), 669–679. https://doi.org/10.1177/1049731513491635
Lee, M. J., Maranda, M. J., Magura, S., & Greenman, G. (2022). References to Evidence-based Program Registry (EBPR) websites for behavioral health in U.S. State Government Statutes and Regulations. Journal of Applied Social Science, 16(2), 442–458. https://doi.org/10.1177/19367244221078278
Liem, G. A. D., Chua, B. L., Seng, Y. B. G., Kamarolzaman, K., & Cai, E. Y. L. (2017). Social and emotional learning in Singapore’s schools: Framework, practice, research, and future directions. Social and emotional learning in Australia and the Asia-Pacific: Perspectives, programs and approaches (pp. 187–203). Springer.
Magura, S., Lee, M. J., Abu-Obaid, R. N., Landsverk, J., DeCamp, W., Rolls-Reutz, J., & Flagg, A. (2022). State department and provider agency utilization of evidence-based program registries in behavioral healthcare and child welfare. Evaluation & the Health Professions. https://doi.org/10.1177/01632787221085754
Maranda, M. J., Magura, S., Gugerty, R., Lee, M. J., Landsverk, J. A., Rolls-Reutz, J., & Green, B. (2021). State behavioral health agency website references to evidence-based program registers. Evaluation and Program Planning, 85, 101906. https://doi.org/10.1016/j.evalprogplan.2021.101906
Maxfield, T., Park, E. Y., & Blair, K. S. C. (2022). Synthesis of bullying interventions for individuals with disabilities: A meta-analysis. Journal of Behavioral Education. https://doi.org/10.1007/s10864-021-09466-x
Means, S. N., Magura, S., Burkhardt, J. T., Schröter, D. C., & Coryn, C. L. S. (2015). Comparing rating paradigms for evidence-based program registers in behavioral health: Evidentiary criteria and implications for assessing programs. Evaluation and Program Planning, 48, 100–116. https://doi.org/10.1016/j.evalprogplan.2014.09.007
Nwabuzor Ogbonnaya, I., Martin, J., & Walsh, C. R. (2018). Using the California evidence-based clearinghouse for child welfare as a tool for teaching evidence-based practice. Journal of Social Work Education, 54(sup1), S31–S40. https://doi.org/10.1080/10437797.2018.1434434
Paulsell, D., Thomas, J., Monahan, S., & Seftor, N. S. (2017). A trusted source of information: How systematic reviews can support user decisions about adopting evidence-based programs. Evaluation Review, 41(1), 50–77. https://doi.org/10.1177/0193841X16665963
Pew-MacArthur Results First Initiative. (2017). How states engage in evidence-based policymaking.
Pham, M. T., Rajić, A., Greig, J. D., Sargeant, J. M., Papadopoulos, A., & McEwen, S. A. (2014). A scoping review of scoping reviews: Advancing the approach and enhancing the consistency. Research Synthesis Methods, 5(4), 371–385. https://doi.org/10.1002/jrsm.1123
Silbernagle, D. (2022). The impact of a trauma-informed model of care on child welfare workers and staff turnover in a care management organization. Unpublished dissertation. Saint Peter’s University.
Siqueira Drake, A. (2013). The use of core competencies in suicide risk assessment and management in supervision: A feminist-narrative approach. Journal of Feminist Family Therapy, 25(3), 183–199. https://doi.org/10.1080/08952833.2013.777881
Stephenson, A. L. (2017). Journey toward evidence-based status: Seeking admission to formal program registries. Health Promotion Practice, 18(5), 681–687. https://doi.org/10.1177/1524839916670575
Walker, S. C., Lyon, A. R., Aos, S., & Trupin, E. W. (2017). The consistencies and vagaries of the Washington State Inventory of Evidence-Based Practice: The definition of “evidence-based” in a policy context. Administration and Policy in Mental Health and Mental Health Services Research, 44(1), 42–54. https://doi.org/10.1007/s10488-015-0652-y
Westbrook, T. R., Avellar, S. A., & Seftor, N. (2017). Reviewing the reviews: Examining similarities and differences between federally funded evidence reviews. Evaluation Review, 41(3), 183–211. https://doi.org/10.1177/0193841X16666463
Yon, A., & Scogin, F. (2007). Procedures for identifying evidence-based psychological treatments for older adults. Psychology and Aging. https://doi.org/10.1037/0882-7974.22.1.4
Zack, M. K., Karre, J. K., Olson, J., & Perkins, D. F. (2019). Similarities and differences in program registers: A case study. Evaluation and Program Planning, 76, 101676. https://doi.org/10.1016/j.evalprogplan.2019.101676
Zhao, Y. (2020). Another education war? The coming debates over social and emotional learning. Phi Delta Kappan, 101(8), 42–48. https://doi.org/10.1177/0031721720923791
Acknowledgements
Mary E. Ramlow provided administrative support.
Funding
National Institute on Drug Abuse Grant No. R01 DA042036.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors have no competing financial or other interests.
Ethical Approval
The study was reviewed by the Institutional Review Board of Western Michigan University which determined there is no involvement of human research subjects.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Lee-Easton, M.J., Magura, S., Maranda, M.J. et al. A Scoping Review of the Influence of Evidence-Based Program Resources (EBPR) Websites for Behavioral Health. Adm Policy Ment Health 50, 379–391 (2023). https://doi.org/10.1007/s10488-022-01245-8
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10488-022-01245-8