Evidence clearinghouses evaluate and summarize literature to help decision-makers prioritize and invest in evidence-informed interventions. Clearinghouses and related practice-oriented tools are continuously evolving; however, it is unclear the extent to which these tools assess and summarize evidence describing an intervention’s impact on health equity. We conducted a systematic scan to explore how clearinghouses communicated an intervention’s equity impact and reviewed their underlying methods and how they defined and operationalized health equity. In 2021, we identified 18 clearinghouses that were US-focused, web-based registries of interventions that assigned an intervention effectiveness rating for improving community health and the social determinants of health. We reviewed each clearinghouse’s website and collected publicly available information about their health equity impact review, review methods, and health equity definitions and values. We conducted a comparative analysis among select clearinghouses using qualitative methods. Among the 18 clearinghouses, fewer than half (only seven) summarized an intervention’s potential impact on health equity. Overall, those seven clearinghouses defined and operationalized equity differently, and most lacked transparency in their review methods. Clearinghouses used one or more approaches to communicate findings from their review: summarize study findings on differential impact for subpopulations, curate interventions that reduce health disparities, and/or assign a disparity/equity rating to each intervention. Evidence clearinghouses can enhance equity-focused methods and be transparent in their underlying values to better support the uptake and implementation of evidence-informed interventions to advance health equity. However, clearinghouses are unable to do so without underlying equity-focused empirical evidence.
Evidence clearinghouses (henceforth “clearinghouses”), also called evidence-based program registries, systematically conduct reviews of evidence to determine the effectiveness of an intervention (i.e., policy, program, or practice) (Horne, 2017; Means et al., 2015). Clearinghouses compile research findings about an intervention, assess the quality and strength of the available evidence, and summarize these findings (Mayo-Wilson et al., 2022; Paulsell et al., 2017). Clearinghouses serve as research dissemination channels that can assist practitioners, including policy makers, grant writers, advocacy groups, and administrators (Burkhardt et al., 2015; Paulsell et al., 2017), who often have limited time or access to scientific literature (Brownson et al., 2018). Clearinghouses advance evidence-based interventions by encouraging the adoption of effective interventions and discouraging the adoption of interventions that have shown negative effects or have not been well studied (Buckley et al., 2022).
Fields like medicine have used evidence-based interventions for centuries (Claridge & Fabian, 2005; Mackey & Bassendowski, 2017). Although scientific research methods have been used to develop evidence-based interventions since the 1960s (Means et al., 2015), growing attention was placed on the use of evidence-based interventions to address health and social issues by the federal government in the late 2000s (Stack, 2018). Federal recognition of the importance of evidence-based interventions led most government agencies to primarily fund interventions that have evidence demonstrating their effectiveness (Burkhardt et al., 2015; Mayo-Wilson et al., 2022; Means et al., 2015). Federal agencies host clearinghouses in areas of education, criminal justice, social welfare, and health to directly link research to funding decisions (Paulsell et al., 2017). Federal clearinghouses improve the visibility of interventions which may also inform research funding and future direction (Burkhardt et al., 2015). Nonprofit organizations and academic institutions also host clearinghouses.
Clearinghouses vary in how they identify which interventions to include in a registry, compile literature, determine causality, and assess program effectiveness (Bergum et al., 2019; Burkhardt et al., 2015; Paulsell et al., 2017). For federal clearinghouses, the purpose, types of interventions included, and the sources reviewed are often defined in the legislation establishing the clearinghouse. Further, clearinghouses provide varying levels of context-specific information to help users determine if an intervention could be effective in their setting, with most clearinghouses providing information about participants or target populations and fewer describing context about implementation fidelity, the implementing agency, costs, or staffing (Horne, 2017). Clearinghouses also vary in how they address an intervention’s readiness to be disseminated, with few clearinghouses including the availability of intervention materials, trainings, and guidance on how users can adopt the intervention for their community while maintaining fidelity (Buckley et al., 2020; Paulsell et al., 2017). Variability in clearinghouses’ methods and approaches means that findings from clearinghouses are not always comparable to one another (Means et al., 2015).
Health Equity, Inequities, Disparities, and the Social Determinants of Health
Health equity researchers and practitioners often use related terms like equity, inequities, disparities, and the social determinants of health. We refer to Braveman et al. (2017) definitions of equity and disparities for this study because they are widely used in public health. Braveman et al. (2017) define health equity as “everyone has a fair and just opportunity to be as healthy as possible” (p. 2). Health disparities are a way to measure progress toward advancing health equity, and Braveman et al. (2017) further describe the relationship between health equity and disparities as “health equity means reducing and ultimately eliminating disparities in health and its determinants that adversely affect excluded or marginalized groups” (p. 2).
The social determinants of health are the social and economic factors, including education, income, and housing, that influence health outcomes (Braveman et al., 2011; Commission on Social Determinants of Health [CSDH], 2008), and the uneven distribution of these determinants contributes to wide health disparities and inequities across populations (CSDH, 2008; National Academies of Sciences, Engineering, and Medicine [NASEM], 2017a). Addressing disparities and inequities in the social determinants of health can affect health disparities and inequities (Solar & Irwin, 2010). Many clearinghouses compile interventions that address the social determinants of health, such as job opportunities, healthy behaviors, safe and clean environments, civic engagement, health care, and community programs.
Clearinghouses’ Role in Advancing Health Equity
Clearinghouses help practitioners identify which interventions may result in improved outcomes for an overall community or target population; however, it is unclear the extent to which they have invested in assessing an intervention’s impact on health equity within or between populations. There are several potential ways clearinghouses can evaluate and summarize evidence to help practitioners understand how an intervention can advance health equity. For example, clearinghouses can provide information about an intervention’s differential impact — how an intervention benefits some groups or areas more than others (Milton et al., 2011) — to help users better understand population groups that can benefit from interventions, and whether interventions impact disparities between subgroups. Universal interventions, also called population-level interventions, can generate differential impact (Milton et al., 2011). Interventions that can improve health outcomes on average do not necessarily have a positive impact on health equity. In fact, sometimes, interventions even worsen health disparities and inequities (Jansen et al., 2022). Researchers acknowledge the importance of assessing interventions’ differential impact (Jaciw, 2020; Maden, 2016; Van Horn et al., 2015), but there is still limited empirical research measuring differential impacts which limits how clearinghouses assess differences in effectiveness among subgroups. For example, a recent systematic review of systematic reviews on adolescent population health interventions found limited published evidence about differential impacts (Macintyre et al., 2020).
Clearinghouses can also help practitioners consider the level at which an intervention is working and its potential to change underlying systems that sustain inequity. For example, many interventions focus on the individual or interpersonal level which may not address the environmental and system-level factors that are needed to sustain improvements and address underlying determinants of health (Brown et al., 2019; Thornton et al., 2016). Clearinghouses can also help practitioners focus attention on various social identities within and among population groups (e.g., place of residence, race/ethnicity, occupation, gender, religion, education) (Higgins et al., 2022; O’Neill et al., 2014) and guide them to understand how an intervention may benefit or harm one group more than another.
To our knowledge, no studies have examined how and the extent to which clearinghouses disseminate information on an intervention’s potential impact on health equity. In this study, we conducted a systematic scan to explore the state of the field for clearinghouses.
We created a comprehensive directory of clearinghouses following the search methods of Bergum et al. (2019). We identified clearinghouses through an internet search using terms such as “evidence clearinghouse,” “evidence-based program registries,” and “evidence rating.” We cross-checked the list with clearinghouse directories collated by organizations such as the Pew Charitable Trusts, AmeriCorps, health.gov, and the Office of Planning, Research & Evaluation.
We included clearinghouses that were US-focused, offered web-based registries of interventions (i.e., system changes, policies, programs, and practices), focused on interventions that communities can implement to improve health and the social determinants of health, and assigned an intervention effectiveness rating based on their review of synthesized evidence. We excluded clearinghouses from our analytic review if they (a) rated the quality of individual studies only, not the intervention; (b) conducted systematic reviews or meta-analyses but did not assign an effectiveness rating; (c) focused only on clinical interventions for a specific disease or illness; or (d) did not regularly update their registries as of December 1, 2021. Figure 1 shows clearinghouse identification, inclusion, and exclusion criteria for this study.
For the identified clearinghouses, a lead researcher collected publicly available information on how clearinghouses conducted health equity impact reviews from each clearinghouse’s website as of December 1, 2021.Footnote 1 The data was analyzed independently by two researchers who then interpreted the results together. We broadly defined health equity impact review to include various approaches clearinghouses might use, including presentations of an intervention’s differential impact, assessments of an intervention’s ability to reduce existing disparities in health and the social determinants of health, assessments of whether an intervention is equitably designed and implemented, and assessments of how an intervention enhances opportunities for subpopulations and makes systems that affect health and the social determinants of health more equitable. We also collected characteristics about clearinghouses including topic areas covered, host organization, and availability of search functions that allow users to filter interventions by specific health equity subpopulations or topic areas.
We conducted a comparative analysis of clearinghouses with publicly available health equity impact reviews on their websites. Our analysis explored how clearinghouses communicated an intervention’s health equity impact and reviewed their health equity definition and underlying methods. The analysis was guided by these key questions: (1) how does the clearinghouse define equity, and how does the definition guide their health equity impact review? (2) Does the clearinghouse assess the impact an intervention has on disparities, equity, or both? (3) How does the clearinghouse review an intervention’s health equity impact and present results? (4) Are the health equity impact review methods publicly available? (5) What population groups (e.g., racial, gender, geography) does the clearinghouse consider when examining equity impact? (6) What equity-related intervention characteristics (e.g., intervention level — individuals, communities, and systems change; targeting approach — universal, targeted, and combined) does the clearinghouse consider in the health equity impact review?
We identified 18 clearinghouses that assigned an intervention effectiveness rating. Ten clearinghouses were hosted by governmental agencies, and eight were hosted by academic institutions or nonprofit organizations (see Supplementary material). Most clearinghouses (N = 14) provided search filters to identify interventions for populations experiencing disadvantages or interventions aiming for an equity-enhancing goal, such as target population (e.g., racial or age group) or setting (e.g., rural) (see Supplementary material). However, most clearinghouses (61%) did not assess evidence for an intervention’s impact on existing health disparities or inequity. Generally, clearinghouses assessed an intervention’s effectiveness based on average effects and did not consider differential impacts across population groups. Most clearinghouses did not consider how an intervention contributes to worsening, sustaining, or reducing existing disparities or inequities. Only seven of the 18 clearinghouses conducted health equity impact reviews: Blueprints for Healthy Youth Development (Blueprints), California Evidence-Based Clearinghouse for Child Welfare (CEBC), CrimeSolutions,Footnote 2 Home Visiting Evidence of Effectiveness (HomVEE), Maternal and Child Health (MCH) Innovations Database (limited to the content published after MCH Innovation Hub was redesigned in May 2021), The Guide to Community Preventive Services (The Community Guide), and What Works for Health (WWFH). In the following sections, we present our in-depth analyses of the seven clearinghouses.
Clearinghouse Definitions of Equity
We compared how all 18 clearinghouses defined or operationalized equity by analyzing their vision and mission statements as well as any public information about equity or similar concepts on the clearinghouse and its host organization’s webpages. Eleven clearinghouses that did not conduct a health equity impact review also did not provide any explicit definitions or a vision statement about equity. Among the seven clearinghouses conducting a health equity impact review, three clearinghouses (The Community Guide, WWFH, and MCH) explicitly connected health equity to equal and just opportunities to be healthy. Two (WWFH and MCH) provided a clear definition of health equity and stated that health equity is an organizational core value via their vision statement. Two clearinghouses (The Community Guide and WWFH) addressed the social determinants of health to explain what causes health disparities. One clearinghouse (CEBC) acknowledged existing disparities with discussion about potential effects of biases and societal factors on such disparities but did not provide a clear definition of equity nor a vision statement. Three clearinghouses (Blueprints, CrimeSolutions, and HomVEE) did not provide any explicit definitions or a vision statement about equity (see Table 1).
Focus on Disparities in Outcomes vs. Equity in Design and Implementation
Interventions can be reviewed for impacts on disparities in their outcomes (e.g., reduced disparities in access to affordable housing between racial groups), equity in their design and implementation (e.g., equitable design and implementation in housing programs), or both. Five of the seven clearinghouses examined an intervention’s impact on disparities in health outcomes and relevant social determinants of health (Blueprints, CrimeSolutions, HomVEE, The Community Guide, and WWFH). Other clearinghouses examined both disparities in outcomes and equity in implementation. CEBC focused on an intervention’s potential impact on racial outcomes and equity in implementation among families, staff, and agencies engaged in the decision-making process in the child welfare system. MCH also examined both disparities in outcomes and equity in implementation. For example, MCH assessed how equitably practices were performed among staff and stakeholders in program design, delivery, and implementation.
Presentation of Health Equity Impact Review Findings
We identified three distinct, but not exclusive approaches clearinghouses used to communicate health equity impact review findings. One approach used by clearinghouses was to summarize study findings on differential impact, including subgroup analysis findings for subsets of participants within a study or for subsets of studies with different study characteristics (e.g., effectiveness of an intervention implemented in different geographical locations). A second approach was to curate a list of interventions that could reduce disparities or enhance equity. A third approach was to assign a disparity/equity rating to each intervention.
All seven clearinghouses used at least one of these approaches (Table 1). Blueprints, CrimeSolutions, and HomVEE summarized subgroup analysis findings. Blueprints provided research findings related to differences in intervention effects across subgroups and among various social identities (e.g., “Study 1 found the intervention effect on intention to refuse substances was stronger for female students than male students”). CrimeSolutions reported subgroup effects by broad types of characteristics of participants and programs, such as participants’ social status, criminal record, program activities, and program completion status. HomVEE also reviewed subgroup findings by broad types of participant and program characteristics, such as maternal psychological resources level. However, it only reported subgroup findings replicated in distinct samples.Footnote 3
CEBC and The Community Guide curated a subset of interventions that may reduce disparities or inequities. CEBC grouped 13 programs that have the potential to reduce disparities in child welfare. The Community Guide curated 12 policies and programs in education and housing that could reduce health inequity. For those interventions, The Community Guide reported subgroup findings and reviewed intervention effects by different subpopulations such as age groups and racial/ethnic groups with consideration of applicability and generalizability.
Both WWFH and MCH rated each intervention based on their potential impact on health equity and summarized research findings (including subgroup analysis). WWFH assessed a policy or program’s likely effect on disparities and assigned one of three disparity ratings: likely to decrease disparities, no impact on disparities likely, or likely to increase disparities. Like The Community Guide, WWFH analyzed subgroup findings and various intervention effects by different populations, but such information was not presented in a separate designated section of an intervention’s page. MCH incorporated a health disparity and equity impact assessment into its overall assessment of practice impact and then assigned one of four designations to each practice: cutting-edge practice, emerging practice, promising practice, or best practice. MCH also described subgroup findings and how the practice contributed to reducing health inequities.
Transparency About Methods to Assess an Intervention’s Health Equity Impact
In general, the seven clearinghouses provided an overview of how they assess an intervention’s potential impact on health equity, but most lacked enough detail about their methods on their website to be replicated. For the clearinghouses that curated a subset of interventions, CEBC’s criteria for interventions to be included in their list was the “program must specifically target the reduction of disparities and/or disproportionality in the child welfare system either in general or for a specific case (California Evidence-Based Clearinghouse for Child Welfare, n.d.).” However, practitioners must infer how an intervention addresses disparity and disproportionality in the system based on the target population, program goals, and the research review summaries. The Community Guide described how it prioritized the social determinants of health topic and subtopics in education and housing and that it “considered health equity across all systematic reviews (The Guide to Community Preventive Services, n.d.).” However, we could not find additional information on how the interventions in the list were selected over others. Both CEBC and The Community Guide included interventions that did not have enough evidence to demonstrate actual impacts on health equity, indicating that the intervention effectiveness did not seem to inform the selection of interventions.
For clearinghouses that assigned a disparity/equity rating, we could not find clear rationale to help users understand why interventions were assigned a rating. WWFH assigned a disparity rating to an intervention “based on its characteristics (e.g., target population, mode of delivery, cultural considerations, etc.) and best available evidence related to disparities in health outcomes (What Works for Health, n.d.),” without additional information on specific criteria for each rating. MCH provided practitioners with the minimum criteria checklist to help users assess their own practices. MCH’s equity-related criteria for its highest rating designation, “Best practice,” were described as a practice that “provides evaluation data that demonstrate how it has addressed health inequities and/or systemic oppression that impact a key population (Association of Maternal & Child Health Programs, n.d.).” However, MCH did not specify the amount and quality of evidence needed to meet each designation. HomVEE clarified the definition of a subgroup and the protocol for reviewing and reporting subgroup analyses. Specifically, HomVEE reviewed replicable subgroups and reported subgroup results only from replicated subgroups to ensure “that evidence of effectiveness is not due simply to chance” (Sama-Miller et al., 2021). Blueprints and CrimeSolutions did not describe how they review subgroup analyses of individual studies.
In terms of literature sources and study design, MCH used evaluations in addition to experimental studies, including pre-post studies, testimonials, and qualitative studies to inform its equity impact review. The remaining clearinghouses did not describe the types of sources or the standards used to assess the evidence in their health equity impact review. In most cases, we can assume that subgroup analysis was based on the same literature used to determine an intervention’s effectiveness rating.
Health Equity Population Groups of Interest
All seven clearinghouses assessed evidence by racial and ethnic groups (Table 1). Apart from CEBC, which only assessed racial and ethnic disparities in the child welfare system, clearinghouses explored various other population groups. Five clearinghouses examined an intervention’s impacts by socioeconomic status (SES) (e.g., high vs. low SES), four by level of urbanization (e.g., urban vs. rural), three by age group (e.g., older vs. younger participants), and two by gender group (e.g., male vs. female).
Equity-Related Intervention Characteristics
Most clearinghouse considered various levels of intervention for the health equity impact review (Table 1). The list of interventions that CEBC curated included a mix of child- and family-level services and programs and child welfare agency-level staff trainings and practices. The Community Guide focused on the social determinants of health and higher-level interventions to reduce health inequities, specifically housing and education policies for community- and system-level changes. For each housing and education intervention, The Community Guide described how homelessness and educational inequities are closely related to health disparities. For the four clearinghouses that conducted health equity impact reviews for all interventions in their databases (Blueprints, CrimeSolutions, WWFH, and MCH), they included interventions with different intervention levels. Programs for individual-, family-, and community-level changes were most common. These clearinghouses also addressed some higher-level interventions: for example, school reform (Blueprints), policing practices in the justice system (CrimeSolutions), taxation and housing policies (WWFH), and system-level practices intended for system building, shifting power, and inter-sectoral collaboration (MCH). HomVEE addressed family-level interventions only.
We also examined how an intervention’s targeting approach (i.e., universal versus targeted) was considered in a clearinghouse’s disparity impact review (Table 1). CEBC explicitly curated all targeted interventions for ethnic minority children and families involved in the child welfare system. CrimeSolutions primarily had interventions that target individuals in crisis or at risk of violence, particularly offenders and victims. HomVEE assessed home visiting interventions that serve at-risk pregnant women and families with young children. The remaining four clearinghouses included a mix of universal and targeted interventions, for example, The Community Guide’s health equity intervention list included universal education interventions and housing policies exclusively for individuals with lower incomes. The four clearinghouses’ reviews of individual study findings or disparity-related rating assignments did not appear to vary by the intervention’s targeting approach.
The majority of the 18 clearinghouses identified in our systematic scan did not have an explicit focus on health equity. The clearinghouses that conducted health equity impact reviews varied in their definitions of equity, priority populations included, health equity review methods, and presentation of review findings. Clearinghouses used different approaches to complete health equity impact reviews and lacked transparency about their underlying methods which demonstrates that the field is in a developmental phase for this form of translational research and has yet to reach consensus on how to assess interventions for their potential effectiveness in advancing health equity. This study did not assess which approaches to conducting and communicating findings of a health impact review were most effective for user-uptake. Future research should examine the most appropriate methods and how to distill equity-focused information for practitioners. Research that examines specific gaps in the literature should also be a priority so that clearinghouses can work with researchers to focus their studies in ways that fill evidence gaps.
A New Role for Clearinghouses: Opportunities and Barriers
Clearinghouses can be instrumental in helping practitioners understand an intervention’s potential impact on health equity. Clearinghouses have traditionally played a key role in disseminating scientific findings to help users find evidence-informed interventions to meet their needs and goals (Paulsell et al., 2017). Clearinghouses can go beyond simple assessment of average effectiveness and instead consider how interventions influence existing disparities and inequities. This move could support practitioners in their attempts to advance equity and further influence practitioners’ decision-making and policy preferences (NASEM, 2017b). In the systematic review process that some clearinghouses use for their comprehensive research synthesis, researchers have started to pay more attention to equity-focused systematic reviews, and some researchers started to conduct systematic reviews of an intervention’s equity impact (Garnett et al., 2022; Lehne & Bolte, 2017; Smith et al., 2017; Turnbull et al., 2020). However, clearinghouses are not able to conduct equity impact reviews when there is a dearth of equity-focused research, including a lack of studies that systematically analyze subgroup effects with rigor that allow for a substantial assessment of potential impact on health equity.
There is often tension between what researchers study and what information practitioners need to implement an intervention. Although practitioners typically value the relevance of local context, researchers often value methodologies that produce high internal validity, like randomized control trials, which by design reduce the nuance of local context (Alvidrez et al., 2019). Practitioners often need to consider factors outside evidence of average effectiveness, including relevance of the intervention for the focus population, community context, and service delivery system (Horne, 2017; Paulsell et al., 2017). This is especially the case for practitioners who may need to tailor an intervention to advance equity in their community without compromising effectiveness (Alvidrez et al., 2019). Researchers can strengthen the evidence base by assessing and reporting both average effects and differential effects among subgroups of an intervention to fully explain how the intervention works for various subpopulations and affects health disparities and inequities (Maden et al., 2017; Welch et al., 2022; Whitlock et al., 2017). Lastly, there are growing calls for researchers to apply methodologies and frameworks to better align their focus on equity (Chinman et al., 2017; Eslava-Schmalbach et al., 2019; McNulty et al., 2019; Shelton et al., 2021).
Clearinghouses can inform research agendas by calling attention to the need for an evidence base on the equity impact of interventions. Clearinghouses can also uplift system changes and interventions at various levels — individual, community, and systems change — to advance health equity. In addition, clearinghouses can broaden the types of evidence they assess so they are not limited by evidence produced through experimental designs or by what is published in peer reviewed journals. However, legislation that established federal clearinghouses may limit the types of interventions included and types of evidence assessed.
Although there are opportunities for clearinghouses to lead in aligning methods and better supporting practitioners who want to advance equity, they are limited by staffing and financial constraints, completing timely reviews, and understanding what level of detail practitioners need to inform their work (Burkhardt et al., 2015).
Strengths and Limitations
This study has several strengths. The list of clearinghouses we identified included both government- and non-government-hosted clearinghouses and covered diverse topic areas addressing the social determinants of health. This captured a wide breadth of clearinghouses and their approach to equity. Another strength of this study is that we examined how clearinghouses conducted equity impact reviews from various angles, by analyzing not only clearinghouses’ approaches to communicating an intervention’s impact on equity, but also how they defined equity and considered intervention characteristics that can advance equity.
This study is not without limitations. First, despite a systematic approach to identifying clearinghouses for this study, the list was not exhaustive due to the refined search terms and research scope, emergence of tools, or their mode of dissemination for practitioners. For example, clearinghouses with state- or sector-specific focus and no explicit health tie (e.g., Ohio Evidence-based Clearinghouse, Evidence for ESSA, CASEL Program Guide) did not surface using our methods but were identified by experts who reviewed this manuscript. Second, this study relied on publicly available information from each clearinghouse’s website. Therefore, the information we collected might not fully represent the clearinghouses’ approaches to equity. Third, the comparative analysis used a qualitative review and does not preclude bias in authors’ interpretation of collected clearinghouse information. Specifically, because the authors were part of one of the selected clearinghouses and conducted a non-blind review, the interpretation was not able to be completely separated from the authors’ established definitions and values. Finally, this research paper summarizes information on the state of health equity methods among evidence clearinghouses but does not evaluate the effectiveness of these methods as this was beyond the scope of this paper. Future research will address the effectiveness of various methods for equity impact review and their communication and translation to action.
This is the first study to our knowledge that examined how and the extent to which clearinghouses considered equity in their review of evidence. Clearinghouses play an important role in assessing and summarizing evidence for practitioners, but clearinghouses are not able to fully conduct health equity impact reviews until there is a sufficient underlying evidence base for the differential effects of interventions among population groups or social identities. This study found that most clearinghouses have not yet incorporated a health equity impact review and those who have are not aligned or explicit about how health equity is defined and operationalized. Advancing equity through an evidence-informed approach will require researchers to conduct more equity-focused research and clearinghouses to evolve as practice-oriented tools with health equity impact reviews based on clear and transparent underlying definitions, values, and methods.
All data generated or analyzed during this study are included in this published article and its supplementary material.
One clearinghouse, Home Visiting Evidence of Effectiveness (HomVEE), was initially reviewed in December 2021 with the other clearinghouses and again in 2023 during manuscript revision. The analysis for HomVEE still reflects information from December 2021.
Model Programs Guide by Office of Juvenile Justice Delinquency Prevention shared a database of juvenile programs with CrimeSolutions and was excluded.
Beginning with its 2021 annual review, HomVEE started listing which subgroups were examined in a study on the details page of each manuscript where the quality of findings was rated as moderate or high. Subgroup findings were not reported unless replicated.
Alvidrez, J., Nápoles, A. M., Bernal, G., Lloyd, J., Cargill, V., Godette, D., Cooper, L., Heart, H. B., & M. Y., Das, R., & Farhat, T. (2019). Building the evidence base to inform planned intervention adaptations by practitioners serving health disparity populations. American Journal of Public Health, 109(S1), S94–S101. https://doi.org/10.2105/AJPH.2018.304915
Association of Maternal & Child Health Programs. (n.d.). Minimum criteria checklist. Retrieved December 1, 2021, from https://amchp.org/wp-content/uploads/2022/04/Minimum-Criteria-Checklist.pdf
Bergum, A., Grigg, L., Givens, M.L., Booske Catlin, B., & Willems Van Dijk, J. (2019). How to be an informed consumer of evidence ratings: It’s in the details. Preventing Chronic Disease, 16. https://doi.org/10.5888/pcd16.190067
Braveman, P., Egerter, S., & Williams, D. R. (2011). The social determinants of health: Coming of age. Annual Review of Public Health., 32, 381–398. https://doi.org/10.1146/annurev-publhealth-031210-101218
Braveman, P., Arkin, E., Orleans, T., Proctor, D., & Plough, A. (2017). What is health equity? And what difference does a definition make? Robert Wood Johnson Foundation. https://www.rwjf.org/en/library/research/2017/05/what-is-health-equity-.html
Brown, A. F., Ma, G. X., Miranda, J., Eng, E., Castille, D., Brockie, T., Jones, P., Airhihenbuwa, C. O., Farhat, T., Zhu, L., & Trinh-Shevrin, C. (2019). Structural interventions to reduce and eliminate health disparities. American Journal of Public Health, 109(S1), S72–S78. https://doi.org/10.2105/AJPH.2018.304844
Brownson, R. C., Eyler, A. A., Harris, J. K., Moore, J. B., & Tabak, R. G. (2018). Getting the word out: New approaches for disseminating public health science. Journal of Public Health Management and Practice, 24(2), 102–111. https://doi.org/10.1097/PHH.0000000000000673
Buckley, P. R., Ebersole, C. R., Steeger, C. M., Michaelson, L. E., Hill, K. G., & Gardner, F. (2022). The role of clearinghouses in promoting transparent research: A methodological study of transparency practices for preventive interventions. Prevention Science., 23(5), 787–798. https://doi.org/10.1007/s11121-021-01252-5
Buckley, P. R., Fagan, A. A., Pampel, F. C., & Hill, K. G. (2020). Making evidence-based interventions relevant for users: A comparison of requirements for dissemination readiness across program registries. Evaluation Review, 44(1), 51–83. https://doi.org/10.1177/0193841X20933776
Burkhardt, J. T., Schröter, D. C., Magura, S., Means, S. N., & Coryn, C. L. (2015). An overview of evidence-based program registers (EBPRs) for behavioral health. Evaluation and Program Planning, 48, 92–99. https://doi.org/10.1016/j.evalprogplan.2014.09.006
California Evidence-Based Clearinghouse for Child Welfare. (n.d.). Reducing racial disparity and disproportionality in child welfare: Programs. Retrieved December 1, 2021, from https://www.cebc4cw.org/topic/reducing-racial-disparity-and-disproportionality-in-child-welfare/
Chinman, M., Woodward, E. N., Curran, G. M., & Hausmann, L. (2017). Harnessing implementation science to increase the impact of health equity research. Medical Care, 55(Suppl 9 2), S16–S23. https://doi.org/10.1097/MLR.0000000000000769
Claridge, J. A., & Fabian, T. C. (2015). History and development of evidence-based medicine. World Journal of Surgery., 29, 547–553. https://doi.org/10.1007/s00268-005-7910-1
Commission on Social Determinants of Health. (2008). Closing the gap in a generation: Health equity through action on the social determinants of health. Final Report of the Commission on Social Determinants of Health. Geneva, World Health Organization.
Eslava-Schmalbach, J., Garzón-Orjuela, N., Elias, V., & Langlois, E. V. (2019). Conceptual framework of equity-focused implementation research for health programs (EquIR). International Journal for Equity in Health, 18, Article Number 80. https://doi.org/10.1186/s12939-019-0984-4
Garnett, A., Northwood, M., Ting, J., & Sangrar, R. (2022). mHealth interventions to support caregivers of older adults: Equity-focused systematic review. JMIR Aging, 5(3), e33085. https://doi.org/10.2196/33085
Higgins, J. P. T., Thomas, J., Chandler, J., Cumpston, M., Li, T., Page, M. J., Welch, V. A. (editors). Cochrane Handbook for Systematic Reviews of Interventions version 6.3 (updated February 2022). Cochrane, 2022. Retrieved April 30, 2022, from www.training.cochrane.org/handbook
Horne, C. S. (2017). Assessing and strengthening evidence-based program registries’ usefulness for social service program replication and adaptation. Evaluation Review, 41(5), 407–435. https://doi.org/10.1177/0193841X15625014
Jaciw, A. P. (2020). Are estimates of differential impact from quasi-experiments less prone to selection bias than average impact quantities? San Mateo, CA: Empirical Education Inc. https://www.empiricaleducation.com/pdfs/SelectionBias.pdf
Jansen, J. P., Trikalinos, T. A., & Phillips, K. A. (2022). Assessments of the value of new interventions should include health. PharmacoEconomics, 40, 489–495. https://doi.org/10.1007/s40273-022-01131-z
Lehne, G., & Bolte, G. (2017). Impact of universal interventions on social inequalities in physical activity among older adults: An equity-focused systematic review. International Journal of Behavioral Nutrition and Physical Activity, 14, Article 20. https://doi.org/10.1186/s12966-017-0472-4
Macintyre, A. K., Torrens, C., Campbell, P., Maxwell, M., Pollock, A., Biggs, H., Woodhouse, A., Williams, J. M., & McLean, J. (2020). Socioeconomic inequalities and the equity impact of population-level interventions for adolescent health: An overview of systematic reviews. Public Health, 180, 154–162. https://doi.org/10.1016/j.puhe.2019.11.008
Mackey, A., & Bassendowski, S. (2017). The history of evidence-based practice in nursing education and practice. Journal of Professional Nursing., 33(1), 51–55. https://doi.org/10.1016/j.profnurs.2016.05.009
Maden, M. (2016). Consideration of health inequalities in systematic reviews: A mapping review of guidance. Systematic Reviews, 5, 202. https://doi.org/10.1186/s13643-016-0379-1
Maden, M., Cunliffe, A., McMahon, N., Booth, A., Carey, G. M., Paisley, S., Dickson, R., & Gabbaby, M. (2017). Use of programme theory to understand the differential effects of interventions across socio-economic groups in systematic reviews - A systematic methodology review. Systematic Reviews, 6, 266. https://doi.org/10.1186/s13643-017-0638-9
Mayo-Wilson, E., Grant, S., & Supplee, L. H. (2022). Clearinghouse standards of evidence on the transparency, openness, and reproducibility of intervention evaluations. Prevention Science., 23(5), 774–786. https://doi.org/10.1007/s11121-021-01284
McNulty, M., Smith, J. D., Villamar, J., Burnett-Zeigler, I., Vermeer, W., Benbow, N., Gallo, C., Wilensky, U., Hjorth, A., Mustanski, B., Schneider, J., & Brown, C. H. (2019). Implementation research methodologies for achieving scientific equity and health equity. Ethnicity & Disease, 29(Suppl 1), 83–92. https://doi.org/10.18865/ed.29.S1.83
Means, S. N., Magura, S., Burkhardt, J. T., Schröter, D. C., & Coryn, C. L. (2015). Comparing rating paradigms for evidence-based program registers in behavioral health: Evidentiary criteria and implications for assessing programs. Evaluation and Program Planning, 48, 100–116. https://doi.org/10.1016/j.evalprogplan.2014.09.007
Milton, B., Moonan, M., Taylor-Robinson, D., & Whitehead, M. (2011). How can the health equity impact of universal policies be evaluated. Insights into approaches and next steps WHO Collaborating Centre for Policy Research on Social Determinants of Health. https://www.euro.who.int/__data/assets/pdf_file/0019/155062/E95912.pdf
National Academies of Sciences, Engineering, and Medicine. (2017a). Communities in action: Pathways to health equity. Washington, DC: The National Academies Press. https://doi.org/10.17226/24624
National Academies of Sciences, Engineering, and Medicine. (2017b). Communicating science effectively: A research agenda. Washington, DC: The National Academies Press. https://doi.org/10.17226/23674
O’Neill, J., Tabish, H., Welch, V., Petticrew, M., Pottie, K., Clarke, M., Evans, T., Pardo Pardo, J., Waters, E., White, W., & Tugwell, H. (2014). Applying an equity lens to interventions: Using PROGRESS ensures consideration of socially stratifying factors to illuminate inequities in health. Journal of Clinical Epidemiology, 47(1), 56–64. https://doi.org/10.1016/j.jclinepi.2013.08.005
Paulsell, D., Thomas, J., Monahan, S., & Seftor, N. S. (2017). A trusted source of information: How systematic reviews can support user decisions about adopting evidence-based programs. Evaluation Review, 41(1), 50–77. https://doi.org/10.1177/0193841X16665963
Sama-Miller, E., Lugo-Gil, J., Harding, J., Akers, L., & Coughlin, R. (2021). Home visiting evidence of effectiveness (HomVEE) systematic review: Handbook of procedures and evidence standards, version 2.1. OPRE Report # 2021–195, Washington, DC: Office of Planning, Research, and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. Retrieved January 15, 2023, from https://homvee.acf.hhs.gov/sites/default/files/2021-11/HomVEE-Handbook-v2.1-Nov-2021.pdf
Shelton, R. C., Adsul, P., Oh, A., Moise, N., & Griffith, D. M. (2021). Application of an antiracism lens in the field of implementation science (IS): Recommendations for reframing implementation research with a focus on justice and racial equity. Implementation Research and Practice. https://doi.org/10.1177/26334895211049482
Smith, M., Hosking, J., Woodward, A., Witten, K., MacMillan, A., Field, A., Baas, P., & Mackie, H. (2017). Systematic literature review of built environment effects on physical activity and active transport – An update and new findings on health equity. International Journal of Behavioral Nutrition and Physical Activity, 14, Article 158. https://doi.org/10.1186/s12966-017-0613-9
Solar, O., & Irwin, A. (2010). A conceptual framework for action on the social determinants of health. World Health Organization. https://www.who.int/publications/i/item/9789241500852
Stack, K. (2018). The Office of Management and Budget: The quarterback of evidence-based policy in the federal government. The ANNALS of the American Academy of Political and Social Science, 678(1), 112–123. https://doi.org/10.1177/0002716218768440
The Guide to Community Preventive Services. (n.d.). Health equity. The Community Preventive Services Task Force. Retrieved December 1, 2021, from https://www.thecommunityguide.org/topic/health-equity
Thornton, T. L. J., Glover, C. M., Cene, C. W., Clik, D. C., Henderson, J. A., & Williams, D. R. (2016). Evaluating strategies for reducing health disparities by addressing the social determinants of health. Health Affairs, 35(8). https://doi.org/10.1377/hlthaff.2015.1357
Turnbull, S., Cabral, C., Hay, A., & Lucas, P. J. (2020). Health equity in the effectiveness of web-based health interventions for the self-care of people with chronic health conditions: Systematic review. Journal of Medical Internet Research, 22(6), Article e17849. https://doi.org/10.2196/17849
Van Horn, M. L., Jaki, T., Masyn, K., Howe, G., Feaster, D. J., Lamont, A. E., George, M. R., & Kim, M. (2015). Evaluating differential effects using regression interactions and regression mixture models. Educational and Psychological Measurement, 75(4), 677–714. https://doi.org/10.1177/0013164414554931
Welch, V., Dewidar, O., Tanjong Ghogomu, E., Abdisalam, S., Al Ameer, A., Barbeau, V. I., Brand, K., Kebedom, K., Benkhalti, M., Kristjansson, E., Madani, M. T., Antequera Martín, A. M., Mathew, C. M., McGowan, J., McLeod, W., Park, H. A., Petkovic, J., Riddle, A., . . . Wells, G. A. (2022). How effects on health equity are assessed in systematic reviews of interventions. Cochrane Database of Systematic Reviews, 1. Article MR000028. https://doi.org/10.1002/14651858.MR000028.pub3
What Works for Health. (n.d.). Our ratings. County Health Rankings & Roadmaps. Retrieved December 1, 2021, from https://www.countyhealthrankings.org/take-action-to-improve-health/what-works-for-health/our-ratings
Whitlock, E. P., Eder, M., Thompson, J. H., Jonas, D. E., Evans, C. V., Guirguis-Blake, J. M., & Lin, J. S. (2017). An approach to addressing subpopulation considerations in systematic reviews: The experience of reviewers supporting the U.S. Preventive Services Task Force. Systematic Reviews, 6, Article 41. https://doi.org/10.1186/s13643-017-0437-3
The authors would like to thank Bridget Catlin, Amanda Gatewood, Lael Grigg, and Christine Muganda for providing feedback on the draft manuscript. We’d also like to acknowledge assistance from colleagues: Ben Case, Kiersten Frobom, Gillian Giglierano, Ksenia Kostelanetz, Naiya Patel, Jessica Rubenstein, and Jessica Solcz.
This work was supported by the University of Wisconsin Population Health Institute and the Robert Wood Johnson Foundation. The views expressed here do not necessarily reflect the views of the Institute or the Foundation.
Consent to Participate
Conflict of Interest
The authors are affiliated with What Works for Health, one of the evidence clearinghouses discussed in this manuscript. The authors have no relevant financial or non-financial interests to disclose.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Below is the link to the electronic supplementary material.
About this article
Cite this article
Hirsch, B.K., Stevenson, M.C. & Givens, M.L. Evidence Clearinghouses as Tools to Advance Health Equity: What We Know from a Systematic Scan. Prev Sci 24, 613–624 (2023). https://doi.org/10.1007/s11121-023-01511-7