Introduction

The World Health Organization (WHO) estimates that chronic diseases account for 71% of mortality globally, amounting to 41 million deaths each year [1, 2]. Addressing increasing rates of chronic disease is important to improving health, healthcare spending, and quality of life [3,4,5]. To optimize the use of public health funding, public health and community-oriented practitioners should focus on evidence-based interventions, products, and policies that show promise for implementation in community settings [6]. There is a pressing need to translate empirically supported interventions, products, and policies into practice to prevent and control prevalent chronic diseases.

The Knowledge to Action (K2A) Framework is useful for understanding and informing the process of how research is translated into practice and ultimately institutionalized in public health and community settings [7]. The Centers for Disease Control and Prevention’s (CDC) Work Group on Translation, comprised of various divisions within the National Center for Chronic Disease Prevention and Health Promotion, created the K2A Framework [7]. The K2A Framework describes three phases necessary to move knowledge into sustainable action, including the research phase (e.g., efficacy and effectiveness research), the translation phase (e.g., decision to translate knowledge into products, decision to adopt), and the institutionalization phase (e.g., establishing the intervention activities, creating norms within communities) [7, 8]. Moreover, K2A describes the importance of supporting structures within each phase as well as evaluation to move discovery into action [8]. The framework was designed to be relevant regardless of the disease, condition, or risk factor being addressed. K2A also applies to many types of evidence-based programs, policies, interventions, guidelines, tool kits, strategies, and/or messages (hereafter referred to as “interventions”) and works best if research and practice communities are in collaboration [7, 8].

The K2A Framework identifies the “decision to translate” as a pivotal transition step from the research phase to the translation phase. In this step, those responsible for developing or testing the intervention (often the researchers) and those in organizations likely to use them decide whether there is adequate evidence to create an actionable product or to propel an evidence-based intervention into widespread use [8]. Only those interventions deemed “ready” for translation are likely to be disseminated, adopted, implemented, and ultimately institutionalized. Yet, this pivotal step has not received adequate study [9]. Although the K2A framework does have some shortcomings, including that it specifically focuses on evidence-based programs, practices, and policies, and somewhat ignores research products (e.g., tools, indices, technologies) and that it largely targets public health professionals (ignoring the potential use for practitioners or community stakeholders), it is a landmark tool for guiding research translation [8].

In the CDC’s 2018 Request for Applications for Health Promotion and Disease Prevention Research Centers, applicants were required to describe how they would undertake three activities related to translation: (1) propose a prevention research and translation agenda, (2) engage translation partners to increase the translation of research findings into public health practice, and (3) conduct activities to support the translation of center products. In response to the second and third required activities, the University of South Carolina Prevention Research Center proposed to establish criteria to determine if a product or program resulting from our Center’s research is ready for translation and to solicit feedback from community stakeholders on the criteria. These criteria can then be used to prioritize interventions for translation, determine what adaptations may be necessary for translation into a specific setting, and determine whether additional training or resources are needed for the intended audience.

This paper describes the process used to establish criteria for the decision to translate and highlights considerations that can be used to evaluate or compare empirically supported interventions and their readiness for translation. Much has been published in the field of implementation science about factors that influence the adoption, implementation, and dissemination of evidence-based interventions [10,11,12,13,14,15,16,17,18,19]. Some of these factors likely apply to the decision to translate interventions, while others may not. Furthermore, unlike models that guide the study of adoption, implementation, and dissemination, comprehensive frameworks or models do not appear to exist to help researchers and organizational partners decide which interventions are most suitable for translation [13]. Nonetheless, establishing criteria for the decision to translate can be informed by several areas of investigation, including “designing for dissemination,” [20] consideration of specific intervention characteristics that facilitate research translation and dissemination [21,22,23,24], and review of factors important for implementation [15,16,17, 25, 26]. Such criteria are especially needed in community-based research, where researchers, public health-related agencies, and organizations collaborate. The voices of community partners are critical in this process, as they can enhance the quality and relevance of translated research [27].

The purpose of this paper was to create a holistic list of criteria that can be used by researchers, in collaboration with community partners, to help evaluate intervention readiness for translation into community and/or organizational settings. Specifically, research objectives include (1) systematically review existing literature focused on factors influencing translation of empirically supported interventions into community settings and (2) develop a list of factors that have influenced community translation of empirically supported interventions in past research that can be used as criteria for the decision to translate. Since the K2A framework is a well-known planning tool that uniquely highlights the decision to translate and other key aspects of the research translation phase [7], it was used to inform this systematic review. Specifically, the K2A Framework was a starting point in this process and was augmented by a systematic literature review combined with consideration of researcher and community partner input.

Methods

The identification and selection of criteria began with a review of K2A questions from the “decision to translate” stage and then involved conducting a literature review to identify characteristics important for research translation in community settings, using thematic analysis to select unique research translation decision criteria, and soliciting and incorporating researcher and community advisory board feedback.

Knowledge to Action (K2A) Framework

The “decision to translate” stage of the K2A Framework includes 8 planning questions to help decide whether an intervention is ready to move forward for translation (e.g., Is this intervention needed? Is there broad support or buy-in to translate the intervention into practice?) [8]. These questions were converted to items on our coding manual and were used as a starting point for developing criteria for the decision to translate research.

Literature review search strategy

Our next step was to conduct a systematic literature review to understand criteria or factors presented in past research that were relevant to research translation. The review included academic literature identifying criteria for deciding which empirically supported interventions could be effectively translated into practice as well as articles that more generally identify factors relevant to the translation process. PubMed and Google Scholar were searched for peer-reviewed articles published between January 2000 and August 2020. The primary goal of this review was to identify the most prominent literature on research translation and related decisional criteria, so we did not undertake the time-consuming task of integrating a comprehensive list of academic databases. Although some published research identifying factors that impact research translation may not have appeared in our searches, it is unlikely that critical criteria were missed that were not captured by these two databases. PubMed contains more than 32 million citations for biomedical literature from MEDLINE, life science journals, and online books, and Google Scholar contains 389 million records and is currently the most comprehensive academic search engine [28, 29].

A broad initial literature search was performed to identify common terms related to our review and to develop the final search strategy. In turn, we developed and used the following search terms: ‘translation’ OR ‘knowledge translation’ OR ‘integrated knowledge translation’ OR ‘research translation’ OR ‘research to translation’ OR ‘translation decision’ AND (‘criteria’ OR ‘decision’ OR ‘designing for dissemination’ OR ‘community setting’) under the category “Title/Abstract” between January 2000 and August 2020. We chose to only include publications after the year 2000 to ensure our findings on community interventions were relevant and to reflect important developments in the field of implementation science (e.g., creation of frameworks for community implementation) [7, 30, 31]. In the search terms, we also included names of prominent authors that have published on the topic of research translation to identify additional relevant papers.

Process for literature review study selection

Eligibility criteria included (1) research with human subjects, (2) research published in English, (3) research published between 2000 and 2020, (4) peer-reviewed articles or academic literature, and (5) research conducted in community settings. Specifically, community-based research was the focus of this review due to its relevance to our research team, and because the differences in the application and scope of research translation between community versus clinical settings can be substantial. Community settings were defined as “settings for which the primary purpose is not medical care, for example, geographic communities, schools, churches, homeless shelters, worksites, libraries” [32]. Research in community settings can include studies conducted over the phone, online, or in-person that engage groups of people or organizations that are defined by a function, geography, shared interests, or specific characteristics [33].

Titles and abstracts of articles identified through the search strategy were imported into Zotero, and duplicates were removed. Articles were evaluated for eligibility based on the criteria previously stated (i.e., community setting, human subjects, including criteria that could inform the decision to translate research) by a first reviewer (MW). An additional reviewer (SW), with substantial expertise in the field of research translation, provided input throughout the process towards improving the search terms and identifying relevant articles. At the critical full-text review stage, remaining articles were independently screened for eligibility by the first reviewer (MW), while a second reviewer (ZR) screened all articles using the same eligibility and inclusion criteria. One reviewer (MW) compiled data from each article in a Microsoft Excel database, including titles/authors, publication year, objectives, translational products, criteria/factors identified as important for community translation, and literature gaps addressed. Secondary reviewers (SW, ZR) checked data entry for accuracy and completeness. Discussions were held among all reviewers to resolve any remaining conflicts on article inclusion.

Criteria development and selection

The criteria identified from the literature review, including criteria from the K2A Framework that were also noted in selected articles, were combined to form a full list of potential criteria. One researcher (MW) reviewed the full-text articles identified in the literature review for the presence of the constructs related to the decision for research translation of interventions. The researcher used a deductive and inductive thematic analysis approach, guided by constructs of the K2A framework (i.e., codes related to importance of evidence base, relation to a high-priority public health issue, alignment with constituent needs, comparability to other interventions, support or buy-in for translation, presence of supporting structures, economic considerations, adaptability to contextual changes) [34,35,36]. Emergent themes included any factors that past literature highlighted as important for research translation or dissemination or factors that specifically impacted research translation or dissemination for a certain intervention in practice. Each article was independently reviewed by one researcher (MW), who met periodically throughout the entire article review process to discuss findings with a second expert (SW) and adapt the review process when necessary. In these discussions, the researchers decided that themes that identify intervention and population-level barriers or facilitators to research translation should be included in the criteria list. As an example, some studies reported results from the evaluation of interventions and noted decisions that were made about how to move a study from a controlled pilot to wide-scale dissemination. Other articles described the contextual factors that were advantageous for translating research into community practice.

These resultant criteria were subsequently reviewed by three researchers and members of the University of South Carolina Prevention Research Center Community Advisory Board to improve the language and ensure all criteria were relevant and no criteria were overlooked. All three researchers had familiarity or expertise in research translation and/or community-based participatory research. Thirteen Community Advisory Board members were from diverse sectors, including faith-based organizations, public health, economic and community development, physical activity and healthy eating coalitions, and community-based research initiatives. Community Advisory Board members were led through a process where they generated factors that are most important in their decision to use evidence-based programs, reviewed the criteria developed by the Center, and provided input as to whether any criteria were missing, should be removed, or should be revised. Since these criteria were being developed for use by our university’s Prevention Research Center, incorporating community and research input from nationally representative locations was outside the scope of this study.

Data synthesis

Upon receiving community and expert input on the research translation decision criteria identified through our systematic review, we identified the frequency of articles mentioning each and ordered our criteria list according to the most cited (i.e., each item’s usefulness in past research). We also identified underlying frameworks used in each article to guide translation/implementation research, since this may have influenced the respective authors’ focus when outlining possible research translation criteria or factors. Lastly, we identified the frequency in which articles mentioned research translation criteria that were part of the K2A framework (the framework orienting this research).

Results

Study selection — objective 1

As shown in Fig. 1, the search terms returned 18,654 results, and a total of 66 relevant articles were included after an abstract review. After reviewing the reference lists in the selected articles and incorporating papers from other sources, 20 additional articles were identified as relevant to this review. Two reviewers (MW and ZR) screened full-text articles using the same eligibility and inclusion criteria. Their agreement rate was 88%. After a full-text review of the 86 articles identified, 40 articles were removed because they did not contain findings specific to community settings and/or did not focus on research translation. A final list of 46 articles was used to develop the research translation decision criteria for this article (Fig. 1). Information was compiled for each article identified in our search about the interventions that were being translated and the criteria that might be useful for research translation decisions (Table 1).

Fig. 1
figure 1

PRISMA diagram of included and excluded studies, with reasons for inclusion

Table 1 Research translation decision criteria described by the papers included in the review (N = 46)

Study characteristics — objective 1

The criteria for research translation used in past research outlined in Table 1 include important considerations that facilitate research translation, including contextual, organizational, or intervention characteristics. Several referenced one or more theoretical frameworks or models (n=22): ten used the Reach, Effectiveness, Maintenance, Adoption, Implementation, and Maintenance (RE-AIM) framework [20, 22, 37, 40, 41, 43, 52, 59, 60, 77], four used the Interactive Systems Framework [45,46,47, 50], two used Diffusion of Innovations theory [20, 52], two used CFIR [51, 58], one used the Predisposing, Reinforcing, and Enabling Constructs in Educational Diagnosis and Evaluation & Policy, Regulatory, and Organizational Constructs in Educational and Environmental Development (PRECEDE PROCEED) framework [41], one used the Pragmatic-Explanatory Continuum Indicator Summary (PRECIS) model [59], one used the National Institute of Environmental Health Research translational research framework [67], and one used the Evidence Integration Triangle model [59]. A total of 24 articles did not explicitly mention theoretical frameworks or models that were used to develop or apply research translation decision criteria.

Result synthesis — objective 2

Table 2 and Fig. 2 display the 17 research translation decision criteria identified through our literature review and thematic analysis. Of the 8 themes from the K2A Framework that were used to inform the thematic analysis, all 8 were included in the final criteria list after research supported their importance for research translation decision-making (Table 2, criteria 1–8). Nine additional criteria were identified in the literature that were unrelated to the K2A Framework (Table 2, criteria 9–17). During the review phase, no additional criteria were added by the researchers or Community Advisory Board members. Wording changes were suggested by the Community Advisory Board members to improve the simplicity and coherency of select criteria. For example, Community Advisory Board members suggested that wording in one instance be changed from “does not disempower marginalized communities” to “empowers communities.” The following paragraphs describe each criterion, including citations for review articles that highlight their usefulness and application.

Table 2 Research translation decision criteria identified through the literature review
Fig. 2
figure 2

Final research translation decision criteria (rows ordered from most to least cited)

As stated previously, the first 8 criteria in the list (Table 2, Fig. 2) were adapted from the K2A Framework. The first criterion is that the intervention has an adequate evidence base or that efficacy, effectiveness, or implementation studies demonstrate positive public health impacts of the intervention (e.g., research shows clinically significant benefits) [8]. Several articles (n = 20) identified in the literature search also noted this consideration for research translation [8, 22, 37,38,39,40,41, 47, 49, 51, 56, 58,59,60, 63, 65, 67, 69, 71, 73, 74], and specifically cited the importance of internal and external validity of evidence. The second criterion is that the intervention addresses a high-priority public health issue [8]. This means that the intervention addresses a chronic or acute disease affecting a significant portion of the population in the context where it is being implemented (n = 2 articles mentioned this) [8, 22, 59]. The third criterion is that the intervention meets the needs of constituents [8]. Specifically, it is important that the intervention fits with goals, norms, and practices of the population it is serving and is consistent with organizational and program needs (n = 12 articles mentioned this) [8, 21, 42, 44, 51,52,53, 56, 58, 60, 62, 65, 74]. Interventions must also maintain their same meaning after being adapted to fit the community needs [56]. The fourth criterion is that the intervention is comparable to or exceeds outcomes achieved from other available interventions [8]. The intervention should be better than available interventions or comparable but perhaps better suited for the context or population (i.e., there is a relative advantage) (n = 5 articles mentioned this) [8, 25, 41, 47, 51, 73]. The fifth criterion is that there is broad support and/or buy-in to translate the intervention into practice [8]. Research shows that the involvement of key stakeholders and implementation champions early on in the implementation process and proper organizational support are crucial for intervention success (n = 26 articles mentioned this) [8, 21, 25, 33, 39, 40, 42, 44, 46, 47, 49, 51, 54, 57,58,59, 64, 66,67,68,69, 72,73,74,75,76]. One article specifically noted the importance of having proper leadership support, with program goals and a vision that align [47]. The sixth criterion is that there are supporting structures in place (or can be put in place) to support the implementation of the intervention [8]. Resources, training programs, technical assistance, and time are necessary for proper translation, as well as the absence of competing demands, financial and organizational instability, and prevailing practices that work against the intervention goals (n = 26 articles mentioned this) [8, 14, 20,21,22, 25, 33, 39, 42, 44, 46, 47, 49,50,51,52, 54, 57, 58, 60, 62, 64, 70,71,72,73]. The seventh criterion deals with the economic evaluations of research translation, specifically that the intervention is cost-efficient and cost effective [8]. Interventions can be costly, and financial support can be hard to obtain or unreliable and can inhibit implementation efforts (n = 6 articles mentioned this) [8, 22, 25, 47, 51, 55, 60]. If funding and/or donations are available for translating the intervention, there should be some evidence that the investment will yield adequate public health impacts [8]. The eighth criterion adapted from K2A is that changes to the background or contextual factors do not adversely impact the relevance of the intervention [8]. The intervention must be amenable to changes in leadership, the sociopolitical climate, time-related barriers, or other contextual issues (n = 8 articles mentioned this) [8, 25, 40,41,42, 52, 60, 66, 67].

Additional criteria identified in the literature review are also displayed in Table 2 (and Fig. 2) and represent considerations that were not directly addressed in the K2A Framework. The ninth criterion is that the intervention must be very low cost or funding and resources must be available to sustain its implementation (n = 14 articles mentioned this) [21, 22, 25, 33, 37, 42, 46, 51,52,53, 55, 58, 73, 75]. In many contexts, funding may be scarce or unavailable but resource sharing options can promote translation and implementation [51]. The tenth criterion states that intervention must be adaptable to different settings, contexts, or audiences or at least the setting or context under study (n = 15 articles mentioned this) [14, 21, 37, 41,42,43,44, 47, 51, 52, 55, 57, 59, 61, 73]. This was a major consideration in included articles, since interventions were often translated in understudied locations/contexts. Criterion eleven underlines the importance that the intervention is culturally appropriate (n = 8 articles mentioned this) [33, 45, 48, 51, 54, 68, 72, 73], especially when health departments, academic units, or other external institutions with a history of unethical practices are involved [78,79,80,81]. As an example, researchers must continue to acknowledge past incidents, such as the Tuskegee Syphilis Study, that promote distrust for scientific institutions among populations of certain cultural, racial, and/or ethnic backgrounds [80]. Researchers cannot begin to understand and overcome low participation in public health research and programming without openly acknowledging the larger, historical context in which discrimination within the scientific community has led to mistreatment, denial of basic health care, and even death [45, 80, 81]. Adding to this, researchers must ensure interventions have culturally specific characteristics that may increase participation and positive reception [45]. Criterion twelve states that it is important that the intervention empowers communities through translation efforts (n = 3 articles mentioned this) [45, 48, 58]. Research translation should be community driven, meaning that local stakeholders and community members are ultimately autonomous over the intervention planning and participate in the translation process so that it properly addresses the community’s needs [45]. As well, criterion thirteen states that interventions that include multiple activities tend to be more effective because if one activity cannot be implemented, is not effective, or does not gain community interest, the intervention can still be carried out and have positive impacts (n = 1 article mentioned this) [21]. Criteria fourteen, fifteen, and sixteen relate to intervention sustainability: the intervention must be able to be sustained over time through strategic planning efforts (n = 6 articles mentioned this) [40, 42,43,44, 46, 52]; the intervention must be easy to learn, understand, and use for implementers and community members alike (n = 3 articles mentioned this) [21, 25, 42]; and the intervention should be packaged or manualized for easier implementation (n = 4 articles mentioned this) [42, 43, 52, 60]. Lastly, criterion seventeen states that there must be evidence that the intervention can be implemented sufficiently to yield meaningful public health impacts (n = 3 articles mentioned this) [37, 52, 56]. These can be shown through preliminary studies and can be assessed or considered before translation is initiated.

Discussion

Overall findings

This paper outlined the process used to identify and compile criteria that can be used by researchers and community partners to evaluate or compare interventions and their readiness for translation. As stated, the K2A Framework’s “decision to translate” planning questions, a literature review, a thematic analysis, and consideration of researcher and community partner input were used to develop these criteria. While there is growing interest in this research area, there is little current literature specifically on the decision to translate empirically informed interventions for public health and community-oriented researchers and practitioners, with only seven papers identified [38, 40, 42, 45, 56, 58, 75]. Additionally, there is a breadth of literature on factors that impact the research translation process more generally that were used to inform the resultant research translation decision criteria. Our literature review resulted in a final list of 17 criteria that may be useful for deciding whether an empirically informed intervention should be prioritized for translation in a community or organization. While each of these criteria is important, it is likely that an intervention will not meet all of those listed here. Nonetheless, these criteria can be used to assess readiness for translation by applying a holistic list of considerations to one intervention at a time, or they can be used to draw comparisons between well-researched interventions and assist with decision-making on which intervention should take precedence for translation efforts. Overall, the criteria identified through our review highlighted the importance of an intervention’s public health, cultural, and community relevance when considering its potential for research translation. Not only are intervention characteristics (e.g., evidence base, sustainability, cost) necessary to consider when contemplating introducing an intervention to the “real world,” it is also important to consider characteristics of the target setting and/or population (e.g., presence of supporting structures, support/buy-in).

Comparison to past research

The criteria development outlined in this paper was informed by the K2A Framework, although there were important similarities and differences between that existing framework and the factors identified through our literature search. To start, economic evaluations were highlighted as particularly important in the K2A Framework [7, 8]. The importance of economic considerations was additionally supported by research identified from our literature review, specifically stating that the intervention must be low-cost and the community or organizational context must have funding and resources must be available to sustain its implementation [22, 25, 42, 51, 53, 55]. The K2A Framework also lists that interventions must be adaptable to contextual changes over time [7, 8]. Through our review, we discovered literature stating that the intervention must be adaptable to different settings, contexts, or audiences (and particularly those under study) [14, 21, 41,42,43,44, 47, 51, 61]. Next, K2A Framework research translation considerations state that the intervention must meet the needs of constituents [7, 8]. Research identified by our literature review expands on this, by highlighting the importance of culturally appropriate interventions that empower communities [45, 48, 58]. Here, the research pointed to the importance of autonomy for community members and stakeholders, which was not specifically outlined in the K2A Framework. As another example of our literature review identifying gaps, we built on the K2A highlighting that supporting structures (e.g., appropriate resources, training, technical assistance) must be in place [7, 8] by also including that interventions must be properly manualized to ensure quality assurance and control [42, 43]. Lastly, the K2A Framework states that interventions must address a high-priority public health issue [7, 8]. We learned throughout our literature search that an intervention must be able to be implemented sufficiently to yield meaningful public health impacts, which provides an additional consideration for understanding how to address the public health issue at hand [37, 52, 56]. In summary, there is important overlap and also clear distinctions between the criteria identified using the K2A Framework and the criteria developed through our literature review and consulting process.

Results from our review showed that several theoretical frameworks have been used in the past to make decisions around research translation, dissemination, implementation, and program planning [82, 83]. The frameworks identified in this study showed similarities and differences to the K2A Framework, which served as the foundation for our research translation decision criteria. For instance, the Consolidated Framework for Implementation Research (CFIR) promotes implementation theory development and research translation in community settings [51, 84, 85]. CFIR overlaps with the K2A Framework in important ways, and we integrated some CFIR components throughout our criteria development process. For instance, CFIR notes the importance of evaluating intervention evidence strength and quality, adaptability, complexity, packaging, and cost before deciding to translate or implement [51]. Moreover, CFIR states that inner and outer setting characteristics, such as the needs/resources of community members, external policies/incentives, and other structural or contextual factors, must be considered before deciding to translate an intervention to a specific community [51]. External policies, such as public funding opportunities for public health initiatives, and their impact on community buy-in and support are particularly important to consider for research translation [86]. Some citizens and communities even argue there is “overreach” by public health institutions when translating cost-intensive interventions, so it is crucial to properly justify the use of public funds and consider all points of view when evaluating the “contextual factors” outlined in our criteria list [86].

The RE-AIM framework was also identified in the literature on factors influencing research translation and is generally used as a method of systematically considering the strengths and weaknesses of interventions to guide program planning so that the public health impact is maximized [87]. Factors noted as important for research translation and implementation for RE-AIM include the cost of the intervention for community members, the potential for the intervention to yield positive outcomes (based on research), the presence of necessary resources and expertise within the community, the benefit of the intervention compared to existing programs, and the extent to which the intervention can be flexible and maintained over time [87]. Although this framework focuses more on contextual factors than intervention characteristics, these factors are important to consider before translating an intervention to a specific setting.

Implications for research and practice

The literature review process and resultant research translation decision criteria outlined in this paper have important implications for public health research. First, public health researchers can study whether using our research translation decision criteria has an impact on intervention translation, implementation, dissemination, and maintenance in more diverse locations and applications. Researchers may even wish to develop ways to “grade” interventions on their ability to meet each criterion using a rating scale for comparison and to ensure assessments of whether an intervention meets related criteria are reliable. Second, researchers can identify whether our research translation decision criteria have a salient impact in specific communities or populations (i.e., those outside our local community where the criteria were developed), or for specific types of intervention (e.g., behavioral interventions, structural interventions). While creating a holistic list of research translation criteria is an important contribution to the literature, we recognize that some criteria may be less relevant depending on the context or intervention type, so researchers may wish to reduce the list to something less comprehensive or weight the importance of certain criteria more heavily for their application. Third, researchers should continue to identify intervention or community factors that impact research translation by reviewing relevant literature, collecting necessary data during intervention translation phases, and incorporating feedback from a more nationally representative group of experts and community leaders. Factors that impact research translation in community settings evolve, so they should be studied and monitored over time.

This study also has important implications for public health and community practice. To start, these research translation decision criteria can be applied by researchers and local stakeholders to initiate conversations on potential facilitators and barriers to translation into community settings. As an example, we identified an efficacious intervention (R01HL135220) conducted through our Prevention Research Center and asked the principal investigator to write a brief description of how the intervention met each of our 17 criteria to share with the Community Advisory Board. After considering the criteria and making comparisons with other grant options, the Community Advisory Board decided that the intervention (R01HL135220) was ready for translation and agreed to provide a letter of support for a grant application. Next, these criteria can be applied during earlier stages of the research process (before the research translation phase) so that researchers can design interventions that have adequate potential for translation. This practice is supported by the K2A Framework [7, 8] and a growing body of research aimed at “designing for dissemination,” [20, 52, 61] so that interventions are appropriate and sustainable in community settings. Additionally, considering these criteria may lead to additional research questions (e.g., what is the cost-effectiveness of this intervention?) that must be investigated before proceeding with research translation (a tactic also outlined within the K2A framework). Lastly, academic institutions, research centers, or federal agencies may wish to make policies that require public health researchers and practitioners to focus more on the decision to translate and consider developing criteria (using methods similar to ours) that capture factors that impact translation in their target communities. This provides a more consistent manner for evaluating whether an intervention is ready for translation in a community setting and may result in more reliable practices and consistent outcomes on an organizational level.

Limitations and strengths

Limitations of this research should be noted. First, research translation decision criteria were based solely on peer-reviewed and published English-language articles, so information and related criteria from unpublished studies, non-English literature, or other communication forms (e.g., theses, government reports) are not represented. Second, this literature review only included reliability checking with a second reviewer during the full-text study selection phase. Although we acknowledge that this may have slightly decreased the number of relevant studies or themes identified [88], we made sure to employ pre-specified eligibility criteria, a systematic search strategy, and collaborative assessment and interpretation of findings. Third, due to limited research on the decision to translate research products, we incorporated research on the entire process for research translation, dissemination, and implementation. We believe that factors that influence more upstream, dissemination/implementation processes also play an important role in translation. Fourth, while this criteria development process involved over a dozen local community members and several researchers at our university’s Prevention Research Center, study findings and research translation decision criteria may lack generalizability. Future directions for these criteria may involve gaining more input from experts and community members in more diverse locations.

In addition to the noted limitations, this study has several strengths. To start, we made use of an existing framework (i.e., K2A Framework) to develop research translation decision criteria. Since this framework was developed by the CDC to describe and depict the high-level processes necessary to move from scientific knowledge and interventions into action [7], it served as a strong and empirically informed foundation for our criteria development. Another strength of this study is that it expands on the burgeoning field of research focusing on the decision to translate research interventions since there is a need for more research on this pivotal juncture between academic knowledge and community settings. Lastly, this study and its resultant research translation criteria were initiated to fill a specific need within a specific CDC-funded Prevention Research Center. Our criteria and related development methods can be used in similar Centers nationwide and in diverse locations to ensure researchers are bridging the gap between public health knowledge and action.

Conclusion

This article provides a clear process for criteria development, by outlining our literature review, researcher input, and community engagement stages that were relevant to the research translation decision-making process. Our research translation decision criteria provide a holistic list for identifying important barriers and facilitators for research translation that can be considered before introducing an empirically supported intervention into community settings. Ideally, these criteria can serve as a novel tool for public health researchers and practitioners and provide more consistency in the process of research translation. Future directions for the development of these criteria may involve testing their use and seeking input from researchers and community leaders in more diverse locations to improve their generalizability.