Abstract
Background
Implementation research infrequently addresses economic factors, despite the importance of understanding the costs of implementing evidence-based practices (EBPs). Though partnerships with health economists have the potential to increase attention to economic factors within implementation science, barriers to forming these collaborations have been noted. This study investigated the experiences of health economists and implementation researchers who have partnered across disciplines to inform strategies to increase such collaborations.
Methods
A purposeful sampling approach was used to identify eight health economists and eight implementation researchers with experience participating in cross-disciplinary research. We used semi-structured interviews to gather information about participants’ experiences with collaborative research. Thematic analysis was conducted to identify core themes related to facilitators and barriers to collaborations.
Results
Health economists and implementation researchers voiced different perspectives on collaborative research, highlighting the importance of increasing cross-disciplinary understanding. Implementation researchers described a need to measure costs in implementation studies, whereas many health economists described that they seek to collaborate on projects that extend beyond conducting cost analyses. Researchers in both disciplines articulated motivations for collaborative research and identified strategies that promote successful collaboration, with varying degrees of convergence across these themes. Shared motivations included improving methodological rigor of research and making a real-world impact. Strategies to improve collaboration included starting partnerships early in the study design period, having a shared interest, and including health economists in the larger scope of the research.
Conclusions
Health economists and implementation researchers both conduct research with significant policy implications and have the potential to inform one another’s work in ways that might more rapidly advance the uptake of EBPs. Collaborative research between health economists and implementation science has the potential to advance the field; however, researchers will need to work to bridge disciplinary differences. By beginning to develop strong working relationships; increasing their understanding of one another’s disciplinary culture, methodology, and language; and increasing the role economists have within research design and execution, both implementation researchers and health economists can support successful collaborations and robust and informative research.
Similar content being viewed by others
Explore related subjects
Find the latest articles, discoveries, and news in related topics.Background
Stakeholders have identified costs and economic impacts as key factors that drive decision-making about implementing EBPs [1, 2]. Not only do decision makers need to know the cost of an EBP, but also it is important to understand the cost of the implementation process itself. Under- or over-estimating the costs of implementation could lead to failed implementation. Decision makers might not adopt a practice if they believe it will be too expensive. Likewise, if an implementation effort is not adequately financed, it is unlikely to be sustained [2]. Although cost has been identified as a key implementation outcome, it is not frequently evaluated within implementation studies [2,3,4,5]. In order for decision makers to determine if they are going to implement an EBP and the associated strategies to implement it, information on cost is needed. Limited research has compared the relative costs and benefits of different implementation strategies; increasing economic evaluations has been identified as a top priority for enhancing the public health impact of implementation strategies [4,5,6]. To accomplish this goal, increased collaborations between the fields of health economics and implementation science have been recommended to improve the economic evidence related to implementation strategies [5].
Economic evaluations within implementation science have predominately consider the economic impacts (relative to effectiveness) of (a) EBPs as implemented in community settings and, more recently, (b) implementation strategies used to support the implementation of EBPs [3,4,5]. Such research provides critical information for health system administrators, policymakers, payers, and provider organization leaders, who must make decisions about when and how to invest in EBPs [1]. Traditional methods of economic evaluation in health care (e.g., cost-effectiveness and benefit-cost analysis [7]) compare incremental differences in costs and outcomes among discrete and highly specified clinical practices. These methods have required adaptation for use in implementation studies, with a focus on different types of costs and outcomes, lessening of experimental control, and a health system/infrastructure (rather than health care provider) point of view [8].
Despite these methodological advances, economic evaluations remain rare in implementation research—let alone other types of research examining economic factors (e.g., influence of market forces on supply of and demand for EBPs) or financing (e.g., sustainable approaches to funding various training and quality assurance activities). Various reasons contribute to the paucity of economic evaluations in implementation science, including difficulty tracking implementation costs, inconsistent resource needs given the varying stages in which organizations are positioned at the time of adopting a new practice, and reluctance to disclose financial information. Furthermore, though implementation researchers come from a variety of disciplines, the majority of identified leaders in the field tend to have backgrounds in social work, psychology, and public health, with limited representation from health economics [9,10,11].
A recent review of health economic evaluations in implementation and quality improvement science called for “increased collaboration between health economics and implementation science” in order to address gaps in the literature [5]. Therefore, one relatively efficient and impactful strategy to improve economic evaluation in implementation science is to collaborate with health economists as part of cross-disciplinary teams. Health economists are well-positioned to contribute to implementation research as their work investigates health care resource allocation, efficiency, and value as well as consumer, practitioner, and healthcare system behaviors [12]. Cross-disciplinary collaborations can be characterized as being multidisciplinary, interdisciplinary, or transdisciplinary, which range in their level of integration across disciplines [13, 14]. In multidisciplinary teams, researchers work within their own disciplines on a common research problem, with the goal to eventually combine efforts, whereas researchers in interdisciplinary teams are more interactive throughout the research project, with researchers each drawing from their own disciplines. Transdisciplinary research is the most collaborative as it spans disciplinary bounds to develop new scientific frameworks and methodologies [13]. Aarons and colleagues [15] have identified cross-disciplinary dissemination and implementation science teams as a way “to expedite the translation process through having the most relevant and innovative perspectives come together to determine the most efficient and effective ways to move research to practice (p.2).” Yet, challenges exist with how to best identify and partner with health economists who are interested in typical implementation research. There are documented shortages of individuals with health economics expertise to consult on grants [16]. Adding to the challenge, health economists often are contacted late in a project, rather than being consulted early on to plan for appropriate research design [16]. Consistently, economic evaluations have been treated as adjunctive to the main study design, which can be dropped if there is not adequate grant funding [17].
Although implementation science lends itself to transdisciplinary work by its nature, a recent survey of dissemination and implementation researchers found a tendency for researchers to collaborate with individuals from within their own discipline (e.g., social work or psychology) [11]. Furthermore, the perspectives of health economists have not been included in past research on team science in dissemination and implementation research [15, 18]. Given calls to increase economic evaluations within implementation research, the potential of collaborating with health economists, and the documented challenges in doing so, further understanding is needed on how to best facilitate these collaborations. In this study, we explore the experiences of health economists and implementation researchers from other fields (e.g., psychology) who have conducted collaborative implementation research involving economic evaluations. The purpose of this study is to understand the challenges associated with partnerships between health economists and implementation researchers and to inform future collaborative efforts.
Methods
Design
Expert interviews were conducted with health economists and implementation researchers who had experience conducting collaborative research on topics related to implementation science and health economics. Purposeful sampling was conducted, using a combined criterion-i and snowball sampling approach [19]. First, using a criterion-i sampling strategy, which is a purposeful sampling strategy where participants meet a predetermined criterion of importance to the study, members of the research team (M.B., A.D., L.S., and B.P.) identified researchers with experiences (i.e., existing publications or grants related to implementation research) collaborating across the two fields. Second, at the end of every interview, participants were asked if they knew other researchers from either field who had conducted research in the area of implementation research and health economics. With the use of snowball sampling, some implementation researchers and health economists had collaborated on projects together, but the majority had not or had collaborated with a range of researchers across the two disciplines, which informed their interview responses. Given the low-risk nature of the study, and the lack of personal information obtained in the interviews, the protocol received an exemption from the University of California, Santa Barbara’s Institutional Review Board. We described the methods, results, and interpretations consistent with the Consolidated Criteria for Reporting Qualitative Research [20], included in Additional file 1.
Participants
Identified researchers across the two disciplines were emailed by the interviewers, who described the purpose of the study and inquired if the researcher would be willing to participate in an expert interview. Of the researchers contacted, 61.5% of the health economists and 72.7% of the implementation researchers agreed to participate in the study (n invited = 13 and 11 respectively). Those who did not participate either did not respond to email requests or stated that they were too busy. Eight health economists and eight implementation researchers from psychology, public health, and engineering (hereafter referred to as implementation researchers) participated in interviews. Health economists and implementation researchers were employed in a variety of settings, including academic institutions, the US Department of Veterans Affairs, and policy centers. They had varied research interests, ranging from substance use and behavioral health disorders to chronic medical conditions. Each of them had experience collaborating across disciplines in the evaluation of interventions or the implementation of interventions, though this experience varied. Implementation researchers ranged in their experience conducting economic evaluations from collaborating on one project with a health economist (with minimal previous exposure to economic evaluations) to leading cost analyses. Health economists’ experience conducting implementation research included evaluations of community-implemented interventions and conducting economic evaluations of implementation strategies. Although not all health economists were specifically engaged in measuring implementation costs, each had participated in research that shared the objectives of implementation research, including enhancing the uptake of EBPs in community settings. The majority of participants were female (62.5%) and ranged in age from 30 to 77 (M = 46.81, SD = 11.64). All participants had doctoral degrees and ranged from early career to established, senior researchers.
Data collection procedures
Participants completed a brief demographic questionnaire and a semi-structured interview conducted by either the first or second authors. Interviewers were early career implementation researchers, with doctorates and faculty appointments in clinical psychology, who were interested in cross-disciplinary research with health economists. Some participants knew the interviewers through academic societies, conference attendance, or overlapping research interests. To build rapport with all participants, reasons for doing the study were explained at the onset of the interview. Interviews were conducted and recorded via Zoom and lasted from 13tes to 40 minutes (M = 25.69, SD = 6.91). An iterative process of interviews and analysis was conducted, in which the interviewers had regular meetings to review notes and themes they were beginning to identify. Efforts were made to reach saturation, or the point in which data begins to repeat and additional data collection becomes redundant, which has been shown to occur with 6–12 interviews when the same questions are asked of a relatively homogenous set of respondents [21, 22]. We also sought to balance the perspectives of implementation researchers and health economists. The research team determined that saturation had been reached following 16 interviews (8 implementation researchers and health economists respectively) due to redundancy in interview content. Participants were offered a $20 gift card in exchange for completion of the interview. Participants were informed that direct quotes only would be used in publication with permission in order to provide additional privacy protection for interviews that address experiences within academic disciplines. Only minor edits to grammar were made by participants to enhance readability.
Measures
Demographic questionnaire
Participants completed short surveys with demographic and professional information, including their age, gender, race/ethnicity, degree, and primary discipline (e.g., economics, public health, psychology).
Semi-structured interview guide
The interview guide was developed by the research team and informed by the literature on team science, with questions derived from key factors thought to facilitate increasing capacity for interdisciplinary collaborations (e.g., conceptual issues, methodological issues, measures of success) [14, 23]. Interviews began with a general question about the participant’s research interests and the extent of their experience conducting interdisciplinary research. Subsequent questions addressed the participant’s experiences conducting interdisciplinary research with health economists and implementation researchers, challenges and facilitators to this type of research, and characteristics of these types of research partnerships. Given the purpose of this study to increase capacity for partnerships with health economists in implementation science, specific questions were asked of each discipline. Health economists were asked, “What would you like non-health economists to know about your field if they hope to partner with you?” and implementation researchers were asked, “What training would be valuable for you to increase economic methodology in your implementation research?” Interviewers asked follow-up questions as needed to clarify content and encourage elaboration. See Table 1 for comparisons between interview guides.
Data analysis
Interviews were transcribed and de-identified and uploaded into NVivo 11 Software, for coding and theme development. The data were analyzed using thematic analysis [24]. Inductive and deductive codes were first developed from the interview guides and key statements and phrases that were identified in the interviews. Then, a coding team reviewed and applied the codes across each interview, codes were clustered to develop themes, and themes were reviewed and refined. The coding team consisted of the first author and third author, along with an undergraduate research assistant. The coding team met regularly throughout the coding process to establish consensus, review discrepancies in coding, and iteratively develop the code book. The official code book was developed and revised through an iterative process until all coders reached consensus on four interviews, which included two interviews with health economists and implementation researchers respectively. Of the remaining interviews, 75% were double coded and discrepancies were resolved through discussion and code clarification.
Qualitative themes were identified and developed by looking at the convergence and comparison of codes across the two disciplines of interview participants. Following the steps outlined by Morgan (1993) regarding comparing across groups, first code occurrence across the two disciplines was used to first identify patterns in differences and similarities in themes, then text from these codes was further analyzed to interpret these patterns. Whereas the initial counts allowed the qualitative analysis team to identify areas for further in-depth analysis, the interpretation of the text provided rationale for the shared and differing perspectives across themes [25]. After themes were initially developed, they were shared and refined with the full authorship team.
Results
An overarching finding from the qualitative interviews was that health economists and implementation researchers had differing perspectives on collaborative research efforts, which highlighted the need for improved understanding across fields. Health economists more frequently identified methodological differences, misperceptions across fields, and different disciplinary cultures, whereas implementation researchers more often discussed differences in language (e.g., “it can be really hard to learn one another’s professional languages and lexicons and that you really do have to take the time to define terms”). Though differences in language might encapsulate some of the challenges that health economists identified, it appeared that the differing perspectives were not merely semantic.
Themes were identified and grouped into the following categories that addressed (1) motivations for research collaborations and ( 2) strategies to promote successful collaborations. See Table 2 for illustrative quotes for each theme from participants from both disciplines. Quotes in the text are annotated according to participant discipline, which is denoted by abbreviation (i.e., health economist, HE; implementation scientist, IS); category, which is denoted by number; and theme, which is denoted by letter. For example, HE1a corresponds to a quote from a health economist for category 1: motivations to collaborate, theme a: goal to impact real world issues.
Motivations to conduct collaborative implementation research
Health economists and implementation researchers both identified that they have a common goal in research to impact real world issues, including policy. These shared interests were identified as motivators to conduct collaborative research together (HE1a; IS1a). Furthermore, health economists and implementation researchers identified that conducting collaborative research allowed for personal growth as researchers and improved the quality of the science they conducted (HE1b; IS1b). However, interest in collaborating on economic evaluations related to costs differed significantly across disciplines. Implementation researchers primarily discussed partnering with health economists to conduct cost analyses, including measuring implementation costs, cost-benefit analyses, and cost-effectiveness analyses (IS1c). Although implementation researchers saw measuring costs as a primary motivation to collaborate with health economists, the majority of health economists identified that a common misperception of their field was that their research primarily focused on costs (HE1c).
In order to increase motivation for health economists to partner on cost analyses, health economists identified the importance of having a strong relationship and a shared topic of interest with the implementation scientist (HE1d). Though it was not recognized consistently in interviews, some implementation researchers recognized their role in motivating health economists to join projects by working with them to identify areas of interest (IS1d). Disciplinary cultures also contributed to differing perceptions of benefits or motivations for collaborative research. Whereas implementation researchers identified the importance of having health economists included as investigators to have the expertise needed for grant funding, implementation researchers and health economists recognized that salary support was not always beneficial for health economists, because they were either located within hard money positions or were already funded on multiple grants (IS1e; HE1e). Furthermore, health economists noted the importance of publishing in specific economic journals for researchers employed within traditional economics departments (i.e., as opposed to within schools of medicine or public health), regardless of the impact of a journal in another field (HE1e). Therefore, only certain opportunities for publications and grant funding might serve as an adequate incentive for collaboration for health economists.
Strategies to promote effective collaborations
Researchers across disciplines identified that the strongest collaborations occur when partnerships begin early and involve health economists in the larger scope of the project (IS2a; HE2a). Health economists identified challenges in instances when they were not included fully enough or provided with the necessary resources needed to conduct rigorous economic evaluations. Researchers from both disciplines identified that health economists have strong training in methodology and it would be beneficial to include them in research design (IS2b; HE2b). Health economists also noted other methodological strengths, beyond cost analyses, that could contribute to implementation science, including a focus on establishing causality (HE2b) and analyses using large administrative claims datasets. In general, it was acknowledged that collaborations were most successful when there was mutual respect across disciplines for areas of expertise (HE2c). Though some implementation researchers had experience and expertise leading economic evaluations, the majority did not. They did, however, identify that it would be helpful to receive training in how to lead interdisciplinary teams and increase basic understanding of health economics (IS2c).
Discussion
Health economics and implementation science are two fields that are situated to study real-world issues, providing a fertile landscape for collaboration to improve the public health impact of EBPs. In fact, multiple researchers that straddle the fields of health economics and implementation science have called for these collaborations to improve the rigor and understanding of the economic impact of different implementation strategies and efforts [5, 8, 26]. Both health economists and implementation researchers identify a desire to impact real-world practice and policy as a key reasons to collaborate. However, our findings also highlight potential reasons why there has been a dearth of economic research within implementation science. One of the most notable mismatches across fields was the need expressed by implementation researchers to measure costs associated with implementation strategies, and the health economists’ perspective of a common misperception of their field being a focus on calculating costs. Although there are health economists who do focus on cost analyses as their main area of research, many do not. For example, several of the health economists focused their research on evaluating the impact of health policy changes using large administrative claims data. A clear theme emerged suggesting the need to increase understanding of interests and skills across the two fields in order to foster successful collaborations.
Challenges also were noted regarding the field’s capacity regarding individuals who can conduct economic evaluations within implementation studies. Furthermore, implementation researchers and health economists discussed collaborations that would continue over multiple projects, posing additional challenges for individuals first trying to start a collaboration. As Norton and colleagues [11] noted, the most important priority amongst researchers conducting implementation science was working with someone with whom they had previously worked, which can lead to a phenomenon where the “rich get richer.” This might further exacerbate a limited workforce of health economists interested in partnering on studies in which they are primarily brought on to measure implementation costs. Two potential solutions might be needed to address these workforce issues. First, by fully engaging the expertise of health economists within implementation science, collaborations may increase and improve, providing opportunities to advance a truly transdisciplinary field focused on increasing the implementation and sustainment of EBPs. Secondly, strategies might be needed to increase the capacity of individuals who are able to conduct economic evaluations within implementation science to address the pressing need to be able to measure implementation costs, such as including master’s-level economists on projects or individuals not traditionally trained as health economists (e.g., implementation researchers with specialized training in economic evaluations).
One potential innovation could be the creation of consultation services focused on conducting economic evaluations within implementation research, including measuring implementation costs. For example, the QUERI program in the VA, which conducts implementation research, has a dedicated group of health economists to provide consultation on studies [27]. Furthermore, NIDA recently funded a multi-institutional Center of Excellence, the Center for Health Economics of Treatment Interventions for Substance Use Disorders, HCV, and HIV (CHERISH) [16]. As part of CHERISH and to address the shortage of health economics expertise, an economic consultation service was funded, which is free to researchers. Initial evaluation of CHERISH found that limiting health-economist consultation service to 6 h was feasible to support the preparation of a grant application, and often led to future collaborations with the consultant [16]. Additionally, lessons can be taken from the multiple training programs developed to build capacity in implementation science, which often lead to increased collaborations amongst the expert faculty and trainees in the programs [28, 29]. There is potential for cross-disciplinary training that aims to further integrate economists into training programs to foster collaborations and advance economic methodology in implementation science.
Our study identified the importance of effective communication and leadership across cross-disciplinary teams with health economists. These findings were consistent with a past study, which found that successful team science in implementation research was fostered when there were clear expectations and roles in conducting research, effective communication was promoted and modeled, and there was a shared goal and mission across team members [15]. Indeed, implementation researchers are frequently tasked with forming and leading large teams, which include community practitioners and researchers from multiple disciplines such as medicine, engineering, biostatistics, psychology, social work, anthropology, and economics. As opposed to learning each of these fields, implementation researchers can focus on gaining expertise in best practices in team science [14, 15, 23]. Many of the skills that facilitate other research partnerships can help to promote successful collaborations with health economists, including learning the “language” used in the field and clarifying that there is a shared understanding across researchers in terms of roles, expectations, and incentives. This overarching finding regarding team science can be expanded with three key recommendations for implementation researchers who seek to partner with health economists, which were identified in this study:
-
1)
Identify and build relationships with health economists who seek to make a real-world impact in a shared area of research interest (e.g., substance use treatment) to promote synergy and motivation across the research team.
-
2)
Similar to past recommendations, consultation with a health economist should occur early and include integration into planning the design and methods of the study [16]
-
3)
Learn from health economists about other methodological strengths to advance the field of implementation science. Beyond partnering on traditional economic evaluations, the field of implementation science may benefit from additional areas of expertise that health economists offer, including a focus on determining causality within real-world settings and methodological expertise with large administrative claims data [6]. For example, one recent example of economist-led implementation research concerns the use of discrete choice experiments to define and measure how stakeholders value different implementation strategies and outcomes [30].
Strengths and limitations
Using criterion-i and snowball sampling, we only interviewed individuals who had already conducted collaborative research within the fields of implementation science and health economists. Thus, this sample may be more interested in building collaborations and conducting team science than other implementation researchers and economists who have not yet pursued such collaborative work. These interviews provided rich insights into facilitators and barriers to existing collaborations. However, additional insights may be gained from researchers that aim to collaborate across health economics and implementation science, but have yet to secure such partnerships. Additionally, our sample of interviewees was drawn from the USA, which could limit generalizability to other contexts where the institutional structures and processes involved in health economics, implementation research, and interdisciplinary collaboration might differ. Furthermore, the interview guides focused predominately on how implementation researchers could increase capacity in economic evaluations either in their own training or by partnering with health economists. We did not systematically collect information on training needs for health economists in implementation science; however, this could be an important direction for increasing cross-disciplinary collaborations. Given qualitative findings regarding differences in methodological approaches and terminology used, it would also be beneficial to more systematically assess the understanding health economists have of implementation science objectives and concepts, and correspondingly implementation researchers have of health economics. These findings could inform training programs across the two disciplines.
Finally, this study looked specifically at how collaboration can be enhanced by strengthening the relationships between implementation researchers and health economists, while many other stakeholders participate in implementation research and practice. It is important to recognize the importance of fostering successful collaborations across various professionals, who could be part of multidisciplinary teams to conduct implementation efforts or research studies. For example, it has been recommended that clinicians collaborate directly with health economists on the establishment of clinical guidelines [31]. Furthermore, by fostering collaborations with developers of interventions and clinical guidelines, health economists, and implementation researchers, costs associated with the practice and implementation strategies could be evaluated more efficiently [32]. Future efforts should explore how to enhance collaborations across multiple fields to improve implementation efforts.
Conclusions
In sum, our findings point to potential strategies to foster collaborations between health economists and implementation researchers and expand capacity in the field. Although differences in training, disciplinary cultures, and methodological approaches can pose challenges to these collaborations, both health economists and implementation researchers have a shared desire to partner with other disciplines involved in real-world research. With the increased interest within the implementation science field to move beyond costing of implementation strategies, and to consider the more nuanced and impactful role that economics play in large scale-up and policy, this is a serendipitous moment that should not be ignored. As implementation science increases its traction, particularly related to healthcare, economic evaluations are essential to establish feasible plans. Pragmatically, a “best-practice” implementation approach cannot be used without understanding of (a) the resources needed to execute it, (b) the consequences to the programs currently utilizing those resources, and (c) the ultimate benefit of allocating resources to the implementation. Thus, without the inclusion of economics within the scope of implementation science, the field runs the risk of perpetuating the very reason for its development—evidence-based implementation approaches will remain unused for the successful scale-up of EBPs.
Availability of data and materials
The interviews generated and analyzed during the current study are not publicly available to protect the identities of participants, who are members of the academic community, but are available from the corresponding author on reasonable request.
References
Pegg SL, Walsh LM, Becker-Haimes EM, Ramirez V, Jensen-Doss A. Money makes the world go ’round: a qualitative examination of the role funding plays in large-scale implementation and sustainment of youth evidence-based practice. Psychol Serv. 2019.
Saldana L, Chamberlain P, Bradford WD, Campbell M, Landsverk J. The cost of implementing new strategies (COINS): a method for mapping implementation resources using the stages of implementation completion. Child Youth Serv Rev. 2014;39:177–82.
Dopp AR, Mundey P, Beasley LO, Silovsky JF, Eisenberg D. Mixed-method approaches to strengthen economic evaluations in implementation research. Implement Sci. 2019;14:2.
Reeves P, Edmunds K, Searles A, Wiggers J. Economic evaluations of public health implementation-interventions: a systematic review and guideline for practice. Public Health. 2019;169:101–13.
Roberts SLE, Healey A, Sevdalis N. Use of health economic evaluation in the implementation and improvement science fields - a systematic literature review. Implement Sci. 2019;14.
Powell BJ, Fernandez ME, Williams NJ, Aarons GA, Beidas RS, Lewis CC, et al. Enhancing the impact of implementation strategies in healthcare: a research agenda. Front Public Heal. 2019;7 JAN.
Drummond MF, Sculpher MJ, Claxton K, Stoddart GLTG. Methods for the economic evaluation of health care programmes. 4th ed. Oxford: Oxford University Press; 2015.
Eisman AB, Kilbourne AM, Dopp AR, Saldana L, Eisenberg D. Economic evaluation in implementation science: making the business case for implementation strategies. Psychiatry Res. 2019.
Padek M, Mir N, Jacob RR, Chambers DA, Dobbins M, Emmons KM, et al. Training scholars in dissemination and implementation research for cancer prevention and control: a mentored approach. Implement Sci. 2018;13:1–13.
Proctor EK, Landsverk J, Baumann AA, Mittman BS, Aarons GA, Brownson RC, et al. The implementation research institute: training mental health implementation researchers in the United States. Implement Sci. 2013;8:1–12.
Norton WE, Lungeanu A, Chambers DA, Contractor N. Mapping the growing discipline of dissemination and implementation science in health. Scientometrics. 2017;112:1367–90.
Kernick DP. Introduction to health economics for the medical practitioner. Postgrad Med J. 2003;79:147–50.
Rosenfield PL. The potential of transdisciplinary research for sustaining and extending linkages between the health and social sciences. Soc Sci Med. 1992;35:1343–57.
Stokols D, Hall KL, Taylor BK, Moser RP. The science of team science. Overview of the field and introduction to the supplement. American Journal of Preventive Medicine. 2008;35 2 SUPPL.
Aarons GA, Reeder K, Miller CJ, Stadnick NA. Identifying strategies to promote team science in dissemination and implementation research. J Clin Transl Sci. 2019;:1–32.
Murphy SM, Leff JA, Linas BP, Morgan JR, McCollister K, Schackman BR. Implementation of a nationwide health economic consultation service to assist substance use researchers: lessons learned. Subst Abus 2018;0:01–19.
Smith MW, Barnett PG. The role of economics in the QUERI program: QUERI series. Implement Sci. 2008;3:20.
Guerrero EG, Hahn EE, Khachikian T, Chuang E, Brown AF. Interdisciplinary dissemination and implementation research to advance translational science: challenges and opportunities. J Clin Transl Sci. 2017;1:67–72.
Palinkas LA, Horwitz SM, Green CA, Wisdom JP, Duan N, Hoagwood K. Purposeful sampling for qualitative data collection and analysis in mixed method implementation research. Adm Policy Ment Heal Ment Heal Serv Res. 2015;42:533–44.
Tong A, Sainsbury P, Craig J. Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups | international journal for quality in health care | Oxford academic. Int J Qual Heal Care. 2007;19:349–57.
Guest G, Bunce A, Johnson L. How many interviews are enough? Field methods. 2006;18:59–82.
Hennink MM, Kaiser BN, Marconi VC. Code saturation versus meaning saturation: how many interviews are enough? Qual Health Res. 2017;27:591–608.
Falk-Krzesinski HJ, Börner K, Contractor N, Fiore SM, Hall KL, Keyton J, et al. Advancing the science of team science. Clin Transl Sci. 2010;3:263–6.
Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006;3:77–101.
Morgan DL. Qualitative content analysis: a guide to paths not taken. Qual Health Res. 1993;3:112–21.
Hoomans T, Severens JL. Economic evaluation of implementation strategies in health care. Implement Sci. 2014;9:168.
Smith MW, Barnett PG. The role of economics in the QUERI program: QUERI Series. 2008.
Proctor EK, Chambers DA. Training in dissemination and implementation research: a field-wide perspective. Transl Behav Med. 2017;7:624–35.
Proctor EK, Landsverk J, Baumann AA, Mittman BS, Aarons GA, Brownson RC, et al. The implementation research institute: training mental health implementation researchers in the United States. Implement Sci. 2013;8:105.
Salloum RG, Shenkman EA, Louviere JJ, Chambers DA. Application of discrete choice experiments to enhance stakeholder engagement as a strategy for advancing implementation: a systematic review. Implement Sci. 2017;12.
Knies S, Severens JL, Brouwer WBF. Integrating clinical and economic evidence in clinical guidelines: more needed than ever! J Eval Clin Pract. 2019;25:561–4.
Hoomans T, Severens JL, Evers SMAA, Ament AJHA. Value for money in changing clinical practice: should decisions about guidelines and implementation strategies be made sequentially or simultaneously? Med Decis Mak. 2009;29:207–16.
Acknowledgements
The authors would like to acknowledge the efforts of the undergraduate research assistants in the PADRES lab, especially Madeleine Tremblay, who contributed to data transcription and coding.
Funding
This study is funded by the National Institute of Health K01MH110608 awarded to MLB and R01DA044745 awarded to LS. Further, the time and effort to prepare this manuscript was supported by K01MH113806 awarded to BJP. Additionally, the preparation of this article was supported in part by the Implementation Research Institute (IRI) at the Brown School, Washington University in St. Louis, through an award from the National Institute of Mental Health (R25 MH080916). MLB and AD are fellows of IRI and BJP and LS are past fellows of IRI.
Author information
Authors and Affiliations
Contributions
MLB is the principal investigator for the study; oversaw the design, collection of interviews, and qualitative data analysis; and was primarily responsible for drafting the manuscript. ARD participated in the design and collection of interviews, thematic analysis, and drafting the manuscript. CK conducted qualitative data analysis and participated in drafting the manuscript. SLE is a consultant on MLB’s K01 award regarding training in health economics. As such, she informed study design and provided a member check on thematic analyses. BJP participated in the design of interviews, thematic analysis, and drafting the manuscript. LS is a mentor on MLB’s K01 award and oversees her training related to collaborative implementation research with health economists, provided guidance on study conceptualization and thematic analysis, and participated in drafting the manuscript. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
This study was reviewed and determined exempt by the University of California, Santa Barbara Internal Review Board (3-18-0310).
Consent for publication
Not applicable
Competing interests
The authors declare that they have no competing interests.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary information
Additional file 1.
COREQ (COnsolidated criteria for REporting Qualitative research) Checklist
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Barnett, M.L., Dopp, A.R., Klein, C. et al. Collaborating with health economists to advance implementation science: a qualitative study. Implement Sci Commun 1, 82 (2020). https://doi.org/10.1186/s43058-020-00074-w
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s43058-020-00074-w