Abstract
Background
A stepped-wedge, cluster randomized controlled trial assessed the effectiveness of practice facilitation (PF) for adoption of guidelines for prevention and treatment of cardiovascular disease risk factors. This study estimated the associated cost of PF for guideline adoption in small, private primary care practices.
Methods
The cost analysis included categories for start-up costs, intervention costs, and practice staff costs for the implemented PF-guided intervention. We estimated the total 1-year costs to operate the program and calculated the mean and range of the cost-per-practice by quarter of the intervention. We estimated the lower and upper bounds for all salary expenses, rounding to the nearest $100.
Results
Total 1-year intervention costs for all 261 practices ranged from $7,900,000 to $10,200,000, with program and practice salaries comprising $6,600,000–$8,400,000 of the total. Start-up costs were a small proportion (3%) of the total 1-year costs. Excluding start-up costs, quarter 1 cost-per-practice was the most expensive at $20,400–$26,700, and quarter 4 was the least expensive at about $10,000. Practice staff time (compared with program staff time) was the majority of the staffing costs at 75–84%.
Conclusions
The PF strategy costs approximately $10,000 per practice per quarter for program and practice costs, once implemented and running at highest efficiency. Whether this program is “worth it” to the decision-maker depends on the relative costs and effectiveness of their other options for improving cardiovascular risk reduction.
Trial registration
This study is retrospectively registered on January 5, 2016, at www.clinicaltrials.gov as NCT02646488.
Similar content being viewed by others
Explore related subjects
Find the latest articles, discoveries, and news in related topics.Background
Clinical guidelines for reducing cardiovascular disease (CVD) risk factors are not consistently integrated into primary care practice [1, 2]. One approach to increasing adoption of clinical guidelines is practice facilitation (PF) [3,4,5,6,7,8,9,10,11]. PF is an implementation strategy that emphasizes building practice and organizational capacity to implement innovations in health care delivery into routine primary care practice [5]. Several studies have found that PF is effective in improving adoption of a range of preventive care guidelines, but this research largely has focused on implementing guidelines for single risk factors rather than addressing the complexity of simultaneous guideline implementation across multiple risk factors.
HealthyHearts New York City (HHNYC) was one of seven cooperatives funded through the Agency for Healthcare Research and Quality’s national EvidenceNOW initiative to reduce CVD risk. The study was designed to assess the effect of practice facilitation on adoption of Million Hearts ABCS outcomes defined as (A) aspirin when indicated, (B) blood pressure control, (C) cholesterol management, and (S) smoking screening and cessation intervention [3]. The main risk factor analysis found a significant effect of PF on the smoking composite measure and the proportion of smokers counseled only [12]. The PF literature demonstrates the effectiveness of PF, but most of those studies aimed to improve a single measure (e.g., cervical cancer screening rates or hypertension management). A longer intervention might be necessary to show effectiveness because of the added complexity when supporting system changes to improve a range of prevention and treatment risk factors, which requires changing many care processes at once to achieve guideline-recommended care [13].
The process assessment found a high level of fidelity as measured across four categories: frequency, duration, content, and coverage [14]. All practices received at least 10 of the planned 13 visits by a PF, and over 94% received 13 or more visits. Over 95% of practices received all planned content (introductory and ABCS-specific tasks), and facilitators achieved just over 65% coverage, that is, achieving every goal comprising the number of visits (13), tasks (39), and education on strategies (27). There were no meaningful differences in practice characteristics between those that achieved or did not achieve high rates of fidelity for this complex intervention [14].
Although there is growing interest in understanding how PF can effectively improve patient care and health care outcomes across a multitude of care processes, there is a lack of data on the cost of this strategy. To the best of our knowledge, only two articles have reported on the cost of PF interventions [15, 16], each using a different cost-analysis approach, with one from the USA (2013) and an older one ending in 1998 from Canada (2005). The gaps in the literature are due to the limited cost analyses overall and the variation in interventions and analyses that make comparability challenging. One of these studies was based in South Texas, focused on diabetes only with a much lower intensity (6 PF visits in 12 months), and excluded start-up costs but included travel and food costs [16]; the other was based in Ontario, Canada, and was high intensity (33 visits over 18 months) and included intervention, treatment, and follow-up costs for preventive services used or avoided and essentially was a cost-consequence modeling study incorporating total estimated intervention costs, but the analysis was based on many assumptions beyond data collected directly in the study.
Various stakeholders interested in advancing the use of PF to optimize adoption of clinical guidelines (e.g., policymakers, practice-based research networks, independent practice associations) would benefit from having cost information and analysis [17]. This article aimed to fill gaps in the literature by estimating the start-up costs, salary expenses, and cost-per-practice for the implemented PF-guided intervention.
Methods
Study setting and design
HealthyHearts New York City (HHNYC) is a partnership between the New York University School of Medicine; and the Primary Care Information Project (PCIP), a bureau of the New York City Department of Health and Mental Hygiene. The study was a stepped-wedge, cluster randomized controlled design in which sites were randomized into one of four 12-month intervention waves to evaluate the effect of practice facilitation (implementation strategy) to help small independent practices adopt CVD guidelines (intervention). A new wave of practices was enrolled every 3 months. The protocol for the PF implementation strategy consisted of a minimum of 13 in-person, on-site PF visits to an assigned panel of practices within a 1-year intervention period to assist practices with their implementation of system changes consistent with the patient-centered medical home and the Chronic Care Model (CCM) [18, 19]. For example, in alignment with the CCM’s “delivery system redesign” component, facilitators promoted the use of patient registries to identify high-risk patients. PFs scheduled two visits to their assigned practices in the first month and monthly visits for the remaining 11 months. For the cost analysis, we included the 261 small independent practices from the PCIP network that were enrolled during the first year of the study intervention phase (1 December 2015–30 November 2016). Sixteen practice facilitators were assigned to work across the practices.
Nearly two-thirds of the 261 practices were solo clinicians (n=149), 37% were in accountable care organizations [20], almost half (47%) were in medically underserved areas [21] and/or designated as patient-centered medical homes, and 45% of patients had Medicaid.
Data sources
There were several data sources for the cost analysis, comprising categories for start-up costs, implementation and intervention costs, and practice staff costs.
Start-up costs
The program manager tracked all start-up costs in a database that included materials, supplies, toolkits for the facilitators and for each practice to implement the CCM and evidence-based guidelines for the ABCS measures, computers for use by the facilitators, webinar hosting, and program staff time and expenses for kickoff events, training, and meetings prior to program launch, based on invoices from and communication with PCIP. Total start-up costs included all of the above-mentioned costs, but excluded time costs for practices, because while we documented the number of staff and clinicians present, we did not know which specific staff members attended.
Implementation and intervention costs
Facilitators used an electronic customer relationship management (CRM) system (i.e., Salesforce™) to document the amount of time spent at each visit and other interactions including email and phone calls. The facilitator costs also included other meetings related to the project that did not involve site contact, such as supervision and project management meetings with other facilitators and project or program staff. Facilitator travel time was incorporated as a regular part of their workday and not calculated separately. Further, research costs were not included, because they would not be part of a future implementation.
In addition to facilitators, we accounted for the time of facilitator managers and several other program staff (e.g., outreach coordinators). Data for salaries were obtained either from published salary ranges from the New York City Department of Health and Mental Hygiene or estimated from the 2016 data of the U.S. Bureau of Labor Statistics, where we assigned a dollar value for each hour of staff time based on the national wage and fringe rate of those who could perform the activity in the same setting. We estimated the staff time cost with a lower and upper bound based on the given New York City Department of Health and Mental Hygiene salary range (e.g., $74,700–85,700/year for a practice facilitator including fringe) or from possible occupation types from the U.S. Bureau of Labor Statistics. Several occupation types could fulfill the duties of different program staff, such as nurse practitioner ($49.54/hour including fringe), registered nurse ($31.68/hour including fringe), or medical assistant ($15.76/hour including fringe), and all have different wage levels [22].
Practice staff costs
The HHNYC practice member survey was used to estimate the amount of time physicians and their practice staff spent on activities that were implemented as part of the intervention. (Questions were essentially, “Does your practice site conduct [daily huddles or outreach to high-risk patients]?” with a skip pattern allowing for recall of number of minutes per most recent full day or week spent on the activity.) The surveys were completed by all providers and staff at 3 times (baseline, post-intervention, and 6-month follow-up). We used 2016 data from the U.S. Bureau of Labor Statistics to estimate hourly wages including fringe for practice staff time involved in the program [22]. Examples of personnel included medical biller, financial controller, front desk staff, general and operations manager, medical assistant, medical secretary, nurse practitioner, office manager, physician assistant, physician, registered nurse, and secretary/administrative assistant. We used the national average wage as the upper bound on time costs and 80% of that as a lower bound.
Analytic approach
Our analyses distinguished between start-up costs (e.g., kickoff events, program staff time), program staff costs (i.e., facilitator and associated staff time), and practice costs (e.g., provider and practice staff) [23,24,25]. These categories allowed for estimating the perspectives of both the entity that must decide to pay for the initial program and of the practice. We estimated the total 1-year costs to operate the program and calculated the mean and range of the cost-per-practice by quarter of the intervention, knowing that facilitators increased their volume of practices as the year progressed (i.e., started at less than full capacity). That is, Wave 1, quarter 1, had the lowest number of practices per facilitator, and this increased through the year. By estimating the cost-per-practice, we indicate how program efficiency over time might change the cost-per-practice over 1-year duration, as facilitators operated at closer to full capacity. We estimated the lower and upper bounds for all salary expenses, rounding to the nearest $100.
Results
Table 1 shows the estimated costs for the 1-year PF program encompassing 261 primary care practices. Total intervention cost estimates ranged from $7,900,000 to $10,200,000, with program and practice salaries comprising $6,600,000 to $8,400,000 of the total. Start-up costs for the PF program ranged from $311,500 to $315,000. Start-up costs were a small proportion (3%) of the total 1-year costs.
The number of practices participating increased over the year, as planned, (Table 2) yielding a varying staff cost-per-practice by quarter. Excluding start-up costs, quarter 1 was the most expensive at $20,400–$26,700 per practice, followed by a decreasing quarterly cost-per-practice over time, averaging $14,300, $11,900, and $10,000 in quarters 2–4, respectively. Practice staff time (compared with program staff time) was the majority of the staffing costs at 75–84%, depending on the quarter (Table 1).
Discussion
Our findings showed that once scaled-up, the cost-per-practice of a complex PF intervention conducted in small urban primary care practices was as low as $10,000 (2016US$) for the program and practice staff time. However, policymakers and health care system leaders will not be inclined to pay for a PF program if it is not achieving stated goals. Despite high levels of fidelity to the intensive PF protocol, operationalizing the large number of changes required to concurrently improve guideline adoption across a broad range of chronic disease indicators was challenging. We have documented several potential explanations for the lack of change in the other three risk factor measures, including that some clinics began the study with relatively high rates of meeting targets. Because intervening on multiple, rather than single, risk factor targets and measures is more complex and less studied, it was clear that the PFs may have needed more time to partner with practices to implement capacity-building activities and the necessary system changes, which would increase costs.
In addition, basing an assessment of the value of PF solely on short-term changes in clinical risk factor measures may underestimate the value of PF. Qualitative interviews with practices enrolled in HHNYC found that small independent practices viewed facilitation as an important resource, particularly because they offered support to the practices that was unavailable onsite to optimize their use of the EHR for identifying and addressing other quality improvement gaps.
Only two articles have reported on the cost of PF-guided interventions [15, 16]. A Canada-based study of a PF-guided intervention to improve preventive services estimated a cost of $10,835 (1999 CAD$) per practice [15]. Culler reported on a PF-guided intervention to improve diabetes care, with an estimated median cost of $9670 (US$, data year unknown) per practice, depending on wages and the intensity of the intervention [16]. The two studies had different ways of measuring costs, different target populations, and different intervention components; however, their findings were relatively similar to one another and to ours. We encourage others to report on programmatic costs, consequences, and components to help build a greater understanding of PF program costs.
This study had limitations. Given the setting of our study, our estimates should be considered conservative, as PCIP provided an existing infrastructure for the intervention, eliminating costs such as practice recruitment and extensive PF training. If facilitators are unavailable at the time of program initiation and new ones need to be recruited and/or trained to be general facilitators (i.e., separate from intervention-specific training), the program cost may be underestimated [26]. Because travel costs were included as part of a facilitator’s day, but not calculated separately, we may be overestimating the cost of the PF program if implemented elsewhere; in a smaller geographic area, travel time could be much lower than that required for public transportation in New York City, and therefore, the facilitator could meet with more practices per day and be more efficient. The more practices that a facilitator manages, the lower the total cost-per-practice (i.e., increase the denominator); on the other hand, the practice-specific costs may not change. In addition, we did not capture practice-based remuneration for activities like smoking cessation counseling, which is billable. Also, note that we included the cost of report generation as a program cost in this study because they were created by the facilitators, but they typically would be a practice-associated cost. As noted earlier, total start-up costs excluded time costs for practices, because while we documented the number of staff and clinicians present, we did not know which specific staff members attended; this would lead to an underestimate of total costs. Finally, this program involved working with an organization that is part of a large, urban health department, which has been doing similar work in the past and had some pre-existing infrastructure in place prior to implementation (e.g., staff activity tracking via Salesforce software).
This program reached up to 261 practices by its final quarter at a total mean cost of $9 million. In order for any health care organization or individual practice to decide whether this PF-guided program is reasonable to implement, they need to know the effectiveness of such a program first, followed by an understanding of total costs from their perspective, that is, to their practice. Based on the relatively high quarterly costs, from a maximum of $19,600 early in the program to a minimum of $7400 in the final quarter, small independent practices could not afford a PF service. However, this emphasizes the role of organizations like PCIP that have the infrastructure and mission to support practice improvement by offering shared resources like practice facilitation. However, PCIP and other stakeholders who provide PF services need to be able to assess the cost of this service. Further, this study’s PF protocol required training and monthly meetings that generated a cost ranging from $16/h (medical assistant) to $50/h (nurse practitioner) or more for physicians, plus fringe, depending on which practice staff worked with the facilitator [22]. If lower-paid staff could substitute in the practice, costs might be lower. This analysis showed total costs broken into relevant categories for different stakeholder perspectives, which can be useful for decision-making by these parties.
Conclusion
In conclusion, the HHNYC PF program costs approximately $10,000 per practice per quarter for program and practice costs, once implemented and running at the highest efficiency. Start-up costs were a small portion of total overall costs, however, and earlier-quarter estimates of cost-per-practice were high. Whether this program is “worth it” to the decision-maker depends on the relative costs and effectiveness of their other options for improving the ABCS outcomes of (A) appropriate aspirin use, (B) blood pressure control, (C) cholesterol management, and (S) smoking cessation.
Availability of data and materials
The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.
References
Shelley D, Blechter B, Siman N, Jiang N, Cleland C, Ogedegbe G, et al. Quality of cardiovascular disease care in small urban practices. Ann Fam Med. 2018;16:S21–8 American Academy of Family Physicians; [cited 2019 Apr 3]. Available from: http://www.ncbi.nlm.nih.gov/pubmed/29632222.
Hajjar I, Kotchen TA. Trends in prevalence, awareness, treatment, and control of hypertension in the United States, 1988-2000. J Am Med Assoc. 2003;290:199–206 American Medical Association; [cited 2020 Jul 27]. Available from: https://jamanetwork.com/.
Shelley DR, Gepts T, Siman N, Nguyen AM, Cleland C, Cuthel AM, et al. Cardiovascular disease guideline adherence: an RCT using practice facilitation. Am J Prev Med. 2020;58:683–90. https://doi.org/10.1016/j.amepre.2019.12.013 Elsevier Inc. [cited 2020 Jul 28].
Shelley DR, Ogedegbe O, Anane S, Wu WY, Goldfeld K, Gold HT, et al. Testing the use of practice facilitation in a cluster randomized stepped-wedge design trial to improve adherence to cardiovascular disease prevention guidelines: HealthyHearts NYC. Implement Sci. 2015;11:88 [cited 2019 Apr 3]. Available from: http://www.ncbi.nlm.nih.gov/pubmed/27377404.
Baskerville NB, Liddy C, Hogg W. Systematic review and meta-analysis of practice facilitation within primary care settings. Ann Fam Med. 2012;10:63–74 [cited 2019 Mar 11]. Available from: http://www.ncbi.nlm.nih.gov/pubmed/22230833.
Liddy C, Hogg W, Singh J, Taljaard M, Russell G, Deri Armstrong C, et al. A real-world stepped wedge cluster randomized trial of practice facilitation to improve cardiovascular care. Implement Sci. 2015;10:150. https://doi.org/10.1186/s13012-015-0341-y [cited 2019 Mar 11].
Chase SM, Crabtree BF, Stewart EE, Nutting PA, Miller WL, Stange KC, et al. Coaching strategies for enhancing practice transformation. Fam Pract. 2015;32:75–81 [cited 2019 Nov 4]. Available from: http://www.ncbi.nlm.nih.gov/pubmed/25281823.
Hemler JR, Hall JD, Cholan RA, Crabtree BF, Damschroder LJ, Solberg LI, et al. Practice facilitator strategies for addressing electronic health record data challenges for quality improvement: EvidenceNOW. J Am Board Fam Med. 2018;31:398–409 [cited 2019 Nov 4]. Available from: http://www.ncbi.nlm.nih.gov/pubmed/29743223.
Laferriere D, Liddy C, Nash K, Hogg W. Navigating change: how outreach facilitators can help clinicians improve patient outcomes. J Am Board Fam Med. 2012;25:232–7.
Harvey G, Lynch E. Enabling continuous quality improvement in practice: the role and contribution of facilitation. Front Public Heal. 2017;5:27 [cited 2019 Nov 4]. Available from: http://www.ncbi.nlm.nih.gov/pubmed/28275594.
Deri Armstrong C, Taljaard M, Hogg W, Mark AE, Liddy C. Practice facilitation for improving cardiovascular care: secondary evaluation of a stepped wedge cluster randomized controlled trial using population-based administrative data. Trials. 2016;17:434 [cited 2019 Nov 4]. Available from: http://www.ncbi.nlm.nih.gov/pubmed/27596224.
Shelley DR, Gepts T, Siman N, Nguyen A, Cleland C, Cuthel A, et al. Cardiovascular disease guideline adherence: a randomized controlled trial using practice facilitation. Am J Prev Med. 2020;58(5):683–90.
Liddy C, Hogg W, Singh J, Taljaard M, Russell G, Deri Armstrong C, et al. A real-world stepped wedge cluster randomized trial of practice facilitation to improve cardiovascular care. Implement Sci. 2015;10:150. https://doi.org/10.1186/s13012-015-0341-y BioMed Central Ltd. [cited 2020 Nov 23].
Berry CA, Nguyen AM, Cuthel AM, Cleland CM, Siman N, Pham-Singer H, et al. Measuring implementation strategy fidelity in healthyhearts NYC: a complex intervention using practice facilitation in primary care. Am J Med Qual. 2020. https://doi.org/10.1177/1062860620959450.
Hogg W, Baskerville N, Lemelin J. Cost savings associated with improving appropriate and reducing inappropriate preventive care: cost-consequences analysis. BMC Health Serv Res. 2005;5:20. https://doi.org/10.1186/1472-6963-5-20 [cited 2019 Mar 11].
Culler SD, Parchman ML, Lozano-Romero R, Noel PH, Lanham HJ, Leykum LK, et al. Cost estimates for operating a primary care practice facilitation program. Ann Fam Med. 2013;11:207–11. https://doi.org/10.1370/afm.1496 [cited 2019 Mar 11].
Rhodes WCJ, Ritzwoller DP, Glasgow RE. Stakeholder perspectives on costs and resource expenditures: tools for addressing economic issues most relevant to patients, providers, and clinics. Transl Behav Med. 2018;8:675–82 Oxford University Press.
Wagner EH, Austin BT, Davis C, Hindmarsh M, Schaefer J, Bonomi A. Improving chronic illness care: translating evidence into action. Health Aff. 2001;20:64–78 [cited 2019 Sep 24]. Available from: http://www.ncbi.nlm.nih.gov/pubmed/11816692.
Coleman K, Austin BT, Brach C, Wagner EH. Evidence on the chronic care model in the new millennium: thus far, the evidence on the chronic care model is encouraging, but we need better tools to help practices improve their systems. Health Aff. 2009;28:75 NIH Public Access; [cited 2019 Sep 24]. Available from: http://www.ncbi.nlm.nih.gov/pubmed/19124857.
Services UC for M& M. Accountable care organizations (ACOs) [Internet]. Accountable care organ. 2020 [cited 2020 Jul 27]. Available from: https://www.cms.gov/Medicare/Medicare-Fee-for-Service-Payment/ACO.
Health Resources & Services Administration. Medically underserved areas and populations (MUA/Ps) | Bureau of health workforce [Internet]. Medically underserved areas popul. 2020 [cited 2020 Jul 27]. Available from: https://bhw.hrsa.gov/shortage-designation/muap.
US Bureau of Labor Statistics - US Department of Labor. May 2016 national occupational employment and wage estimates [Internet]. 2017 [cited 2019 May 10]. Available from: https://www.bls.gov/oes/2016/may/oes_nat.htm.
Gold HT. Issues in cost-effectiveness analysis for implementation science. In: Chambers D, Vinson C, Norton W, editors. Advancing the Science of Implementation across the Cancer Continuum. 1st ed. Oxford: Oxford University Press; 2018. p. 368–74.
Ritzwoller DP, Sukhanova A, Gaglio B, Glasgow RE. Costing behavioral interventions: a practical guide to enhance translation. Ann Behav Med. 2009;37:218–27.
Eisman AB, Kilbourne AM, Dopp AR, Saldana L, Eisenberg D. Economic evaluation in implementation science: making the business case for implementation strategies. Psychiatry Res. 2019;283:112433 [cited 2019 Sep 18]; Available from: http://www.ncbi.nlm.nih.gov/pubmed/31202612.
Fagnan LJ, Walunas TL, Parchman ML, Dickinson CL, Murphy KM, Howell R, et al. Engaging primary care practices in studies of improvement: did you budget enough for practice recruitment? Ann Fam Med. 2018;16:S72–9 Annals of Family Medicine, Inc.
Funding
This manuscript was funded in part by grant number R18 HS23922-01 from the US Agency for Healthcare Research and Quality. The funding body had no role in the design of the study and collection, analysis, and interpretation of data and in writing the manuscript which should be declared.
Author information
Authors and Affiliations
Contributions
All authors (HTG, NS, AMC, AMN, HP, CAB, DRS) have approved the submitted version (and any substantially modified version that involves the author's contribution to the study) and have agreed both to be personally accountable for the author’s own contributions and to ensure that questions related to the accuracy or integrity of any part of the work, even ones in which the author was not personally involved, are appropriately investigated, resolved, and the resolution documented in the literature. All authors (HTG, NS, AMC, AMN, HP, CAB, DRS) made substantial contributions to the conception or design of the work and were involved in the acquisition or interpretation of data; HTG had primary responsibility for data analyses; all authors (HTG, NS, AMC, AMN, HP, CAB, DRS) drafted the work or substantively revised it.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
This study was approved by the New York University School of Medicine Institutional Review Board (Protocol Number: i14-02042).
Consent for publication
Not applicable.
Competing interests
The authors declare no competing interests.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Gold, H.T., Siman, N., Cuthel, A.M. et al. A practice facilitation-guided intervention in primary care settings to reduce cardiovascular disease risk: a cost analysis. Implement Sci Commun 2, 15 (2021). https://doi.org/10.1186/s43058-021-00116-x
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s43058-021-00116-x