EBQI Implementation Strategy
We partnered with VHA regional leaders for Southern California, Arizona, and New Mexico. The regional Chief Medical Officer co-led the initiative with a local physician-researcher. We used EBQI to engage two VHA Medical Centers (facility A, facility B) in Arizona during our implementation period from June 2018 to September 2019. EBQI included “top-down” (i.e., leadership) and “bottom-up” (i.e., front-line clinical staff) multilevel stakeholder engagement, development of a structured quality improvement (QI) action plan, practice facilitation, formative data feedback, and across-site calls (Table 1).
Table 1 Descriptions of Evidence-Based Quality Improvement (EBQI) Activities During our study period, we engaged national-, regional-, and facility-level stakeholders. Specifically, we twice convened a national advisory board (consisting of national VHA experts in pain and addiction, VHA regional and facility leaders in primary care and mental health, and a VHA health economist) to ensure alignment with national priorities, develop consensus on the problem, and advise on benchmarks of success. We met monthly with VHA regional leaders (our partners) to review formative data on progress, discuss methods to leverage facilitators, and address implementation barriers for MOUD and CIH uptake. On the facility level, we conducted pre-implementation key stakeholder interviews (14 providers, 5 Veterans) to understand OUD, MOUD, and CIH experiences at baseline. We established a local QI team at each facility with clinical staff from several specialties (e.g., primary care, pain, addiction psychiatry) across various disciplines (e.g., physicians, nursing, pharmacy), led by a physician champion. We performed an initial site visit and then convened across-site calls (facilities A and B) twice monthly for a total of 23 meetings (average attendance = 6 facility representatives/meeting). During across-site calls, we performed practice facilitation, provided EBQI training (Plan-Do-Study-Act cycles, using data to monitor progress), and reviewed formative data. QI teams developed structured action plans, performed QI interventions to implement their plans,24 and developed tools. We conducted exit interviews with 8 key stakeholders to assess experiences with the initiative.
Facilities
Facilities A and B were selected in 2018 by the VHA regional leaders for this pilot given greater resources and interest (i.e., organizational readiness25) to implement MOUD and CIH in primary care and develop tools. While not an explicit criterion, the sites were the top two performers in MOUD treatment rates in the region and among the top 20th percentile in the nation. As of July 2018, site A had 87,729 patients, and facility B had 53,019; both were located in urban areas. Facility A included a primary care–based interprofessional pain program,26 consisting of providers with expertise in primary care, pain, addiction, psychiatry, rehabilitation, and acupuncture; pain psychologists; physical and recreation therapists; chiropractors; nurses; pharmacists; and dieticians. Facility A also served as the regional representative in the national VHA Stepped Care for Opioid Use Disorder Train-the-Trainer (SCOUTT) initiative in 2018. Facility B was designated in 2018 as a regional VHA Whole Health Flagship facility, offering health coaching, and CIH therapies and integrating Veterans’ physical, mental, emotional, and spiritual needs to develop personalized health plans.27, 28
Measures
We used the RE-AIM framework (Reach, Effectiveness, Adoption, Implementation, Maintenance)29 to assess the process and outcomes of our pilot intervention (Table 2). Qualitative and quantitative data were shared with site, regional, and national stakeholders throughout the initiative.
Table 2 Outcomes Mapped to RE-AIM29
Quantitative Measures
Based on input from our operational partners, our primary outcome measure was the percentage of patients with OUD who received MOUD in the past year, a VHA performance measure.30 Patients with OUD were identified using ICD-10 codes (F11.1**, F11.2**) from an inpatient or outpatient encounter. MOUD was defined as a prescription for at least one opioid antagonist [naltrexone] or opioid agonist (sublingual buprenorphine [Subutex] or buprenorphine/naloxone [suboxone] or methadone) in VHA and non-VHA pharmacy data. For the VHA performance measure, a patient diagnosed with OUD could either be prescribed MOUD or have at least one visit to an opioid treatment program. At the time, administrative coding for patients’ use of CIH therapies was nascent and inconsistent, so reliable CIH utilization metrics were not available.13 Our sample size was not powered sufficiently to measure changes in opioid-related mortality.
Qualitative Measures
Semi-structured interviews were conducted one month before and one month after the implementation period using the Practical Robust Implementation and Sustainability Model (PRISM).31 We explored contextual factors influencing MOUD prescribing and referring to CIH during the pre- and post-implementation interviews.
Data Sources
Data were obtained from the VHA electronic health record through the VHA Corporate Data Warehouse (CDW), semi-structured interviews, and administrative records (meeting minutes).
CDW includes patient demographics, diagnoses, utilization, and medications.32 We used VHA Academic Detailing reports, drawn from CDW and DEA records (April 2018–December 2019) to identify providers with an X-waiver recognized by VHA as having permission to prescribe buprenorphine.
For pre-implementation key stakeholder interviews, we used snowball sampling with guidance from regional leadership to identify appropriate stakeholders at each facility. These included PCPs, addiction psychiatrists, nurses from primary care and pain, and clinical pharmacists. We also interviewed patients diagnosed with OUD and who had received MOUD prior to implementation. Exit interviews were conducted after implementation with QI team participants. Interview guides were reviewed by regional leadership and union representatives to ensure relevance to facilities; subject matter experts ensured coverage of relevant domains. Interviews lasted 15–30 min, were conducted by phone, and were audio-recorded and professionally transcribed. We used a rapid analysis approach33, 34 to explore a priori themes based on the interview guides, but also allowing for emergent themes.
We reviewed administrative records (i.e., detailed minutes of workgroup meetings and QI meetings) and obtained records from facility champions to construct a timeline of interventions at each facility. These interventions were used to annotate facility-specific statistical process control charts (Appendix), a technique frequently used in QI to visualize data trends and indicate when observed changes may be attributed to inherent variation (common cause variation) or an intervention (special cause variation).35, 36
Ethics
This QI initiative was designed for internal purposes in support of the VHA mission37 and was given a determination of non-research by the VHA Greater Los Angeles Institutional Review Board.