Abstract
Background
Permanent supportive housing (PSH)—subsidized housing paired with support services such as case management—is a key part of national strategic plans to end homelessness. PSH tenants face high overdose risk due to a confluence of individual and environmental risk factors, yet little research has examined overdose prevention in PSH.
Methods
We describe the protocol for a hybrid type 3 stepped-wedge cluster randomized controlled trial (RCT) of overdose prevention practice implementation in PSH. We adapted evidence-based overdose prevention practices and implementation strategies for PSH using input from stakeholder focus groups. The trial will include 20 PSH buildings (with building size ranging from 20 to over 150 tenants) across New York City and New York’s Capital Region. Buildings will be randomized to one of four 6-month intervention waves during which they will receive a package of implementation support including training in using a PSH Overdose Prevention (POP) Toolkit, time-limited practice facilitation, and learning collaboratives delivered to staff and tenant implementation champions appointed by each building. The primary outcome is building-level fidelity to a defined list of overdose prevention practices. Secondary and exploratory implementation and effectiveness outcomes will be examined using PSH staff and tenant survey questionnaires, and analysis of tenant Medicaid data. We will explore factors related to implementation success, including barriers and facilitators, using qualitative interviews with key stakeholders. The project is being conducted through an academic-community partnership, and an Advisory Board including PSH tenants and other key stakeholders will be engaged in all stages of the project.
Discussion
We describe the protocol for a hybrid type 3 stepped-wedge cluster RCT of overdose prevention practice implementation in PSH. This study will be the first controlled trial of overdose prevention implementation in PSH settings. The research will make a significant impact by testing and informing future implementation strategies to prevent overdose for a population at particularly high risk for overdose mortality. Findings from this PSH-focused research are expected to be broadly applicable to other housing settings and settings serving people experiencing homelessness.
Trial registration
ClinicalTrials.gov, NCT05786222, registered 27 March 2023.
Similar content being viewed by others
Explore related subjects
Find the latest articles, discoveries, and news in related topics.Background
The overdose crisis continues to worsen in the USA, and health disparities related to overdose have widened in recent years [1,2,3,4]. Amidst these widening disparities, the connections between social determinants of health and overdose have become increasingly clear. For example, research has shown that homelessness is strongly associated with heightened risk for overdose [5,6,7,8].
Permanent supportive housing (PSH)—subsidized housing paired with support services such as case management—is a key part of national strategic plans to end homelessness [9]. PSH is generally targeted to people who have been chronically homeless and have significant health conditions, including substance use disorders and mental illness. Decades of evidence, including multiple RCTs, have proven that PSH is highly effective in durably resolving an individual’s homelessness, including for people with serious mental illness and people who use drugs [10,11,12,13,14]. There are currently 387,305 units of PSH across the USA, a number that has grown consistently in the past 15 years and that continues to grow [9, 15]. PSH is sometimes referred to as “Housing First,” which originated as a specific model, but now is a term often used more generally to describe the approach of placing people into housing without stepwise requirements or prerequisites of sobriety or “stability” of mental illness [16, 17]. The original Housing First model has harm reduction as a core tenet, but currently there is variability regarding the extent to which different PSH agencies embrace harm reduction [18].
While housing is critical to ending homelessness, placement into housing alone may not reduce overdose risk [10]. In fact, emerging evidence suggests relatively high overdose rates in PSH and similar housing settings such as single room occupancies (SROs), likely due to a confluence of individual and environmental risk factors [19,20,21]. For example, in a 2019 survey of leaders from 49 New York PSH agencies, 63% of agencies reported at least one opioid-involved overdose among their PSH tenants in the past year, and at least 118 tenants were known to have died from an overdose in the past 5 years [20]. PSH leaders completing the survey also identified multiple modifiable gaps related to overdose prevention in PSH [20].
Evidence-based practices for overdose prevention exist but their implementation in PSH has been sparsely studied. In general, integration of harm reduction principles and substance use-related initiatives in PSH settings is variable [22,23,24,25]. Limited non-experimental research has examined implementation of “Housing First” principles including harm reduction into PSH [26]. One study suggested that training and practice facilitation positively impacted PSH staff knowledge and attitudes toward harm reduction, and was met with high satisfaction [26]. Researchers in Vancouver, Canada, conducted qualitative research examining overdose risk and selected overdose prevention interventions (overdose response buttons and peer-led naloxone training and distribution) in PSH and SROs [21, 27, 28]. However, overall there is a paucity of high-quality evidence related to harm reduction in PSH [29] and there remains a significant gap in the evidence related to the effective implementation of overdose prevention practices in these settings. Indeed, to our knowledge, there has not yet been any experimental research examining implementation of overdose prevention practices in PSH. We seek to fill this gap by conducting a stepped-wedge cluster RCT to study the implementation of overdose prevention practices across 20 PSH buildings in New York.
Methods
Study design
This study is a hybrid type 3 trial using a stepped-wedge cluster RCT design [30], with the primary goal of studying building-level implementation of overdose prevention practices in PSH and a secondary goal of examining effectiveness on clinically relevant tenant outcomes. A stepped-wedge cluster RCT design was chosen because it can provide rigorous evidence for intervention effects while allowing all participating buildings to eventually receive the intervention, in contrast to traditional two-arm RCTs. The stepped-wedge design also presents advantages including feasibility related to staggered intervention start times, and improved power versus parallel cluster RCTs.
The study is funded by the National Institute on Drug Abuse of the National Institutes of Health and was approved by the Institutional Review Board at NYU Grossman School of Medicine. The study’s external Data Safety and Monitoring Board meets twice yearly. This manuscript adheres to CONSORT reporting guidelines for cluster randomized trials (checklist provided as an Additional file 1: Table S1).
Conceptual frameworks
We drew on the EPIS (Exploration, Preparation, Implementation, Sustainment) framework to guide the study’s design [31, 32]. This multilevel framework includes both process (“phases”) and determinant (“constructs”) components. We previously completed the Exploration phase through surveys conducted with PSH building leaders in New York to identify the scope of overdose and related gaps in PSH [20]. The Preparation phase of our work uses key stakeholder focus groups to refine a package of overdose prevention practices and implementation strategies for PSH. The stepped-wedge cluster RCT encompasses both the implementation and sustainment phases of EPIS, as further described in the sections that follow.
We consider key drivers of overdose risk and overdose prevention practice implementation in PSH within the EPIS constructs of outer context, inner context, bridging factors, and innovation factors. We organize these further within Rhodes’ Risk Environment Framework, which categorizes physical, social, economic, and policy-level risks at the level of the micro- and macro-environment [33]. Researchers have previously used Rhodes’ Risk Environment Framework to categorize environmental factors that confer risk for overdose in SROs, such as lack of shared spaces and rules or norms which may lead to using drugs alone [21, 34, 35]; many of these risks are common to PSH settings. We hypothesize that building receipt of an intervention package that considers the inner and outer context in PSH—as we are developing in the study’s Preparation phase—will improve fit and, subsequently, the likelihood that buildings will successfully implement the overdose prevention practices.
The overall project is grounded in the philosophies of community based participatory research (CBPR) [36]. From the beginning of the project, academic investigators have worked in partnership with the Metro Team (covering New York, New Jersey, and Pennsylvania) of the Corporation for Supportive Housing (CSH). CSH is intimately familiar with strengths, assets, and barriers specific to PSH. In the study’s Preparation phase, the planned overdose prevention practices and implementation strategy package are being refined based on input from PSH leaders, frontline staff, and tenants. Additionally, the project is guided by a Study Advisory Board (SAB) at all stages of the research. The SAB includes PSH tenants and staff, people with lived experience of drug use, and representatives from relevant community (e.g., harm reduction, housing advocacy) and governmental (e.g., city and state departments of health) organizations.
Setting
The stepped-wedge cluster RCT will include 20 PSH buildings in New York City (NYC) and New York’s Capital Region. These areas were chosen to provide a diversity of settings, enhancing generalizability. New York’s Capital Region encompasses the mid-sized metropolitan areas of Albany, Troy, and Schenectady. This trial includes congregate PSH buildings, where PSH tenants live together and have access to onsite social services such as case management. In general, onsite services are provided by a nonprofit agency whose portfolio might include multiple PSH buildings as well as other homeless services. Separate property/building management companies may operate the physical housing/apartment complex. Some congregate PSH buildings are mixed-use buildings, also having affordable or market-rate units for non-PSH tenants. Congregate PSH stands in contrast to “scattered site” PSH, where PSH tenants live “scattered” in subsidized market units across the community. Our trial focuses on congregate PSH because this form of PSH is most amenable to building-level interventions and most generalizable to other types of buildings serving populations at high risk for overdose.
Study population and eligibility
Twenty PSH buildings in NYC and New York’s Capital Region were selected for participation in the trial. CSH’s Metro Team conducted initial outreach to 57 nonprofit agencies in NYC and the Capital Region that provide PSH services, representing the large majority of such agencies in these areas. Agency leaders were provided with written information about the project. They were also invited to an information session held by Zoom and engaged in individual meetings to discuss the project. Agencies were asked to complete online building assessment questionnaires including questions about the size of the building, population served, number of fatal and nonfatal overdoses in the past year, and existing building practices related to overdose prevention. Questionnaires were completed by 25 agencies, encompassing 44 unique buildings. Of the 32 agencies to whom outreach was conducted who did not ultimately complete a questionnaire, 15 did not reply to outreach e-mails, 8 expressed that they were not interested in the project, and 9 were determined not to be eligible (e.g., due to not providing congregate PSH).
The CSH Metro Team and academic study team used the information gathered from their meetings with buildings and from the building assessment questionnaires to select buildings for participation. The primary selection criteria were that buildings had to have at least 20 PSH tenants and overdose had to be a significant concern, as demonstrated either by report of past overdoses on building assessment questionnaires or report from building leaders during meetings. Of the 44 buildings completing building assessment questionnaires, 2 were not eligible based on size and 2 expressed that they did not want to participate. From the remaining 40 buildings, we selected and invited 20 to participate; 3 buildings (from 2 agencies) declined and were replaced to reach 20 participating buildings. Selection prioritized buildings with high levels of overdose concern. Buildings also had to have some degree of “room to improve” in overdose prevention, as demonstrated by their building assessment questionnaire responses related to existing overdose prevention efforts or based on gaps in overdose prevention identified in meetings. To maximize generalizability, buildings were not required to demonstrate a certain level of readiness for implementing new overdose prevention practices; however, buildings did have to express willingness to engage in activities to support them in implementing new overdose prevention practices (e.g., practice facilitation meetings), and to participate in the research study procedures. We also aimed to ensure diversity in participating buildings (e.g., in population served or agency size). No more than two buildings were selected from any given nonprofit agency and, in the case of multiple buildings from the same agency, buildings were required to be geographically dispersed, have different directors, and operate independently, to avoid concerns related to “clustering.” Larger buildings were prioritized for selection in NYC given that Capital Region buildings tend to be smaller (see “Sample size” and “Power” sections).
Leaders from the 20 buildings participating in the trial completed a project participation agreement with CSH and a data sharing agreement with the academic study team.
Intervention overview
The intervention is provision of multi-faceted implementation support to PSH buildings, with the goal of helping them implement a set of evidence-based practices to reduce tenant overdose. As detailed below, the intervention will be delivered by CSH. The implementation strategies to be tested and overdose prevention practices to be implemented and are being refined in a 1-year preparation phase. In this phase, insight to and feedback on the implementation strategies and overdose prevention practices are being gathered from multiple sources including: focus groups with PSH tenants, staff, and leaders in NYC and New York’s Capital Region; additional discussions with PSH staff and leaders from buildings participating in the study; Study Advisory Board meetings; and meetings with and review by content experts and other relevant stakeholders. In future publications we will present focus group results and the final implementation strategy and overdose prevention practice packages. In the sections that follow, we provide an overview of the anticipated implementation strategies to be tested and overdose prevention practices to be implemented.
Implementation strategies to be tested
Each building participating in the trial will receive 6 months of support in implementing the overdose prevention practices. CSH will provide implementation support consisting of four primary strategies (see Table 1): (1) a POP (PSH Overdose Prevention) Toolkit and associated trainings, (2) tenant and staff implementation champions, (3) limited practice facilitation, and (4) learning collaboratives. These strategies—which are included in the compilation of implementation strategies from the Expert Recommendations for Implementing Change (ERIC) project [37]—were selected based on conversations between the academic study team and CSH about which implementation strategies were most likely to be accepted by and useful to PSH buildings. Together, we are calling this package of implementation support “technical assistance,” to align with language more commonly used by PSH buildings.
Trainings, initial practice facilitation meetings and coaching sessions, and learning collaboratives are expected to amount to approximately 20 h over the first 3 months of each 6-month technical assistance period. More limited practice facilitation will continue in the next 3 months, in addition to ongoing learning collaborative meetings. Outside of scheduled meetings, building leaders and staff and tenant implementation champions are expected to spend additional time working to implement the overdose prevention practices in their building. Overall, the amount of time for active implementation activities is moderate, and deliberately designed to maximize generalizability in PSH settings given real-world resource constraints.
Overdose prevention practices to be implemented
Buildings will receive support for implementing overdose prevention practices in three core categories: (1) overdose response; (2) harm reduction; and (3) support for substance use disorder (SUD) treatment. While the exact list of specific overdose prevention practices within each category is being refined in the study’s preparation phase, examples of anticipated practices are shown in Table 2.
There has been no past research that would suggest a set of “gold standard” overdose prevention practices for PSH specifically. However, the planned overdose prevention strategies outlined above have either been studied in other settings or are generally accepted as best practices, including for structurally marginalized populations such as people experiencing homelessness [38,39,40,41,42,43,44,45,46,47,48]. We modeled an initial list of overdose prevention practices on an overdose prevention practice package developed by an interagency workgroup for use in isolation and quarantine hotels for people experiencing homelessness during the COVID-19 pandemic. We felt this package would be promising for adaptation to PSH settings because it was comprehensive, based on expert consensus on evidence-based practices, and developed for settings bearing similarities to PSH (e.g., serving a high-risk and stigmatized population, having private rooms where overdose is possible behind closed doors). We made initial adaptations based on results from New York PSH leader surveys in the project’s exploratory phase [20], which provided insight to inform overdose prevention in PSH. For example, the surveys revealed stigma and misunderstanding related to medication for opioid use disorder, a lack of defined referral pathways for SUD treatment, and gaps in PSH staff training on naloxone use.
We are further adapting the package of overdose prevention practices for PSH settings in a 1-year preparation phase, including gathering feedback from focus groups with PSH tenants, staff, and leaders in NYC and New York’s Capital Region, as well as from the Study Advisory Board, content experts, and other relevant stakeholders. We will adapt, refine, and finalize the list of overdose prevention practices based on this feedback. We hypothesize that adapting the overdose prevention practices for the specific PSH setting will increase the likelihood that they are viewed as acceptable and appropriate by PSH staff and tenants, and that they are implemented with fidelity and sustained.
Buildings participating in the study will receive education, training, and support for implementing the overdose prevention practices during their randomly assigned 6-month intervention (technical assistance) period. While buildings will be trained on and receive support in implementing each of the overdose prevention practices, we will not require and do not anticipate that all buildings will implement every practice. The primary goal of the study is to examine how successful buildings are in implementing the practices and we expect there to be heterogeneity across buildings.
Randomization
Buildings will be randomly assigned to one of four sequential 6-month intervention waves (five buildings per wave). With the stepped-wedge design, all study buildings will begin in the control condition. Buildings are randomly assigned to cross over at different times, with all eventually receiving the intervention. See Fig. 1 for a schematic of the stepped-wedge cluster RCT design.
Randomization will be conducted by the study statistician, who will not have contact with the PSH buildings. There is no stratification of randomization. Buildings will be notified of their assigned intervention wave before the first wave starts.
POP study stepped-wedge RCT design
Legend: Schematic of the stepped-wedge RCT design. Each building will be randomized to one of 4 waves during which they will receive the 6-month technical assistance intervention. There is a 1-month break/buffer period between each wave to facilitate measurement (e.g., staff surveys and fidelity checklist completion) and preparation for the subsequent wave. Not shown in the figure is that formal measurement of sustainment will occur for each building in the 8th month following wave completion
Outcomes
As a hybrid type 3 effectiveness-implementation trial, this study aims primarily to examine implementation outcomes and secondarily to explore clinical effectiveness.
Primary outcome
The primary outcome is building-level fidelity to the overdose prevention practices. This outcome will be measured with a scored building-level fidelity checklist completed by two raters blinded to building wave assignment. Checklists will be completed for each participating building at five time points: once before the first intervention wave begins, and once as each of the four waves ends. Raters will complete the fidelity checklists using a combination of program material review (e.g., lease language, building overdose prevention plan, training calendar and attendance logs), self-assessment surveys completed by building leaders and key staff, and environmental observation when possible/applicable (e.g., presence of naloxone in the building). For each overdose prevention practice, buildings will receive a fidelity checklist score of 0 (not implemented), 1 (partial implementation), or 2 (full implementation). Scores will be benchmarked to defined, objective, measurable criteria. The two raters will independently complete checklists, and their scores averaged. The primary outcome is the average sum score on the fidelity checklist, treated as a continuous variable. The range of possible scores will depend on the final number of overdose prevention practices (for example, if there are 15 final overdose prevention practices, fidelity checklist scores would range from 0 to 30). Secondary analyses will examine fidelity checklist sub-scores (e.g., for specific overdose prevention practice categories).
Secondary and exploratory outcomes
Secondary implementation and effectiveness outcomes, and exploratory effectiveness outcomes, are summarized in Tables 3 and 4. Secondary and exploratory outcomes will be examined using (1) PSH staff surveys, (2) Medicaid data analysis, and (3) PSH tenant surveys.
PSH staff surveys will be conducted at five timepoints for staff from all participating buildings: once before the first intervention wave begins, and once as each of the four waves ends. All PSH staff with tenant-facing, supervisory, or leadership roles will be invited via e-mail to complete surveys. Invitation emails will include a hyperlink to a secure online REDCap survey. Invitations to participate in surveys will be non-coercive; it will be made clear that there will be no negative ramifications for their employment if staff decline to participate. A consent document will be included for staff to review prior to deciding whether to participate. Survey content is described in Table 3. Surveys are anticipated to take less than 20 min to complete.
Medicaid data analysis will use statewide Medicaid data to examine tenant-level effectiveness outcomes, as outlined in Table 3. Participating PSH buildings will provide investigators with PSH tenant identifying information. Investigators will use deterministic matching procedures to link this data with New York Medicaid data. After linkage, individual identifying information will be removed to create a de-identified Medicaid dataset for analysis; a building code will be retained and each tenant will be given a unique non-identifying study code to facilitate longitudinal analyses.
PSH tenant surveys will be used to examine exploratory effectiveness outcomes. These surveys will be administered twice for tenants of each participating building: immediately before that building’s intervention wave starts and approximately 12 months later. Paper surveys will be mailed to each tenant with a consent document, instructions for completion, and a self-addressed stamped return envelope. Tenants will also be offered the option to complete the survey by phone or online. Tenant surveys are anticipated to take approximately 30 min to complete. The study team will take multiple steps to increase survey participation rates, including explaining to tenants that the surveys are confidential and doing direct outreach in the PSH buildings. Survey content is described in Table 4.
Buildings participating in the study will complete agreements outlining provisions for data sharing (i.e., of staff and tenant contact information for survey distribution and tenant identifying information for linkage with Medicaid data) with the study team.
Statistical analysis
To estimate effects of the intervention on the primary outcome, we will use a linear mixed model that incorporates both within- and between-cluster information and accounts for secular temporal trends. In particular, to assess the intervention effect, we will use a model with random site effects of the form: Yit = μ + β1t + β2Iit + β3Iit(t – si) + bi where Yit is the fidelity checklist score in building i during period t, for t ∈ (0, 1, …, 4). Each period is 6 months; t = 0 is the first 6-month period. Iit is an indicator variable; Iit = 1 if building i has been assigned to implementation at period t and Iit = 0 otherwise. s is the period when implementation begins for building i. bi is a random effect associated with each building i (the deviation of the intercept for the building from the overall intercept μ). Models will take into account a general time trend and allow for the intervention effects to grow over time following implementation. Models will be fit using the lme4 package using R software. Each hypothesis will be tested using a two-sided level of significance α = 0.05. Similar models will be used for analysis of the secondary implementation outcomes.
Implementation sustainment will be measured in the 8th month after the conclusion of each 6-month intervention wave. Paired-samples t tests will be used to compare each building’s fidelity scores at the end of its control period with scores during the sustainment period. For buildings assigned to early waves, there is also an opportunity to measure longer term (> 12 months) sustainment within the study measurement period.
Secondary effectiveness outcomes using Medicaid data and staff surveys will use generalized linear mixed models appropriate to each type of outcome (e.g., a Poisson model to compare visit rates). Health service use variables (e.g., ED visits) will be calculated as rates when appropriate (e.g., visits per study population per time period). For all secondary and exploratory analyses, we will examine the amount and type of missing data (e.g., missing at random or not at random) and implement appropriate statistical procedures for missing data as necessary. We will examine exploratory outcomes from tenant surveys using mixed-effects regression analysis. For the post-intervention survey time point we will conduct sub-analyses limited to tenants who have lived for at least 6 months in the building.
Power and sample size
With 20 buildings participating in the study and 4 “steps” or waves in the stepped-wedge RCT (i.e., n = 100 observations over time across all buildings given 5 total time points per building), we will have at least 80% power to detect an increase of approximately two-thirds of a standard deviation (d = 0.69) or larger in the primary implementation outcome, a meaningful and feasible difference. This assumes a moderate correlation between scores for the same building at different time points (ICC = 0.5), reflecting stable differences among buildings. Even in the unlikely event that we do not retain 20 buildings in the study, with 16 buildings we would still have at least 80% power to detect an increase of about three-quarters of a standard deviation (d = 0.77) in the primary implementation outcome. To make these effect sizes more concrete, if the checklist score had a standard deviation of 8 and an average score of 15 under the control condition, the stepped-wedge design has 80% power to detect an increase of about 5 to 6 points on the checklist score (e.g., an increase from 15 to 20).
Qualitative interviews
After the intervention is delivered, we will conduct qualitative interviews with PSH building staff, as well as tenant implementation champions, to explore multilevel factors influencing implementation, including barriers and facilitators. We will use purposeful sampling to maximize breadth and utility of information gained, interviewing individuals holding different staff roles from diverse PSH buildings participating in the study. We will also interview staff and tenant implementation champions. Interviews will use a semi-structured interview guide that will capture key EPIS framework construct domains related to success of implementation (e.g., inner context, outer context, bridging factors, innovation factors). Qualitative interviews with building leaders will additionally explore penetration of the overdose prevention practices across other buildings (i.e., those not participating in the study) operated by their agency. Interview guides will be tailored to each type of key stakeholder.
Interviews will be digitally recorded and professionally transcribed. We will perform line-by-line coding of transcripts using a list of key domains identified a priori based on EPIS and our study goals (deductive), but allowing new themes to emerge organically from the text (inductive) in the grounded theory tradition. We will also create templated summaries of each interview and conduct matrix analysis focused on key EPIS domains [59]. We will use Dedoose qualitative research web application to assist with thematic analysis and data organization [60].
Payments and incentives
The Corporation for Supportive Housing is providing an honorarium of $2000 per participating PSH agency plus an additional $1000 per building participating in the study. Tenant champions will receive an honorarium totaling approximately $500. Additionally, tenants and staff will be compensated by the study team for the time they spend completing surveys and qualitative interviews.
Discussion
We describe the protocol for a hybrid type 3 stepped-wedge RCT of overdose prevention practice implementation in PSH. Changes in the epidemiology of the overdose crisis—including widening racial and ethnic disparities—highlight the necessity of concerted efforts to reduce the disparate burden of overdose faced by structurally marginalized populations. Homelessness and housing instability are strongly associated with increased risk of overdose [5, 7, 8, 61,62,63,64,65]. And, while PSH is an evidence-based intervention to resolve homelessness [13, 66], additional interventions are needed to reduce tenant overdose risk.
The 20 PSH buildings participating in the trial have distinct leadership teams, are geographically disbursed across NYC and in New York’s Capital Region, and are not generally accustomed to participating in research studies. Buildings are heterogenous in size, harm reduction orientation, and existing tenant services. Though these factors increase the complexity of study administration, ultimately, we hope that they enhance the real-world applicability and generalizability of the study. The partnership of academic researchers with the Metro Team of CSH, a national nonprofit organization focused on advancing best practices in PSH, is critical for enhancing the feasibility of the study. As a trusted entity in the field, CSH is well-positioned to deliver the implementation intervention to PSH buildings participating in the study and, eventually, to disseminate the study results nationally. Project planning has also included significant involvement of people with lived experience of drug use and as PSH tenants, which we believe has further enhanced the feasibility and real-world applicability of the study. Other strengths of the trial include the multiple, robust sources of data being used to evaluate implementation and effectiveness outcomes.
To our knowledge, our study will be the first controlled trial of overdose prevention in PSH. In general, little prior overdose prevention research has focused on PSH or similar housing settings, despite their being high-risk environments for overdose and potentially promising sites for interventions [34]. The majority of related studies have been conducted in PSH and SROs in Vancouver, Canada. There, researchers have conducted qualitative interviews with PSH residents identifying overdose risks related to using drugs alone in their rooms and potential benefits of safer supply medications [28]; qualitative interviews examining a tenant-led naloxone training and distribution intervention in SROs [21]; and qualitative interviews assessing use of overdose response buttons in a women-only PSH building [27]. These studies suggested risk factors and a few potentially promising interventions to prevent overdose in PSH and SROs, yet overall there remains a large gap in the literature related to effective interventions to prevent overdose deaths in these settings.
In general, very little implementation science research has been conducted in PSH or similar housing settings [26, 67,68,69]. Notably, interventions for substance use disorders are still primarily delivered in healthcare or other specialized settings, despite the fact that individuals generally spend only several hours per year in healthcare settings and orders of magnitude more time in housing settings. Our study sets the stage for a new paradigm of research and strategies bringing overdose prevention to where people live and spend most of their time. Additionally, through the study we will test the application of the EPIS implementation science framework in PSH settings, shedding light on its utility in such settings and examining whether modifications should be made to maximize its applicability in future housing-based implementation efforts.
Our trial does have some limitations. First, the building-level fidelity checklist we will use to assess the primary outcome has not been previously validated. However, a similar measure has been used successfully by the study team and we have described the multiple steps we plan to take to ensure rigor of this measure, including having two blinded raters independently complete each fidelity checklist [70]. A second small limitation is that outcomes based on Medicaid data will exclude a small number of tenants (anticipated to be < 10%) who do not have Medicaid. However, using Medicaid data will allow us to feasibly assess objective outcome measures for most tenants from PSH buildings in the study. As described, we are supplementing Medicaid data analysis with tenant-collected survey questionnaires. We will attempt to maximize tenant survey participation as described earlier, but there is still the possibility of selection bias in who completes surveys and social desirability bias in responses. Finally, we are testing a package of implementation strategies; our study design will not provide experimental evidence of which of the strategies were most impactful. We will, however, explore staff and tenant champion perceptions of the specific strategies in qualitative interviews. Our priority is to test a package of implementation strategies that we believe will be effective yet which is potentially feasible for broad replication in PSH. If this research finds the package was effective, we will pursue future studies to refine the most effective combination of strategies and minimum effective dose.
In conclusion, this stepped-wedge cluster RCT will test strategies to support implementation of overdose prevention practices in PSH settings. We anticipate that the knowledge gained about implementation of overdose prevention practices in PSH will be generalizable to other types of housing settings including transitional housing provided in hotels and motels (which became more common during the COVID-19 pandemic), other types of transitional housing, SROs, and public housing or other subsidized housing buildings. Ultimately, we hope that this work will inform efforts to prevent death and suffering among the many people affected by the junction of the overdose and housing crises.
Availability of data and materials
Not applicable.
Abbreviations
- CSH:
-
Corporation for Supportive Housing
- EPIS:
-
Exploration, Preparation, Implementation, Sustainment framework
- MOUD:
-
Medication for opioid use disorder (e.g., methadone, buprenorphine)
- NYC:
-
New York City
- PSH:
-
Permanent supportive housing
- RCT:
-
Randomized controlled trial
- SAB:
-
Study advisory board
- SRO:
-
Single-room occupancy
- SUD:
-
Substance use disorder
References
Townsend T, Kline D, Rivera-Aguirre A, Bunting AM, Mauro PM, Marshall BDL, et al. Racial/ethnic and geographic trends in combined stimulant/opioid overdoses, 2007–2019. Am J Epidemiol. 2022;191(4):599–612.
Mattson CL, Tanz LJ, Quinn K, Kariisa M, Patel P, Davis NL. Trends and geographic patterns in drug and synthetic opioid overdose deaths - United States, 2013–2019. MMWR Morb Mortal Wkly Rep. 2021;70(6):202–7.
Friedman JR, Hansen H. Evaluation of increases in drug overdose mortality rates in the US by race and ethnicity before and during the COVID-19 pandemic. JAMA Psychiat. 2022;79(4):379–81.
Furr-Holden D, Milam AJ, Wang L, Sadler R. African Americans now outpace whites in opioid-involved overdose deaths: a comparison of temporal trends from 1999 to 2018. Addiction. 2021;116(3):677–83.
Barocas JA, Wang J, Marshall BDL, LaRochelle MR, Bettano A, Bernson D, et al. Sociodemographic factors and social determinants associated with toxicology confirmed polysubstance opioid-related deaths. Drug Alcohol Depend. 2019;200:59–63.
Kerr T, Fairbairn N, Tyndall M, Marsh D, Li K, Montaner J, et al. Predictors of non-fatal overdose among a cohort of polysubstance-using injection drug users. Drug Alcohol Depend. 2007;87(1):39–45.
Marshall JR, Gassner SF, Anderson CL, Cooper RJ, Lotfipour S, Chakravarthy B. Socioeconomic and geographical disparities in prescription and illicit opioid-related overdose deaths in Orange County, California, from 2010–2014. Subst Abus. 2019;40(1):80–6.
Doran KM, Rahai N, McCormack RP, Milian J, Shelley D, Rotrosen J, et al. Substance use and homelessness among emergency department patients. Drug Alcohol Depend. 2018;188:328–33.
The U.S. Interagency Council on Homelessness. All In: The Federal Strategic Plan to Prevent and End Homelessness. December 2022. Available at: https://www.usich.gov/All_In_The_Federal_Strategic_Plan_to_Prevent_and_End_Homelessness.pdf. Accessed 2 Jan 2023.
National Academies of Sciences, Engineering, and Medicine. Permanent Supportive Housing: Evaluating the Evidence for Improving Health Outcomes Among People Experiencing Chronic Homelessness. Washington, DC: The National Academies Press; 2018.
Raven MC, Niedzwiecki MJ, Kushel M. A randomized trial of permanent supportive housing for chronically homeless persons with high use of publicly funded services. Health Serv Res. 2020;55(S2):797–806.
Kertesz SG, Baggett TP, O’Connell JJ, Buck DS, Kushel MB. Permanent supportive housing for homeless people - reframing the debate. N Engl J Med. 2016;375(22):2115–7.
Rog DJ, Marshall T, Dougherty RH, George P, Daniels AS, Ghose SS, et al. Permanent supportive housing: assessing the evidence. Psychiatr Serv. 2014;65(3):287–94.
Urbanoski K, Veldhuizen S, Krausz M, Schutz C, Somers JM, Kirst M, et al. Effects of comorbid substance use disorders on outcomes in a housing first intervention for homeless people with mental illness. Addiction. 2018;113(1):137–45.
The U.S. Department of Housing and Urban Development. The 2022 Annual Homelessness Assessment Report (AHAR) to Congress. Part I: Point-in-Time Estimates of Homelessness. December 2022. Available at: https://www.huduser.gov/portal/sites/default/files/pdf/2022-AHAR-Part-1.pdf. Accessed 2 Jan 2023.
Tsemberis S. Providing housing first and recovery services for homeless adults with severe mental illness. Psychiatr Serv. 2005;56(10):1303–5.
Tsemberis S. From streets to homes: An innovative approach to supported housing for homeless adults with psychiatric disabilities. J Community Psychol. 1999;27(2):225–41.
Tsemberis S, Gulcur L, Nakae M. Housing First, consumer choice, and harm reduction for homeless individuals with a dual diagnosis. Am J Public Health. 2004;94(4):651–6.
Rowe CL, Riley ED, Eagen K, Zevin B, Coffin PO. Drug overdose mortality among residents of single room occupancy buildings in San Francisco, California, 2010–2017. Drug Alcohol Depend. 2019;204:107571.
Corporation for Supportive Housing. Supportive Housing and the Opioid Crisis. Dec 2020. Available from: https://www.csh.org/resources/supportive-housing-and-the-opioid-crisis/. Accessed 25 Apr 2023.
Bardwell G, Fleming T, Collins AB, Boyd J, McNeil R. Addressing intersecting housing and overdose crises in Vancouver, Canada: opportunities and challenges from a tenant-led overdose response intervention in single room occupancy hotels. J Urban Health. 2019;96(1):12–20.
Dickson-Gomez J, Quinn K, Bendixen A, Johnson A, Nowicki K, Ko Ko T, et al. Identifying variability in permanent supportive housing: a comparative effectiveness approach to measuring health outcomes. Am J Orthopsychiatry. 2017;87(4):414–24.
The National Center on Addiction and Substance Abuse at Columbia University (CASA Columbia) and Corporation for Supportive Housing. Unlocking the door: an implementation evaluation of supportive housing for active substance users in NYC. 2012. Available from: https://www.csh.org/wp-content/uploads/2012/07/report_casafullreport_712.pdf.pdf. Accessed 12 Dec 2020.
Henwood BF, Harris T, Woo D, Winetrobe H, Rhoades H, Wenzel SL. Availability of comprehensive services in permanent supportive housing in Los Angeles. Health Soc Care Community. 2018;26(2):207–13.
Robbins PC, Callahan L, Monahan J. Perceived coercion to treatment and housing satisfaction in housing-first and supportive housing programs. Psychiatr Serv. 2009;60(9):1251–3.
Watson DP, Ahonen EQ, Shuman V, Brown M, Tsemberis S, Huynh P, et al. The Housing First Technical Assistance and Training (HFTAT) implementation strategy: outcomes from a mixed methods study of three programs. Subst Abuse Treat Prev Policy. 2018;13(1):32.
Bardwell G, Fleming T, McNeil R, Boyd J. Women’s multiple uses of an overdose prevention technology to mitigate risks and harms within a supportive housing environment: a qualitative study. BMC Womens Health. 2021;21(1):51.
Ivsins A, MacKinnon L, Bowles JM, Slaunwhite A, Bardwell G. Overdose prevention and housing: a qualitative study examining drug use, overdose risk, and access to safer supply in permanent supportive housing in Vancouver. Canada J Urban Health. 2022;99(5):855–64.
Kerman N, Polillo A, Bardwell G, Gran-Ruaz S, Savage C, Felteau C, et al. Harm reduction outcomes and practices in Housing First: a mixed-methods systematic review. Drug Alcohol Depend. 2021;228:109052.
Curran GM, Bauer M, Mittman B, Pyne JM, Stetler C. Effectiveness-implementation hybrid designs: combining elements of clinical effectiveness and implementation research to enhance public health impact. Med Care. 2012;50(3):217–26.
Aarons GA, Hurlburt M, Horwitz SM. Advancing a conceptual model of evidence-based practice implementation in public service sectors. Adm Policy Ment Health. 2011;38(1):4–23.
Moullin JC, Dickson KS, Stadnick NA, Rabin B, Aarons GA. Systematic review of the Exploration, Preparation, Implementation, Sustainment (EPIS) framework. Implement Sci. 2019;14(1):1.
Rhodes T. Risk environments and drug harms: a social science for harm reduction approach. Int J Drug Policy. 2009;20(3):193–201.
Bardwell G, Collins AB, McNeil R, Boyd J. Housing and overdose: an opportunity for the scale-up of overdose prevention interventions? Harm Reduct J. 2017;14(1):77.
Knight KR, Lopez AM, Comfort M, Shumway M, Cohen J, Riley ED. Single room occupancy (SRO) hotels as mental health risk environments among impoverished women: the intersection of policy, drug use, trauma, and urban space. Int J Drug Policy. 2014;25(3):556–61.
Israel BA, Schulz AJ, Parker EA, Becker AB. Community-based participatory research: policy recommendations for promoting a partnership approach in health research. Educ Health (Abingdon). 2001;14(2):182–97.
Powell BJ, Waltz TJ, Chinman MJ, Damschroder LJ, Smith JL, Matthieu MM, et al. A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project. Implement Sci. 2015;10(1):21.
Chimbar L, Moleta Y. Naloxone effectiveness: a systematic review. J Addict Nurs. 2018;29(3):167–71.
Chou R, Korthuis PT, McCarty D, Coffin PO, Griffin JC, Davis-O’Reilly C, et al. Management of suspected opioid overdose with naloxone in out-of-hospital settings: a systematic review. Ann Intern Med. 2017;167(12):867–75.
Malta M, Varatharajan T, Russell C, Pang M, Bonato S, Fischer B. Opioid-related treatment, interventions, and outcomes among incarcerated persons: a systematic review. PLoS Med. 2019;16(12):e1003002.
Sordo L, Barrio G, Bravo MJ, Indave BI, Degenhardt L, Wiessing L, et al. Mortality risk during and after opioid substitution treatment: systematic review and meta-analysis of cohort studies. BMJ. 2017;357:j1550.
Bahji A, Cheng B, Gray S, Stuart H. Reduction in mortality risk with opioid agonist therapy: a systematic review and meta-analysis. Acta Psychiatr Scand. 2019;140(4):313–39.
Chou R, Dana T, Blazina I, Grusing S, Fu R, Bougatsos C. U.S. Preventive Services Task Force Evidence Syntheses. Interventions for unhealthy drug use—supplemental report: a systematic review for the U.S. preventive services task force. Rockville (MD): Agency for Healthcare Research and Quality (US); 2020.
Magwood O, Salvalaggio G, Beder M, Kendall C, Kpade V, Daghmach W, et al. The effectiveness of substance use interventions for homeless and vulnerably housed persons: a systematic review of systematic reviews on supervised consumption facilities, managed alcohol programs, and pharmacological agents for opioid use disorder. PLoS ONE. 2020;15(1):e0227298.
Winhusen T, Walley A, Fanucchi LC, Hunt T, Lyons M, Lofwall M, et al. The Opioid-overdose Reduction Continuum of Care Approach (ORCCA): evidence-based practices in the HEALing Communities Study. Drug Alcohol Depend. 2020;217:108325.
Irvine MA, Kuo M, Buxton JA, Balshaw R, Otterstatter M, Macdougall L, et al. Modelling the combined impact of interventions in averting deaths during a synthetic-opioid overdose epidemic. Addiction. 2019;114(9):1602–13.
Barglow P. Commentary: The opioid overdose epidemic: evidence-based interventions. Am J Addict. 2018;27(8):605–7.
U.S. Interagency Council on Homelessness. Strategies to address the intersection of the opioid crisis and homelessness. 2017. Available from: https://www.usich.gov/resources/uploads/asset_library/Strategies_to_Address_Opioid_Crisis.pdf. Accessed 25 Apr 2023.
Weiner BJ, Lewis CC, Stanick C, Powell BJ, Dorsey CN, Clary AS, et al. Psychometric assessment of three newly developed implementation outcome measures. Implement Sci. 2017;12(1):108.
Klein KJ, Conn AB, Sorra JS. Implementing computerized technology: an organizational analysis. J Appl Psychol. 2001;86(5):811–24.
Dunn KE, Barrett FS, Yepez-Laubach C, Meyer AC, Hruska BJ, Sigmon SC, et al. Brief Opioid Overdose Knowledge (BOOK): a questionnaire to assess overdose knowledge in individuals who use illicit or prescribed opioids. J Addict Med. 2016;10(5):314.
Luoma JB, O’Hair AK, Kohlenberg BS, Hayes SC, Fletcher L. The development and psychometric properties of a new measure of perceived stigma toward substance users. Subst Use Misuse. 2010;45(1–2):47–57.
Owens PL, Fingar KR, McDermott KW, Muhuri PK, Heslin KC. Agency for Healthcare Research and Quality, Healthcare Cost and Utilization Project, Statistical Brief #249: inpatient stays involving mental and substance use disorders, 2016. Available at: https://www.hcup-us.ahrq.gov/reports/statbriefs/sb249-appendix.pdf. Accessed 10 Sept 2021.
Peterson AM, Nau DP, Cramer JA, Benner J, Gwadry-Sridhar F, Nichol M. A checklist for medication compliance and persistence studies using retrospective databases. Value Health. 2007;10(1):3–12.
Continuity of pharmacotherapy for opioid use disorder. National Quality Forum, 2018. Available at: https://www.qualityforum.org/Qps/MeasureDetails.aspx?standardID=3175&print=0&entityTypeID=1. Accessed 8 Sept 2020.
Bohnert AS, Bonar EE, Cunningham R. A pilot randomized clinical trial of an intervention to reduce overdose risk behaviors among emergency department patients at risk for prescription opioid overdose. Drug Alcohol Depend. 2016;163:40–7.
Coffin PO, Santos GM, Matheson T, Behar E, Rowe C, Rubin T, et al. Behavioral intervention to reduce opioid overdose among high-risk persons with opioid use disorder: a pilot randomized controlled trial. PLoS ONE. 2017;12(10):e0183354.
Gelberg L, Robertson MJ, Arangua L, Leake BD, Sumner G, Moe A, et al. Prevalence, distribution, and correlates of hepatitis C virus infection among homeless adults in Los Angeles. Public Health Rep. 2012;127(4):407–21.
Hamilton AB. Qualitative methods in rapid turn-around health services research. VA HSR&D Cyberseminar Spotlight on Women's Health. Dec 11, 2013. Available at: https://www.hsrd.research.va.gov/for_researchers/cyber_seminars/archives/780-notes.pdf. Accessed 10 Sept 2020.
Dedoose Version 8.0.42, web application for managing, analyzing, and presenting qualitative and mixed method research data (2018). Los Angeles, CA: SocioCultural Research Consultants, LLC www.dedoose.com.
Baggett TP, Hwang SW, O’Connell JJ, Porneala BC, Stringfellow EJ, Orav EJ, et al. Mortality among homeless adults in Boston: shifts in causes of death over a 15-year period. JAMA Intern Med. 2013;173(3):189–95.
Bradford AC, Bradford WD. The effect of evictions on accidental drug and alcohol mortality. Health Serv Res. 2020;55(1):9–17.
Colledge S, Peacock A, Leung J, Larney S, Grebely J, Hickman M, et al. The prevalence of non-fatal overdose among people who inject drugs: a multi-stage systematic review and meta-analysis. Int J Drug Policy. 2019;73:172–84.
Los Angeles County Department of Public Health, Center for Health Impact Evaluation. Recent trends in mortality rates and causes of death among people experiencing homelessness in Los Angeles County. Oct 2019. Available from: http://publichealth.lacounty.gov/chie/reports/HomelessMortality_CHIEBrief_Final.pdf. Accessed 12 Mar 2021.
San Francisco Office of the Chief Medical Examiner. Report on Accidental Overdose Deaths - January to October, 2020. Nov 2020. Available from: https://sf.gov/sites/default/files/2020-12/2020%2011_OCME%20Overdose%20Report.pdf. Accessed 2 Feb 2021.
Shinn M, Khadduri J. In the Midst of Plenty: Homelessness and What to Do About It. Hoboken: Wiley Blackwell; 2020.
Tiderington E, Ikeda J, Lovell A. Stakeholder perspectives on implementation challenges and strategies for Moving On initiatives in permanent supportive housing. J Behav Health Serv Res. 2020;47(3):346–64.
Watson DP, Young J, Ahonen E, Xu H, Henderson M, Shuman V, et al. Development and testing of an implementation strategy for a complex housing intervention: protocol for a mixed methods study. Implement Sci. 2014;9:138.
Goering P, Veldhuizen S, Watson A, Adair C, Kopp B, Latimer E, et al. National At Home/Chez Soi Final Report. Calgary, AB: Mental Health Commission of Canada. 2014. Available from: https://www.mentalhealthcommission.ca/wp-content/uploads/drupal/mhcc_at_home_report_national_cross-site_eng_2_0.pdf. Accessed 25 Apr 2023.
Hung DY, Shelley DR. Multilevel analysis of the chronic care model and 5A services for treating tobacco use in urban primary care clinics. Health Serv Res. 2009;44(1):103–27.
Acknowledgements
The authors would like to thank the Study Advisory Board members and Kristin Miller, who was instrumental in preliminary research and planning related to this project.
Funding
This study is funded by the National Institute on Drug Abuse (NIDA) of the National Institutes of Health (1R01DA054976). The funder had no role in the study design or writing or reviewing the manuscript. The content of this manuscript is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.
Author information
Authors and Affiliations
Contributions
KMD, AT, SB, PH, EM, LV, CMC, CN, MAG, and DS participated in conceptualizing and designing the study. KMD obtained study funding. KMD drafted the manuscript. AT, SB, PH, EM, LV, CMC, CN, MAG, and DS contributed revisions. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
This study was approved by the Institutional Review Board at NYU Grossman School of Medicine (i23-00098).
Consent for publication
Not applicable.
Competing interests
EM, LV, and PH are employed by the Corporation for Supportive Housing. The authors declare that they have no other competing interests.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Additional file 1:
Table S1. CONSORT 2010 checklist of information to include when reporting a cluster randomised trial.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Doran, K.M., Torsiglieri, A., Blaufarb, S. et al. The POP (Permanent Supportive Housing Overdose Prevention) Study: protocol for a hybrid type 3 stepped-wedge cluster randomized controlled trial. Implementation Sci 18, 21 (2023). https://doi.org/10.1186/s13012-023-01278-z
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s13012-023-01278-z