Background

Protease inhibitors remain important options for the treatment of HIV infection [1, 2]. When administered with low doses of ritonavir, protease inhibitors impose a high genetic barrier against the selection of drug-resistant variants of HIV and are therefore especially reliable options for patients for whom poor antiretroviral adherence is anticipated [3, 4]. Because of once-daily dosing and low rates of gastrointestinal adverse effects relative to other members of their class [5, 6], ritonavir-boosted atazanavir and darunavir were, until recently, designated as ‘preferred’ protease inhibitor-based options for the treatment of antiretroviral naïve patients in the United States Depatment of Health and Human Services (DHHS) HIV treatment guidelines [2]. However, atazanavir/ritonavir was reclassified as an ‘alternative’ to darunavir/ritonavir in the most recent iteration of the DHHS guidelines [2] based on high rates of discontinuation due to toxicity among patients treated with atazanavir/ritonavir in ACTG 5257, a randomized trial comparing the efficacy of atazanavir/ritonavir-, darunavir/ritonavir- and raltegravir-based therapy [7].

Despite these findings, questions remain about the comparative effectiveness of atazanavir/ritonavir and darunavir/ritonavir in clinical practice. Although randomized trials are essential for generating evidence about efficacy required to inform clinical guidelines, individuals enrolled in these studies are often not representative of patients treated in routine care [8, 9]. Observational studies can address this limitation by providing evidence of the comparative effectiveness and tolerability of different treatment regimens in patients who are treated in clinical practice. Although observational studies comparing the tolerability of atazanavir/ritonavir and darunavir/ritonavir have been conducted, no such studies have specifically compared the effectiveness of these drugs [1012]. Accordingly, we conducted a retrospective cohort study comparing the effectiveness and durability of atazanavir/ritonavir- and daruanavir/ritonavir-based regimens among antiretroviral naïve patients enrolled in a longitudinal Canadian cohort study.

Methods

Study population

The Canadian Observational Cohort (CANOC) collaboration is a multisite cohort study of antiretroviral-naïve HIV positive patients initiating combination antiretroviral therapy (cART) after January 1, 2000 [13]. The collaboration currently includes 8 participating cohorts from Ontario, Quebec and British Columbia. Criteria for inclusion into CANOC were documented HIV infection, residence in Canada, age 18 years and older, initiation of a first antiretroviral regimen comprised of at least three individual agents, and at least one HIV-1 RNA viral load and CD4 count measurement within one year prior to treatment initiation. Antiretroviral data collection methods vary by site, and include abstraction from patient charts and linkage with provincial prescription databases. Nonnominal data were submitted from each participating site to the coordinating center in Vancouver, British Columbia, Canada.

Participants were eligible for inclusion in this analysis if they initiated atazanavir/ritonavir- or darunavir/ritonavir-based antiretroviral therapy, did not have a viral load less than or equal to 200 copies/mL at or before cART initiation and had at least one follow-up viral load measurement available after treatment initiation. We excluded patients who initiated atazanavir without concomitant ritonavir.

Outcome measures

The primary outcome of the study was time to regimen failure, defined as a composite of virologic failure and discontinuation for any reason [Table 1, A (includes B1) or B2]. Similar to ACTG 5257, we defined virologic failure as a viral load >1000 copies/mL at or after week 16 but before week 24, or a viral load >200 copies/mL at or after week 24 (A) [7]. Patients who never suppressed or who suppressed and subsequently rebounded were included in this definition. We defined discontinuation as stopping atazanavir or darunavir for more than 60 days. We did not consider changes to the nucleoside backbone, ritonavir, or the addition of other antiretroviral medications as discontinuations. All discontinuations were hierarchically classified as due to virologic failure (B1)or other reasons (B2). Patients who died were considered to have met a competing risk; otherwise patients were censored at the first occurrence of a gap in viral load measurements exceeding two years, the last recorded antiretroviral stop date if followed by a viral load ≤50 copies/mL, or the last available viral load measurement.

Table 1 Outcome and Competing Risk Definitions

We conducted several secondary analyses (Table 1). First, we examined time to virologic failure (A) and time to discontinuations due to virologic failure (B1) separately, considering death and discontinuations for other reasons (B2) as competing risks. Next, in the absence of specific adverse event data, we examined time to discontinuation of either darunavir or atazanavir for reasons other than virologic failure (B2). Such discontinuations may have occurred because of toxicities attributable to the protease inhibitor. Individuals who experienced virologic failure (A) and those who died were considered to have met a competing risk. Finally, we examined time to virologic suppression (C), defined as time to the first of at least two consecutive viral load measurements below 50 copies/mL at least 30 days apart. Patients who died or discontinued atazanavir or darunavir for any reason (B) were considered to have met a competing risk. We used the same censoring rules as in the primary analysis in all secondary analyses.

Statistical analysis

All analyses were conducted with SAS 9.4 (SAS Institute, Cary, North Carolina, USA) and R 3.3.1 (R Development Core Team, Vienna, Austria). We compared baseline characteristics between the two regimen groups using chi-square tests for categorical variables and Wilcoxon rank sum tests for continuous variables. For each outcome, cumulative incidence functions taking into account competing risks were determined by regimen and compared using Gray’s Test for Equality [14].

We used multivariable Fine and Gray competing risk regression [15] to estimate the association between treatment with darunavir/ritonavir relative to atazanavir/ritonavir and each outcome. We adjusted our models for age, sex and men who have sex with men (MSM) status, race, baseline viral load and CD4 count, calendar year of treatment initiation, nucleoside analogue backbone (emtricitabine/tenofovir versus other backbones), Canadian province of residence, and history of injection drug use (IDU). Because of collinearity beween IDU and co-infection with hepatitis C, we adjusted our models for the former variable only. For covariates with large amounts of missing data, separate categories for missing were created when these variables were included in the regression models.

We conducted several sensitivity analyses to test the robustness of our findings. First, we conducted analyses by provincial subgroup (British Columbia vs Ontario/Quebec) because of regional differences in prescribing patterns and characteristics of CANOC participants [13]. Specifically, antiretroviral treatment guidelines in British Columbia recommended efavirenz or atazanavir/ritonavir as first-line regimens during our study period, favouring the latter for patients who use drugs or with mental health illness and preserving darunavir/ritonavir for treatment failures. In contrast, no such recommendations were in place in Ontario and Quebec during the study period. Further, participants in British Columbia differ from those in Ontario and Quebec in important ways, including mode of HIV acquisition and hepatitis C coinfection [13]. We therefore reasoned that residual confounding due to associated unmeasured variables such as mental health illness and socioeconomic status could occur. Second, we examined whether outcomes varied by baseline viral load (< 100,000 copies/mL or >100,000 copies/mL). Third, because approximately one-quarter of atazanavir-treated patients started treatment between 2004 and 2006, we replicated our analyses, restricting to patients who started treatment on or after January 1, 2010. Fourth, patients who had a viral load of ≤50 copies/mL and who were switched to a single table regimen were re-defined as having discontinued treatment for simplification and included as competing risks. Finally, we replicated our analyses following multiple imputation for missing values of the race, IDU and MSM variables. To our knowledge, no methods currently exist to impute data specifically for Fine & Gray competing risk regression models, and so a substantive model compatible version of fully conditional specification was used to impute data intended for cause-specific competing risk regression models [16]. For each outcome, all covariates used in the original multivariable models were used to impute missing values five different times. Fine & Gray models were then run on each imputed dataset and the resulting parameter estimates and variances were combined using Rubin’s rules [17, 18].

Results

During the study period, we identified 1791 eligible patients whose first cART regimen included atazanavir/ritonavir and 222 eligible patients whose first regimen included darunavir/ritonavir. Patients treated with atazanavir/ritonavir were more likely to be female (19% vs. 13%; p = 0.02), co-infected with hepatitis C (30% vs. 13%; p < 0.0001) and report injection drug use as a risk factor for HIV infection (29% versus 9%; p < 0.0001) (Table 2). These differences were mitigated when restricting comparisons to participants from Ontario and Quebec only. The median (interquartile range, IQR) duration of follow-up was 3.5 (1.6, 5.4) years and 1.5 (0.7, 2.3) years in the atazanavir/ritonavir and darunavir/ritonavir treated participants respectively (Table 2).

Table 2 Demographic and clinical characteristics at initiation of combination antiretroviral therapy by regimena

The cumulative incidence of regimen failure (A or B2) one year following the initiation of treatment was 0.29 (95% confidence interval (CI) 0.27 to 0.31) for patients initiating atazanavir/ritonavir and 0.21 (95% CI 0.15 to 0.27) for those starting darunavir/ritonavir (p < 0.01, Fig. 1a and b). A total of 43 patients experienced a competing risk of death. Following multivariable adjustment, there was no difference between darunavir/ritonavir and atazanavir-ritonavir in the risk of regimen failure (adjusted hazard ratio 0.76, 95% CI 0.56 to 1.03) (Table 3). This finding was similar in sensitivity analyses (Table 4).

Fig. 1
figure 1

Cumulative incidence functions of time to events and competing risks

Table 3 Multivariable Fine and Gray models of time to events
Table 4 Adjusted hazard ratios for darunavir/ritonavir vs. atazanavir/ritonavir from sensitivity analyses

The one-year cumulative incidence of virologic failure (A) was 0.09 (95% CI 0.08 to 0.10) for patients starting atazanavir/ritonavir and 0.04 (95% CI 0.02 to 0.08) for those starting darunavir/ritonavir (p = 0.02, Fig. 1a and b). Forty-three patients died prior to virologic failure. Following multivariable adjustment, the risk of virologic failure was lower in darunavir/ritonavir-treated patients (adjusted hazard ratio 0.50, 95% CI 0.28 to 0.91) (Table 3). However, this finding was driven primarily by high failure rates among atazanavir/ritonavir-treated patients in the province of British Columbia. In a sensitivity analysis by Canadian province, there was no difference in the risk of virologic failure among participants in Ontario and Quebec (adjusted hazard ratio 0.90, 95% CI 0.44 to 1.86) (Table 4). In the analysis of participants from British Columbia, the point estimate of the adjusted hazard ratio of virologic failure associated with darunavir was similar (adjusted hazard ratio = 0.41, 95% CI (0.09, 1.78)) to that from the analysis of the entire cohort but the finding was not statistically significant due to the infrequent use of darunavir in this province (Table 4).

The cumulative incidence of discontinuation due to virologic failure (B1) in atazanavir/ritonavir and darunavir/ritonavir-treated patients was 0.01 (95% CI 0.01 to 0.02) and 0.00, respectively (p = 0.01, Fig. 1a and b). The lack of events in darunavir/ritonavir treated patients resulted in adjusted hazard ratios of 0.00 for darunavir/ritonavir vs. atazanavir/ritonavir when modelling this outcome.

The cumulative incidence of discontinuation for reasons other than virologic failure (B2) was 0.2 (95% CI 0.18 to 0.22) for patients initiating atazanavir/ritonavir and 0.17 (95% CI 0.12 to 0.22) for patients initiating darunavir/ritonavir (p = 0.16, Fig. 1a and b). Forty-three patients experienced a competing risk of death. There was no difference between darunavir/ritonavir and atazanavir/ritonavir in the risk of discontinuation for reasons other than virologic failure after adjusting for confounding variables (adjusted hazard ratio 0.93, 95% CI 0.65 to 1.33) (Table 3). These results were similar in sensitivity analyses (Table 4).

The cumulative incidence of virologic suppression (C) at 1 year after treatment initiation was 0.73 (95% CI 0.70 to 0.75) for participants whose first regimen included atazanavir/ritonavir and 0.73 (95% CI 0.66 to 0.79) for those whose first regimen included darunavir/ritonavir (p = 0.62, Fig. 1c and d). Twenty-four patients died prior to achieving virologic suppression. Following multivariable adjustment, there was no difference in the time to virologic suppression (adjusted hazard ratio 0.99, 95% CI 0.82 to 1.21) according to treatment regimen (Table 3). Results were similar in sensitivity analyses (Table 4).

In sensitivity analyses of patients who initiated treatment on or after January 1, 2010, the adjusted hazards ratios for treatment group were very similar to those of the main analysis considering patients starting on or after January 1, 2003 (Table 4). However, the estimates were less precise because of the smaller sample size.

Discussion

In our analysis of more than two thousand antiretroviral naïve patients from three Canadian provinces, patients initiating darunavir/ritonavir were at a lower risk of virologic failure (A) and subsequent discontinuations due to virologic failure (B1) than patients treated with atazanavir/ritonavir. In contrast, we observed no differences in time to regimen failure (A or B2), virologic suppression (C) or to discontinuation for reasons other than virologic failure (B2).

Our findings differ from those of ACTG 5257, a randomized trial comparing darunavir/ritonavir, atazanavir/ritonavir- and raltegravir-based antiretroviral therapy [7]. Specifically, this trial found a higher incidence of tolerability discontinuation among patients randomized to atazanavir/ritonavir, mediated primarily by participant-driven regimen change for jaundice or hyperbilirubinemia and non-hepatobiliary gastrointestinal side effects. Although we did not have data regarding the exact reasons for discontinuation, we found no difference in the risk of discontinuations for reasons other than virologic failure (B2), an outcome which includes toxicity-driven discontinuation. In a sensitivity analysis, there was no difference in the risk of discontinuations for reasons other than (i) virologic failure or (ii) simplification, an outcome that may more closely approximate toxicity-driven discontinuation. The discrepancy between the results of our analysis and those of the ACTG 5257 trial may be due in part to differences in the calendar year periods of atazanavir and darunavir initiation in our study. Because atazanavir-treated patients started treatment approximately three years earlier than darunavir-treated patients, with approximately one-quarter starting between 2004 and 2006, we speculated that discontinuations due to jaundice or asymptomatic hyperbilirubinemia were tempered by a lack of potent, tolerable treatment alternatives during this period. Most notably, 70% of patients starting atazanavir/ritonavir resided in British Columbia, a province where the epidemic is driven primarily by injection drug use, thereby potentially deterring clinicians from switching patients to regimens with lower barriers to resistance or higher rates of gastrointestinal side effects. In contrast, ACTG 5257 participants initiated treatment between 2009 and 2011, a period marked by the availability of potent treatment alternatives conducive to supporting participant-driven requests for regimen change. Although sensitivity analyses restricted to participants initiating cART between 2010 and 2012 yielded similar results, we speculate that this reflects a desire to preserve darunavir/ritonavir and other new options as second-line regimens for patients treated with atazanavir/ritonavir in British Columbia.

Our finding of an increased risk of virologic failure among patients receiving atazanavir/ritonavir also contrasts with the results of ACTG 5257, in which no difference was observed in this outcome. A possible explanation relates to inter-study differences in the prevalence and distribution of baseline characteristics known to adversely affect adherence and sustained virologic suppression. Specifically, relative to ACTG 5257 our study population included a greater proportion of patients who had a history of injection drug use (27% versus 7%), were coinfected with hepatitis C (28% versus 7.8%) and with baseline CD4 counts below 350 cells/mm3 (77% versus 8.8%). Notably, these characteristics were disproportionately represented among patients treated with atazanavir/ritonavir in our study, likely predisposing these patients to virologic failure.

Inter-provincial differences in patient characteristics and prescribing practices may also account for disparate findings between our study and ACTG 5257. Specifically, a higher prevalence of injection drug use and hepatitis C was observed among participants in British Columbia relative to Ontario and Quebec. Although we adjusted for injection drug use in our analysis, we lacked data regarding co-existing mental health illness, other substance use and socioeconomic status; residual confounding is therefore possible. Also, as noted earlier, atazanavir/ritonavir was the recommended protease inhibitor for antiretroviral naïve patients in British Columbia during the study period, particularly for patients with co-morbid illness or social circumstances that could predispose them to treatment failure. In contrast, no such recommendations were in place in Ontario and Quebec during the study period. The impact of these selection biases was evident in sensitivity analyses restricted to participants from Ontario and Quebec, in that no differences between regimens were observed for any outcome, including virologic failure.

Strengths of our analysis include the size of the study population, the diversity of the participants in CANOC and the ability to compare clinical outcomes between individuals initiating atazanavir/ritonavir and darunavir/ritonavir in a clinical practice setting. However, several limitations of our study merit emphasis. Most notably, as with all observational studies, our findings may be biased by residual inter-group differences in baseline variables and unmeasured confounders. In addition, as noted earlier, differences in the timing of darunavir and atazanavir availability may have precluded our ability to observe differences in the risk of treatment discontinuation. The nature of antiretroviral data in a retrospective cohort also imposes some limitations when considering discontinuation. Some sites have prescription based data with stop dates calculated from the days supplied by the prescription. These stop dates are inaccurate when a patient is not perfectly adherent. Other sites provide start and stop dates abstracted from patient charts which are subject to recall and documentation errors. Since 70% of participants who had atazanavir as part of their first regimen resided in British Columbia, where antiretroviral records are prescription-based compared to 18% of participants who had darunavir as part of their starting regimen, this may have resulted in an overestimate of time to discontinuation among participants on atazanavir. Finally, we lacked data regarding exact reasons for treatment discontinuation.

Conclusions

In conclusion, darunavir/ritonavir and atazanavir/ritonavir were of similar effectiveness in the treatment of antiretroviral naïve patients. Differences in the risk of virologic failure between darunavir/ritonavir and atazanavir/ritonavir varied substantially by province due to regional differences in prescribing patterns and patient characteristics. Our data provide both a comparison of the effectiveness of these two protease inhibitors in the clinical setting and an illustration of the potential magnitude and impact of selection bias in a cohort study setting.