Background

Atrial fibrillation (AF) is an independent risk factor for stroke and increased mortality [1]. It was estimated that 5.2 million US adults were affected by AF in 2010, while in 2015 the prevalence of AF was close to 9.6 million. This number is projected to increase to 12.1 million by 2030, corresponding to a growth rate of 4.3% [2, 3].

Warfarin, a vitamin K antagonist (VKA), has been the standard treatment for decades for stroke prevention among AF patients [4]. The American College of Cardiology/American Heart Association/ Heart Rhythm Society Guideline recommends oral anticoagulants (OACs) be used in patients with non-valvular AF (NVAF) and prior stroke, transient ischemic attack (TIA), or a CHA2DS2-VASc (congestive heart failure, hypertension, aged > 75 years, diabetes, prior stroke or transient ischemic attack, thromboembolism, vascular disease, aged 65–74 years, and gender) score ≥ 2 [5]. Besides warfarin, four direct oral anticoagulants (DOACs; dabigatran, rivaroxaban, apixaban, edoxaban) have received US Food and Drug Administration (FDA) approval. When compared with warfarin, DOACs have advantages of more predictable pharmacological profiles, fewer drug-drug interactions, an absence of major dietary effects, no requirement for regular international normalized ratio (INR) monitoring, and less risk of intracranial bleeding [5].

Four large prospective non-inferiority clinical trials have compared the effectiveness and safety between DOACs and warfarin among NVAF patients [6,7,8,9]. In the RE-LY trial, those prescribed 150 mg dabigatran had lower rates of stroke/SE and similar rates of major bleeding compared to warfarin [6]. The ROCKET AF trial showed that patients prescribed rivaroxaban had non-inferior rates of stroke/SE and similar rates of major bleeding [7]. In the ARISTOTLE trial, apixaban demonstrated superiority to warfarin with lower rates of stroke/SE and major bleeding [8]. The ENGAGE AF trial showed that patients prescribed edoxaban had non-inferior rates of stroke/SE and lower rates of major bleeding compared to warfarin [9].

In addition to clinical trials, several real-world studies have evaluated comparative effectiveness and safety between DOACs and warfarin [10, 11]. Being one of the largest health care plans in the US, the analysis of the US Department of Defense (DOD) health care system adds evidence and complements the profile in understanding the real-world treatment effects of OACs among NVAF patients in the US. However, few real-world studies using the DOD data have been conducted between DOACs and warfarin. The aim of this study was to compare the risk of stroke/SE and major bleeding between DOACs and warfarin in the DOD data.

Methods

Data source

This retrospective observational study used the US DOD data from January 1, 2012 to September 30, 2015. The DOD provides health care to over 9.4 million beneficiaries located in all 50 US states and multiple countries globally. Eligible beneficiaries include active duty, activated guard and reserve, retirees, survivors, some inactive guard and reserve, and their family members. Most beneficiaries are retired service members and their family members (5.42 million, 57%), many of whom are Medicare eligible (3.18 million). Beneficiaries remain in the system for an average length of 7.2 years, which is 2–3 times longer than commercial insurance plans. The data repository includes comprehensive datasets providing integrated information about the inpatient, outpatient, ER, and pharmacy claims from the US DOD facility and civilian/private sector care for eligible beneficiaries.

Medical and pharmacy claim coding utilizes the National Drug Code (NDC) coding system, Healthcare Common Procedure Coding System (HCPCS) codes, Current Procedural Terminology (CPT) codes, and the International Classification of Disease, 9th Revision, Clinical Modification (ICD-9-CM).

Study population

This study selected adult patients with ≥1 pharmacy claim for an OAC (warfarin, apixaban, dabigatran, or rivaroxaban) from January 1, 2013 to September 30, 2015 (identification period). Edoxaban was not included in the analysis due to small sample size (N = 131). The first DOAC prescription claim date was defined as the index date for patients with a DOAC claim(s). For those without a DOAC claim, the first warfarin prescription claim date was defined as the index date. The baseline period was defined as one-year before the index date, during which patients had ≥1 medical claim for AF (ICD-9-CM: 427.31) and continuous enrolment [12]. Patients were excluded from the study if they had claims for valvular heart disease, heart valve replacement, dialysis, kidney transplant, end-stage chronic kidney disease, venous thromboembolism, reversible AF, or a pharmacy claim for an OAC during the baseline period, hip or knee replacement within 6 weeks prior to the index date, > 1 OAC claim on the index date, or a pregnancy diagnosis during the study period (Additional file 1: Table S1).

The follow-up period was defined as one day after the index date until the earliest of the following dates: OAC discontinuation date (≥30-day gap between OAC prescriptions), switch to a non-index OAC < 30 days before or after discontinuation, death, end of continuous medical and pharmacy enrollment, or end of study period [13].

Outcome measures

Defined by primary or secondary diagnosis position on inpatient claims, stroke/SE was utilized as the effectiveness outcome measure while major bleeding served as the measure for safety outcomes. Stroke/SE was further classified into ischemic stroke, hemorrhagic stroke, and SE. Major bleeding consisted of intracranial hemorrhage (ICH), gastrointestinal (GI) bleeding, and major bleeding at other key sites. Validated administrative claim-based algorithms as well as published articles were used to derive the stroke/SE and major bleeding code lists. (Additional file 1: Table S2) [14,15,16,17].

Baseline variables

Baseline measurements included patient demographics, comorbidities, medications, hospitalizations during the 12-month baseline period, and clinical risk scores (HAS-BLED [hypertension, abnormal kidney or liver function, stroke, bleeding, age > 65 years, and drugs/alcohol abuse or dependence], Charlson Comorbidity Index [CCI], and CHA2DS2-VASc).

The CHA2DS2-VASc stroke risk score and HAS-BLED bleeding risk scores were calculated (Additional file 1: Table S3 and Table S4) [18, 19]. Note that for the HAS-BLED score, INR and other lab values were unavailable in the data; a modified score (range 0 to 8) was used.

Statistical methods

The design, analytical methods, and presentation of this study were informed by the guidelines for comparative effectiveness research [20, 21].

To assess significant differences for dichotomous variables, Pearson’s Chi-square tests were performed. For continuous variables, student t-tests were used.

To control for potential confounders between comparative cohorts (apixaban vs warfarin, rivaroxaban vs warfarin, and dabigatran vs warfarin), one-to-one propensity score matching (PSM) was used to balance demographics and clinical characteristics and to estimate the average treatment effects in patients with similar characteristics for whom each of the two OACs would be a reasonable treatment choice [22]. The logistic regression for the propensity score calculation included inpatient admissions, baseline medication use, age, gender, US geographic region, CCI score, HAS-BLED score, CHA2DS2-VASc score, stroke and bleeding history, and comorbidities [23]. The nearest neighbor method without replacement with a caliper of 0.01 was used. The balance of baseline patient characteristics was checked based on mean standardized differences with a threshold of 10% [24].

Incidence rates per 100 person-years of stroke/SE and major bleeding in PSM matched cohorts were calculated. To assess the risk of stroke/SE and major bleeding for patients in the matched cohorts, Cox proportional hazards models were utilized. Hazard ratios, 95% confidence intervals (CIs), and p-values were provided. OAC treatment was included as the independent variable, and no other covariates were included in the model because the cohorts were balanced.

Sensitivity analyses

Sensitivity analyses, for the purpose of testing the robustness of the main results, were conducted. In the first of these analyses, cohorts were stratified by dosage of DOACs (standard and reduced) on the index date to assess if the outcomes were altered by DOACs dosage. The post-PSM population was separated per dosage of DOACs on the index date: standard-dose (apixaban 5 mg-warfarin, rivaroxaban 20 mg-warfarin, and dabigatran 150 mg-warfarin) and reduced-dose (apixaban 2.5 mg-warfarin, rivaroxaban 15 mg-warfarin, and dabigatran 75 mg-warfarin). In each matched subgroup by dosage of DOACs, imbalanced baseline variables with standardized difference > 10% were included in the Cox proportional hazards models. The statistical significance of the interaction term between treatment and dose was determined with a cutoff point of p-value = 0.10.

Second, patients who had catheter ablation within 2 months prior to the index prescription and those who had cardioversion 1 month before or after index drug were excluded. After excluding those patients, the balance of the baseline characteristics was checked and variables which were unbalanced were incorporated in the multivariate model. These patients were excluded because they likely had a low risk of stroke and received the OACs for the procedures and not long-term stroke prevention. Third, a sensitivity analysis using the 6-months after the index date as follow-up was also conducted. In this analysis, patients were censored at the earliest of: the OAC prescription discontinuation date, date of switching, date of death, date of disenrollment, end of the study period (September 30, 2015), or 6 months after the index date. This sensitivity analysis allowed the follow-up period to be more balanced between the cohorts. Lastly, a sensitivity analysis using the intent-to-treat method was used, where patients were followed based on the index drug regardless of discontinuation or switch.

Results

Baseline characteristics

After applying the selection criteria and before performing the PSM, a total of 41,001 patients were included in the study, including 9255 (22.6%) warfarin, 4312 (10.5%) dabigatran, 15,680 (38.2%) rivaroxaban, and 11,754 (28.7%) apixaban patients. Warfarin initiators were older with significantly higher baseline mean CCI and CHA2DS2-VASc scores vs those who initiated apixaban, rivaroxaban, and dabigatran. After 1:1 PSM, there were 3691 dabigatran-warfarin matched pairs, 8226 rivaroxaban-warfarin matched pairs, and 7607 apixaban-warfarin matched pairs (Fig. 1).

Fig. 1
figure 1

Patient Selection Figure. AF: atrial fibrillation. OAC: oral anticoagulant

After PSM, baseline demographic and clinical characteristics were balanced between the matched cohorts with standardized difference less than 10%. Dabigatran-warfarin patients had the best health status with a mean CCI score of 2.0, CHA2DS2-VASc score of 3.7, and HAS-BLED score of 2.8, followed by rivaroxaban-warfarin and apixaban-warfarin patients with a mean CCI score approximately 2.5, CHA2DS2-VASc score around 4.1, and HAS-BLED score of 3.0 (Table 1).

Table 1 Demographic and Clinical Characteristics in Propensity Score Matched DOAC and Warfarin Cohorts

Effectiveness outcomes

The incidence rates of stroke/SE are shown in Fig. 2. Apixaban (hazard ratio [HR]: 0.55; 95% CI: 0.39, 0.77; p < 0.001) was associated with a significantly lower risk of stroke/SE compared to warfarin. Apixaban was also associated with a significantly lower risk of hemorrhagic stroke (HR: 0.49; 95% CI: 0.25, 0.93; p = 0.030) and SE (HR: 0.07; 95% CI: 0.01, 0.54; p = 0.010).

Fig. 2
figure 2

Propensity Score Matched Incidence Rates and Hazard Ratios for Stroke/SE. CI: confidence interval. SE: systemic embolism

Compared to warfarin, dabigatran (HR: 0.68; 95% CI: 0.43, 1.07; p = 0.096) and rivaroxaban (HR: 0.83; 95% CI: 0.64, 1.09; p = 0.187) were associated with a non-significantly lower risk of stroke/SE (Fig. 2). Both dabigatran (HR: 0.24; 95% CI: 0.07, 0.88; p = 0.031) and rivaroxaban (HR: 0.57; 95% CI: 0.34, 0.95; p = 0.032) had a lower risk of hemorrhagic stroke versus warfarin.

Safety outcomes

The incidence rates of major bleeding are shown in Fig. 3. Apixaban (HR: 0.65; 95% CI: 0.53, 0.80; p < 0.001) patients had a significantly lower risk of major bleeding compared to warfarin. The decrease in major bleeding risk was driven by all types of major bleeding, including GI, ICH, and other major bleeding. Dabigatran (HR: 1.05; 95% CI: 0.79, 1.40; p = 0.730) and rivaroxaban (HR: 1.07; 95% CI: 0.91, 1.27; p = 0.423) were associated with similar risks of major bleeding compared to warfarin (Fig. 3). Both dabigatran (HR: 0.30; 95% CI: 0.13, 0.71; p = 0.006) and rivaroxaban (HR: 0.56; 95% CI: 0.37, 0.84; p = 0.005) were associated with a significantly lower risk of ICH versus warfarin; however, rivaroxaban was associated with a significantly higher risk of GI bleeding (HR: 1.30; 95% CI: 1.06,1.60; p = 0.013).

Fig. 3
figure 3

Propensity Score Matched Incidence Rates and Hazard Ratios for Major Bleeding. CI: confidence interval. GI: gastrointestinal. ICH: intracranial hemorrhage

Sensitivity analyses

The results were generally consistent in the dose subgroup analysis compared to the results in the main analysis (Table 2). There was a significant interaction for rivaroxaban treatment dose and major bleeding. The second and third sensitivity analyses showed results similar to the results of the main analysis. In the sensitivity analysis where patients with cardioversion and catheter ablation (i.e., low risk stroke patients) were excluded, patients who initiated rivaroxaban had a significantly lower risk of stroke/SE compared to patients who initiated warfarin (Table 3). All other trends remained the same.

Table 2 Dose Sensitivity Analysis for Propensity Score Matched Patients
Table 3 Other Sensitivity Analyses for Propensity Score Matched Patients

Discussion

In this real-world study among NVAF patients initiating OAC treatment in the US DOD population, apixaban was found to be the only DOAC associated with a significantly lower risk of stroke/SE and major bleeding compared to warfarin, while dabigatran and rivaroxaban initiation were associated with similar risk of stroke/SE and major bleeding compared to warfarin. These findings were supported by several sensitivity analyses.

This observational study adds real-world evidence to supplement the results from clinical trials. In the RE-LY trial, compared to warfarin, 110 mg dabigatran (not approved in the US) was associated with similar risk of stroke/SE and lower risk of major bleeding, while 150 mg dabigatran had a significantly lower risk of stroke/SE and similar risk of major bleeding [6]. However, in our study, we observed a similar risk of stroke/SE and major bleeding among dabigatran patients compared to warfarin patients. In the ROCKET-AF clinical trial, rivaroxaban was non-inferior for both stroke/SE and major bleeding compared to warfarin [7]. Similarly, our study showed a consistent safety result but numerically lower effectiveness results comparing rivaroxaban and warfarin. Consistent with our study, the ARISTOTLE trial found apixaban showed superiority to warfarin in terms of the risk of stroke/SE and major bleeding [8].

In addition to clinical trials, a few real-world studies have also examined the risk of stroke and major bleeding of OACs. In prior effectiveness and safety comparisons between dabigatran and warfarin, dabigatran was shown to have similar to lower risk of stroke/SE and major bleeding versus warfarin. In the Villines et al. study, which also used US DOD data, dabigatran was shown to be associated with a lower risk of stroke and similar risk of major bleeding compared to warfarin [25]. Consistent with the Villines et al. study, in a study using Medicare data, dabigatran was associated with a lower risk of ischemic stroke and similar risk of major bleeding compared to warfarin [11]. In a meta-analysis including 20 observational studies comparing dabigatran and warfarin, dabigatran was found to have a lower risk of ischemic stroke and major bleeding [26]. However, another meta-analysis found no statistical difference between dabigatran and VKA for ischemic stroke or major bleeding [10] Dabigatran 110 mg is not available in the US; therefore, this study included patients prescribed 150 mg or 75 mg dabigatran and may not be generalizable to countries where 110 mg dabigatran is available. Our study indicated that dabigatran had a numerically lower risk of stroke/SE and similar risk of major bleeding compared to warfarin. Since the dabigatran cohort has the smallest sample size in our study, a larger sample size may be warranted for this population to examine the difference between dabigatran and warfarin.

In many real-world comparisons of rivaroxaban and warfarin, rivaroxaban was associated with a similar risk of stroke/SE and major bleeding compared to warfarin; however, some inconsistencies exist in other real-world studies. In a meta-analysis of observational study, Ntaios et al. found that there was no statistical difference between rivaroxaban and VKA for stroke/SE and major hemorrhage [10]. However, in a meta-analysis, Bai et al. found that rivaroxaban was associated with a lower risk of stroke/SE and a similar risk of major bleeding [27]. In Amin et al. (Medicare data), rivaroxaban was associated with a lower risk of stroke/SE, but a higher risk of major bleeding compared to warfarin [17]. Tamayo et al. evaluated major bleeding incidence rates among rivaroxaban users in the DOD population and found the incidence of major bleeding to be 2.86 per 100 person-years. The reported incidence is smaller than our study where the incidence of major bleeding was 4.96 per 100 person-years. The difference may have been due to different selection criteria; for example, we excluded patients with previous anticoagulant use, and we used a different definition of major bleeding [28].

In this study, apixaban was the only DOAC that showed significant safety and effectiveness results, which is generally consistent with other real-world studies. Similarly, in a study pooling four claims datasets, apixaban initiators were associated with a 33% lower risk of stroke/SE and 40% lower risk of major bleeding compared with warfarin initiators [29]. In the Amin et al. study using Medicare data, apixaban was also associated with both significantly lower risk of stroke/SE and major bleeding compared to warfarin [17]. The Ntaios et al. meta-analysis demonstrated that apixaban was associated with a similar risk of ischemic stroke/SE and lower risk of major hemorrhage compared to warfarin [10]. Another meta-analysis of apixaban and warfarin comparisons showed that apixaban had similar risk of stroke/SE and lower risk of major bleeding versus warfarin [30].

By comparing the effectiveness and safety of DOACs versus warfarin using the most recent DOD data, this study provides supplemental information for the clinical trials as well as the real-world study profiles. To our knowledge, this was the first study using DOD data to examine the effectiveness and safety of all DOACs compared to warfarin. Findings from this study may inform decision makers and health care providers in the DOD and other health care systems.

This study has several limitations. First, due to the nature of claims studies, diagnoses and procedures in this study were identified using ICD-9-CM, CPT, HCPCS, and NDC codes. These coding systems were originally designed for billing purposes rather than research, without further adjudication using precise clinical criteria. Second, although cohorts were PSM, potential residual confounders exist hence no causal inferences can be drawn. In addition, since PSM was conducted between each DOAC and warfarin, no comparisons across the three DOACs should be made. Although no direct comparison to the clinical trials can be made given the nature of observational study, our findings from the main, subgroup, and sensitivity analyses provided additional real-world evidence and support for the clinical trial study results. Finally, only treatment-naïve patients and the DOD population were evaluated in the study, which may impact the generalization of the results.

Conclusions

This analysis using the US DOD data adds real-world evidence about the comparative effectiveness and safety of OAC use for stroke prevention in NVAF. Among NVAF patients in the US DOD population, apixaban initiation was associated with significantly lower risks of stroke/SE and major bleeding compared to warfarin. Dabigatran and rivaroxaban initiation were associated with similar risks of stroke/SE and major bleeding compared to warfarin.