Background

Chronic fatigue is characterized by persistent and recurring fatigue that cannot be alleviated by rest [1],[2]. It has been associated with lower quality of life [3]-[5] and higher health care utilization [6]-[10]. The cost of lost productivity associated with chronic fatigue has been estimated to be between £75-£129 million annually in the U.K. and the burden of disease was especially high among those who access specialist services [11].

Cognitive behavioral therapy (CBT) has been shown to be effective in reducing fatigue symptoms as compared to adaptive pacing therapy or usual care [12], while graded exercise therapy (GET) has seen mixed results [13]-[16]. CBT combines elements of both behavioral therapy and cognitive therapy to facilitate the identification and reduction of negative thoughts and to build activity tolerance and positive coping skills among chronic fatigue patients. However, economic evaluations for the treatment of chronic fatigue in primary care have been limited and the findings are generally inconclusive [17]-[20]. In addition, no economic evaluation study has been reported in the US. The assessment of the relative value of CBT will be important for programmatic and policy decisions that must balance costs and outcomes of care [21],[22].

The purpose of the present study is to compare the cost-effectiveness of a brief CBT-based Fatigue Self-Management (FSM) intervention and usual care (UC) conditions in a sample of primary care patients with chronic fatigue.

Methods

Chronic fatigue self-management study

The Chronic Fatigue Self-Management Study is a randomized controlled trial involving 111 primary care patients with chronic fatigue in New York between 2009 and 2011. Details of the study and results of the primary end point were reported elsewhere [23]. While the study was powered for the primary outcome of fatigue impact on functioning, the economic evaluation was designed as a pilot and feasibility study. All patients were recruited from a family medicine/primary care practice with 14 attending physicians and 21 family practice residents. The inclusion criteria for participants were (a) between 18 and 65 years of age; (b) at least six months of persistent fatigue with no medical or psychiatric exclusions (as determined by primary care physicians and a psychiatric nurse). Exclusion criteria were: (a) Medical: fatigue due to identifiable medical conditions (such as autoimmune diseases) or to medications (such as beta blockers); (b) Psychiatric: psychosis or dementia, alcohol or substance abuse, depression with melancholic or psychotic features, and anorexia nervosa or bulimia nervosa. These Axis I psychiatric diagnoses were identified from a nurse-conducted Structured Clinical Interview for DSM-IV (SCID) [24]. The study protocol received ethical approval from the Stony Brook University Institutional Review Board (IRB) and the drafting of this manuscript adheres to the CONSORT statement [25].

After written informed consent forms and baseline assessments were obtained, patients were randomly assigned to one of three groups as follows: CBT-based FSM (n = 37), attention control (AC) (n = 38), and usual care (UC) (n = 36). A variable-sized block randomization procedure was used to minimize potential selection bias. The study statistician generated the random allocation sequence, the principal investigator conducted the initial telephone interview, and a graduate student assigned participants to interventions. Data collection staff were blinded to the group assignment and sample size was chosen to ensure adequate power to detect treatment effect on the primary outcome. Additional details of the study have been reported elsewhere [23]. The CBT-based FSM group received two individual face-to-face fatigue self-management training sessions with a nurse (for up to 60 minutes) and a 61-page self-management booklet containing material assigned and discussed in the two sessions. This protocol was adapted from an efficacious 12-session CBT program for Chronic Fatigue Syndrome (CFS) [26]. Patients in the AC group received two sessions with a nurse therapist regarding emotional support and home-based self-monitoring of symptoms, affect, and stress. The AC group was designed to control for therapist attention and homework assignments so that potential placebo effects can be isolated from the FSM treatment effect. The UC group received no treatment beyond usual medical care. All three groups were assessed at baseline and 12-month follow-up [23]. For the purpose of this study, patients in the AC group were excluded because the attention control would be dominated by the control group as it requires higher costs (due to therapists' attention) with no commensurate benefit.

Outcome measures

The primary outcome was the Fatigue Severity Scale (FSS). The FSS was designed to measure the effect of fatigue on functioning. It is comprised of nine items rated on a 7-point Likert scale, where one indicates no impairment and seven indicates severe impairment. A one-point decrease on the FSS is considered clinically significant improvement. It is a validated scale for use in CFS with high internal consistency [27] and has been shown to be sensitive to treatment change [28].

Service use and costs

Health resource use and costs were identified and valued from the societal perspective for the Reference Case analysis following the 'Panel Recommendations" [29]. Health care resource use was measured with a modified version of the Client Service Receipt Inventory (CSRI), a validated health care utilization diary [30], to record health service use as well as informal care for the 3 month period prior to baseline and on a monthly basis by trained staff via a telephone interview during the post-treatment follow-up period.

To evaluate the economic effects of the prescribed treatments, we identified relevant cost categories of resource use by measuring utilization in each resource category (direct and indirect) and identifying the unit costs (prices) of the corresponding category. As economic endpoints, direct health care costs, direct non-health care costs and indirect costs were included [31]. The direct study-based health care costs included costs of the behavioral interventions and the economic consequences of the programs in terms of health services utilization before and after the intervention (direct health care costs). Intervention costs include costs of personnel (clinical psychologist, nurse interventionists, and staff), training, material (self-help booklet), time spent by study personnel and patients (intervention sessions and travel), facility costs (space, maintenance, and utilities), and other costs (advertising and telephone services). Costs were allocated to individual patients based on the number of sessions they attended. Direct health care costs included the costs of hospitalizations and visits to health care providers (e.g. general practitioner, specialist, physical therapist, alternative medicine providers) and the use of prescription and over-the-counter medications. The direct non-health care costs include out-of-pocket expenses, costs of paid and unpaid help, and travel costs of attending medical appointments. As part of the modified CSRI, information on the frequency of paid help, travel time for medical appointments, and the number of illness-related absences from paid or unpaid work were collected. Indirect costs include the value of production lost to society due to illness-related absence from work (paid or unpaid).

For each category of health care resources, we used standard approaches to estimate costs [32],[33]. Unit costs for major health care services (e.g. provider office visits) and prescription medications were based on national average of Medicare payment rates, estimated from the 2010 Medical Expenditure Panel Survey (MEPS). Medicare payment rates are widely used as approximate measures of the opportunity costs associated with health services use in economic evaluations. Unit costs of various diagnostic tests were based on 2010 Medicare Physician Fee Schedule Payment Schedule published by the Centers for Medicare and Medicaid Services (Table 1).

Table 1 Unit prices used to value the different types of services in the analysis (in 2010 $)

Although informal caregivers are not paid for their inputs, there is still a cost involved from the societal perspective when other opportunities are forgone. It is assumed that the work provided by informal caregivers will be similar to that of home care workers. Therefore, we used the national average hourly wage of home health and personal care aides from the 2010 Occupational Employment and Wage Estimates produced by the Bureau of Labor Statistics (BLS) to approximate the unit cost of informal caregivers as well as unpaid help by family and friends.

The days of lost work were valued using average wages obtained from the U.S. Census Bureau (U.S. Census Bureau, Statistical Abstract of the United States, 2012). We calculated daily wages from annual wages and then estimated the total lost income for each patient as a product of the total number of days missed work and daily wages. For participants who did not work, we used ½ wage rates as estimates of lost productivity [29]. Because the treatment phase for all patients began in 2009 and ended in 2011, we used 2010 prices and did not adjust for inflation [32]. For each patient, total health care expenditures were calculated as the sum of the volume of various services multiplied by the corresponding unit costs.

Analysis

Outcomes

Statistical analyses were performed using STATA (Version 11, College Station, TX). We first compared patients' baseline characteristics in the FSM and UC groups using appropriate tests of statistical significance (i.e. Chi-square test for binary variables, t-test for continuous variables). Last observation carried forward (LOCF) method was used to impute the 12-month outcome data for 26 individuals who did not complete the 12-month assessment and no cost data was imputed. For the effectiveness measure, we used the difference-in-difference approach in multivariate regression analysis to identify the effects of the intervention by controlling for baseline effectiveness or cost measures, as well as baseline patient characteristics (age, gender, education, marital status, employment status, number of chronic conditions, and number of symptoms).

For the cost measure, our primary interest was to examine the between-group differences in total health care expenditures among participants in the FSM as compared to those in the UC group. Therefore, we estimated total expenditures using a generalized linear model (GLM) with a gamma distribution and log link function to account for the distributional characteristics of expenditure data. We chose GLM over ordinary least squares models (with log-transformed dependent variables) based on the modified Park Test examining the distributional characteristics of residuals from both approaches as suggested by Manning and Mullahy [22],[34].

Cost-effectiveness analysis

ICERs were estimated using the standard formula: ICER = (ΔC 1ΔC 2)/(ΔE 1ΔE 2), where ΔC 1ΔC 2 is the difference in the average cost change from baseline to 1-year follow-up between two groups and (ΔE 1ΔE 2) is the difference in the average effectiveness change between the two groups [35]. We plotted a cost-effectiveness plane (with a cost dimension and a FSS dimension) to show the incremental change in FSS scores and in costs for FSM versus UC. The plane is divided into four quadrants: northeast (more effective, more costly), northwest (less effective, more costly), southwest (less effective, less costly), and southeast (more effective, less costly). To account for uncertainty involved in the statistical inference, 3000 incremental cost-effectiveness values were obtained through bootstrapping, a non-parametric method of statistical inference in which the empirical sampling distribution is estimated by repeated re-sampling from the observed distribution [36]. To evaluate the potential impact of imputation on ICER, plots from both the imputed sample and the complete case analysis were generated.

Because negative ICER may result in ambiguity as to which group is dominated, we used the net-benefit approach to evaluate the cost-effectiveness of the treatment group as suggested in the literature [37]-[40]. The net benefit approach can be defined as: NMB = R T ΔEΔC, where NMB = Net Monetary Benefit, R T =Threshold of Willingness-to-pay per unit of benefit, ΔE =difference in effectiveness (net reduction in FSS score), and ΔC =difference in cost. Given a certain level of willingness-to-pay (often unknown from the societal perspective), NMB measures the net benefit the decision-maker is willing to pay per unit of increased effectiveness (R T ), less the increase in cost (ΔC). As a result, a program is deemed cost-effective if NMB > 0 [32]. In the present study, net benefits were calculated for each patient in the sample using a range of values ($0 to $10000 in $50 increments) for R T to reflect the uncertainty regarding the societal willingness-to-pay per unit of effectiveness. We then compared differences in net benefits between FSM and UC using bootstrapped multiple regression models controlling for patient characteristics and pre-treatment FSS and costs.

Sensitivity analysis

To test the robustness of the results, we conducted sensitivity analyses under two conservative scenarios. First, because the cost of informal care is likely to be excluded from the total cost in the employer's decision-making process of whether to adopt the intervention, we calculated the alternative total costs by assuming that the unit cost of informal care equals to zero. Second, as there is some uncertainty regarding the cost of the FSM intervention, we also calculated total costs assuming the intervention costs are 100 percent higher than our estimates. Results from this analysis will show whether the main findings are sensitive to changes in intervention costs.

Results

Sample characteristics

Although 75 individuals were randomized into the FSM (n = 37) and UC (n = 36) groups, the complete-case cost-effectiveness analysis excluded 26 individuals due to missing both effectiveness and costs data (Figure 1). Patients in FSM and UC groups did not differ significantly in baseline patient characteristics, nor are those included in the cost-effectiveness analysis differ significantly from those excluded (data not shown).

Figure 1
figure 1

CONSORT flow diagram.

Table 2 presents average use of services and average costs by resource use categories for both groups during the study period. Overall, the FSM group had lower unadjusted average annual total cost as compared to the UC group before intervention ($3026 vs. $4862) and after the intervention ($4039 vs. $6903). As a result, the FSM group had smaller increase in average annual total costs over the study period ($1012 vs. $2041) even after the intervention costs were factored in. In terms of effectiveness, the FSM group had bigger reduction in FSS score as compared to the UC group (0.99 vs. 0.26). It appears that patients in the FSM group had smaller increases in provider visits, larger decreases in ER/hospital visits and absence from work. In summary, the unadjusted analysis showed that on average, the FSM group had better outcome and smaller increase in costs as compared to the UC group.

Table 2 Costs and changes in costs for UC and FSM, by category and period

Table 3 summarizes the regression-adjusted incremental cost, incremental effectiveness, and incremental cost-effectiveness ratios (ICERs) for FSM versus UC. The FSM appeared to be more effective in improving FSS score and was associated with somewhat lower total costs as compared to UC. Over the 12 months study period, the FSM group had an ICER of −2358 (FSM dominant). This means that compared to UC, FSM intervention generated a societal saving of $2358 for each point reduction in the FSS score. When the bootstrapped 95% confidence interval for the ICER is considered, results suggest that the favorable ICER results for FSM should be interpreted as preliminary evidence because zero was included in the confidence interval. The same analysis using only the complete cases yielded similar results with somewhat smaller savings with wider confidence intervals, as expected from a smaller sample.

Table 3 Adjusted incremental costs, effectiveness, and cost-effectiveness ratios

Figure 2 shows the incremental cost-effectiveness for FSM and AC as compared to UC in 3000 bootstrapped samples. Consistent with results from bivariate analysis presented in Table 2, the great majority of the ICER for FSM vs. UC fell in the southeast quadrant of the ICER plane, indicating than FSM is likely to be more effective with lower costs as compared to UC. The analysis using complete cases yielded similar results with greater uncertainty.

Figure 2
figure 2

Plots of incremental cost-effectiveness ratios for fatigue self-management and attention control from bootstrapped samples. Note: Four quadrants: northeast (more effective, more costly), northwest (less effective, more costly), southwest (less effective, less costly), and southeast (more effective, less costly). Imputed sample included 26 individuals with imputed fatigue assessment data.

Figure 3 presents the cost-effectiveness acceptability curve for FSM as compared to UC, as well as acceptability curves under the two scenarios of the sensitivity analysis. Scenario 1 assumes that the unit cost of informal care equals to zero and scenario 2 assumes that the intervention costs are 100 percent higher than the costs calculated in the study. For the base case, even if society values each point reduction in FSS score at $0, the probability that the FSM would generate a positive NMB is 0.833 (95% CI: 0.819, 0.847). Reducing the value of informal care had virtually no impact on NMB and doubling the intervention costs reduced the probability of positive NMB to 0.735 (95% CI: 0.710, 0.760) assuming $0 willingness-to-pay.

Figure 3
figure 3

Cost-effectiveness acceptability curve comparing fatigue self-management versus usual care, base case and sensitivity analysis. Note: Scenario 1: informal help was valued at $0; Scenario 2: intervention cost was valued at 2 times of the base case rate.

Discussion

While CBT has an effect on fatigue symptoms comparable to graded exercise therapy and counseling in primary care, the longer term cost-effectiveness of CBT remains unclear [17]-[20]. This analysis tested the cost-effectiveness of a brief two-session CBT intervention with a self-management education component in a pilot study of primary care patients with chronic fatigue. To our knowledge, this study appears to be the first economic evaluation conducted alongside of a randomized controlled trial to examine the cost-effectiveness of a brief CBT-based FSM intervention in the U.S. The analysis of the outcome results at 12-month showed significant differences between the FSM group and the UC group after adjusting for baseline characteristics. The FSM intervention appears to be cost-effective in that it was associated with reduced fatigue impact on functioning and lower total costs.

Previous studies have shown that CBT interventions conducted in primary care by trained professionals were effective in reducing fatigue symptoms [18],[19] whereas group CBT was not [15]. This study provides the first U.S. economic evidence that a brief FSM intervention may offer a promising alternative to traditional multi-session CBT delivered by experienced therapists, as it only involves two individual training sessions plus a self-help booklet, as compared to 6-16 visits in CBT trials for CFS patients [9]. This is consistent with the finding from a recent study of non-traditional face-to-face CBT, which showed that an internet-based CBT was cost-effective for severe health anxiety at 1-year follow-up [41].

A number of limitations should be considered in interpreting the findings. First, the attrition rate of this pilot study was high, suggesting that the compliance for the FSM intervention is not optimal or that the burden of monthly follow-up may be high, or both. As a result, findings such as a larger decrease in ER/hospital costs in the FSM group may due to chance. Future studies of CBT interventions should focus on better data collection techniques such as a dedicated staff person for follow-up and implementing oversight processes to reduce the amount of missing data [42]. However, given the self-management nature of this intervention, it mimics adoption rates for other behavioral interventions (such as diet and exercise) in real world settings. In addition, to the extent that the rates of attrition were similar across all three groups and that no statistical differences were detected between completers and non-completers, the attrition is unlikely to bias our findings. Nevertheless, future studies should examine what factors contribute to attrition and explore whether attrition can be reduced by modifying the intervention protocols. A second limitation is the imputation method used, which is based on the assumption that those who did not complete the study on average had no change in fatigue impact which may not be the case. However, the complete case analysis suggests that the findings were not driven by the imputation method used. Third, because patients were recruited from one geographic location, findings may not be generalizable to patients in other locations. A multi-center randomized controlled study is needed to test whether the FSM intervention is cost-effective in more diverse chronic fatigue patient populations. Finally, it is unclear to what extent the beneficial treatment effect for fatigue impact on functioning lasts beyond the 1-year follow-up period.

Despite these limitations, the present study provides important initial evidence of cost-effectiveness for a new brief two-session CBT-based FSM intervention in primary care. It has the strength of incorporating the economic data collection into the clinical outcomes measures by design and as a result, both cost and effectiveness data were collected from the same individuals [43]. Nevertheless, additional research is needed to examine how to improve treatment compliance and whether similar cost-effectiveness can be achieved in a broader patient population across multiple primary care practices and/or regions.

Conclusion

The brief two-session CBT-based fatigue self-management intervention appeared to be cost-effective in this pilot study in that the intervention costs was more than offset by cost savings generated from reduced health services utilization during the 1 year follow-up. However, due to the small sample size and high attrition rates, interpretation of the findings should be cautious. Nevertheless, less labor-intensive modalities of CBT such as the brief nurse-led self-management approach reported here should be tested in future studies in primary care.