The aim of this study was to assess the cost-effectiveness of two brief interventions—motivational interviewing (MI) and a combined intervention of MI and problem solving therapy (MI-PST)—administered by lay counsellors to reduce substance use among patients presenting to emergency departments in resource poor settings, in comparison to a control group.
Study design
This cost-effectiveness analysis was conducted as part of Project STRIVE (Substance use and Trauma InterVention), a randomized control trial comparing two brief interventions to a control group. The MI-PST intervention is a combination of problem-solving therapy with motivational interviewing while the MI intervention offered just motivational interviewing to patients attending emergency departments in the Western Cape province of South Africa. The interventions were offered by lay counsellors and patients were followed up at 3 months post-baseline to assess the effectiveness of the interventions [12]. Cost-effectiveness was assessed from the societal perspective. Economic costs were calculated for the provider perspective in each arm, and a subset of patient costs were assessed in the MI-PST arm. Ingredients and step down methods were used to calculate the economic cost of the interventions and cost-effectiveness was assessed by computing incremental cost-effectiveness ratios (ICERs). The ICER is the ratio of additional costs to additional effects—comparing each costlier intervention to the one directly preceding it [13]. Given that all costs and outcomes occurred within a 1-year period, neither costs nor outcomes were discounted. A range of one-way sensitivity analyses and scenario analyses were conducted to examine the robustness of the study findings. Analysis was undertaken using Microsoft Excel and TreeAge Pro 2013, R1.0. All costs were calculated in 2012/13 prices and were converted to United States Dollars (US$) using an exchange rate from the same period (US$1 = ZAR 10.3952) [14].
Study setting
Participants were recruited within the emergency departments of Khayelitsha Site B Community Health Centre, Khayelitsha District Hospital and Elsie’s River Community Clinic, all located within the Western Cape Province. The unemployment rate in the Province is about 21% [15]. The Province also has a high rate of substance use, crime and violence [16].
Screening, recruitment and assessment
Across the three emergency departments, lay counsellors screened 2736 consenting patients using the Alcohol, Smoking, and Substance Involvement Screening Test (ASSIST) while they waited to see a healthcare provider. Based on ASSIST scores, patients were classified as low risk (with a score of 0–10 for alcohol and < 4 for other drug use), moderate risk (with a score of 11–26 for alcohol and 4–26 for other drug use) or high risk (with scores above 26 for alcohol and other drugs use) [12]. Of the total screened, 531 (19%) patients screened positive for moderate to high risk of substance use, of whom 332 (63%) agreed to be included in the intervention program. Patients were randomly assigned to a single session intervention based on motivational interviewing (MI; n = 113), a blended motivational interviewing and problem solving intervention (MI-PST) comprising five counselling sessions (n = 109) or a control group (n = 110). Patients at high risk were referred for specialised treatment whilst those at low risk were excluded from the study. Patients excluded from the study were not significantly different from the eligible patients. Those who refused to participate in the study had significantly lower ASSIST scores (M = 15.68, SD = 7.60) compared to those who were willing to participate in the study (M = 17.45, SD = 9.08) [12].
In addition to the patient’s level of substance use involvement, their depressive symptoms were assessed at baseline with the Centre for Epidemiological Studies Depression Scale (CES-D) [15]. This scale measures common symptoms of depression based on 20 self-rated items. Each item is graded on a four-point Likert scale, ranging from 0 (representing presence of no depressive symptom) to 3 (indicating the presence of depressive symptoms most of the time). Composite scale scores range from 0 to 60, with a score of 16 or higher representing clinically meaningful depression [12, 17].
These assessments were re-administered at 3 months to determine the effectiveness of the interventions. This was done for 182 participants [control group = 66; MI group = 70; MI-PST group = 46] who were available for the 3 months follow-up assessment. These formed 54% of the entire study sample. More details on the screening, recruitment and assessment of the outcomes are provided in the published trial paper [12].
Counsellors
The counsellors used for the study were recruited from the study areas. They had tertiary level education or equivalent knowledge, and were trained specifically to screen and offer the interventions. In addition to being trained, they participated in biweekly supervision and debriefing sessions throughout the study period [12, 18].
Description of interventions
MI intervention
Patients randomised to the MI group received one session of MI directly after screening and baseline assessment. This session lasted about 30 min in total and was based on the ASSIST linked brief intervention [19]. During this session, lay counsellors provided feedback on the patient’s level of risk based on their ASSIST score, discussed the patient’s substance use patterns and the importance of moderating behaviour in order to minimise health and other risks. Through a motivational interviewing approach, they enhanced the patient’s motivation and willingness to change. Patients received MI-specific substance use risk cards which summarized their risks, in addition to the substance misuse fact sheet and the contact details of local support centres [12].
MI with PST intervention
Patients assigned to this intervention group received the same MI intervention as outlined above in addition to four sessions of PST provided on a weekly basis. These PST sessions were designed to help patients cope better with psychological stress and the other stresses of daily life [20, 21]. The first PST session lasted about 60 min while the other three lasted 40 min each. The content of these sessions has been described in detail elsewhere [12, 18].
Control
While no additional psychotherapeutic support was offered to patients randomized to this group, in an improvement over usual care, patients were provided with a leaflet providing information on the effects of substance use and the contact details of local support centres [12].
Outcome measures
Outcome measures for the study were patients’ scores on the ASSIST and the CES-D. As explained above, these measure patient’s risk of substance use and depressive symptoms respectively. Mean scores for patients in each of the intervention and control groups were calculated at baseline and at the 3 months follow-up. The differences in the means at baseline and the 3 months follow-up for each of the groups were calculated and compared to establish the effectiveness of the interventions. For patients who used more than one substance, reduction in ASSIST scores for the primary substance was used in the analysis.
Provider costs
The scope of provider costs included all cost items needed to deliver the interventions including staffing (counsellors and psychologists), supplies (screener tools, flyers, manuals, fact sheets, pens, tapes and tape recorders for fidelity checks) and capital (counselling room, furniture and training). Research costs (e.g. administering baseline and follow-up assessments) were excluded. The costs were categorized as variable or fixed, and are summarized in Table 1. Table 1 also summarizes the unit cost of each resource and quantity consumed.
Variable costs are those that vary with scale. Under staffing, these include the clinical psychologist that was contracted to undertake bi-weekly supervision and fidelity checks, and whose payment was related directly to hours worked. Variable costs also include the manuals, tools and flyers that were distributed to each client as appropriate to the intervention arm. Fixed costs, on the other hand, are assumed to stay constant over the short term. For the purposes of this costing, these include certain supplies (pens, clipboards, tapes and tape recorders for fidelity checking), capital costs (counselling room space, furniture, and training) and counsellor salary costs.
Capital costs included the cost of counsellors’ training, room space and furniture used within the facilities. The interventions were administered in private rooms in the emergency departments. Cost of room space was estimated based on the price index for new buildings in South Africa [22]. Cost of furniture was estimated based on market prices. It was assumed that the useful life for furniture and buildings were 5 and 20 years respectively. Total cost of counsellor training was estimated as the cost of the training materials, room space, and the salary of the trainer. Retraining for lay counsellors was assumed to be within the next 3 years. Capital costs were annuitised using a 3% discount rate [13], chosen to facilitate comparability with other cost-effectiveness analyses. The nature of this intervention (offered at emergency departments that are open 24 h/day, 7 days/week) meant that 5 counsellors were employed in total across the 3 facilities, with implications for economies or diseconomies of scale within the costing calculations. Counsellor salary costs were therefore assessed as fixed costs, and variation was explored within sensitivity/scenario analysis.
Allocation of provider costs to interventions
The costs of manuals, screeners and flyers were allocated directly to patients based on their utilization within each intervention arm. All other costs were allocated to screening, MI and MI-PST based on the amount of time that counsellors spent on these different components. In essence, the patient contact time (in minutes) for each session (screening, MI and MI-PST) was calculated and multiplied by the number of each type of session. The proportion of total time spent screening, offering the MI intervention, or the MI-PST intervention was then used to allocate costs to intervention components. These calculations are presented in Table 2.
Table 2 Estimated counsellor time spent on different intervention components
Patient costs
Costs to patients for participating in the intervention included the transportation costs incurred when travelling to the facilities to attend their PST sessions, productivity costs in terms of salary loss, cost of care takers and other non-health care costs to patients as a result of their participation in the intervention. These costs were only incurred by patients in the MI-PST group, given that patients in the other arms were counselled while present at the emergency department for treatment for their injuries.
Estimation of intervention costs and cost-effectiveness
Once costs had been allocated to intervention components, they were allocated to interventions to estimate the total costs of screening and each of the interventions. For example, screening costs were incurred for all 2736 participants screened, and were allocated equally to each intervention group, while MI costs were allocated to the MI group, MI-PST costs were allocated to the MI-PST group etc. The allocation of costs is visually depicted in Fig. 1, which replicates the structure of the decision tree employed for this analysis (created in TreeAge Pro 2013, R1.0). The decision tree is an appropriate modelling approach for interventions unfolding over short time periods [23]. In the model, patients were allocated to the intervention groups (MI only, MI with PST and status-quo of no intervention (control)) and followed through a series of events to establish the costs and outcomes of the interventions. In assessing cost-effectiveness, the model took into account patients who were lost to follow-up, excluded or refused the intervention. Costs and outcomes for patients in the MI-PST intervention group for instance were analysed based on whether they dropped out of the intervention or not and the number of PST sessions they attended. The model estimated the incremental cost effectiveness ratios (ICERs) of the interventions. The ICER is the ratio of additional costs to additional effects—comparing each more costly intervention to the one directly preceding it [13]. It compares the difference in costs and effectiveness of the competing interventions as illustrated in Eqs. (1) and (2) below:
$${\text{ICER}}_{\text{YX}} = \Delta {\text{C/}}\Delta {\text{E}}$$
(1)
$$\Delta {\text{C}} = {\text{C}}_{\text{Y}} - {\text{C}}_{\text{X}} ;\quad \Delta {\text{E}} ={\text{E}}_{\text{Y}} - {\text{E}}_{\text{X}}$$
(2)
where CY is the cost of intervention Y (the more costly intervention) and EY is its effectiveness; CX and EX are the costs and effectiveness of intervention X (the less costly intervention).
Sensitivity analysis
One-way sensitivity analysis was conducted to test the robustness of the study findings [24] by varying key cost and outcome drivers. Testing the generalizability of the findings to other (non-study) settings was of particular interest. The proportion of patients screening positive for substance misuse, the proportion of patients accepting participation in the interventions and the extent of excess capacity within the fixed costs (counselling time, supplies and capital) were varied. The impact of these changes on incremental costs, the incremental ASSIST score and incremental cost-effectiveness ratios were captured.