Identification and Assessment of Adherence-Enhancing Interventions in Studies Assessing Medication Adherence Through Electronically Compiled Drug Dosing Histories: A Systematic Literature Review and Meta-Analysis

Abstract

Background

Non-adherence to medications is prevalent across all medical conditions that include ambulatory pharmacotherapy and is thus a major barrier to achieving the benefits of otherwise effective medicines.

Objective

The objective of this systematic review was to identify and to compare the efficacy of strategies and components thereof that improve implementation of the prescribed drug dosing regimen and maintain long-term persistence, based on quantitative evaluation of effect sizes across the aggregated trials.

Data sources

MEDLINE, EMBASE, CINAHL, the Cochrane Library, and PsycINFO were systematically searched for randomized controlled trials that tested the efficacy of adherence-enhancing strategies with self-administered medications. The searches were limited to papers in the English language and were included from database inception to 31 December 2011.

Study selection

Our review included randomized controlled trials in which adherence was assessed by electronically compiled drug dosing histories. Five thousand four hundred studies were screened. Eligibility assessment was performed independently by two reviewers. A structured data collection sheet was developed to extract data from each study.

Study appraisal and synthesis methods

The adherence-enhancing components were classified in eight categories. Quality of the papers was assessed using the criteria of the Cochrane Handbook for Systematic Reviews of Interventions guidelines to assess potential bias. A combined adherence outcome was derived from the different adherence variables available in the studies by extracting from each paper the available adherence summary variables in a pre-defined order (correct dosing, taking adherence, timing adherence, percentage of adherent patients). To study the association between the adherence-enhancing components and their effect on adherence, a linear meta-regression model, based on mean adherence point estimates, and a meta-analysis were conducted.

Results

Seventy-nine clinical trials published between 1995 and December 2011 were included in the review. Patients randomized to an intervention group had an average combined adherence outcome of 74.3 %, which was 14.1 % higher than in patients randomized to the control group (60.2 %). The linear meta-regression analysis with stepwise variable selection estimated an 8.8 % increase in adherence when the intervention included feedback to the patients of their recent dosing history (EM-feedback) (p < 0.01) and a 5.0 % increase in adherence when the intervention included a cognitive-educational component (p = 0.02). In addition, the effect of interventions on adherence decreased by 1.1 % each month. Sensitivity analysis by selecting only high-quality papers confirmed the robustness of the model. The random effects model in the meta-analysis, conducted on 48 studies, confirmed the above findings and showed that the improvement in adherence was 19.8 % (95 % CI 10.7–28.9 %) among patients receiving EM-feedback, almost double the improvement in adherence for studies that did not include this type of feedback [10.3 % (95 % CI 7.5–13.1 %)] (p < 0.01). The improvement in adherence was 16.1 % (95 % CI 10.7–21.6 %) in studies that tested cognitive-educational components versus 10.1 % (95 % CI 6.6–13.6 %) in studies that did not include this type of intervention (p = 0.04). Among 57 studies measuring clinical outcomes, only 8 reported a significant improvement in clinical outcome.

Limitations

Despite a common measurement, the meta-analysis was limited by the heterogeneity of the pooled data and the different measures of medication adherence. The funnel plot showed a possible publication bias in studies with high variability of the intervention effect.

Conclusions

Notwithstanding the statistical heterogeneity among the studies identified, and potential publication bias, the evidence from our meta-analysis suggests that EM-feedback and cognitive-educational interventions are potentially effective approaches to enhance patient adherence to medications. The limitations of this research highlight the urgent need to define guidelines and study characteristics for research protocols that can guide researchers in designing studies to assess the effects of adherence-enhancing interventions.

Introduction

Adequate adherence to medications of proven efficacy and acceptable safety is essential for realizing their health benefits. Yet, suboptimal adherence to prescribed medication regimens is prevalent across all clinical conditions and populations [1].

In the setting of chronic conditions, non-adherence to medications generally worsens outcomes of treatments, leading to increased risk of adverse medical events, more consultations with physicians, higher rates of hospitalization, and increased health care costs [1–5]. Non-adherence has recently been estimated to cost the US health care system $310 billion annually [6] with the associated economic burden being specific to disease severity, co-morbidity, and the respective severities of co-morbidities [7].

Many reasons exist for non-adherence to medicines, and knowledge of these could help clinicians to target patients in need of intervention, design these interventions, and help researchers to plan studies of adherence.

Several reviews [8–11] of interventions for enhancing adherence to medications have consistently highlighted methodological weaknesses in the study designs and methods used, often precluding quantification and permitting only qualitative assessments. In particular, there are major between-study differences in methods used to assess adherence, differing not only in reliability but also in the degree of temporal resolution of their measurements. These methodological differences have thus hampered the identification of interventions that can effectively enhance adherence to medications.

Among the different measurement methods available, electronic medication-event monitoring, which consists of automatic compilation of the time history of each patient’s entry into the drug package, has been considered to provide the most reliable data on adherence in complex clinical situations and in the setting of clinical trials and adherence research [1]. Moreover, it has been reported that electronic medication-event monitoring is the most accurate method for identifying non-adherence [12–14]. Several studies confirm that package opening times are a robust indicator of the times at which patients take the prescribed doses [15–17].

Electronically-compiled dosing histories may also be used as part of the adherence-enhancing intervention, by allowing the health professional to provide feedback to the patient on his/her dosing history. This approach has been referred to as “Measurement-Guided Medication Management (MGMM)” [4].

In the present study, we have systematically searched the literature to identify randomized controlled trials (RCTs) containing empirical data on the efficacy of interventions to enhance adherence to prescribed medications, as assessed by electronic medication-event monitoring methods.

This research was performed within the Ascertaining Barriers to Compliance (ABC) Project, which is an international collaboration of European research groups in the field of adherence to medications funded by the European Commission, Seventh Framework Programme [18].

Methods

The reporting of this systematic review follows the PRISMA guidelines [19].

Eligibility Criteria

We included RCTs, including cross-over and cluster-randomized trials, containing empirical data on interventions expected to enhance adherence to prescribed medications in adults and children, where adherence was assessed by electronic medication-event monitoring methods.

Papers were excluded for the following reasons:

(1) Studies that did not focus on adherence to medications; (2) studies in which adherence was not measured electronically in all patients enrolled in the clinical trial; (3) studies that were not RCTs; (4) studies that focused on interventions to improve disease or symptom management; (5) studies that did not include an adherence intervention; (6) studies in which no quantifiable adherence data were reported; (7) studies that did not report a formal comparison of adherence data between intervention and control conditions; (7) double citations. No paper was excluded on the grounds of quality.

Information Sources

MEDLINE, EMBASE, CINAHL, the Cochrane Library, and PsycINFO were searched for all papers testing adherence-enhancing interventions. The searches were limited to papers in the English language and were included from database inception to 31 December 2011. Detailed search strategies specific to the different databases are provided in Appendix 1 in the Electronic Supplementary Material (ESM).

Study Selection

Eligibility assessment of title and abstract was performed independently in an unblinded standardized manner by two reviewers (JD, TR). If one reviewer coded a study as potentially eligible, the paper was included for full-text review. The full texts of potentially eligible papers were retrieved and reviewed in the second stage of the screening process. Disagreements were resolved by discussion, and a final decision was reached between the two reviewers.

Data Collection Process

A structured data collection sheet was developed to extract data from each study. All data were extracted from the papers; no additional information was sought from authors. The following paragraphs describe which data were extracted.

Data Items

Types of Participants

Studies including ambulatory patients who were prescribed medications for any medical disease were considered for this review.

Demographic data, such as sample size of each study group, population age, percentage of female subjects in each group, and ethnicity of the patients, were extracted from each paper.

Categorization of Interventions

Any intervention or combination of interventions intended to affect adherence to self-administered prescribed medications in short-term and in long-term therapy.

The adherence-enhancing components were classified in eight categories, based on a taxonomy developed from other sources [10, 20–22].

• 1. Interventions based on a treatment simplification (TRT simpl) consist of changes in the dosage schedule (e.g., once daily vs. twice daily) or a change in formulation (e.g., change from tablets to liquid formulation);

• 2. Cognitive-educational interventions (Cogn-Educ) present information individually or in a group setting, delivering it verbally, in written form, and/or audiovisually. These interventions are designed to educate and motivate patients based on the concept that patients who understand their condition and its treatment will be more informed, more empowered and more likely to adhere [10, 20, 21];

• 3. Behavioral-counseling interventions (Behav-Counsel) shape and/or reinforce behavior, and empower patients to participate in their own care, while positively changing their skill levels or normal routines (e.g., skill building by a health care professional, pillboxes, calendars, steps intended to remind the patient to take the medication or tailor the regimen to the patient’s daily routine) and problem solving [10, 20, 21];

• 4. Social-psycho-affective interventions (Soc-Psych) focus on patients’ feelings and emotions or social relationships and social support (e.g., family counseling, group meetings with peers or another groups, stress management) [10, 20], as long as the interventions are based on the assumptions that cognitions can be monitored and altered, and in turn may facilitate behavior change [22];

• 5. Interventions based on electronically monitored adherence feedback (EM-feedback) are designed to provide feedback on patients’ dosing histories compiled from electronic medication-event methods;

• 6. Interventions based on technical reminder systems (Tech rem) are designed to provide technical devices to remind the patients when it is time to take their medications (e.g., mobile phone text message, pager, electronic monitor with beeper);

• 7. Interventions using technical equipment for monitoring the disease being managed (Tech equip) are designed to use various technologies to provide patients with feedback on a clinical outcome (e.g., glucose meter, BP home measurement, feedback on laboratory results);

• 8. Rewards: any kind of rewards for adhering to medication (e.g., cash reinforcement, toys for children).

Types of Studies

Randomized controlled trials, including cross-over and cluster-randomized trials, which tested the effectiveness of adherence-enhancing interventions in an intervention group versus a control group receiving no intervention, e.g., usual care. Adherence had to be assessed through electronically compiled dosing histories in all patients. Studies with small sample sizes were included. Although they often lack statistical power, small studies sometimes contribute novel interventions or target difficult-to-recruit populations.

Study design, number of monitored medications, types of electronic medication-event monitoring, and information on the condition being managed (medical condition, regimen, type of administration) were extracted from each study.

Types of Outcome Measures

Studies in which medication adherence was reported as the primary or secondary outcome assessed with any kind of electronic medication-event monitoring system. We did not assess the quality of the selected studies in regard to whether or not the study was appropriately powered to detect differences in adherence. Clinical outcomes were extracted if reported.

Adherence Definitions

A range of variables was extracted, according to reporting in the primary studies. These were labeled as follows over the relevant reporting period:

• Correct dosing was defined as the percentage of treatment days with the correct number of doses taken;

• Taking adherence was defined as the percentage of prescribed doses taken;

• Timing adherence was defined as the percentage of doses taken within a pre-defined time window;

• Percentage of adherent patients was defined as the percentage of patients with adherence measures greater than a pre-defined value.

Data on mean adherence outcomes were extracted for each reported adherence variable, with a 95 % confidence interval (CI) or standard deviation (SD) for all the study groups. Each study may however report the result of the adherence intervention using one summary variable and not the others. Therefore, to take into account all studies available for the analysis, a combined adherence outcome was defined by selecting the available adherence summary variable of each paper in the following order: correct dosing, taking adherence, timing adherence, and percentage of adherent patients. To study the association between the adherence-enhancing components and their effect on adherence, the analyzed outcome variable was the difference in reported adherence percentages between the intervention group and the control group. If adherence outcomes were reported at several time points, the outcome reported at the end of the intervention period was coded for each study.

Health Outcomes

Data on clinical outcomes were extracted and reported as a significant or non-significant difference between study groups. We did not assess the quality of the selected studies with regard to whether or not the study was appropriately powered to detect differences in clinical outcomes.

Risk of Bias in Individual Studies

A quality assessment of the articles included in this review was processed by two independent reviewers (PK, JD) after the data collection process. The evaluation was based on the assessment of potential bias as reported in the Cochrane Handbook for Systematic Reviews of Interventions (http://www.cochrane-handbook.org/) [23]. The studies were assessed based on their risk of: (1) selection bias (biased allocation to interventions) due to inadequate generation of a randomised sequence, (2) attrition bias due to the amount, nature, or handling of incomplete outcome data, (3) reporting bias due to selective outcome reporting, and (4) risk of contamination of the intervention to the control group. For each type of possible bias, the articles were given a score −1 (high risk of bias), 0 (unclear risk of bias), or +1 (low risk of bias). Total score for bias ranged from −4 to +4 with studies scored between −4 and 0 considered as being of lower quality.

Synthesis of Results

Descriptive statistics (mean, SD, median, IQR, minimum, maximum) were used to summarize the structured data retrieved from the reviewed papers. Box–whisker plots were used to illustrate the data graphically.

When more than one type of intervention was tested, data from each arm of the study were considered as separate data points. A sensitivity analysis was performed to check for potential bias resulting from over-representation of studies with more than one intervention arm (see ESM).

In a first step, the mean adherence (point estimate) was considered for univariate and multivariate linear regression analysis. The dependent variable of those models was the difference in the adherence outcome between the intervention and control groups of each study. In the model-building process, the effect of each available potentially confounding factor on the combined adherence outcome was tested using a linear meta-regression model.

The following were included as explanatory variables: medical condition, unit of allocation at randomization (randomization by patients or centers), average age, percentage of females, number of subjects in the intervention group, study duration (in weeks), the type of adherence outcome measure used in the analysis, the category of adherence-enhancing intervention, and the effect of the occupation of the person delivering the intervention (physician, nurse, pharmacists, or support partner). A stepwise regression procedure with forward selection and a t statistic equal to 2 were used to define the final model.

For the studies in which the SD of the adherence outcome was reported together with its mean, we conducted a more formal estimation of the adherence-enhancing effect, measured by the difference between the adherence outcome of each intervention and the control group of each study (and aggregated 95 % confidence interval) resulting from the different intervention types identified.

In the meta-analysis, a random effects model was used. The random effects model was fitted using a two-step approach [24]. First, the amount of residual/heterogeneity (τ ²) was estimated by random effects model using restricted maximum-likelihood method [24, 25]. Then the true effect was estimated using weighted least squares with weight of study i equal to w _i  = 1/(v _i  + τ ²), where v _i is the sampling variance of study i and τ ² is the variability among the true effects that is not accounted for by the model. The analysis was executed using metafor package [26] implemented in R statistical package version 2.13.2. Total variability due to heterogeneity (I ²) and Q test were used to assess the statistical heterogeneity of the studies.

Risk of Bias Across Studies

A funnel plot was used to assess the presence of publication bias across studies. The funnel plot shows the individual observed effect sizes or outcomes on the x axis against the corresponding standard errors (i.e., the square root of the sampling variances) on the y axis [27].

Results

Study Selection

Seventy-nine RCTs were included in the review. An overview of the review process and reasons for exclusion at the different steps are displayed in Fig. 1.

Fig. 1

Flow diagram of study selection process. CI confidence interval, SD standard deviation

Study Characteristics

Individual study characteristics are listed in Appendix 2 in ESM. The majority of the studies were two-arm studies with one intervention group compared with one control group. However, 5 [28–32] of the 79 studies were 3-arm or 4-arm studies testing the efficacy of more than one adherence-enhancing component, each compared with the same control group. To check for potential bias resulting from over-representation of studies with more than one intervention arm, a sensitivity analysis was performed. In this analysis, studies with multiple intervention arms were (1) excluded, (2) only a single intervention arm was kept for analysis, or (3) each intervention arm was considered as a separate study. The resulting difference in parameter estimates between the three approaches was marginal (<1 %). Therefore, in the remainder of the paper, each intervention arm was considered as a separate study for analysis, yielding 87 cohorts totaling 5,237 subjects.

Types of Participants

Mean sample size expressed as number of subjects was 61.4 [range (5; 1,113)] in the usual care group and 64.1 [range (4; 1,189)] in the intervention group.

Average age expressed in years was 47.5 [range (3.0; 73.7)] in the usual care group and 46.8 [range (3.4; 76.2)] in the intervention group. Five studies [33–37] designed adherence-enhancing interventions for children. Participants’ demographic characteristics are presented in Tables 1 and 2.

Table 1 Group of patients targeted by the interventions in the 87 intervention groups

Table 2 Demographic characteristics of the 87 intervention groups by randomization group

Categorization of Interventions

In 40 intervention groups, the efficacy of only one adherence-enhancing component was tested against a control group, whereas in 47 intervention groups a combination of multiple adherence-enhancing components was tested (Fig. 2).

Fig. 2

Combination of adherence-enhancing components for each intervention group (n = 87). Each column stands for one intervention group. Intervention groups are ranked by number and types of components tested. In each intervention group, the tested intervention components are illustrated by red boxes. TRT simpl Interventions based on treatment simplification, Cogn-Educ cognitive-educational interventions, Behav-Counsel behavioral-counseling interventions, Soc-Psych social-psycho-affective intervention, EM-feedback interventions based on electronic-monitoring adherence feedback, Tech rem interventions based on a technical reminder use, Tech equip interventions based on a technical equipment use, Rewards any kind of rewards for adhering to medications

The average intervention period was 19.4 weeks with a range of 0–52 weeks. In two studies [38, 39], the intervention was delivered only on one occasion to the patients. In both of these studies, the patient post-intervention follow-up period ranged from 4 weeks [39] to 12 weeks [38]. The median duration of patient follow-up was 26 weeks [range (4; 64)].

The frequency with which the intervention was delivered to patients was not included as a variable in the meta-analysis and was presumably optimized based on the type of intervention. In studies in which multiple intervention components were part of the adherence-enhancing intervention, each intervention component was reported with a different frequency. In several studies the frequencies were not clearly described [40–42].

Sixty-six of the 79 control groups received routine care, e.g., groups in which ‘usual care’ was provided to the patients and no adherence-enhancing intervention was tested. In some of these studies, the control groups were just named as ‘standard of care’ without a clear description of what was exactly provided to the patients of these groups.

In 13 control groups, however, an enhanced standard of care was provided to the patients. In one study [43], for example, the control group received the same care as the intervention group except for behavioral strategies. Control patients used self-monitoring of symptoms and attended the same number of visits as the intervention group.

Types of Studies

Within our selected RCTs, five were cluster randomized [44–48], and three were cross-over studies [49–51]. The publication years ranged from 1995 to 2011 with a peak in 2007 (n = 12). Out of five cluster-randomized studies, three [44, 45, 47] took into account the within-cluster (within-center) correlation to analyze the adherence intervention effects.

The majority of the monitored medications were oral medication (87.4 %) monitored with the medication event monitoring system (MEMS)^® caps (85.1 %). Table 3 illustrates the principal treatment characteristics of the 87 intervention groups.

Table 3 Treatment characteristics of the 87 intervention groups

The number of medications monitored ranged from 1 to 4 in each patient. In most of the studies (89.0 %), medication adherence was assessed electronically for one medication. In studies with multiple medications for a single indication, typically the medication with the most frequent or the most complicated dosing regimen was monitored. In the majority of these studies, however, adherence-enhancing interventions aimed to enhance medication adherence with all prescribed medications. In four studies [38, 40, 52, 53], it was not clear which and how many medications were monitored.

Disease categories were broad (23 different diseases); 38.0 % of studies concerned HIV infection. Studies exclusively reported patients with chronic diseases (hypertension 13.9 %, asthma 12.7 %, heart failure 5.1 %, etc.).

Three studies [54–56] provided an estimate of the intervention’s costs. The first study [54] reported an intervention based on daily text message reminders sent to the patients over a 4-week period (costs estimated per patient: US$3.60, projected costs per year: US$46.80; 2009). The second study [55] reported that the price for an alarmed vial used for 4 weeks ranged from US$16 to US$80 (2001). The third study reported a cost of US$205 per patient [56] for a 1-year intervention delivered by a trained pharmacist providing patient-centered instructions and education (2007). No further conclusion on intervention costs could be derived given the limited information and the diversity of the studies.

Types of Outcome Measures

Adherence Definitions

Twenty-five studies reported correct dosing, 49 studies reported adherence as taking adherence, 27 reported timing adherence, and 18 studies adherence as percentage of adherent patients.

Forty-eight studies reported mean adherence outcomes with a 95 % CI or standard deviation and were therefore included in the random effects model of the meta-analysis.

Health Outcomes

Among the 57 studies that reported data on clinical outcomes (72.2 %), only 8 [35, 44, 52, 57–61] reported a significant difference in clinical outcome between the intervention and the control groups.

Ducharme et al. [35] showed that children receiving a written action plan coupled with a prescription displayed significantly better asthma control with 40 % more patients reporting less than two indicators of poor control (relative risk 1.36; 95 % CI 1.04; 1.86). Asthma control was measured with the Asthma Quiz for Kids, which is a validated questionnaire measuring the number of indicators of poor asthma control.

Delmas et al. [44] concluded that adherence reinforcement strategies (feedback on bone turnover markers) were associated with a lower incidence of new radiologically determined vertebral fractures in osteoporosis patients (odds ratio 0.4; 95 % CI 0.2–1.0).

Bogner et al. [52] reported fewer depressive symptoms (CES-D mean score difference between groups: 9.3; p < 0.01), lower systolic blood pressure (systolic BP difference between groups: 14 mmHg; p < 0.01), and lower diastolic blood pressure (diastolic BP difference between groups: 9.2 mmHg; p < 0.01) in hypertensive patients of the intervention group (integrating depression treatment with hypertension management) compared to patients of the usual care group. Patients’ treatment was monitored for 6 weeks.

Kardas et al. [57] noted that patients treated with once-daily sulfonylurea drugs achieved significantly better glycaemic control than those treated with the twice-daily medication (HbA1c level difference between groups: 0.9 %; p < 0.0001).

De Bruin et al. [58] showed that the number of HIV patients with an undetectable viral load increased in the intervention group (theory- and evidence-based underpinnings of the determinants and behavior change techniques) compared to the control group (p < 0.05).

Another study conducted by the group of Bogner and de-Vries [59] noted that participants in the integrated care intervention group (integrating depression treatment into care for type 2 diabetes mellitus) had lower levels of glycosylated hemoglobin (p < 0.05) and fewer depressive symptoms (p < 0.04) compared to participants in the usual care group at 12 weeks of diabetes treatment.

Rudd et al. [60] found that hypertensive patients randomized to the intervention group (home-based, physician-directed, nurse-guided drug therapy) achieved greater reductions in office blood pressure values at 6 months than those receiving usual care (systolic BP difference between groups: 8.5 mmHg; p < 0.01; diastolic BP difference between groups: 1.4 mmHg; p < 0.05).

Another study of Kardas [61] reported that the mean weekly number of chest pain episodes in angina pectoris patients was greater in patients with once-daily oral nitrates compared to patients randomized to the twice daily regimen (0.94 ± 4.32 and 0.30 ± 1.20 episodes per week for the once and twice daily regimens, respectively; p < 0.0001).

Synthesis of the Results

Adherence data collected from the 87 intervention studies resulted in drug dosing history data compiled among 10,551 ambulatory patients. Patients randomized to an intervention group had an average combined adherence outcome of 74.3 %, which was 14.1 % higher than in patients randomized to the control group (60.2 %). The median difference in the combined adherence outcome was 12.6 % (range −7.0, 59.0 %; IQR 16 %).

The median difference in adherence measures between the control and intervention group at the end of the intervention period in studies that reported adherence as correct dosing (n = 25) was 14.0 % (range 0.0, 32.0 %; IQR 12.9 %); in studies that reported taking adherence (n = 49), the median difference was 8.3 % (range −7.0, 49.0 %; IQR 12.7 %); in studies that reported timing adherence (n = 27), the median difference was 14.9 % (range 2.0, 33.6 %; IQR 11.5 %); in studies that reported the percentage of adherent patients (n = 18), the median difference was 20.9 % (range 1.8, 59.0 %; IQR 26.4 %).

Potential Confounding Factors and Intervention Components that Affect Adherence Measures

Univariate linear regression models were used to explore the association between each potential confounding factor and the difference in adherence measures between the control and intervention group. The models showed that study duration was the only factor that significantly affected adherence measures (p < 0.01). The longer the patient follow-up is, the smaller the difference in the adherence outcome between the study groups at the end of the study (Fig. 3). For each additional month of follow-up, the effect on adherence decreased by 1.0 %.

Fig. 3

Improvement in adherence outcome (percentage points) by study duration (linear regression model) (n = 86) *Loess: locally weighted scatterplot smoothing

The number of subjects enrolled in the intervention group, subject gender, and average patients’ age in the intervention group did not significantly affect this difference. For each increase in the number of intervention elements, the adherence outcome increased by 2.3 % (p = 0.05). The results of the univariate linear regression model are summarized in Table 4. The unit allocation of randomization, by either patients (effect 14.1 %) or centers (effect 14.0 %), had no significant effect on the difference in the adherence outcome between the study groups at the end of the study (rank-sum test; p = 0.97).

Table 4 Effect of potential confounding factors on adherence measures: results from univariate regression models

Figure 4 depicts the differences in the adherence outcome by intervention component tested in the intervention. Studies that included an EM-feedback type had a mean improvement of 19.9 % (median 20.3 %), the highest average among all intervention components. On average, they were 7.7 % more effective than studies testing intervention strategies that did not include such feedback (rank-sum test; p = 0.02). Four studies used rewards as part of the intervention strategies, providing a mean improvement of adherence of 17.3 % and a median of 22 % (the highest median among all intervention components). On average, studies with rewards were 3.3 % more effective than studies without rewards (rank-sum test; p = 0.44).

Fig. 4

Difference in the combined adherence outcome (expressed as percentages) between intervention and control group by adherence-enhancing component. The point near the middle of the box is the median. The lower and upper bounds of the box are the 25th and 75th percentile of the distribution. The ends of the whiskers represent the minimum and the maximum of the distribution after taking out the outliers. A point is considered as an outlier if it is above the 75th percentile of the distribution plus 1.5 of the interquartile range or if it is below the 25th percentile of the distribution minus 1.5 of the interquartile range. The reported p values are based on the Wilcoxon rank sum test to evaluate if there is any significant difference in adherence amelioration outcome between studies that included the corresponding intervention component and studies that did not include this type of intervention component. TRT simpl Interventions based on treatment simplification, Cogn-Educ cognitive-educational interventions, Behav-Counsel behavioral-counseling interventions, Soc-Psych social-psycho-affective intervention, EM-feedback interventions based on electronic-monitoring adherence feedback, Tech rem interventions based on a technical reminder use, Tech equip interventions based on a technical equipment use, Rewards any kind of rewards for adhering to medications. The number of studies that reported a statistical comparison between the groups (p value) and the proportion of them that were statistically significant at the 5 % level are depicted on the right-hand side

The occupation of the person who provided the intervention had no significant effect on adherence measures (rank-sum test; physician: effect = 1.0 % p = 0.99; nurse: effect = 1.3 % p = 0.93; psychologist: effect = 4.7 % p = 0.72; pharmacist: effect = 5.4 % p = 0.58; support partner: effect = −5.8 % p = 0.45).

Significant Factors that Affect Adherence Outcomes: Results from the Multiple Regression Model

When all variables were analyzed in a multiple regression model using a stepwise method, the variable indicator of EM-feedback type (p < 0.01) and cognitive-educational (p = 0.02) were the intervention components that remained significant in the final model. The model estimated an 8.8 % increase in adherence when the intervention included an electronically monitored adherence feedback system and 5.0 % increase in adherence when the intervention included a cognitive-educational component.

Study duration was also a significant factor that affected adherence measures (p < 0.01). For each additional month of follow-up, the effect on adherence decreased by 1.1 %. The variable percent adherent patient indicator (equal to 1 when the percentage of adherent patients is used as outcome variable, 0 otherwise) was significant in the model (p < 0.01), indicating that the percentage of adherent patients was not interchangeable with other adherence measures (correct dosing, taking adherence, timing adherence). The inclusion of the indicator variable in the model then served a correction when this percentage of adherent patients was used as an adherence measure.

Effects of Adherence-Enhancing Interventions on Adherence Outcomes: Results from the Meta-Analysis

Forty-eight of the 87 studies were included in the meta-analysis. The excluded studies did not report the variability of the effect of the intervention, which is needed to perform the meta-analysis.

The forest plot reported in Fig. 5 illustrates the percentage point differences in the adherence outcome between intervention and control groups from the individual studies as well as the estimated overall percentage point difference on adherence based on random effects model. The estimated overall percentage point difference between intervention and control groups of the 48 studies was 12.6 % (95 % CI 9.4–15.8) with a wide variability in percentage point differences and confidence intervals between studies.

Fig. 5

Percentage point differences in adherence outcomes (ordered by year of publication)

When explanatory variables were introduced in the mixed-effect model of the meta-analysis, the EM-feedback (p < 0.01) and cognitive-educational (p = 0.04) element of the intervention had a significant effect on patient adherence. The model estimated an 8.7 % increase of the adherence measure when the intervention included an electronically monitored adherence feedback system and 5.6 % increase of adherence measure when the intervention included an cognitive-educational component. Variable study duration was also significant in this model (1.2 % decrease for each month longer, p < 0.01). The variable percent adherence indicator was borderline significant in this model (p = 0.09).

The combined adherence outcome in studies that tested the EM-feedback type as part of the intervention showed an overall percentage point difference of 19.8 % (95 % CI 10.7–28.9). The overall percentage point difference was 10.3 % (95 % CI 7.5–13.1) for the studies that did not test the EM-feedback type as part of the intervention. The improvement in adherence was 16.1 % (95 % CI 10.7–21.6 %) in studies testing cognitive-educational components versus 10.1 % (95 % CI 6.6–13.6 %) in studies that did not include this type of intervention.

Risk of Bias in Individual Studies

Out of 87 studies, 12 studies (13.8 %) were considered of lower quality and prone to bias (1 had a score of −1 and 11 had a score of 0). Multiple regression analysis based on high quality studies only confirmed that EM-feedback (p < 0.01) and the cognitive-educational (p = 0.01) element of the intervention had a significant effect on patient adherence. The model estimated a 7.7 % increase in the adherence measure when the intervention included an electronically monitored adherence feedback system and 5.9 % increase in the adherence measure when the intervention included a cognitive-educational component. The variable study duration (1.0 % decrease for each month longer, p < 0.01) and the variable percent adherence indicator were significant in this model as well (p < 0.01).

Risk of Bias Across Studies

The Q statistic suggested considerable heterogeneity among the true effects (p < 0.01). The percentage of total variability due to heterogeneity (I ²) based on this model was estimated as 99.9 %, showing that the studies were heterogeneous.

By using the standardized mean difference in the meta-analysis, the percentage of total variability due to heterogeneity (I ²) based on this model was reduced slightly to 97.3 %. When explanatory variables were introduced in the mixed-effect model of the meta-analysis, the Q statistic remained significant (p < 0.01), suggesting considerable heterogeneity among the true effects.

The funnel plot (Fig. 6) showed possible publication bias in studies with high variability of the intervention effect. The regression test for funnel plot asymmetry [62] showed that the observed mean difference in the adherence outcome between the intervention and control group was related to the standard error of the difference in the adherence outcome (p < 0.01). Studies with large intervention effects gave low p values despite their high standard errors, and studies with p < 0.05 were more likely to be published.

Fig. 6

Funnel plot to assess any publication bias across studies

Discussion

Summary of Evidence

In this systematic literature review, we identified 79 RCTs reporting 87 pair-wise comparisons of interventions intended to enhance patient adherence to prescribed medications.

Patients randomized to an intervention group had, on average, an adherence outcome that was 14.1 % higher than in patients randomized to standard care. This effect size is similar to the value reported in Peterson et al. [63] who conducted a meta-analysis on adherence-enhancing intervention trials and reported an overall effect size of 4–11 %, but no single strategy appeared to be best.

Relative to other intervention components, studies that included an EM-feedback type had the largest mean improvement in adherence measures. Studies using rewards as part of the intervention had the largest median improvement; however, probably due to its low sample size, the effect is not significant. Intervention strategies that included a focused discussion based on giving feedback to the patient of his/her recent dosing history data (EM-feedback) were 7.7 % more effective than intervention strategies that did not include such feedback (p = 0.02).

The linear meta-regression analysis estimated an 8.8% increase in adherence when the intervention included feedback to the patients of their recent dosing history (EM-feedback) (p < 0.01). Our meta-analysis showed an average difference of 19.8 % (95 % CI 10.7–28.9 %) in the combined adherence outcome between patients receiving EM-feedback versus control group—almost double the average difference among patients receiving an intervention that did not include the EM-feedback versus control group: 10.3 % (95 % CI 7.5–13.1 %).

This finding is consistent with the results of Kripalani and colleagues [21] who reported that the most common and effective forms of intervention were dosage simplification and repeated assessment of medication adherence with feedback. They used stringent inclusion criteria, considering only studies in chronic medical conditions that reported at least one measure of medication adherence and one clinical outcome, and with at least 80 % follow-up of patients during 6 months of treatment. The methods used to measure adherence, however, varied widely in their studies.

Another study recently highlighted that EM-feedback can be a clinically useful tool when used in combination with other adherence-promoting treatment strategies aimed at enhancing medication adherence among chronically ill youths [64].

Though EM-feedback can be considered as a behavioral-counseling intervention, in terms of influencing patients’ behavior by giving feedback on their recent drug dosing history, it was considered as a separate intervention component in our review. Given that our review focused on studies that assessed medication adherence through electronic medication-event monitoring, we sought to investigate how many studies utilized feedback on the patient’s recent drug dosing history data in their intervention groups. Twenty-two intervention groups (25.3 %) actually included EM-feedback in their adherence-enhancing intervention.

Measurement-Guided Medication Management (MGMM) of adherence may be an approach to enhance adherence to medications in which reliable, detailed, recent, electronically compiled drug dosing history data are provided as feedback to the patient on his/her adherence to prescribed medications. It sets the stage for focused dialogue between the healthcare providers and their patients, reinforcing behavioral, social, and cognitive interventions.

Cognitive-educational interventions, designed to educate and motivate patients by instructional means, were also significant intervention strategies in our final model. The linear meta-regression analysis estimated a 5.0 % increase in adherence when the intervention included a cognitive-educational component (p = 0.02).

Non-adherence to medication is recognized as a multi-factorial and complex problem. Most studies included in our review assessed successfully complex interventions but did not assess the separate effects of the components, begging the question of whether all elements were required.

Kripalani’s research group found in 2007 [21] that complex programs which utilized multiple interventions delivered over a longer period of time appeared more likely to achieve better outcomes. It is likely that these more complex interventions were effective because they address a greater number of the potential barriers impacting a patient’s ability to adhere to therapy and provide reinforcement over time.

In a review, Haynes et al. [9] reported that several simple interventions appeared to improve adherence with short-term regimens, but interventions to improve medication use for chronic conditions appeared less effective overall and were often multifaceted, making it more difficult to synthesize published evaluation. This finding begs the question of whether multiple components are necessary or whether less complex interventions may be just as effective.

Since the frequency or dose of the different intervention components was not always clearly described in the studies or sometimes somewhat confusing because of the multiplicity of the components tested, we could not draw any conclusions on which intervention dose suits each component best.

Our review highlights, nevertheless, that several interventions were effective in improving adherence to medications. Few of them, however, were able to demonstrate an impact on clinical outcomes. While data on clinical outcomes were reported in 57 studies, only 8 studies (14.0 %) [35, 44, 52, 57–61] reported a significant difference in the effect of adherence-enhancing interventions on clinical outcomes. Of note is that most studies were not powered to show a difference in clinical outcomes, nor did they control for other potential influences on the clinical outcomes. There may also be a reporting bias; studies with significant adherence outcomes but not significant clinical outcomes may have not reported the non-significant clinical outcomes. Kripalani and colleagues [21] drew the same conclusion, having identified only a few studies demonstrating an impact on clinical outcomes, despite including only studies in which at least one measure of clinical outcome was reported.

The duration of the study follow-up showed a significant effect on the improvement in the combined adherence outcome, suggesting that the intervention effects on adherence tended to diminish over time. This evident diminution in improvement has an important clinical implication: it may not be realistic to expect a single episode of adherence-enhancing intervention to have long-lasting effects. In two studies [38, 39], the intervention was delivered on one occasion, with a statistically significant effect on adherence outcomes, but the short follow-up period did not allow for an estimation of the intervention’s waning effect over time. Interventions may have to be provided in a sustained fashion as an integral part of the treatment plan in order to achieve and maintain adherence.

The RCTs included in this review often lacked a detailed description of the control groups. Standard care provided to control participants in intervention trials may also contain effective behavior change techniques. De Bruin et al. [65] performed a meta-analysis on the impact of standard care on effects of adherence interventions in HIV patients. The control groups of their review—reportedly receiving “usual care”—were actually exposed to widely varying forms of effective adherence care. As the capacity of standard care increased, fewer behavioral problems remained, making it less likely that the intervention will be effective. These findings suggest that intervention effects will be systematically reduced in settings with higher levels of standard care.

Estimation of adherence to medication may differ according to the measure of adherence. Since we focused on studies that used electronically compiled drug-dosing histories, we could confidently exclude a potential bias present in other systematic reviews that would have been introduced by heterogeneous adherence measures. This method of electronically compiled drug dosing histories is considered to be the most reliable and the most detailed approach for estimating adherence to medication in ambulatory patients. Consequently, however, only a limited number of adherence-enhancing interventions may have been included in this review.

Limitations

This meta-analysis was limited by the heterogeneity of the pooled data and the different medication adherence definitions.

Furthermore, we included each randomized controlled trial testing adherence-enhancing interventions. We did not apply any quality appraisal during the paper’s selection process.

Given that the review was limited to EM monitoring of adherence, we have probably included more studies of MGMM than a review with broader inclusion criteria for adherence measurement. A publication bias might exist because only significant MGMM studies might be published, and inferior comparators might be used (investigators are sold to the concept of MGMM, and are “EM practitioners”).

While studies on which electronic monitors are used to automatically compile dosing history data provide the most reliable estimate of adherence, some potential bias cannot be excluded. For example, non-adherent patients may refuse to participate in an adherence study, resulting in over-estimation of medication adherence. On the other hand, some patients who are adherent to the treatment may not use the electronic monitors appropriately (e.g., pocket dosing, weekly organizers, etc.), resulting in potential under-estimation of adherence. In general, those patients remain an exception and are typically screened out by the investigators, but it cannot be excluded that this phenomenon becomes less frequent among patients receiving EM-feedback.

Among the RCTs reviewed, considerable variability was evident with respect to study size, randomization method, frequency of intervention repetition, potential bias, operational definition of adherence, identification of the intervention types, study follow-up, definition of standard of care, and inclusion criteria used. The lack of detailed descriptions of control groups might have underestimated the intervention effects. In contrast to our review, McDonald et al. [10] conducted a descriptive review of the included studies instead of a quantitative summarization (i.e., meta-analysis) of findings across studies because of the heterogeneity in the methodology of adherence-enhancing intervention studies.

The majority of the papers did not clearly describe the methods used. This problem, also highlighted by several other authors [9, 66–68], led to discrepancies in data extraction between the two reviewers that needed to be resolved. A majority of studies reported significant differences in at least one adherence measure between the study groups (19.7 % significant differences vs. 8.5 % non-significant differences), but a potential publication bias across the studies was identified through the funnel plot. We did not search conference abstracts or other sources to quantify this potential bias.

Finally, many of the studies (38.0 %) included in this review involved patients with HIV. The high effect size found in this review might be due to the assumption that differences in the perceived severity of the various health conditions in the studies may influence patients’ response to adherence interventions.

Future Research

The limitations of this research support the need for future studies to adhere to guidelines concerning the design, conduct, analysis, and reporting of studies designed to assess the effects of adherence-enhancing interventions [67, 68].

Because there is a broad spectrum of reasons for non-adherence, including unintentional as well as intentional, any single intervention is not likely to be effective in enhancing medication adherence. The most effective approach might be based on patient stratification and personalized medicine, i.e., (1) identifying the patients with sub-optimal adherence; (2) identifying the origins for non-adherence, and (3) targeting those patients with a suitable intervention. It might be worthwhile to identify those patients most likely to respond to one form of intervention versus another and estimate the impact of adherence-enhancing interventions on clinical outcomes [9, 69].

Our review has shown that there is a large variability in intervention studies, and we have consequently identified several aspects that might help in improving the power of future intervention trials. More specifically, interventional trials should be adequately powered for a clinical endpoint, use a sound adherence measure, and be statistically robust.

Researchers should be informed that the efficacy of adherence-enhancing interventions wane over time, requiring repeated administration and adequate patient follow-up to ascertain not only long-term efficacy of interventions, but also the frequency of repeated interventions.

Finally, settings of clinical trials are different from real life, and researchers should place greater emphasis on testing adherence-enhancing interventions in real life settings, including evidence-based economic evaluations. Furthermore, most intervention studies are designed to change patient behavior, whereas healthcare system or multilevel interventions are still in an early research stage. It seems to be important to plan for suitable system-related intervention studies.

Conclusions

To our knowledge, this is the first review to focus on studies in which dosing histories were electronically compiled at rates of data sampling high-enough to provide adequate definition of when doses were or were not taken. Despite several limitations, this review supports the efficacy of EM-feedback and cognitive-educational interventions. Future research on adherence-enhancing interventions should address the multifaceted nature of non-adherence and utilize better study methods.