INTRODUCTION

Diabetes affects over 29 million individuals in the United States and is associated with significant morbidity and mortality, increased health care utilization, and higher health care costs, accounting for an estimated $245 billion in total expenditures annually.1 Diabetes disproportionately affects non-Hispanic blacks (NHBs) and is associated with poorer outcomes, negative beliefs and attitudes towards diabetes, inadequate self-management, and worse perceived control.1 7 There is compelling evidence that self-management is important for improving glycemic control.8 13 In fact, one meta-analysis of 31 randomized controlled trials found that self-management education interventions led to a 0.76% reduction in glycosylated hemoglobin A1c (HbA1c) levels (95% confidence interval 0.34–1.18).10 In addition, evidence supports the efficacy of telephone interventions in improving patient outcomes.14 16 Such studies in NHBs, however, are limited.

A number of studies involving various knowledge and information, motivation and coping, and behavioral and skills training interventions have shown mixed results.17 27 While some have demonstrated significant improvements in glycemic control or self-management,17 , 23 , 24 others have reported less favorable results.17 , 22 , 24 A systematic review of diabetes self-management interventions suggests that intervention effects can vary depending on the mode of delivery, hours of engagement, and baseline HbA1c at the time of enrollment.25 Results can be further complicated when targeting a vulnerable population such as NHBs, where factors such as cultural relevance, social support, and subsistence needs (e.g., transportation, access, caregiver responsibilities) should be considered.17 , 20 , 23 , 27

Overall, the generalizability of prior studies is limited by 1) the recruitment of insufficient numbers of NHBs; 2) a lack of randomized controlled trials comparing critical aspects of the interventions such as knowledge, behavioral modification, and skills training independently or in combination; 3) poor internal validity; 4) inadequate dosage and frequency of the intervention, coupled with minimal patient-centeredness and tailoring; and 5) a limited number of interventions based on behavioral theories such as motivational interviewing. Therefore, this study was designed to test the efficacy of separate and combined telephone-delivered diabetes knowledge and behavioral skills training in high-risk NHB adults with poorly controlled type 2 diabetes. We hypothesized that the results for patients in the separate and combined interventions would be superior to those in the control group regarding the reduction in HbA1c at 12-month follow-up.

METHODS

Study Design and Participants

The study design featured a 2 × 2 factorial randomized controlled trial (RCT) with a follow-up period of 12 months.28 Assessment visits were conducted at baseline and at 3, 6, and 12 months. The study participants were high-risk NHBs with poorly controlled type 2 diabetes (HbA1c ≥ 9% within 12 months of randomization) who were recruited mainly from clinics (general internal medicine, endocrinology, family medicine, and community primary care) at the Medical University of South Carolina (MUSC; general internal medicine, endocrinology, family medicine, and community primary care clinics) and the Ralph H. Johnson Veterans Administration Medical Center (VAMC), both located in Charleston, South Carolina.

NHB patients with type 2 diabetes were identified using (1) clinic billing records for ICD-9 codes consistent with a diagnosis of type 2 diabetes, and (2) referrals from physicians and other clinic staff such as nurses, or patients themselves. Letters of invitation signed by the patients’ primary care providers were mailed to patients, and institutional review board (IRB)-approved recruitment flyers were posted in prominent locations in the study clinics. Patients eligible to participate in the study were 18 years of age and older, had a clinical diagnosis of type 2 diabetes and HbA1c ≥ 9% at screening, self-identified as non-Hispanic black or African American, were taking at least one oral medication for hypertension or hyperlipidemia and were willing to use an electronic compliance monitor (eCAP) bottle for 12 months, were able to communicate in English, and had access to a telephone (landline or cell phone) for the 12-week intervention period. Patients who had mental confusion on interview suggesting significant dementia, were participating in other diabetes clinical trials, had alcohol or drug abuse/dependency, had active psychosis or acute mental disorder, or had a life expectancy less than 6 months were excluded from the study. Eligible participants received $25 at the completion of each assessment at baseline and 3, 6, and 12 months, for a total of $100.00. All study procedures were approved by the MUSC IRB and the Research and Development (R&D) Committee at the Ralph H. Johnson VAMC.

Randomization and Blinding

After being provided with a study overview and explanation of the procedures, risks, and benefits by the program assistants, participants signed the informed consent forms. Per protocol,28 all eligibility criteria were verified at the baseline visit by the health educators (HEs), who then randomized the participants into one of the four study arms: (1) diabetes knowledge group, (2) skills training group, (3) combined knowledge and skills training group, or (4) control group (usual standard of care plus general health education). The randomization was performed in waves, with approximately 64 patients randomized every 6 months. The randomization sequence was web-based and computer-generated. In addition to verifying eligibility, the HEs were responsible for randomizing the participants and conducting the 12-week intervention.

To prevent bias in the evaluation of outcomes, the treating physicians, clinic staff, and the research assistant who collected primary data on outcomes were blinded to treatment assignment. In addition, the patients were blinded to treatment assignment, and received treatment over the telephone for the same time and treatment interval (i.e., weekly calls of minimum of 30 min on the same day at the same time for 12 weeks).

Clinical Interventions

Details about the specific content of the interventions have been published previously.17 All intervention sessions were delivered by telephone. The proposed separate and combined interventions were based on the information-motivation-behavioral (IMB) skills model.29 , 30 Per the IMB model adapted to diabetes, information on diabetes is a prerequisite for appropriate diabetes self-management, motivation determines the adherence to diabetes self-management instructions, and behavioral skills are a major prerequisite for effective diabetes self-management.29 32

Regardless of the randomization group, all participants received 12 telephone sessions. Two full-time masters-level HEs, who were trained in behavioral skills counseling and the content and conduct of diabetes and general health education, delivered the weekly 30-min telephone calls to participants in all four study groups. Participants randomized to the diabetes knowledge group completed 12 diabetes education modules over the 12-week period. The educational materials were developed based on guidelines for diabetes education.33 Participants randomized to the skills group were administered 12 sessions of behavioral skills training over the 12-week period, which focused on four behaviors: physical activity, diet, medication adherence, and blood glucose self-monitoring. For the participants in this group, the HEs, who were trained in motivational interviewing, worked with the patients to develop a patient-generated action plan for improving one targeted behavior over 3 weeks. In addition, participants in this group were given a list of five questions to ask their providers at every visit (patient activation) and were asked to complete a “Diabetes Care Package” (patient empowerment) during the first session. Participants randomized to the combined diabetes knowledge and skills intervention received weekly diabetes information, behavioral skills training, patient activation, and patient empowerment over the 12-week period. To optimize time for the combined calls compared to the knowledge and skills only groups, education was covered in the first 10 min of the call, followed by 20 min for skills training. In addition to usual care, participants randomized to the control group received weekly general health education sessions (excluding diabetes education) over the 12-week period to control for attention. General health education sessions included topics such as back pain, sleep problems, stroke and transient ischemic attacks, vitamins, health care insurance basics, hepatitis, influenza and pneumonia, dyspepsia, colon cancer, migraine headaches, sore throat, and esophageal reflux. All sessions were audiotaped, and 20% were randomly selected and reviewed by two co-investigators using a pre-defined template to assess inter-rater reliability on an item-by-item basis. There was 90% agreement between the two co-investigators that treatment fidelity was followed by the HEs.

Given the intensity of the intervention protocol, we ensured optimal compliance by (1) stressing the importance of attending the sessions, (2) making reminder telephone calls on the day or evening prior to each session, (3) requesting contact information for three of the participants’ friends or relatives, (4) being flexible in accommodating participants’ schedules when arranging weekly telephone calls, and (5) providing compensation for time devoted to study participation.

Primary Outcome

Glycosylated hemoglobin A1c (HbA1c) was measured at baseline and 3-, 6-, and 12-month visits. The primary outcome of interest was continuous HbA1c level at 12-month follow-up measured from blood specimens collected by trained phlebotomists/nurses.

Statistical Analyses

The power and sample size calculation specific to a 2 × 2 factorial design that tests three hypotheses suggested that a total of 42 participants per arm were required to achieve 85% power to detect a clinically relevant difference of one percentage point in HbA1c during the 12-month follow-up (assuming a common standard deviation of 1.5). Therefore, the total sample size required for a per-protocol (PP) analysis was 168 subjects. After accounting for anticipated 15% attrition and10% of randomized participants not attending the first treatment session, the total sample size needed for the intent-to-treat (ITT) analysis was 255.

First, we looked at descriptive statistics of demographics and baseline clinical characteristics, overall and by treatment group. We assessed similarities between treatment groups and identified potential confounders to be used as covariates in subsequent analyses (chi-square tests for categorical variables and ANOVA tests for continuous variables).

Second, we performed primary and secondary analyses of the ITT population, which included all randomized participants who completed at least one treatment session. We used multiple imputations (MI) assuming data missing at random (MAR) to impute missing values of HbA1c for all randomized participants, and obtained complete data sets for each visit. The MI was implemented in SAS version 9.4 software (SAS Institute Inc., Cary, NC) using PROC MI (Markov chain Monte Carlo method), and the results from multiple imputed data sets were combined using PROC MIANALYZE via Rubin’s rule. The variables used in the imputation model were age, education, gender, marital status, income, and diabetes duration.

For the primary statistical analyses, we performed an analysis of covariance (ANCOVA) on the ITT data after imputation to compare HbA1c levels between treatment groups at 12 months after adjusting for baseline levels of HbA1c. We repeated the ANCOVA analysis, adjusting for possible confounders.

For the secondary analyses, we performed a mixed effects longitudinal analysis to assess differences in the rate of change in HbA1c levels over time between treatment groups using a random intercept and slope longitudinal model. The longitudinal model included the treatment group, visit (time) as a continuous variable, and the interaction between treatment and visit as primary (fixed) independent variables. A significant interaction between visit and treatment would suggest that the rates of change over time were different between the treatment groups. We chose between a random intercept and a random intercept and slope based on a likelihood ratio test using maximum likelihood (ML) approximation. The above analyses were repeated for the PP population, defined as participants who completed all 12 education sessions and provided outcome measurements for all four visits, to evaluate the impact of missing data on study results.

RESULTS

Trial Profile

Between August 1, 2009, and March 31, 2011, we screened 443 patients, and the HEs randomly assigned 255 participants (intent-to-treat [ITT] population): 64 (25%) in the control, 63 (25%) in the knowledge only, 65 (25%) in the skills only, and 63 (25%) in the combined knowledge and skills group. There were 255 (100%) patients at baseline; 217 (85%) patients completed assessments at 3 months, 217 (85%) at 6 months, and 217 (85%) at 12 months. Figure 1 shows the flow of patients through the study (CONSORT diagram). There were 39 (15%) participants with missing HbA1c measures at each of the study time points. The probability of missing HbA1C at 12 months was not significantly associated with treatment group or with any demographics or other baseline characteristics at an 0.05 alpha level.

Figure 1
figure 1

Trial profile (CONSORT diagram).

Sample Demographics by Treatment Group

In Table 1, we present characteristics of the ITT population at baseline. Most participants were men (55%), with a mean age of 53 years, and most had government insurance (62%). Among the four treatment arms, there were significant differences only in income levels (p = 0.013) and comorbidities as measured the by Charlson comorbidity index34 (p = 0.033).

Table 1 Sample Demographics by Treatment Group

Primary Outcome: Differences in HbA1c Between Treatment Groups at 12 Months

In Table 2, we present ANCOVA analyses on the ITT population after imputation of missing data. At 12 months, there were no significant differences between the active intervention groups and the control group (control is the reference; knowledge: 0.49, p = 0.123; skills: 0.23, p = 0.456; combined: 0.48, p = 0.105). Higher levels of baseline HbA1c (0.51, p < 0.001) were significantly associated with higher levels of HbA1c at 12 months. A second ANCOVA analysis was performed, adjusting for covariate imbalance at baseline (income and comorbidities). Similar to the initial analysis, only higher levels of HbA1c at baseline (0.50, p < 0.001) were significantly associated with higher levels of HbA1c at 12 months.

Table 2 Analyses of Covariance (ANCOVA) for Differences in Levels of HbA1c Between the Treatment Groups at 12 Months, with Baseline HbA1c as Covariate

Differences Between Treatment Groups in Rate of Change in HbA1c Levels over Time

In Table 3, we present longitudinal mixed effects analyses of the ITT population after multiple imputations. The interaction terms suggest that the rates of decline in levels of HbA1c over time for the active intervention groups were not significantly different from those of the control group (“time*control” is the reference; “time*knowledge”: 0.06, p = 0.053; “time*skills”: 0.02, p = 0.448; “time*combined”: 0.05, p = 0.062). Overall, there was a significant reduction in levels of HbA1c over time (−0.07, p < 0.001). Across all treatment groups, the absolute change in levels of HbA1c from baseline to 3 months was 0.62 (decrease) and from baseline to 12 months was 0.6 (decrease). A second longitudinal analysis was performed, adjusting for covariate imbalance at baseline (income and comorbidities). Like the first longitudinal model, only “time” was significant, suggesting that on average, there was a significant decrease in levels of HbA1c over time (−0.08, p < 0.001). We repeated both the ANCOVA and longitudinal analyses for the PP population and obtained similar results.

Table 3 Longitudinal Mixed Effects Analyses for Differences in the Rate of Change in Levels of HbA1c over Time Between the Treatment Groups

Mean Levels of HbA1c over Time by Treatment Group

Figure 2 shows a graph of the observed mean levels of HbA1c over time for the four treatment groups for both the ITT and PP populations. There were no significant differences between the observed mean levels of HbA1c over time.

Figure 2
figure 2

Mean levels of hemoglobin A1c over time by treatment group.

DISCUSSION

This study shows that combined diabetes education and skills training, diabetes knowledge alone, and skills training alone were not sufficient for achieving glycemic control at 12 months post-randomization in NHBs with poor glycemic control. There were no significant differences in HbA1c levels among treatment means at 12 months of follow-up or any significant differences among groups in the treatment slopes of HbA1c levels over time.

This study has several important features that are noteworthy. First, it is novel in that it targets a vulnerable and high-risk population with a high burden of disease and poor outcomes.1 Evidence suggests that diabetes self-management interventions are effective in improving glycemic control8 10 , 25; however, many of those studies have limited generalizability to NHBs. In our study, we recruited and retained a sufficient number of NHB participants with poorly controlled type 2 diabetes to establish the effectiveness of this type of intervention in this patient population. Second, it is innovative, as there are no randomized clinical trials that have compared a diabetes knowledge intervention and a skills training intervention against each other or in combination among NHBs with type 2 diabetes. Third, in addition to testing the efficacy of the separate and combined intervention arms, the intervention sessions were conducted over the telephone, a method shown to be efficacious in improving patient outcomes in multiple randomized clinical trials.14 , 16 , 26 Fourth, dose and intensity were controlled for, in that all treatment groups received the same number of sessions, for the same amount of time, over the same time. In addition, given the importance of lifestyle choices such as blood sugar monitoring, medication adherence, physical activity, and healthy eating in achieving glycemic control, participants identified the behaviors to address and were able to focus on one behavior at a time instead of multiple behaviors simultaneously. After identifying the order of the behaviors, the participants worked with the same HE throughout the intervention period. If the assigned HE left the study, the participant was quickly assigned a new HE with whom the participant worked throughout the intervention period. Fifth, study implementation was rigorously controlled, including careful a priori analyses and sample size calculations, and therapist fidelity monitoring, resulting in high study retention and session attendance, follow-up assessments up to 12 months, and examination of clinical outcomes in a vulnerable, difficult-to-treat, and understudied clinical sample.

The study had some challenges and possible explanations for the findings that are worth mentioning. First, for budgetary reasons, patients were considered eligible for the study based on HbA1c levels within the previous 12 months, which caused the period between screening eligibility and baseline visit to vary significantly. As a result, only 52% (132/255) of patients had HbA1c values ≥ 9 at the baseline assessment, after enrollment and randomization. Values for the remaining participants had dropped below the eligibility criteria by that time. It is possible that the drop in HbA1c below the a priori established eligibility range for nearly half of the patients diminished the power of the study to detect a significant difference between treatments. Second, during the time the study was conducted, staff turnover was high, especially among the HEs who conducted the telephone sessions and interventions for the treatment groups. This may have affected the study findings, in that some participants had to establish trust and rapport with the newly assigned HEs while simultaneously generating action plans for behavioral modification. The reasons for the high staff turnover remain unclear; however, we have attempted to address this problem in subsequent studies by using nurse case managers instead of HEs to conduct the interventions. Third, the control group was not a “true” control group, as they received weekly calls and general health information in the same dose, frequency, and intensity as the treatment groups. Surprisingly, after the study explanation during the consent process, several patients expressed a preference for randomization to the control group, as they preferred receiving support as part of the weekly calls, even though it was not diabetes-specific, without having to develop action plans as required in the other treatment groups. Fourth, all participants received 30-min calls regardless of randomization group. As such, individuals randomized to the combined arm of the study received both education and skills training in the same time frame, which could have reduced the amount of education and skills training received, resulting in an inability to detect noticeable differences in this treatment group compared to the others. Fifth, evidence supports the notion that social support may be an important component in diabetes care for African Americans.12 , 27 , 35 Under the design of this study, all groups received support. For example, the HEs offered social support to participants in the control group simply by talking and listening to them on the telephone during the sessions. Additionally, although the control group did not receive the formal diabetes education that was provided to the treatment groups, HEs felt compelled to answer their questions about diabetes, which may have affected the study results. To reduce the risk of contamination of information between treatment groups, HEs met with the principal investigator weekly for treatment fidelity reminders and to emphasize the potential effects of biasing the study results. In unpublished data from the pilot study used to design this intervention, mean HbA1c for the combined treatment group dropped by 0.95% at 6 months of follow-up, whereas the mean HbA1c for the control group increased by 0.3% during the same period. However, in the unpublished pilot, patients in the control group received only usual care and were not contacted by the health educators, suggesting that social support provided to the enhanced control group in the current study may have impacted the outcomes. Finally, in the pilot study, the intervention sessions were administered by a nurse, whereas we used HEs to administer the telephone sessions, and it may have taken the HEs longer to understand the tenets of motivational interviewing. This change was made due to budget constraints, in an attempt to use a lower-cost health worker to deliver the intervention.

Because of the study findings and challenges mentioned above, processes for subsequent studies have been modified to reflect lessons learned, which may be of benefit to other researchers working with African American populations with type 2 diabetes. First, because of the drop in HbA1c below the eligibility limit during the time between recruitment and baseline measurement as noted in this study, a screening visit has now been included in the enrollment process for subsequent studies, and participants are required to have HbA1c levels above the eligibility threshold within 2 weeks of randomization and baseline assessment. Second, given the high turnover rate of the masters-level HEs in this study, registered nurses/nurse case managers are now used to deliver the intervention. With this change in staffing, turnover is no longer a factor, and nurse case managers have been consistently providing patient-centered continuity of care. In addition, with minimal effort and time, the nurses have learned the motivational interviewing technique and have administered it appropriately in all clinical research scenarios. Third, given the strong evidence for social support as an underlying mechanism for intervention effect in African Americans, we now use a “true” control group that receives only the standard of care at the study clinics and does not have contact with the intervention nurses.

In summary, this study shows that separate and combined education and skills training are not sufficient for achieving glycemic control in NHBs with poorly controlled type 2 diabetes. Future research should focus on determining alternative strategies to improve glycemic control in this high-risk population.