Abstract
Background
In theory, Motivational Interviewing (MI) fidelity should be associated with client outcomes. Nevertheless, this fidelity-effectiveness association is rarely investigated. This study evaluated the extent to which Telephone Motivational Interviewing (TMI) fidelity is associated with change in self-reported physical activity (PA), fruit intake, and vegetable consumption.
Method
Adults in primary care (45–70 years) participated in a study that compared the effect of tailor print communication, telephone motivational interviewing (TMI), and a combination of the two on PA, fruit intake, and vegetable consumption. MI fidelity was assessed using the behavioral coding method “Motivational Interviewing Treatment Integrity Code (MITI)” in 409 randomly selected audio-recorded sessions, representing 232 participants of the TMI group. The associations between MI fidelity scores and the behavioral changes from baseline to 47-week follow-up were examined using backward multiple linear regression analyses (adjusted for covariates).
Results
A significant and positive association between the percentage of MI adherent responses and improvements in PA and fruit consumption was found with respectively a small and medium effect size. The global rating “Spirit” (which resembles an all-at-once appraisal of the interviewer’s MI competence) was significantly, but inversely associated with progress in vegetable intake with a medium effect size.
Conclusion
The finding that relatively lower MI competency was associated with higher vegetable consumption went against our expectations. Findings suggest that practicing MI-consistent skills was beneficial in promoting PA and fruit consumption, but moderated vegetable intake. This study contributes to the scientific confidence that TMI enables change in PA and fruit intake.
Introduction
The number of older people is increasing at a greater rate than any other age group [1]. Adults in their middle to late years are expected to live longer, but they are not necessarily living healthier lives. Unhealthy lifestyles put people at risk for a variety of cardiovascular diseases (CVD), including coronary heart disease, cerebrovascular disease, and peripheral vascular disease [2]. Meeting the national guidelines for a healthy diet [3] and PA [4] may reduce the risk of cardiovascular morbidity and mortality [5] [6]. Therefore, it is recommended that adults with an unhealthy lifestyle be referred to behavioral change programs that encourage PA and a healthy diet in order to prevent CVD [7].
According to the Dutch recommendations for PA, adults should engage in moderate-intense physical activity for at least 30 min on most days (at least 5) of the week [8]. In the Netherlands, fruits and vegetables have separate dietary recommendations due to differences in consumption circumstance and meals, as well as their associations with health and disease [9]. The nutritional advice for daily fruit and vegetable intake is two pieces of fruit (at least 200 g) and at least 150–200 g of vegetables [8].
As a large portion (about 60%) of the Dutch adult population is inactive [10, 11] and more than 85% does not meet the aforementioned diet norms [11, 12], there is a need to find efficient ways of delivering interventions that motivate people to change these behaviors. Telephone Motivational Interviewing (TMI) is a motivational approach that can reach a large number of people [13]. MI is a type of counseling that aims at stimulating health-related motivation and behavior change. MI assumes that clients know what is best for them, and counselors are there to assist them in making positive changes in their lives. It incorporates two components, which are categorized as principles and particular counseling behaviors. These components and their sub-elements constitute the basic criteria for the assessment of MI fidelity. Principles concern the overall spirit of MI, which are divided into three categories [14]: collaboration, evocation, and autonomy support. A collaborative counselor avoids adopting an authoritarian attitude and, instead, appreciates the client’s expertise and perspectives in a partner-like relationship. Instead of trying to advise or teach the client, an evocative counselor strives to elicit the client’s motivation for change, for example, by inviting the client to verbalize the reasons for change (known as change talk). A counselor who supports the client’s autonomy acknowledges that the responsibility for change lies with the client, and thus tries to avoid imposing the motivation for change. Furthermore, four guiding principles underlie the overall spirit of MI. The first is expressing empathy: an empathic counselor tries to understand and appreciate the client’s perspective. A fundamental aspect involved in this is skillful reflective listening. The second principle is developing discrepancy: clients are encouraged to change by letting them see the discrepancy between their present unhealthy behavior and important personal goals or values. The third is rolling with resistance: the counselor must avoid advocating for change because this frequently leads to the client defending the opposing viewpoint. Thus, rather than opposing resistance, the counselor acknowledges it as being natural and understandable. Supporting self-efficacy is the fourth guiding principle; this is the client’s belief in the possibility of change, and it functions as a motivator for change [15].
Five counseling behaviors appear to be useful throughout the MI process and should be used to support MI’s spirit and underlying principles. Four of them (i.e., asking open questions, listening reflectively, affirming, and summarizing), which are derived from client-centered counseling, are used by the MI counselor in the service of the fifth MI-specific counseling behavior (i.e., eliciting change talk) [15]. Examples of clients’ change talk are recognizing the drawbacks of the current situation, expressing optimism about change, or expressing the intention to change. The principles and counseling behaviors of MI are often applied in two phases, first to build intrinsic motivation for change, and second—when the client is willing and able to change—to enhance the commitment to change and developing a change plan [15].
MI principles and counseling behaviors are practice based and several of them overlap with existing behavioral change theories (entailing variables as attitude, self-efficacy, social influence, intention to change). These theoretical concepts were used to design the content of our TMI counseling protocol (Example Appendix 1) [16]. For instance, discussing the pros and cons of whether or not to change (decisional balance) is practiced by MI counselors and is part of our counseling script [16,17,18]. The content is about what is being said and communication skills concern how a topic is addressed. Therefore, for our study’s reliability and internal validity, it was important not only to assess whether, for instance, weighing pros and cons lead to changes in lifestyle behavior, but also to evaluate whether the fidelity with which MI was executed may have implications for our study’s outcomes. The Motivational Interviewing Treatment Integrity tool (MITI 3.0) was used to examine the qualifications of our MI counselors, who were judged to have beginner proficiency [19]. This suggests that the next step, to link MI fidelity to change in PA, fruit intake, and vegetable consumption in older adults, is appropriate.
So far, there have been few studies that have evaluated the fidelity of MI delivery and have linked MI components to outcomes [20, 21]. Moreover, the evidence that is available is mixed, with positive, negative, and no evidence of an association [22,23,24].
To better understand our treatment effects, this study examines not only whether the defined (behavioral) concepts that guided the content of the TMI intervention and several background variables are associated with lifestyle behavior changes [25,26,27], but also whether the fidelity with which counselors apply MI is associated with behavioral change.
Methods
Description of the Original Study Design
Our trial originally compared the effects of four computer-generated tailored print communications (TPC), four telephone-delivered MI sessions (TMI), and a combined intervention (two TPC letters and two TMI sessions), with no intervention on PA, fruit intake, and vegetable consumption [25]. TPC and TMI are both individualized interventions, in the sense that they provide feedback based on characteristics of the individual. Though both types of intervention focus on the individual, there are differences between them. TPC lacks the relational support and interactional aspects of TMI. This interpersonal nature may make TMI more individualized than TPC. However, because the latter is not person-delivered, it is easier to reach larger groups of people with TPC than with TMI [28]. On the other hand, TMI can be more expensive and time consuming than TPC because it requires the use of skilled counselors [27].
In the TPC intervention, participants complete a survey with questions on their health, behavior, and presumed behavioral determinants, and the results are saved in a data file. The data are linked to a message library that contains all of the health education messages that may be required, i.e., messages that are appropriate for all of the various survey responses. Computer software with if-then algorithms is used to connect the individual survey responses to the messages. Next, the computer program generates feedback for each participant, which is then printed and mailed to the participants [25]. The surveys, messages, and algorithms are based on expert input, behavioral theories, and empirical evidence.
TMI entails a counseling approach, as described, conducted during a scheduled telephone appointment, that can help people find the motivation to make positive health decisions and commitment to change in order to achieve a specific health goal [13]. TMI addresses similar behavior change component as TPC, i.e., decisional balance, social influence, self-efficacy, intention to change, and action planning.
The participants in the TMI group will make up the study population in the remainder of this work in which it is examined whether fidelity of the TMI intervention is associated with change in PA, fruit intake, and vegetable intake.
Participants and Attrition
It was anticipated that 50% of those invited would participate, of whom 50% would fail to meet at least two of the three guidelines. Dropout was estimated at 20%. Based on power calculations, a total sample size of 1,600 participants (400 per study group) was needed at baseline using a small effect size of d = 0.3, a power of 90%, a two-tailed alpha of 1% to correct for multiple testing, an intraclass correlation of 0.02, and an average sample size of 70 participants per general practice (GP) [25].
Adults (n = 6,420 outpatients) from 23 Dutch general practices (GPs) were randomly selected from the Research Network Family Medicine Maastricht database using a computer program [25]. About half of the adults chosen should be men and only one person per address should be selected. Inclusion criteria were as follows: (1) aged 45–70 years; (2) about 50% diagnosed by their GP as hypertensive according to the International Classification of Primary Care (ICPC code K86 or K87 for hypertension without or with organ damage respectively) [29]; (3) not participating in other studies according to the GP database; (4) failing to meet at least two of the three guidelines. Hypertension status was included to see if having a risk factor for CVD (disease awareness) moderated the intervention effects. Following the GP’s suitability check (e.g., not able to speak or read Dutch, physical and mental disabilities) [11], 5,545 people received an invitation letter outlining the study’s setup, and 2,881 of them returned a signed written informed consent form. Of the 2,568 responders to the lifestyle assessment, 1,629 were included in an RCT if they failed to meet at least two of three Dutch public health guidelines (for PA and either fruit or vegetable intake) (see Fig. 1). A more detailed description of the baseline (non-) responders was published elsewhere. The obtained population was a good reflection of the selected population [11]. After the baseline assessment, all parties were aware of the treatment groups. Researchers had no in-person contact with participants (measurements were filled in at home). Measurement dropout over time was found to be unrelated to age, sex, hypertension, and region, and was significantly higher in the TPC group (alone or combined) than in other participant groups, particularly from week 47 onwards [26]. Possible bias effect of dropout was adjusted for in the effect analyses by including all dropouts and all predictors of dropout into the analyses of each behavioral outcome [30].
TMI Intervention Logistic
The TMI group participants (n = 407) received four telephone counseling sessions, two of which focused on PA and the other two on both fruit and vegetable intake in tandem. The participants in the TMI study group were followed from the baseline to the first posttest at 47-week follow-up. In the first and third sessions, participants could choose the order of the conversation topics of the two subsequent TMI counseling session (“agenda setting”). For example, in case they preferred to discuss PA in the first session, then they talked about fruit and vegetable consumption in the second session, and vice versa. This procedure was followed in sessions 3 and 4, as well. After participants had returned the baseline questionnaire by mail, the counseling sessions were held at 5, 13, 30, and 43 weeks. In total, 1,472 counseling sessions were conducted in the TMI group. A (computer-generated) random sample of 409 sessions was selected from each time point (about a hundred per week: weeks 5, 13, 30, and 43, respectively) representing 232 participants who are involved in the current study. Table 1 includes the participant characteristics.
Counselors were 16 bachelor’s and master’s level students in Health Sciences and Psychology [19]. They received six 3-h training sessions by two certified trainers after which they had to perform one TMI conversation with adequate integrity according to the 1-Pass Coding System for motivational interviewing [31]. A protocol was developed for each interview and provided to counselors to support them in applying MI, with the aim of ensuring treatment fidelity. The protocol steps were as follows: introduction, assess current behaviors and progress, discuss the public health guideline, assess and enhance motivation and self-efficacy for behavior change, assess readiness to change, summarize and close the session. Due to practical constraints, different therapists delivered the four sessions to one participant. Counselors read the standardized communication logs from prior sessions with a specific participant to prepare themselves for their session.
Measurement
MI Fidelity
Counselors’ MI fidelity was assessed with a behavioral coding system called the MITI 3.0 (available at http://casaa.unm.edu/download/miti3.pdf) [32]. The MITI 3.0 is designed to assess two components: the global scores are meant to capture the coder’s global impression of the entire communication interaction and the behavior counts, which require the coder to count particular practitioners’ counseling behaviors (such as “the use of open questions”).
The global score requires the coder to assign a single number from a 5-point scale (1 = low to 5 = high) to capture the rater’s overall judgment of how well or poorly the counselor meets the intent of the scale. Behavioral anchors for each point on a scale guide the coding. The global counselor scores are calculated by the average of (1) empathy (counselor attempts to find out what the client feels or thinks), (2) direction (counselor maintains an appropriate focus on a specific target behavior), and (3) spirit (an all-at-once judgment of the interviewer MI competency). The latter is the average of evocation (counselor understands that change resides within the client), collaboration (counselor works towards mutual understanding), and autonomy support (counselor actively fosters client’s perception of choice).
The purpose of behavior counts is to capture specific counseling behaviors regardless of how they fit into the overall perception of the interviewer’s use of MI. The expressions of the counselors are counted regarding giving information, questions (open vs. closed), reflections (simple vs. complex), MI adherent behaviors (e.g., asking permission, emphasizing control, affirming or supporting), and MI nonadherent expressions (e.g., advising without permission, confronting or directing). Summary scores are calculated to obtain the percentage of open questions, the percentage of complex reflections, the reflections/questions ratio, and the percentage of MI adherent expressions.
Coders rated the sessions independent of knowing about the outcome data. Seven master’s level students/graduates in Health Promotion received 40 h of coding training [19]. Coders were trained by a Dutch certified instructor. The training included readings, videotapes, and brief discussions. Coders used a computer to listen to the recorded interviews. They assessed the counselors’ competence with a printed version of the MITI 3.0.
In total, 94 sessions (28%) were double coded. Inter-rater reliabilities were fair to good, except for the global score on direction (ICC .35), the % complex reflection (ICC .23), and the number of simple reflection (ICC .32) [19]. The MI fidelity for global clinician scores (direction, empathy, spirit) and the percentage of complex reflections exceeded the MITI (3.0) threshold for beginning proficiency (MI cutoffs: mean > 3.5 on a 5-point scale and > 40%). Lower scores were found for the percentage of open questions (< 50%), the reflections-to-questions ratio (1), and the percentage of MI adherent responses (> 90%) [19, 32]. Beginning proficiency level with core client-centered counseling was considered satisfactory [19].
Lifestyle Behaviors
To assess change in PA and fruit and vegetable consumption, postal surveys were conducted, supplemented with two postal reminders at the baseline and 47-week follow-up.
The 28-item modified CHAMPS Physical Activity questionnaire assessed the frequency of a PA activity (times per week) and its duration (hours per week) and intensity (e.g., walking in a leisurely vs. brisk manner) concerning a typical week during the past four weeks [33]. Activities included, for example, walking leisurely or briskly and doing light or heavy housekeeping. Based on the PA compendium by Ainsworth et al. [34], metabolic equivalents (METs) and the oxygen cost of energy expenditure were determined for each activity. The recommended cutoff to define at least moderate-intensity activities is ≥ 3 MET, which was used to calculate the total number of weekly PA hours with at least a moderate intensity. The modified CHAMPS has been validated with cardiorespiratory fitness (VO2 maximum) estimated by a submaximal treadmill test [33]. Others reported adequate test-retest reliability for activities ≥ 3 METs and revealed an adequate association with accelerometer minutes of corresponding intensity [35].
A 16-item short fruit and vegetable questionnaire assessed frequency (days per week) and quantity of daily vegetables (cooked and raw), and daily fruit consumption (fruit juice, tangerines, other citrus fruits, apples or pears, bananas, and other fruits) concerning a typical week during the past four weeks [36]. The outcome was the quantity of daily consumption; fruit consumption in servings/day (one piece of fruit is considered one serving); and intake of vegetables in grams/day.
Additionally, a range of possible covariates were assessed including patient characteristic and potential cognitive-behavioral determinants of the target behaviors (i.e., awareness, pros and cons, social support, modeling, self-efficacy expectations, action plans, habit strength, and stages of change) (see Table 1). These cognitive-behavioral variables represent the I-Change Model [37].
Patient characteristics included at baseline were, i.e., sex, age, highest completed level of education, marital status, work situation, ethnicity, region in which participants were living, and season in which the baseline questionnaire was completed.
Other variables were PA, fruit intake and vegetable consumption, smoking behavior, alcohol consumption, saturated fat intake, and health variables (i.e., hypertension, presence of diabetes, family history of CVD, stress, and body weight and height to calculate the body mass index (BMI)). A description of the questionnaire was published [30].
Data Analysis
Of the selected sample of 409 20-min session fragments, 336 were coded (representing 232 TMI participants). Computer recording failure or bad recording quality hampered coding. If more than one interview of a participant was coded, then the indicator of MI fidelity per participant was the average of the MITI 3.0 values across the interviews.
Handling missing values and checking data for outliers were discussed elsewhere [30]. The primary outcomes were checked for normality. Because of positive skewness, fruit in servings a day and PA in hours a week were square root transformed at baseline and at 47-week follow-up for all analyses. The heteroscedasticity of residuals was checked and not found. Data were examined for multi-collinearity by inspecting the variance inflation factor (VIF) of each predictor in a multiple regression model with all baseline variables as predictors. No VIFs above 10 were found, indicating the absence of multi-collinearity [38]. Impact of measurement dropout over time was analyzed with mixed regression analysis (using PQL estimation, ML-wiN software).
SPSS version 15.0 was used to describe descriptives and frequencies. To check for baseline differences (α = .05), a backward multiple logistic regression analysis was conducted comparing the randomly selected sample of participants from the TMI group (n = 232), whose counseling sessions were selected to the other participants that were not included. The dependent variable was “selection” and independent variables were sociodemographic variables, lifestyle and health variables, and PA, fruit intake, and vegetable consumption at baseline.
The relation between MI fidelity and behavior change was examined with backward multiple linear regression analyses. No multilevel analysis was done, because there was no evidence for general practice effects and because participants were not nested within interviewers or coders. For each outcome behavior (PA in hours/week, intake of fruit in servings/day, and consumption of vegetables in grams/day), the dependent variable was the difference of the outcome value between baseline measurement and the follow-up at week 47 [39]. Patient characteristics, potential cognitive-behavioral determinants, other lifestyle and health variables, baseline behavior of other outcomes, and choice of the order of conversation topic were used as covariates. The inclusion of these covariates improves the power and precision of effect testing and estimation due to reduced residual outcome variance [39]. In the original study, the efficacy was examined of participants receiving a pedometer by sending a random half of the participants in the three intervention groups a pedometer before the third intervention component (week 29), the rest received this instrument after the 47-week follow-up. Whether participants received a pedometer during the intervention was included as an additional covariate in the analyses of the relation between MI fidelity and behavior change. MI fidelity summary measures (the three global clinician ratings, the percentage of open questions, the percentage of complex reflections, the percentage of MI adherent expressions, and reflection to question ratio) were included as independent variables. Non-significant independent variables and covariates were excluded from the model; manually one by one, the variable with the highest p-value was excluded first. The aim was to only to show the relevant predictors. However, hypertension and having received a pedometer during the intervention period remained in all models because these were used in the randomization procedures. Educational level, age, and sex were also kept in all models because these were used as selection variables or in hypotheses in the original study. Because of the explorative nature of the analyses, an alpha of .05 was used to exclude variables from the model. In view of multiple testing (i.e., diverse measures of fidelity were used as predictors), results with p between .05 and .01 must be interpreted with caution.
Cohen’s f2 was used to calculate the effect size. This is the most common method for calculating the effect size in a multiple regression model where both the independent and dependent variables are continuous. Cohen’s f2 is categorized as small (≥ 0.02), medium (≥ 0.15), or large (≥ 0.35).
Results
In the selected TMI sample, 232 participants finished the baseline data collection and 194 (84%) completed the first follow-up. Logistic regression showed that slightly more participants in the selected sample were living together at baseline (84.9%) than were participants in the total sample (79%; OR = 1.49, 95% CI = 1.02 to 2.18). However, this result may be due to multiple testing and was not significant at the 1% level, implying a low risk of selection bias.
A disadvantage of linear regression analysis is that participants who have dropped out at 47 weeks after the baseline were excluded from the analyses (see the coming section about the relationship between MI fidelity and behavior change). Hence, a secondary backward logistic regression analysis was conducted to examine whether MI fidelity summary scores were related to dropout at the 47-week follow-up, corrected for sociodemographic variables, cognitive-behavioral determinants, lifestyle and health variables, and baseline outcome behaviors. These results revealed that MI fidelity summary scores were not related to dropout at the 47-week follow-up, indicating a low risk of selection bias (all p > .20).
Behavior Change
The selected TMI sample (n=232) significantly (p<.01) increased their level of moderately intense PA from 4.65 hours a week (sd =3.97) at baseline to 5.45 hours a week (sd =4.37) at follow-up 1. At baseline, participants consumed 2.12 (sd =1.64) servings of fruit a day, whereas they had an intake of 2.83 daily servings (sd =1.99, p< .05) at follow-up 1. The vegetable intake was 165 grams/day at baseline (sd =82) and 184 grams (sd=78) at the first follow-up, p<.05.
Association between MI Fidelity and Behavior Change
The global ratings (e.g., spirit, direction, and empathy) and the behavioral counts (e.g., percentages of open questions, complex reflections, MI adherent responses, reflection to questions ratio) were used to evaluate the relation between MI fidelity and change in PA, fruit, and vegetable consumption (Table 2).
Physical Activity
Diverse sociodemographic variables, potential cognitive-behavioral determinants, other lifestyle and health variables, and baseline behavior of other outcomes were added as covariates with PA as the outcome behavior. Direction was positively related (p < .05) to change in the level of PA from baseline to 47-week follow-up with a medium effect size. Since the ICC for Direction was not optimal (ICC = .35) [19], the analysis was repeated without Direction. Subsequently, the percentage of MI adherent expressions was significantly (p < .05) and positively related to change in the level of PA from baseline to 47-week follow-up, with a small effect size (f2 = .02; unstandardized β = 0.003; standard error = .02, 95% confidence interval = .000 to 0.06; standardized β = .15, p < .05.
Fruit Intake
Improvement in intake of fruit was significantly and positively related to the percentage of MI adherent expressions (p < .05), with a medium effect size.
Vegetable Consumption
Only the global clinician rating “Spirit” was significantly (p < .001), but inversely, related to the change in vegetable consumption from baseline to the first follow-up measurement with a medium effect size. The inverse relation between global counselor rating “Spirit” and vegetable intake was further explored. Whether MI works better in people who are less motivated to change as Stages of Change was checked a predictor of vegetable intake improvement [40]. The interaction between Spirit and Stage of Change was added to the final model with change in vegetable consumption as the outcome. This interaction was not significant (unstandardized β = −.50; standard error = 4.85; 95% confidence interval = −10.08 to 9.08; standardized β = −.05, p = 92). In addition, it was explored whether the inverse relation between “Spirit” and change in vegetable consumption could be explained by the type of diet behavior. The Pearson correlation between baseline fruit and vegetable intake was examined and found unrelated (r = .10, p = .13). This was similar to the relation between change in fruit and vegetable intake (r = .02; p = .83).
To examine if the choice of the order of conversation topic in the TMI sessions influenced the relation between MI fidelity summary scores and behavior change, two dummy variables indicating topic choice in conversation one and three (both 0 = PA first; 1 = intake of fruit and vegetables first) were added to the final models described before. The choice of the conversation topic at sessions 1 and 3 was not related to behavior change or behavior at follow-up corrected for baseline behavior (all p>.05), and including both dummies as predictors did not change the B’s of the fidelity predictors.
Discussion
This paper aimed to explore the association between telephone MI fidelity using MITI 3.0 indicators and changes in PA and fruit and vegetable consumption. MI adherent expressions seemed significantly and positively related to an increase in PA and fruit intake. MI “spirit” seemed significant, but inversely related to vegetable intake. But, findings need to be interpreted with caution considering multiple testing bias (p-value below p < .05, but above .01).
Although Direction appeared positively and significantly related to change in the level of PA with a medium effect size, it was omitted from analysis because of the low inter-rater correlation [19]. The reason for this is that it is important to distinguish “competent” from “not competent” delivered intervention elements to be able to determine what is “MI” when studying the association between MI and behavioral change. Other researchers have reported low ICCs for global scores as well and suggested that this may be due to the restricted 5-point scoring range [41]. More research may be needed to investigate the assessment of Direction since it might be relevant to PA change.
Our findings for PA are in line with research showing that MI, in general, is an important predictor for intervention effects [42]. Also, other research revealed that MI adherent counseling behaviors were associated with increases in PA behavior [43, 44].
Comparing our nutrition findings to those of other research and reviews is complicated by the fact that many studies and reviews combine fruit and vegetable intake into one outcome, e.g., [45, 46]. Although in our study MI fidelity was positively related to fruit increase, the opposite was true for vegetable intake. The unexpected negative influence of MI fidelity on vegetable consumption was further examined, especially since our TMI intervention was shown to outweigh the control condition for this behavior [30]. Stage misclassification may explain this finding and has been shown in other studies to be more substantial for vegetable intake than for fruit intake [47]. Stage of change, as MI is thought to be especially effective in unmotivated participants [48], did not explain this finding. As vegetables are more often eaten in mixed dishes than fruit and therefore more difficult to conceptualize in terms of servings [9], it may have happened that when counselors stimulated autonomy of and exploration by participants regarding their vegetable intake, the phenomenon the more one thinks about it, the more unclear it becomes occurred. The complexity of the “vegetable” behavior might have hindered the client’s behavior change process. Our study is not the only one that has revealed contra-intuitive findings regarding MI fidelity and “vegetable” intake. A recent review reported smaller MI effects on FVC in reports where researchers reported greater consistency with the MI style [49]. Unfortunately, fruit and vegetable intake were not reported separately.
In our telephone sessions, fruit and vegetable intake were discussed together, starting with fruit intake. Both behaviors improved in the intervention condition compared to control. A review showed that effect sizes for combined FVC intake are bigger when sessions take 30 to 40 min [49]. Ours were 20 min on average. Maybe that during the short conversation vegetable intake was lost sight of to some extent. Counselors who scored high on MI spirit (evocation, autonomy support, collaboration) may have been less successful in achieving vegetable intake change because they never reached the point to discuss “action” compared to counselors who more quickly moved to this stage of the change process. That fruit classification is less debated than vegetable classification [50] may also imply that vegetable intake is a relatively more complex behavior. Changing such behavior may have been helped by expert advice to increase the behavioral capability. However, to check these ideas, the content of the recordings will need to be reassessed.
Vegetable intake and fruit intake appeared unrelated. The latter might again point out that these are indeed distinct behaviors that should probably not automatically be combined into one combined fruit vegetable consumption (FVC) outcome. As stated, discussing changing two distinct behaviors at the same time during a telephone conversation might be too much to handle. Results of whether it is better to discuss fruit and vegetables sequentially or simultaneously without overloading participants remain inconclusive [51]. More research into the separate relation between MI fidelity and intake of vegetables is needed, including the search for a hidden confounder which may have affected vegetable consumption, but not fruit consumption or PA in the present study.
The strength of this study is that almost all conversations were recorded, the large number of MITI-assessed motivational interviews and the computer-generated randomly selected study sample, representing a substantial group of counselees (low selection bias). The randomization and random selection as conducted in this study also enable the generalization of the study findings, especially to different samples and cultural context. Sessions were selected from different time points with diverse clients to have a representative view of counselors MI skills and patients at different stages of change [21]. Besides, coders could not foresee which interviews they had to code (low selection bias) and were blind to the lifestyle change outcomes (low performance and detection bias). Dropout was low and unlikely to be related to the true outcome (low attrition bias). Fruit intake, vegetable consumption, and physical activity have consistently been found to be positively correlated, e.g., [52]. This study accounted for such transfer effects by including change in other lifestyle behaviors in the evaluation of potential predictors of change for a particular behavior. Most studies that explored the association of MI with behavior change focused on addictive behaviors (alcohol consumption, drug use, or smoking), e.g., [53, 54]. In this study, the relation between MI and behavior change was examined outside the addiction field. Finally, by including covariates in our analyses, power and precision of predictor testing and estimation are improved due to reduced residual outcome variance [39].
Yet, some limitations need to be addressed. MI fidelity scores of our counselors were generally at the beginning proficiency level. It is still unclear what level of expertise is required for MI to work [55]. Nevertheless, a link between some MI fidelity aspects and lifestyle behavior change was found. Whether higher fidelity will lead to more behavior change is still to be established. Findings suggested that participants in the randomly selected interviews were more likely to live together with a partner than other participants. This may have biased the relation between MI fidelity codes and behavior change. However, marital status was not a significant covariate in the analyses relating MI fidelity to lifestyle change, and because of multiple testing in the selection check (the p-value for marital status was .04), there seems to be no evidence for selection bias in our results. MI fidelity was assessed to ensure that our intervention is true to the character of MI to avoid error when drawing conclusions from our results. The MITI 3.0 is one of the tools available to assess MI fidelity [56, 57]. With this tool, the impact of MI features on client conversation behavior, for instance, was not assessed (e.g., change talk or sustain talk). Yet, some indicators of “client behaviors” such as self-reported self-efficacy were included in the analysis as covariates. Nevertheless, associations with client behavior may differ when using other fidelity measures [56]. Furthermore, the focus was on the relation between MI fidelity and change in three lifestyle behaviors. The MITI 3.0 scores were averaged across different sessions and therapists. Meantime, other studies have shown that MI fidelity varies between sessions and therapists [58]. Future studies should therefore also perform more refined analyses to determine variability between session and therapists regarding MI fidelity and the relation with behavior change [21]. In this study, the MI fidelity was rated concerning selected sessions. Other than that the coders involved had no relation with the MI counselors, bias in individual raters was not assessed (as halo, horn, leniency, or central tendency errors) [59]. Thus, due to rater bias as well as random error, caution is advised in the interpretation of the MITI scores. Importantly, competence in MI was tied to self-reported client improvement. The use of self-report methods to assess PA, fruit intake, or vegetable intake is a potential limitation. It may be beneficial to use both self-report and objective measures in future studies. Furthermore, this study occurred in specific regions of The Netherlands and used telephone-based guided MI, all of which may limit the external validity of our results. Although our study revealed significant changes in lifestyle behavior, only a few aspects of MI could be cautiously related to these increases in the final model. This may be due to the suboptimal levels of MI treatment integrity for some aspects as shown by our assessment study [19]. Hence, it needs to be noted that several other studies have shown no relation between a higher competence level of the MI interventionist and better study outcomes, e.g., [53, 54, 60]
Conclusion
This study moves the scientific field forward because it showed that particular MI counselor behaviors, as assessed with the MITI 3.0, were predictive of behavioral lifestyle outcomes. Such findings contribute to the unraveling of the potential mechanisms of change regarding these behaviors [47], and, as such, inform practice, processes, and training of MI. As our counselors had beginner proficiency, there is potential for improvement and a need for more careful MI training and monitoring of fidelity. MI adherent responses improved PA and fruit intake. Higher “spirit” scores hindered vegetable intake. Further studies exploring the relationship between MI “spirit” and vegetable intake separate from fruit consumption are needed since others found a positive relationship with “spirit” when addressing fruit and vegetable intake as a combined outcome [61].
References
United Nations (2015) DoEaSA, Population Division World Population Ageing. New York: United Nations 2015. (Contract No.: ST/ESA/SER.A/390 2015)
WHO. Prevention of cardiovascular disease. Guidelines for assessment and management of cardiovascular risk. Geneva: WHO 2007.
US Department of Health and Human Services and US Department of Agriculture. 2015–2020 Dietary Guidelines for Americans 8ed. Washington, DC 2015.
US Department of Health and Human Services. Physical Activity Guidelines for Americans 2018.
Rhodes RE, Janssen I, Bredin SSD, Warburton DER, Bauman A. Physical activity: health impact, prevalence, correlates and interventions. Psychol Health. 2017;32(8):942–75. https://doi.org/10.1080/08870446.2017.1325486.
Patnode CD, Evans CV, Senger CA, Redmond N, Lin JS. Behavioral counseling to promote a healthful diet and physical activity for cardiovascular disease prevention in adults without known cardiovascular disease risk factors. Updated systematic review for the U.S. Preventive Services Task Force: Agency for Healthcare Research and Quality (US) 2017 (Contract No.: 15–05222-EF-1)
Force USPST. Healthful diet and physical activity for cardiovascular disease prevention in adults with cardiovascular risk factors: behavioral counseling 2014.
Gezondheidsraad. Richtlijnen goede voeding 2006 - achtergronddocument [Guidelines for good nutrition 2006 - background material]. Den Haag: Gezondheidsraad 2006.
Brug J, de Vet E, de Nooijer J, Verplanken B. Predicting fruit consumption: cognitions, intention, and habits. J Nutr Educ Behav. 2006;38(2):73–81. https://doi.org/10.1016/j.jneb.2005.11.027.
National Institute for Public Health and the Environment MoH, Welfare and Sport. Bewegen (Physical Activity). 2021. https://www.rivm.nl/leefstijlmonitor/bewegen (Accessed 16 July 2021)
van Keulen HM, Mesters I, van Mechelen W, de Vries H. Single-item and multiple-item measures of adherence to public health behavior guidelines were incongruent. J Clin Epidemiol. 2010;63(1):75–84. https://doi.org/10.1016/j.jclinepi.2009.03.003.
National Institute for Public Health and the Environment MoH, Welfare and Sport. Groente en Fruit (Vegetables and Fruit) 2021. https://www.wateetnederland.nl/resultaten/voedingsmiddelen/richtlijnen/groente-en-fruit (Accessed July 16, 2021)
Teeter BS, Kavookjian J. Telephone-based motivational interviewing for medication adherence: a systematic review. Transl Behav Med. 2014;4(4):372–81. https://doi.org/10.1007/s13142-014-0270-3.
Miller WR, Rollnick S. Motivational Interviewing, Helping People Change. New York: The Guilford Press; 2013.
Miller WR, Rose GS. Toward a theory of motivational interviewing. Am Psychol. 2009;64(6):527–37. https://doi.org/10.1037/a0016830.
Hardcastle SJ, Fortier M, Blake N, Hagger MS. Identifying content-based and relational techniques to change behaviour in motivational interviewing. Health Psychol Rev. 2017;11(1):1–16. https://doi.org/10.1080/17437199.2016.1190659.
Michie S, Richardson M, Johnston M, Abraham C, Francis J, Hardeman W, et al. The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behavior change interventions. Ann Behav Med. 2013;46(1):81–95. https://doi.org/10.1007/s12160-013-9486-6.
Kok G, Gottlieb NH, Peters GJ, Mullen PD, Parcel GS, Ruiter RA, et al. A taxonomy of behaviour change methods: an intervention mapping approach. Health Psychol Rev. 2016;10(3):297–312. https://doi.org/10.1080/17437199.2015.1077155.
Mesters I, van Keulen HM, de Vries H, Brug J. Counselor competence for telephone Motivation Interviewing addressing lifestyle change among Dutch older adults. Eval Program Plann. 2017;6:47–53. https://doi.org/10.1016/j.evalprogplan.2017.06.005.
Jiang S, Wu L, Gao X. Beyond face-to-face individual counseling: a systematic review on alternative modes of motivational interviewing in substance abuse treatment and prevention. Addict Behav. 2017;73:216–35. https://doi.org/10.1016/j.addbeh.2017.05.023.
Jelsma JGM, Mertens VC, Forsberg L, Forsberg L. How to measure motivational interviewing fidelity in randomized controlled trials: practical recommendations. Contemp Clin Trials. 2015;43:93–9. https://doi.org/10.1016/j.cct.2015.05.001.
O’Halloran PD, Blackstock F, Shields N, Holland A, Iles R, Kingsley M, et al. Motivational interviewing to increase physical activity in people with chronic health conditions: a systematic review and meta-analysis. Clin Rehabil. 2014;28(12):1159–71. https://doi.org/10.1177/0269215514536210.
Frost H, Campbell P, Maxwell M, O'Carroll RE, Dombrowski SU, Williams B et al. Effectiveness of motivational interviewing on adult behaviour change in health and social care settings: a systematic review of reviews. PLoS One. 2018;13(10). https://doi.org/10.1080/17437199.2014.882006.
Lovejoy TI, Heckman TG, Suhr JA, Anderson T, Heckman BD, France CR. Telephone-administered motivational interviewing reduces risky sexual behavior in HIV-positive late middle-age and older adults: a pilot randomized controlled trial. AIDS Behav. 2011;15(8):1623–34. https://doi.org/10.1007/s10461-011-0016-x.
van Keulen HM, Mesters I, Brug J, Ausems M, Campbell M, Resnicow K, et al. Vitalum study design: RCT evaluating the efficacy of tailored print communication and telephone motivational interviewing on multiple health behaviors. BMC Public Health. 2008;8:216. https://doi.org/10.1186/1471-2458-8-216.
van Keulen HM, van Breukelen G, de Vries H, Brug J, Mesters I. A randomized controlled trial comparing community lifestyle interventions to improve adherence to diet and physical activity recommendations: the VitalUM study. Eur J Epidemiol. 2021;36(3):345–60. https://doi.org/10.1007/s10654-020-00708-2.
van Keulen HM, Bosmans JE, van Tulder MW, Severens JL, de Vries H, Brug J, et al. Cost-effectiveness of tailored print communication, telephone motivational interviewing, and a combination of the two: results of an economic evaluation alongside the Vitalum randomized controlled trial. Int J Behav Nutr Phys Act. 2010;7(7):64. https://doi.org/10.1186/1479-5868-7-64.
Neville LM, O’Hara B, Milat AJ. Computer-tailored dietary behaviour change interventions: a systematic review. Health Educ Res. 2009;24(4):699–720. https://doi.org/10.1093/her/cyp006.
Lamberts H, Wood M. ICPC international classification of primary care. Oxford: Oxford University Press; 1987.
van Keulen HM, Mesters I, Ausems M, van Breukelen G, Campbell M, Resnicow K, et al. Tailored print communication and telephone motivational interviewing are equally successful in improving multiple lifestyle behaviors in a randomized controlled trial. Ann Behav Med. 2011;41(1):104–18. https://doi.org/10.1007/s12160-010-9231-3.
McMaster F, Resnicow K. Validation of the one pass measure for motivational interviewing competence. Patient Educ Couns. 2015;98(4):499–505. https://doi.org/10.1016/j.pec.2014.12.014.
Moyers TB, Martin T, Manual JK, Miller WR, Ernst D. Revised global scales: Motivational Interviewing Treatment Integrity 3.0 (MITI 3.0): University of New Mexico, Center on Alcoholism, Substance Abuse and Addictions (CASAA) 2007.
Resnicow K, McCarty F, Blissett D, Wang T, Heitzler C, Lee RE. Validity of a modified CHAMPS physical activity questionnaire among African-Americans. Med Sci Sports Exerc. 2003;35(9):1537–45. https://doi.org/10.1249/01.MSS.0000084419.64044.2B.
Ainsworth BE, Haskell WL, Whitt MC, Irwin ML, Swartz AM, Strath SJ, et al. Compendium of physical activities: an update of activity codes and MET intensities. Med Sci Sports Exerc. 2000;32(9 Suppl):S498-504. https://doi.org/10.1097/00005768-200009001-00009.
Hekler EB, Buman MP, Haskell WL, Conway TL, Cain KL, Sallis JF, et al. Reliability and validity of CHAMPS self-reported sedentary-to-vigorous intensity physical activity in older adults. J Phys Act Health. 2012;9(2):225–36. https://doi.org/10.1123/jpah.9.2.225.
Bogers RP, Van Assema P, Kester AD, Westerterp KR, Dagnelie PC. Reproducibility, validity, and responsiveness to change of a short questionnaire for measuring fruit and vegetable intake. Am J Epidemiol. 2004;159(9):900–9. https://doi.org/10.1093/aje/kwh123.
Vries H, Mesters I, van de Steeg H, Honing C. The general public’s information needs and perceptions regarding hereditary cancer: an application of the Integrated Change Model. Patient Educ Couns. 2005;56(2):154–65. https://doi.org/10.1016/j.pec.2004.01.002.
Field A. Discovering statistics using spss. 3rd ed. London: SAGE Publications Ltd.; 2009.
Van Breukelen GJ. ANCOVA versus change from baseline: more power in randomized studies, more bias in nonrandomized studies [corrected]. J Clin Epidemiol. 2006;59(9):920–5. https://doi.org/10.1016/j.jclinepi.2006.02.007.
Diclemente CC, Velasquez MM. Motivational interviewing and stages of change. In: Miller WR, Rollnick S, editors. Motivatinal interviewing, preparing people for change. New York: The Guilford Press; 2002.
Spohr SA, Taxman FS, Rogriguez M, Walters ST. Motivational interviewing fidelity in a community corrections setting: treatment initiation and subsequent drug use. J Subst Abuse Treat. 2016;65:20–5. https://doi.org/10.1016/j.jsat.2015.07.012.
Frost H, Campbell P, Maxwel lM, O’Carroll RE, Dombrowski SU, Williams B et al. Effectiveness of motivational interviewing on adult behaviour change in health and social care settings: a systematic review of reviews. PLoS ONE. 2018;13(10):e0204890. https://doi.org/10.1371/journal.pone.0204890.
Cox ME, Yancy WS Jr, Coffman CJ, Ostbye T, Tulsky JA, Alexander SC, et al. Effects of counseling techniques on patients’ weight-related attitudes and behaviors in a primary care clinic. Patient Educ Couns. 2011;85(3):363–8. https://doi.org/10.1016/j.pec.2011.01.024.
Knittle K, De Gucht V, Mejino A, Hurkmans E, Vliet Vlieland T, Maes S. Are aspects of a motivational interview related to subsequent changes in physical activity and regulatory style? Examining relationships among patients with rheumatoid arthritis. Motivational Interviewing: Training, Research, Implementation, Practice. 2015;1(3):42–7. https://doi.org/10.5195/mitrip.2014.46.
Campbell MK, Carr C, Devellis B, Switzer B, Biddle A, Amamoo MA, et al. A randomized trial of tailoring and motivational interviewing to promote fruit and vegetable consumption for cancer prevention and control. Ann Behav Med. 2009;38(2):71–85. https://doi.org/10.1007/s12160-009-9140-5.
do Valle Nascimento TM, Resnicow K, Nery M, Brentani A, E. K, Agrawal P et al. A pilot study of a community health agent-led type 2 diabetes self-management program using motivational interviewing-based approaches in a public primary care center in São Paulo, Brazil. BMC Health Serv Res. 2017;17(1). https://doi.org/10.1186/s12913-016-1968-3.
Lechner L, Brug J, De Vries H, van Assema P, Mudde AN. Stages of change for fruit, vegetable and fat intake: consequences of misconception. Health Educ Res. 1998;13(1):1–11. https://doi.org/10.1093/her/13.1.1-a.
Lundahl B, Moleni T, Burke BL, Butters R, Tollefson D, Butler C, et al. Motivational interviewing in medical care settings: a systematic review and meta-analysis of randomized controlled trials. Patient Educ Couns. 2013;93(2):157–68. https://doi.org/10.1016/j.pec.2013.07.012.
Schneider JK, Wong-Anuchit C, Stallings D, Krieger MM. Motivational interviewing and fruit/vegetable consumption in older adults. Clin Nurs Res. 2017;26(6):731–46. https://doi.org/10.1177/1054773816673634.
Agudo A. Measuring the intake of fruit and vegetables Fruit and vegetables for health: report of the Joint FAO/WHO Workshop on Fruit and Vegetables for Health. Kobe, Japan 2004;1–3.
Schulz DN, Kremers SP, Vandelanotte C, Adrichemvan MJ, Schneider F, Candel MJ, et al. Effects of a web-based tailored multiple-lifestyle intervention for adults: a two-year randomized controlled trial comparing sequential and simultaneous delivery modes. J Med Internet Res. 2014;16(1): e26. https://doi.org/10.2196/jmir.3094.
Fleig L, Lippke S, Pomp S, Schwarzer R. Intervention effects of exercise self-regulation on physical exercise and eating fruits and vegetables: a longitudinal study in orthopedic and cardiac rehabilitation. Prev Med. 2011;53(3):182–7. https://doi.org/10.1016/j.ypmed.2011.06.019.
Osilla KC, Watkins KE, D’Amico EJ, McCullough CM, Ober AJ. Effects of motivational interviewing fidelity on substance use treatment engagement in primary care. J Subst Abuse Treat. 2018;87:64–9. https://doi.org/10.1016/j.jsat.2018.01.014.
Magill M, Gaume J, Apodaca TR, Walthers J, Mastroleo NR, Borsari B, et al. The technical hypothesis of motivational interviewing: a meta-analysis of MI’s key causal model. J Consult Clin Psychol. 2014;82(6):973–83. https://doi.org/10.1037/a0036833.
Miller WR, Moyers TB. Asking better questions about clinical skills training. Addiction. 2016;111(7):1151–2. https://doi.org/10.1111/add.13095.
Madson MB, Todd C, Campbell DT. Measures of fidelity in motivational enhancement: a systematic review. J Subst Abuse Treat. 2006;31(1):67–73. https://doi.org/10.1016/J.JSAT.2006.03.010.
Gill I, Oster C, Lawn S. Assessing competence in health professionals’ use of motivational interviewing: a systematic review of training and supervision tools. Patient Educ Couns. 2020;103(3):473–83. https://doi.org/10.1016/j.pec.2019.09.021.
Hallgren KA, Dembe A, Pace BT, Imel ZE, Lee CM, Atkins DC. Variability in motivational interviewing adherence across sessions, providers, sites, and research contexts. J Subst Abuse Treat. 2018;84:30–41. https://doi.org/10.1016/j.jsat.2017.10.011.
Hill CE, O’Grady KE, Price P. A method for investigating sources of rater bias. J Couns Psychol. 1988;35(3):346–50. https://doi.org/10.1037/0022-0167.35.3.346.
Lundahl B, Droubay BA, Burke B, Butters RP, Nelford K, Hardy C, et al. Motivational interviewing adherence tools: a scoping review investigating content validity. Patient Educ Couns. 2019;102(12):2145–55. https://doi.org/10.1016/j.pec.2019.07.003.
Pirlott AG, Kisbu-Sakarya Y, Defrancesco CA, Elliot DL, Mackinnon DP. Mechanisms of motivational interviewing in health promotion: a Bayesian mediation analysis. Int J Behav Nutr Phys Act. 2012;9(1):69. https://doi.org/10.1186/1479-5868-9-69.
Acknowledgements
The authors thank the participants and primary care centers for their collaboration, and the MI counselors and The MITI raters for their excellent work. The study was conducted under the auspices of the School for Public Health and Primary Care (Caphri), which has been acknowledged since 1995 by the Royal Netherlands Academy of Arts and Sciences (KNAW).
Funding
This work is funded by the Netherlands Organization for Health Research and Development (220000120).
Author information
Authors and Affiliations
Contributions
All authors contributed to the conceptualization of the manuscript. IM and JB planned and designed the research. IM and HK carried out the study. HV provided support/advice. HK performed the statistical analysis.
Corresponding author
Ethics declarations
Ethics Approval
Medical Ethics Committee of Maastricht University and the University Hospital Maastricht approved the trial. All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Informed Consent
Informed consent was obtained from all individual participants included in the study.
Conflict of Interest
The authors declare no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Mesters, I., van Keulen, H.M., de Vries, H. et al. Intervention Fidelity of Telephone Motivational Interviewing On Physical Activity, Fruit Intake, and Vegetable Consumption in Dutch Outpatients With and Without Hypertension. Int.J. Behav. Med. 30, 108–121 (2023). https://doi.org/10.1007/s12529-022-10076-8
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12529-022-10076-8
Keywords
- Fruit consumption
- Vegetable consumption
- “Activities, physical”
- Motivational Interviewing
- Fidelity
- Behavior change
- Fidelity-effectiveness association