From the Patient’s Perspective: The Impact of Training on Resident Physician’s Obesity Counseling
- First Online:
- Cite this article as:
- Jay, M., Schlair, S., Caldwell, R. et al. J GEN INTERN MED (2010) 25: 415. doi:10.1007/s11606-010-1299-8
- 213 Views
It is uncertain whether training improves physicians’ obesity counseling.
To assess the impact of an obesity counseling curriculum for residents.
A non-randomized, wait-list/control design.
Twenty-three primary care internal medicine residents; 12 were assigned to the curriculum group, and 11 were assigned to the no-curriculum group. Over a 7-month period (1–8 months post-intervention) 163 of the residents’ obese patients were interviewed after their medical visits.
A 5-hour, multi-modal obesity counseling curriculum based on the 5As (Assess, Advise, Agree, Assist, Arrange) using didactics, role-playing, and standardized patients.
Patient-report of physicians’ use of the 5As was assessed using a structured interview survey. Main outcomes were whether obese patients were counseled about diet, exercise, or weight loss (rate of counseling) and the quality of counseling provided (percentage of 5As skills performed during the visit). Univariate statistics (t-tests) were used to compare the rate and quality of counseling in the two resident groups. Logistic and linear regression was used to isolate the impact of the curriculum after controlling for patient, physician, and visit characteristics.
A large percentage of patients seen by both groups of residents received counseling about their weight, diet, and/or exercise (over 70%), but the quality of counseling was low in both the curriculum and no curriculum groups (mean 36.6% vs. 31.2% of 19 possible 5As counseling strategies, p = 0.21). This difference was not significant. However, after controlling for patient, physician and visit characteristics, residents in the curriculum group appeared to provide significantly higher quality counseling than those in the control group (std β = 0.18; R2 change = 2.9%, P < 0.05).
Residents who received an obesity counseling curriculum were not more likely to counsel obese patients than residents who did not. Training, however, is associated with higher quality of counseling when patient, physician, and visit characteristics are taken into account.
The majority of Americans are either overweight or obese1 and obesity is associated with higher mortality2 and increased risk of co-morbidities.3–5 Modest weight loss with diet and exercise can improve health outcomes.6 Physician counseling is associated with improved diet and physical activity,7 readiness for lifestyle change,8 and short-term weight loss.9,10 Thus, several organizations recommend that physicians should counsel obese patients to lose weight11–13.
However, physicians often do not counsel patients about their weight.7,14–16 When counseling does occur, most physicians do not discuss specific behavior change recommendations such as diet and exercise,8 indicating that quality of counseling may be poor. Lack of training and competency in obesity management are among the reasons that physicians do not adequately counsel patients.8,17–19
The 5As counseling framework is an evidence-based way to teach physicians to counsel obese patients19,20 and measure the quality of obesity counseling.21 This framework guides providers to assess risk, current behavior, and readiness to change, advise change of specific behaviors, agree and collaboratively set goals, assist in addressing barriers and securing support, and arrange for follow-up.20,22 Training physicians about this framework has been shown to improve patient outcomes in smoking cessation.23 When combined with office management strategies, training physicians to perform the 5As produced greater lipid control and weight loss9 in patients. We, therefore, used the 5As framework to design and evaluate our obesity curriculum.
The goal of this pilot study was to measure the impact of an obesity counseling curriculum on resident physicians’ obesity counseling, operationalized as the use of 5As counseling strategies. In our conceptual model, we anticipated that selected patient (BMI, health status, stage of change, and overall satisfaction with the clinic), visit (degree of continuity, whether physician was primary provider), and physician characteristics (gender, patient-centeredness) would be important confounding influences on physicians’ obesity counseling. Thus, we sought to compare the patient-reported rate and quality of counseling of residents who did and did not participate in an obesity counseling curriculum while controlling for these potential confounders.
Intervention: Obesity Curriculum for Residents
The 5-hour curriculum, given over three weekly sessions, utilized multiple active instructional methods including case-studies, role-playing, standardized patients for counseling practice, and faculty-facilitated videotape review of residents counseling their own patients. Skills such as behavioral assessment, goal setting, and motivational interviewing were stressed19. Participation was monitored using attendance forms.
Measures: Body Mass Index
Weight was measured using one of four analog scales each equipped with a stadiometer to take height measurements with the patients fully clothed except for shoes and jackets. The scales were calibrated at the start of the study.
Patient Exit Interview
Assessment of 5As Obesity Counseling Practices
Did you and your doctor discuss your weight today?
Did your doctor discuss with you how much weight you should lose?
Did your doctor help you set goals (make specific plans) to improve your diet ans (or) exercise more?
Did your doctor tell you when he or she wanted to see you again for follow-up (within 30 days)
Did your doctor ask you about or discuss your diet (what you eat today)
Did your doctor tell you that you should lose weight
Did your doctor ask you about or discuss how you exercise today
Did your doctor ask you if you’re trying to lose weight?
Did your doctor ask you to recall all the food and drinks you’ve had in the past 24 hours
Did your doctor discuss making changes in your diet with you today?
How much were you involved in setting these goals?
Did your doctor talk with you about how to deal with the kinds of things, like stress, temptation, finding time that make it hard for you to lose weight
Did your doctor refer you to the weight management clinic?
Did your doctor ask you know im,portant it is to you to try and lose weight?
Did your doctor discuss making changes in how much you exercise
How realistic do you think it is that you’ll meet these goals?
Did your doctor refer you to any community supports like Overeater’s Anonymous
Did your doctor ask you how confident you are that you can lose weight?
Did your doctor refer you to a nutritionist?
19 Items TOTAL
We also measured theory-based patient, provider, and visit characteristics based on our conceptual model. Patient factors included BMI, socio-demographic information, perceived health status, presence and number of self-reported co-morbidities (diabetes, high cholesterol, hypertension, arthritis), health literacy, and patient stage of weight management change. Stage of change questions were adapted from previously used questionnaires.24 Health literacy was assessed using two literature-derived screening questions.25 We assessed patients’ overall satisfaction with clinic services using 6 items from frequently used satisfaction questionairres26 with fairly strong evidence of reliability (internal consistency and test-retest) and validity (e.g., associations with adherence, doctor shopping, disenrollment from health plans).27
Visit characteristics included a measure of continuity (estimated number of times the patient had seen the physician with 0 = never; 1 = once; 2 = 2–3 times; 4 = 4–10 times; 5 = 11–20 times; 6 = more than 20 times) and whether the patient considered the physician to be his or her primary care provider. Time since the intervention (measured in weeks) was included to control for seasonal (patient) and developmental (resident experience and training, decay of curriculum impact) effects. The provider characteristics included gender and physician’s patient-centeredness of care which was assessed with seven questions adapted from the RAND Patient Satisfaction Questionnaire27 and the OPTION shared decision-making scales.28
We piloted the survey with 20 patients in both Spanish and English to ensure that the questions were understandable, culturally appropriate, and accurately translated.
Patients and Procedures
The residents see patients at Gouverneur Healthcare Services, part of the New York City Health and Hospitals Corporation (HHC). Gouverneur serves a largely low income, underserved immigrant population (45% Hispanic (HHC internal document, August 2008)).
Fifteen nursing staff identified all patients seen by residents with a BMI ≥30 using a BMI measurement wheel. Bilingual research assistants approached patients immediately after their medical visit to invite them to be part of the study. Research assistants obtained verbal consent using a consent script (to accommodate low literacy patients). They then conducted the 15–30 minute interview in a separate room after explicitly stating that the physicians would be informed about patients’ answers. The patient interviews were conducted 1–8 months after the residents received the curriculum. Patients received a pedometer (estimated value $3.15) as compensation. The Institutional Review Boards at New York University School of Medicine and Gouverneur Healthcare Services approved this study.
Sample Size Calculations
A priori power calculations were based on an anticipated 25% difference in the rate of obesity counseling between the intervention and control groups, adjusted for possible clustering effects29. With the number of clusters (residents) fixed at 23, we calculated that we would need a minimum of five patients per resident (115 patients) to have minimum power (0.80) to detect this difference in the rate of obesity counseling assuming relatively large (e.g. conservative) intra-class correlations (ICCs) of up to 0.10.
Our two main outcomes were rate of obesity counseling (patients who indicated that they were counseled about their weight, diet, and/or exercise were counted as ‘counseled’ ) and the quality of counseling using a 5As counseling score (calculated as the % of 19 individual 5As counseling strategies used) and an Advanced Skills Score (calculated as the % of 11 higher-level counseling strategies used). We used t-tests and chi-square statistics to assess the significance of differences between the curriculum groups in rate and quality of counseling.
Multivariate analyses assessed the impact of the curriculum on the rate of counseling (logistic regression using dichotomous counseled or not as the dependent variable) and quality of counseling (linear regression using counseling scores as dependent variables) after controlling for selected patient, visit, and provider characteristics (listed in Table 4). Independent variables were chosen based on findings of significant or nearly significant differences between intervention and control groups in order to control for the non-randomness of our design and on theory suggesting direct associations with obesity counseling (e.g., BMI, health status, and number of co-morbidities of the patient). Given the number of variables in our model, we report adjusted R2.
All analyses were based on an intention-to-treat model; patients of residents in the curriculum group who did not complete the curriculum were included in the analysis.
See Fig. 1 for the resident and patient flow chart. Of the 12 residents in the curriculum group, 11 (92%) completed the full curriculum. Four patients spoke neither English nor Spanish and were thus ineligible. Twenty-eight patients declined to participate mostly due to time constraints. Thus, we interviewed 158 patients. The average number of patients per resident was 7 (range 2–15; three residents who each saw only one patient were excluded). Twenty-one of the patients interviewed had a BMI less than 30 (26–29.99) due to inappropriate referrals and/or BMI calculation errors by staff. Of these, we chose to include patients who had a BMI that rounded to a whole number ≥30 or ≥27 with diabetes or two or more co-morbidities (as per NIH guidelines30 in order to preserve sample size.
Patient and Physician Characteristics
Control Group (no curriculum)
Intervention Group (curriculum)
t-test or Chi Sq
n = 74
n = 78
BMI, mean, (SD)
t = 1.01
Age mean, (SD)
t = 1.19
Female gender, No., (%)
χ2 = 0.08
Hispanic, No. (%)
χ2 = 4.16
Black, No. (%)
Spanish speaking, No. (%)
χ2 = 1.97
Low health literacy, No. (%)
χ2 = 0 .27
Health Characteristics of Patients
Number co-morbidities, mean, (SD)
t = 0.10
Report being obese, No. (%)
χ2 = 0.16
Self-report health statusa (mean, SD)
t = 0.44
Patients’ Stage of Change
% action or maintenance, No. (%)
χ2 = 3.88
Satisfaction with clinic, meanb, (SD)
t = 1.99
Patient-centeredness of MDc, mean, (SD)
t = 1.68
Consider MD to be primary care MD, No. (%)
χ2 = 1.98
Continuity (times seen MD)d, mean, (SD)
t = 1.40
Female, No. (%)
χ2 = 1.10
Gender concordance, No. (%)
χ2 = 0.05
Time (wks since intervention), mean No. (%)
t = 2.05
Patient Report of Physician Obesity Counseling Performance
Control Group (no curriculum) Mean (SD)
Intervention Group (curriculum) Mean (SD)
Patient level analyses
Patients counseled about obesity, No. (%)
Overall counseling score, mean % of 19 5A counseling skills (SD)
Assess (7 items)
Advise (4 items)
Agree (3 items)
Assist (1 item)
Arrange (4 items)
Advanced counseling score (mean % of 11 advanced 5A counseling skills)
Resident Level Analyses
Mean % of patients counseled about obesity (at all)
Mean overall counseling score (% of 19 5A counseling skills)
Mean advanced counseling score (% of 11 advanced 5A counseling skills)
In the multivariate analyses, we found small but significant effects of the intervention on quality of counseling but not on the rate of counseling. Being seen by a resident in the curriculum group was not significantly associated with increased likelihood of being counseled (OR = 1.94, CI .80-4.68, p = 0.14) (not tabled). Patient’s BMI (OR = 1.12; CI 1.01–1.24 P = 0.04), stage of change (OR = 3.54; CI 1.24–10.16, P = 0.02), and continuity (OR = 1.49; CI 1.03–2.15, P = 0.03) were associated with increased odds of being counseled.
Hierarchical Regression Analyses with 5As Obesity Counseling Score and Advanced Skills Score as Dependent Variables
5As Counseling Score
Advanced Skills Score
R2 (Adj) Change
R2 (Adj) Change
Self Report of health status (Better)
Spanish (primary language)
Stage of change
Stage of change (% in action or maintenance)
Satisfaction with clinic services
Patient centeredness of MD
Considered primary care MD
Continuity (times seen MD)
Time (Wks since intervention)
Resident completed obesity counseling curriculum
Total adjusted R2 = 22.9%‡
Total adjusted R2 = 24.3%‡
While a majority of patients in our study reported being counseled, their physicians did not address most of the 5As, thus confirming the need to improve physicians’ quality of obesity counseling.8 Our study did not find significant bivariate differences in obesity counseling between residents in the intervention and control groups. However, when theoretically-supported patient, visit and provider characteristics were taken into account, the obesity counseling curriculum was associated with higher quality of counseling. This is encouraging giving the challenges of determining the direct effects of training on clinical care and supports efforts to train physicians to deliver high quality obesity counseling. This study also highlights that there are many factors besides physician training that influence the quality of care a patient receives.
Patients with a higher BMI were more likely to receive counseling. This is not surprising since both patients and physicians are more likely to identify obesity as a problem when patients weigh more.31 Higher self-reported health status was associated with higher quality physician counseling which supports previous work showing that counseling is most likely to take place when there are fewer competing issues.32 Having a female physician was associated with higher quality of obesity counseling; female physician gender has been shown to predict higher rates of preventive care counseling in other studies.33 Greater continuity of care with the physician was associated with higher quality of counseling--physicians may have more time to counsel patients they have seen previously. Paradoxically, considering the physician to be one’s primary care provider was associated with lower quality counseling—future research is needed to confirm and elucidate whether and why this might be true. Unfortunately, female gender of the patient was associated with decreased quality of obesity counseling. This is concerning and warrants further study because obesity is more common in females.1
While this was a largely negative study, it has important strengths. We tested the impact of our curriculum on patient care. Few studies have examined the impact of medical education interventions on real-world physician performance34 possibly because attempts to show a significant impact of medical education are hindered by the relatively small anticipated effect of curricula on outcomes35 when compared to the myriad of other factors that impact patient care32. Further, we developed a conceptual model and used it to identify important variables which could be expected to influence obesity counseling. While our study did not account for all potentially important factors (e.g., year of resident training, patient activation, language and/or cultural concordance) it demonstrated the need to develop more nuanced models to better identify evidence of educationally sensitive variance in outcomes. This may guide the design of future medical education studies to capture the impact of training interventions on patient outcomes.
There are several limitations to this study. Given the small sample size, our study was underpowered to detect small differences. Residents who did not receive the curriculum may have learned from their peers in the intervention group, diminishing the measured differences between the groups. Generalizability is limited because we studied only one training program, although we anticipate using a more diverse sample of residents would yield substantially larger curriculum effects. Our residents had a higher rate of counseling in both groups than is reported in the literature (>70% vs. 20–30% in other studies (14, 31)), which may have produced a ceiling effect, diminishing the detectable difference between the two groups. Post hoc power calculations suggest that we would have needed a sample size of >700 to have minimum power (0.80) to detect the simple bivariate difference in quality of counseling we found between the curricular groups (about 5%).
There are also limitations in our study design and analysis. We could not randomize the residents to the intervention due to fixed rotation schedules. While patients were blinded to intervention status, the residents were not. There may have been some variability in the quality and accuracy of weight and height measurements. The study was cross-sectional, and by not collecting data from multiple visits, we may have missed important curriculum effects. Our findings may not hold up with different patient populations although we suspect that many of the same core patient and visit characteristics will be important.
Our measures are also limited. Ideally, we would have liked to have assessed more physician and visit characteristics but were limited both by the availability of data (determined by respondent burden and resource constraints) and by our small sample size which precluded the inclusion of too many variables. We relied on patient report to assess the quality of obesity counseling which may have produced a recall bias. While patient report has been shown to be superior to physician report and chart reviews as a method to assess physician practice36, we cannot determine the accuracy of patient reporting in our study.
This study suggests avenues for further research. We plan to test the impact of this obesity curriculum using larger numbers of residents from multiple institutions. We also plan to conduct longitudinal follow-up of patients to see if training physicians to deliver higher quality obesity care leads to improved outcomes such as patient activation, intention to lose weight, and weight loss.
A multi-modal obesity counseling curriculum using the 5As is associated with higher quality of obesity counseling after controlling for patient, visit, and provider factors in underserved patients. Future research should determine whether training physicians improves obesity care in a larger, more heterogeneous sample of physicians and patients.
Melanie Jay had full access to the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis. The authors would also like to thank Jennifer Adams, Sondra Zabar, David Stevens, Mack Lipkin and the Research on Medical Education Outcomes (ROMEO) team for their consultation and contributions to this project.
Conflict of Interest
None of the authors report any conflict of interest.