Abstract
Empathy has been shown to affect the quality of care by enhancing the physician–patient relationship and promoting effective communication. In this study, the newly developed Rating Scales for the Assessment of Empathic Communication in Medical Interviews (REM), designed to assess empathy and confrontation in physician–patient interactions, were subjected to preliminary psychometric testing. Particular attention was paid to face validity, reliability, sensitivity, and practicality. A total of 118 volunteers were asked to assess transcribed interactions between physicians and a standardized patient using the REM. In order to assess the convergent validity of the REM, the Motivational Interviewing Treatment Integrity Code (MITI) and the Behavior Change Counseling Index (BECCI) were used. Factor analysis identified two subscales, reflecting empathy and confrontation. Interrater reliability coefficients for items ranged from r = .82 to .97; Cronbach’s alphas for the two subscales were .89 and .88, respectively. The convergent validity was supported by substantial correlations between the REM scores and the MITI scores and by significant correlations between the REM scores and the BECCI score. The REM demonstrated good psychometric properties suggesting the rating scales might be useful in clinical practice, research endeavors, and medical education. Further research is necessary to assess the test-retest reliability as well as the predictive validity of this instrument.
Similar content being viewed by others
References
Allison, J., Rollnick, S., & Butler, C. (2001). Health behaviour change: A selection of strategies, an aid for trainers. Cardiff: Media Resources Centre, University of Wales College of Medicine.
Brown, T. A. (2003). Confirmatory factor analysis of the Penn State Worry Questionnaire: Multiple factors or method effects? Behaviour Research and Therapy, 41, 1411.
Bylund, C. L., & Makoul, G. (2002). Empathic communication and gender in the physician–patient encounter. Patient Education and Counseling, 48, 207–216.
Del Piccolo, L., Putnam, S. M., Mazzi, M. A., & Zimmerman, C. (2004). The biopsychosocial domains and the functions of the medical interview in primary care: Construct validity of the Verona Medical Interview Classification System. Patient Education Counseling, 53, 47–56.
Demmel, R., & Hagen, J. (2002). Screening for paternal alcoholism: Reliability of a German version of the F-SMAST. European Addiction Research, 8, 128–132.
Demmel, R., & Hagen, J. (2003). The Comprehensive Alcohol Expectancy Questionnaire: I. Scale development. SUCHT – Zeitschrift für Wissenschaft und Praxis, 49, 292–299.
Demmel, R., Hagen, J., Nicolai, J., & Rist, F. (2005). Project BrIAN: Training general practitioners, implementation, and treatment fidelity [Abstract]. SUCHT – Zeitschrift für Wissenschaft und Praxis, 51, 164–165.
Demmel, R., Rist, F., Hagen, J., Aulhorn, I., Scheuren, B., Scherbaum, N., et al. (2003). Sekundärprävention – mehr als Screening und gute Ratschläge [Secondary prevention beyond screening and brief advice]. Suchtmedizin in Forschung und Praxis, 5, 33–36.
Deutsche Gesellschaft für Suchtforschung und Suchttherapie (Ed.). (2001). Dokumentationsstandards III für die Evaluation der Behandlung von Abhängigen [Guidelines for the evaluation of substance abuse treatment, third edition]. [Special issue]. SUCHT – Zeitschrift für Wissenschaft und Praxis, 47(2).
Duan, C., & Hill, C. E. (1996). The current state of empathy research. Journal of Counseling Psychology, 43, 261–274.
Ford, S., & Hall, A. (2004). Communication behaviours of skilled and less skilled oncologists: A validation study of the Medical Interaction Process System (MIPS). Patient Education and Counseling, 54, 275–282.
Francis, N., Rollnick, S., McCambridge, J., Butler, C., Lane, C., & Hood, K. (2005). When smokers are resistant to change: Experimental analysis of the effect of patient resistance on practitioner behaviour. Addiction, 100, 1175–1182.
Funder, D. C. (1980). On seeing ourselves as others see us: Self-other agreement and discrepancy in personality ratings. Journal of Personality, 48, 473–493.
Gallagher, T. J., Hartung, P. J., & Gregory, S. W. (2001). Assessment of a measure of relational communication for doctor–patient interactions. Patient Education and Counseling, 45, 211–218.
Hedges, L. V., & Olkin, I. (1985). Statistical methods for meta-analysis. San Diego, CA: Academic Press.
Hojat, M., Gonella, J. S., Nasca, T. J., Mangione, S., Vergare, M., & Magee, M. (2002). Physician empathy: Definition, components, measurement, and relationship to gender and specialty. American Journal of Psychiatry, 159, 1563–1569.
Hojat, M., Mangione, S., Nasca, T. J., Cohen, M. J. M., Gonnella, J. S., Erdmann, J.B., et al. (2001). The Jefferson Scale of Physician Empathy: Development and preliminary psychometric data. Educational and Psychological Measurement, 61, 349–365.
Kim, S. S., Kaplowitz, S., & Johnston, M. V. (2004). The effects of physician empathy on patient satisfaction and compliance. Evaluation and the Health Professions, 27, 237–251.
Lane, C., Huws-Thomas, M., Hood, K., & Rollnick, S. (2002). The Behaviour Change Counselling Index (BECCI): Manual for coding behaviour change counselling. Retrieved August 4, 2007, from http://www.motivationalinterview.org/library/BECCIForm.pdf
Lane, C., Huws-Thomas, M., Hood, K., Rollnick, S., Edwards, K., & Robling, M. (2005). Measuring adaptations of motivational interviewing: The development and validation of the Behavior Change Counseling Index (BECCI). Patient Education and Counseling, 56, 166–173.
Law, S. A. T., & Britten, N. (1995). Factors that influence the patient-centeredness of a consultation. British Journal of General Practice, 45, 520–524.
Laumeyer, S. (2003). Psychometrische Eigenschaften und Faktorenstruktur einer deutschsprachigen Version des “Drinker Inventory of Consequences” (DrINC) [Psychometric properties and factor structure of a German-language version of the “Drinker Inventory of Consequences” (DrINC)]. Unpublished master’s thesis, University of Münster, Germany.
Lindell, M. K., Brandt, C. J., & Whitney, D. J. (1999). A revised index of interrater agreement for multi-item ratings of a single target. Applied Psychological Measurement, 23, 127–135.
Madson, M. B., & Campbell, T. C. (2006). Measures of fidelity in motivational enhancement: A systematic review. Journal of Substance Abuse Treatment, 31, 67–73.
Mead, N., & Bower, P. (2002). Patient-centered consultations and outcomes in primary care: A review of the literature. Patient Education and Counseling, 48, 51–61.
Mercer, S. W., Maxwell, M., Heaney, D., & Watt, G. C. M. (2004). The Consultation and Relational Empathy (CARE) Measure: Development and preliminary validation and reliability of an empathy-based consultation process measure. Family Practice, 21, 699–705.
Mercer, S. W., & Reynolds, W. J. (2002). Empathy and quality of care. British Journal of General Practice, 52, S9–S13.
Miller, W. R., & Mount, K. A. (2001). A small study of training in motivational interviewing: Does one workshop change clinician and client behavior? Behavioural and Cognitive Psychotherapy, 29, 457–471.
Miller, W. R., & Rollnick, S. (1991). Motivational interviewing: Preparing people to change additive behaviour. New York: The Guilford Press.
Miller, W. R., & Rollnick, S. (2002). Motivational interviewing: Preparing people for change. New York: The Guilford Press.
Miller, W. R., Yahne, C. E., Moyers, T. B., Martinez, J., & Pirritano, M. (2004). A randomized trial of methods to help clinicians learn motivational interviewing. Journal of Consulting and Clinical Psychology, 72, 1050–1062.
MITI Transcript: Ponytail. Retrieved August 4, 2007, from http://casaa.unm.edu/codinginst.html
MITI Transcript: Rounder. Retrieved August 4, 2007, from http://casaa.unm.edu/codinginst.html
Moyers, T. B., Martin, T., Manuel, J. K., Hendrickson, S. M. L., & Miller, W. R. (2005). Assessing competence in the use of motivational interviewing. Journal of Substance Abuse Treatment, 28, 19–26.
Moyers, T. B., Martin, T., Manuel, J. K., & Miller, W. R. (2003). The Motivational Interviewing Treatment Integrity (MITI) Code. Retrieved August 4, 2007, from http://casaa.unm.edu/codinginst.html
Pierson, H. M., Hayes, S. C., & Gifford, E. V. (2007). An examination of the Motivational Interviewing Treatment Integrity Code. Journal of Substance Abuse Treatment, 32, 11–17.
Rollnick, S., Kinnersley, P., & Butler, C. (2002). Context-bound communication skills training: Development of a new method. Medical Education, 36, 377–383.
Rollnick, S., Mason, P., & Butler, C. (1999). Health behavior change: A guide for practitioners. Edinburgh: Churchill Livingstone.
Rollnick, S., Seale, C., Kinnersley, P., Rees, M., Butler, C., & Hood, K. (2002). Developing a new line of pattern: Can doctors change their consultations for sore throat? Medical Education, 36, 678–681.
Roter, D. (2000). The enduring and evolving nature of the patient–physician relationship. Patient Education and Counseling, 29, 5–15.
Roter, D., Hall, J. A., & Aoki, Y. (2002). Physician gender effects in medical communication: A meta-analytic review. Journal of the American Medical Association, 288, 756–764.
Roter, D. L., & Larson, S. (2002). The Roter Interaction Analysis System (RIAS): Utility and flexibility for analysis of medical interactions. Patient Education and Counseling, 46, 243–251.
Roter, D. L., Larson, S., Shinitzky, H., Chernoff, R., Serwint, J. R., Adamo, G., et al. (2004). Use of an innovative video feedback technique to enhance communication skills training. Medical Education, 38, 145–157.
Satorra, A., & Bentler, P. M. (2001). A scaled difference chi-square test statistic for moment structure analysis. Psychometrika, 66, 507–514.
Shrout, P. E., & Fleiss, J. L. (1979). Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin, 86, 420–428.
Stewart, M. (1995). Effective physician patient communication and health outcomes: A review. Canadian Medical Association Journal, 152, 1423–1433.
Tinsley, H. E., & Weiss, D. J. (1975). Interrater reliability and agreement of subjective judgments. Journal of Counseling Psychology, 22, 358–376.
Wagner, P. J., Lentz, L., & Heslop, S. D. (2002). Teaching communication skills: A skills-based approach. Academic Medicine, 77, 1164.
Wasserman, R. C., & Inui, T. S. (1983). Systematic analysis of clinician-patient interactions: A critique of recent approaches with suggestions for future research. Medical Care, 21, 270–293.
Winefield, H. R., & Chur-Hansen, A. (2000). Evaluating the outcome of communication skill teaching for entry-level medical students: Does knowledge of empathy increase? Medical Education, 34, 90–94.
Zinn, W. (1993). The empathic physician. Archives of Internal Medicine, 153, 306–312.
Zhou, Q., Valiente, C., & Eisenberg, N. (2003). Empathy and its measurement. In S. J. Lopez & J. Shane (Eds.), Positive psychological assessment: A handbook of models and measures (pp. 269–284). Washington, DC: American Psychological Association.
Acknowledgments
This research was supported by the German Federal Ministry of Education and Research (grant no. 01EB0131). The authors wish to thank Kelley Kucaba for her helpful comments on drafts of this article and the students of the winter class 2003 for their assistance with the study.
Author information
Authors and Affiliations
Corresponding author
Appendix
Appendix
¼/SimplePara>
(2) Did the physician treat the patient as an equal partner? | |
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7 | |
not equal | completely equal |
¼/SimplePara>
(3) Did the physician show understanding of the patient’s point of view? | |
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7 | |
no understanding | a lot of understanding |
¼/SimplePara>
(4) Did the physician try to put him/herself in the position of the patient? | |
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7 | |
not at all | a lot |
¼/SimplePara>
(5) Did the physician show interest in the patient’s opinion? | |
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7 | |
no interest | a lot of interest |
¼/SimplePara>
(6) Did the physician put the patient under pressure? | |
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7 | |
no pressure | a lot of pressure |
¼/SimplePara>
(7) Did the physician “preach”? | |
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7 | |
did not “preach” | “preached” a lot |
¼/SimplePara>
(8) Did the physician admonish the patient? | |
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7 | |
not at all | a lot |
¼/SimplePara>
(9) Was the physician responsive to the patient? | |
1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7 | |
not responsive | very responsive |
Rights and permissions
About this article
Cite this article
Nicolai, J., Demmel, R. & Hagen, J. Rating Scales for the Assessment of Empathic Communication in Medical Interviews (REM): Scale Development, Reliability, and Validity. J Clin Psychol Med Settings 14, 367–375 (2007). https://doi.org/10.1007/s10880-007-9081-8
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10880-007-9081-8