Skip to main content
Log in

Rating Scales for the Assessment of Empathic Communication in Medical Interviews (REM): Scale Development, Reliability, and Validity

  • Published:
Journal of Clinical Psychology in Medical Settings Aims and scope Submit manuscript

Abstract

Empathy has been shown to affect the quality of care by enhancing the physician–patient relationship and promoting effective communication. In this study, the newly developed Rating Scales for the Assessment of Empathic Communication in Medical Interviews (REM), designed to assess empathy and confrontation in physician–patient interactions, were subjected to preliminary psychometric testing. Particular attention was paid to face validity, reliability, sensitivity, and practicality. A total of 118 volunteers were asked to assess transcribed interactions between physicians and a standardized patient using the REM. In order to assess the convergent validity of the REM, the Motivational Interviewing Treatment Integrity Code (MITI) and the Behavior Change Counseling Index (BECCI) were used. Factor analysis identified two subscales, reflecting empathy and confrontation. Interrater reliability coefficients for items ranged from = .82 to .97; Cronbach’s alphas for the two subscales were .89 and .88, respectively. The convergent validity was supported by substantial correlations between the REM scores and the MITI scores and by significant correlations between the REM scores and the BECCI score. The REM demonstrated good psychometric properties suggesting the rating scales might be useful in clinical practice, research endeavors, and medical education. Further research is necessary to assess the test-retest reliability as well as the predictive validity of this instrument.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Allison, J., Rollnick, S., & Butler, C. (2001). Health behaviour change: A selection of strategies, an aid for trainers. Cardiff: Media Resources Centre, University of Wales College of Medicine.

    Google Scholar 

  • Brown, T. A. (2003). Confirmatory factor analysis of the Penn State Worry Questionnaire: Multiple factors or method effects? Behaviour Research and Therapy, 41, 1411.

    Article  PubMed  Google Scholar 

  • Bylund, C. L., & Makoul, G. (2002). Empathic communication and gender in the physician–patient encounter. Patient Education and Counseling, 48, 207–216.

    Article  Google Scholar 

  • Del Piccolo, L., Putnam, S. M., Mazzi, M. A., & Zimmerman, C. (2004). The biopsychosocial domains and the functions of the medical interview in primary care: Construct validity of the Verona Medical Interview Classification System. Patient Education Counseling, 53, 47–56.

    Article  Google Scholar 

  • Demmel, R., & Hagen, J. (2002). Screening for paternal alcoholism: Reliability of a German version of the F-SMAST. European Addiction Research, 8, 128–132.

    Article  Google Scholar 

  • Demmel, R., & Hagen, J. (2003). The Comprehensive Alcohol Expectancy Questionnaire: I. Scale development. SUCHT – Zeitschrift für Wissenschaft und Praxis, 49, 292–299.

    Google Scholar 

  • Demmel, R., Hagen, J., Nicolai, J., & Rist, F. (2005). Project BrIAN: Training general practitioners, implementation, and treatment fidelity [Abstract]. SUCHT – Zeitschrift für Wissenschaft und Praxis, 51, 164–165.

    Google Scholar 

  • Demmel, R., Rist, F., Hagen, J., Aulhorn, I., Scheuren, B., Scherbaum, N., et al. (2003). Sekundärprävention – mehr als Screening und gute Ratschläge [Secondary prevention beyond screening and brief advice]. Suchtmedizin in Forschung und Praxis, 5, 33–36.

    Google Scholar 

  • Deutsche Gesellschaft für Suchtforschung und Suchttherapie (Ed.). (2001). Dokumentationsstandards III für die Evaluation der Behandlung von Abhängigen [Guidelines for the evaluation of substance abuse treatment, third edition]. [Special issue]. SUCHT – Zeitschrift für Wissenschaft und Praxis, 47(2).

  • Duan, C., & Hill, C. E. (1996). The current state of empathy research. Journal of Counseling Psychology, 43, 261–274.

    Article  Google Scholar 

  • Ford, S., & Hall, A. (2004). Communication behaviours of skilled and less skilled oncologists: A validation study of the Medical Interaction Process System (MIPS). Patient Education and Counseling, 54, 275–282.

    Article  Google Scholar 

  • Francis, N., Rollnick, S., McCambridge, J., Butler, C., Lane, C., & Hood, K. (2005). When smokers are resistant to change: Experimental analysis of the effect of patient resistance on practitioner behaviour. Addiction, 100, 1175–1182.

    Article  PubMed  Google Scholar 

  • Funder, D. C. (1980). On seeing ourselves as others see us: Self-other agreement and discrepancy in personality ratings. Journal of Personality, 48, 473–493.

    Article  Google Scholar 

  • Gallagher, T. J., Hartung, P. J., & Gregory, S. W. (2001). Assessment of a measure of relational communication for doctor–patient interactions. Patient Education and Counseling, 45, 211–218.

    Article  PubMed  CAS  Google Scholar 

  • Hedges, L. V., & Olkin, I. (1985). Statistical methods for meta-analysis. San Diego, CA: Academic Press.

    Google Scholar 

  • Hojat, M., Gonella, J. S., Nasca, T. J., Mangione, S., Vergare, M., & Magee, M. (2002). Physician empathy: Definition, components, measurement, and relationship to gender and specialty. American Journal of Psychiatry, 159, 1563–1569.

    Article  PubMed  Google Scholar 

  • Hojat, M., Mangione, S., Nasca, T. J., Cohen, M. J. M., Gonnella, J. S., Erdmann, J.B., et al. (2001). The Jefferson Scale of Physician Empathy: Development and preliminary psychometric data. Educational and Psychological Measurement, 61, 349–365.

    Article  Google Scholar 

  • Kim, S. S., Kaplowitz, S., & Johnston, M. V. (2004). The effects of physician empathy on patient satisfaction and compliance. Evaluation and the Health Professions, 27, 237–251.

    Article  CAS  Google Scholar 

  • Lane, C., Huws-Thomas, M., Hood, K., & Rollnick, S. (2002). The Behaviour Change Counselling Index (BECCI): Manual for coding behaviour change counselling. Retrieved August 4, 2007, from http://www.motivationalinterview.org/library/BECCIForm.pdf

  • Lane, C., Huws-Thomas, M., Hood, K., Rollnick, S., Edwards, K., & Robling, M. (2005). Measuring adaptations of motivational interviewing: The development and validation of the Behavior Change Counseling Index (BECCI). Patient Education and Counseling, 56, 166–173.

    Article  PubMed  Google Scholar 

  • Law, S. A. T., & Britten, N. (1995). Factors that influence the patient-centeredness of a consultation. British Journal of General Practice, 45, 520–524.

    Google Scholar 

  • Laumeyer, S. (2003). Psychometrische Eigenschaften und Faktorenstruktur einer deutschsprachigen Version des “Drinker Inventory of Consequences” (DrINC) [Psychometric properties and factor structure of a German-language version of the “Drinker Inventory of Consequences” (DrINC)]. Unpublished master’s thesis, University of Münster, Germany.

  • Lindell, M. K., Brandt, C. J., & Whitney, D. J. (1999). A revised index of interrater agreement for multi-item ratings of a single target. Applied Psychological Measurement, 23, 127–135.

    Article  Google Scholar 

  • Madson, M. B., & Campbell, T. C. (2006). Measures of fidelity in motivational enhancement: A systematic review. Journal of Substance Abuse Treatment, 31, 67–73.

    Article  Google Scholar 

  • Mead, N., & Bower, P. (2002). Patient-centered consultations and outcomes in primary care: A review of the literature. Patient Education and Counseling, 48, 51–61.

    Article  Google Scholar 

  • Mercer, S. W., Maxwell, M., Heaney, D., & Watt, G. C. M. (2004). The Consultation and Relational Empathy (CARE) Measure: Development and preliminary validation and reliability of an empathy-based consultation process measure. Family Practice, 21, 699–705.

    Article  PubMed  Google Scholar 

  • Mercer, S. W., & Reynolds, W. J. (2002). Empathy and quality of care. British Journal of General Practice, 52, S9–S13.

    Google Scholar 

  • Miller, W. R., & Mount, K. A. (2001). A small study of training in motivational interviewing: Does one workshop change clinician and client behavior? Behavioural and Cognitive Psychotherapy, 29, 457–471.

    Article  Google Scholar 

  • Miller, W. R., & Rollnick, S. (1991). Motivational interviewing: Preparing people to change additive behaviour. New York: The Guilford Press.

    Google Scholar 

  • Miller, W. R., & Rollnick, S. (2002). Motivational interviewing: Preparing people for change. New York: The Guilford Press.

    Google Scholar 

  • Miller, W. R., Yahne, C. E., Moyers, T. B., Martinez, J., & Pirritano, M. (2004). A randomized trial of methods to help clinicians learn motivational interviewing. Journal of Consulting and Clinical Psychology, 72, 1050–1062.

    Article  PubMed  Google Scholar 

  • MITI Transcript: Ponytail. Retrieved August 4, 2007, from http://casaa.unm.edu/codinginst.html

  • MITI Transcript: Rounder. Retrieved August 4, 2007, from http://casaa.unm.edu/codinginst.html

  • Moyers, T. B., Martin, T., Manuel, J. K., Hendrickson, S. M. L., & Miller, W. R. (2005). Assessing competence in the use of motivational interviewing. Journal of Substance Abuse Treatment, 28, 19–26.

    Article  PubMed  Google Scholar 

  • Moyers, T. B., Martin, T., Manuel, J. K., & Miller, W. R. (2003). The Motivational Interviewing Treatment Integrity (MITI) Code. Retrieved August 4, 2007, from http://casaa.unm.edu/codinginst.html

  • Pierson, H. M., Hayes, S. C., & Gifford, E. V. (2007). An examination of the Motivational Interviewing Treatment Integrity Code. Journal of Substance Abuse Treatment, 32, 11–17.

    Article  PubMed  Google Scholar 

  • Rollnick, S., Kinnersley, P., & Butler, C. (2002). Context-bound communication skills training: Development of a new method. Medical Education, 36, 377–383.

    Article  PubMed  Google Scholar 

  • Rollnick, S., Mason, P., & Butler, C. (1999). Health behavior change: A guide for practitioners. Edinburgh: Churchill Livingstone.

    Google Scholar 

  • Rollnick, S., Seale, C., Kinnersley, P., Rees, M., Butler, C., & Hood, K. (2002). Developing a new line of pattern: Can doctors change their consultations for sore throat? Medical Education, 36, 678–681.

    Article  PubMed  Google Scholar 

  • Roter, D. (2000). The enduring and evolving nature of the patient–physician relationship. Patient Education and Counseling, 29, 5–15.

    Article  Google Scholar 

  • Roter, D., Hall, J. A., & Aoki, Y. (2002). Physician gender effects in medical communication: A meta-analytic review. Journal of the American Medical Association, 288, 756–764.

    Article  PubMed  Google Scholar 

  • Roter, D. L., & Larson, S. (2002). The Roter Interaction Analysis System (RIAS): Utility and flexibility for analysis of medical interactions. Patient Education and Counseling, 46, 243–251.

    Article  Google Scholar 

  • Roter, D. L., Larson, S., Shinitzky, H., Chernoff, R., Serwint, J. R., Adamo, G., et al. (2004). Use of an innovative video feedback technique to enhance communication skills training. Medical Education, 38, 145–157.

    Article  PubMed  Google Scholar 

  • Satorra, A., & Bentler, P. M. (2001). A scaled difference chi-square test statistic for moment structure analysis. Psychometrika, 66, 507–514.

    Article  Google Scholar 

  • Shrout, P. E., & Fleiss, J. L. (1979). Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin, 86, 420–428.

    Article  Google Scholar 

  • Stewart, M. (1995). Effective physician patient communication and health outcomes: A review. Canadian Medical Association Journal, 152, 1423–1433.

    PubMed  CAS  Google Scholar 

  • Tinsley, H. E., & Weiss, D. J. (1975). Interrater reliability and agreement of subjective judgments. Journal of Counseling Psychology, 22, 358–376.

    Article  Google Scholar 

  • Wagner, P. J., Lentz, L., & Heslop, S. D. (2002). Teaching communication skills: A skills-based approach. Academic Medicine, 77, 1164.

    Article  Google Scholar 

  • Wasserman, R. C., & Inui, T. S. (1983). Systematic analysis of clinician-patient interactions: A critique of recent approaches with suggestions for future research. Medical Care, 21, 270–293.

    Article  Google Scholar 

  • Winefield, H. R., & Chur-Hansen, A. (2000). Evaluating the outcome of communication skill teaching for entry-level medical students: Does knowledge of empathy increase? Medical Education, 34, 90–94.

    Article  Google Scholar 

  • Zinn, W. (1993). The empathic physician. Archives of Internal Medicine, 153, 306–312.

    Article  PubMed  CAS  Google Scholar 

  • Zhou, Q., Valiente, C., & Eisenberg, N. (2003). Empathy and its measurement. In S. J. Lopez & J. Shane (Eds.), Positive psychological assessment: A handbook of models and measures (pp. 269–284). Washington, DC: American Psychological Association.

    Chapter  Google Scholar 

Download references

Acknowledgments

This research was supported by the German Federal Ministry of Education and Research (grant no. 01EB0131). The authors wish to thank Kelley Kucaba for her helpful comments on drafts of this article and the students of the winter class 2003 for their assistance with the study.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jennifer Nicolai.

Appendix

Appendix

  What impression did you get from this consultation? Please circle one number for each question

¼/SimplePara>

(2) Did the physician treat the patient as an equal partner?

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7

not equal

completely equal

¼/SimplePara>

(3) Did the physician show understanding of the patient’s point of view?

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7

no understanding

a lot of understanding

¼/SimplePara>

(4) Did the physician try to put him/herself in the position of the patient?

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7

not at all

a lot

¼/SimplePara>

(5) Did the physician show interest in the patient’s opinion?

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7

no interest

a lot of interest

¼/SimplePara>

(6) Did the physician put the patient under pressure?

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7

no pressure

a lot of pressure

¼/SimplePara>

(7) Did the physician “preach”?

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7

did not “preach”

“preached” a lot

¼/SimplePara>

(8) Did the physician admonish the patient?

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7

not at all

a lot

¼/SimplePara>

(9) Was the physician responsive to the patient?

1 - - 2 - - 3 - - 4 - - 5 - - 6 - - 7

not responsive

very responsive

Rights and permissions

Reprints and permissions

About this article

Cite this article

Nicolai, J., Demmel, R. & Hagen, J. Rating Scales for the Assessment of Empathic Communication in Medical Interviews (REM): Scale Development, Reliability, and Validity. J Clin Psychol Med Settings 14, 367–375 (2007). https://doi.org/10.1007/s10880-007-9081-8

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10880-007-9081-8

Keywords

Navigation