Validating Measures of Third Year Medical Students’ Use of Interpreters by Standardized Patients and Faculty Observers
Increasing prevalence of limited English proficiency patient encounters demands effective use of interpreters. Validated measures for this skill are needed.
We describe the process of creating and validating two new measures for rating student skills for interpreter use.
Encounters using standardized patients (SPs) and interpreters within a clinical practice examination (CPX) at one medical school.
Students were assessed by SPs using the interpreter impact rating scale (IIRS) and the physician patient interaction (PPI) scale. A subset of 23 encounters was assessed by 4 faculty raters using the faculty observer rating scale (FORS). Internal consistency reliability was assessed by Cronbach’s coefficient alpha (α). Interrater reliability of the FORS was examined by the intraclass correlation coefficient (ICC). The FORS and IIRS were compared and each was correlated with the PPI.
Cronbach’s α was 0.90 for the 7-item IIRS and 0.88 for the 11-item FORS. ICC among 4 faculty observers had a mean of 0.61 and median of 0.65 (0.20, 0.86). Skill measured by the IIRS did not significantly correlate with FORS but correlated with the PPI.
We developed two measures with good internal reliability for use by SPs and faculty observers. More research is needed to clarify the reasons for the lack of concordance between these measures and which may be more valid for use as a summative assessment measure.
- Betancourt, JR (2003) Cross-cultural medical education: conceptual approaches and frameworks for evaluation. Acad Med 78: pp. 560-569 CrossRef
- Flores, G, Gee, D, Kastner, B (2001) The teaching of cultural issues in U.S. and Canadian medical schools. Acad Med 75: pp. 451-455 CrossRef
- American Association of Medical Colleges. Tool for Assessing Cultural Competence Training (TACCT). http://www.aamc.org/meded/tacct/start.htm. Accessed on August 6, 2007.
- Romero, CM (2004) Using medical interpreters. Am Fam Phys 69: pp. 2720-2722
- Karliner, LS, Perez-Stable, EJ, Gildengorin, G (2004) The language divide. The importance of training in the use of interpreters for outpatient practice. J Gen Intern Med 19: pp. 175-183 CrossRef
- Perez-Stable, EJ, Napoles-Springer, A (2000) Interpreters and communication in the clinical encounter. Am J Med 108: pp. 509-510 CrossRef
- McLeod, RP (1996) Your next patient does not speak English: translation and interpretation in today's busy office. Adv Pract Nurs Q 2: pp. 10-14
- Jacobs, EA, Shepard, DS, Suaya, JA, Stone, EL (2004) Overcoming language barriers in health care: costs and benefits of interpreter services. Am J Public Health 94: pp. 866-869 CrossRef
- Rivadeneyra, R, Elderkin-Thompson, V, Silver, RC, Waitzkin, H (2000) Patient centeredness in medical encounters requiring an interpreter. Am J Med 108: pp. 470-474 CrossRef
- Aranguri, C, Davidson, B, Ramirez, R (2006) Patterns of communication through interpreters: a detailed sociolinguistic analysis. J Gen Intern Med 21: pp. 623-669 CrossRef
- Fagan, MJ, Diaz, JA, Reinert, SE, Sciamanna, CN, Fagan, DM (2003) Impact of interpretation method on clinic visit length. J Gen Intern Med 18: pp. 634-638 CrossRef
- Tocher, TM, Larson, EB (1999) Do physicians spend more time with non-English-speaking patients?. J Gen Intern Med 14: pp. 303-309 CrossRef
- Kuo, D, Fagan, MJ (1999) Satisfaction with methods of Spanish interpretation in an ambulatory care clinic. J Gen Intern Med 14: pp. 547-550 CrossRef
- Lee, LJ, Batal, HA, Maselli, JH, Kutner, JS (2002) Effect of Spanish interpretation method on patient satisfaction in an urban walk-in clinic. J Gen Intern Med 17: pp. 641-645 CrossRef
- Zabar, S, Hanley, K, Kachur, E (2006) “Oh! She doesn’t speak English!” Assessing resident competence in managing linguistic and cultural barriers. J Gen Intern Med 21: pp. 510-513 CrossRef
- U.S. Department of Health and Human Services, Office of Minority Health. National standards of cultural and linguistically appropriate services in health care. 2000. http://www.omhrc.gov/templates/content.aspx?ID=87. Accessed August 6, 2008.
- Hudelson, P (2005) Improving patient–provider communication: insights from interpreters. Fam Pract 22: pp. 311-316 CrossRef
- Kaufert, JM, Putsch, RW (1997) Communication through interpreters in healthcare: ethical dilemmas arising from differences in class, culture, language, and power. J Clin Ethics 8: pp. 71-87
- Flores, G (2005) The impact of medical interpreter services on the quality of health care: a systematic review. Med Care Res Rev 62: pp. 255-299 CrossRef
- Makoul, G (2001) Essential elements of communication in medical encounters: the Kalamazoo consensus statement. Acad Med 76: pp. 390-393 CrossRef
- U.S. Census Bureau. R1603. Percent of people 5 years and over who speak English less than “very well”: 2004. Places within United States. Ranking table. Data set: 2004 American Community Survey. Available at: http://factfinder.census.gov/home/saff/main.html?_lang=en&_ts. Accessed August 6, 2007.
- Williams, RG (2004) Have standardized patient examinations stood the test of time and experience?. Teach Learn Med 16: pp. 215-222 CrossRef
- Rose, M, Wilkerson, L (2001) Widening the lens on standardized patient assessment: what the encounter can reveal about the development of clinical competence. Acad Med 76: pp. 856-859 CrossRef
- Saba, GW, Wong, ST, Schillinger, D (2006) Shared decision making and the experience of partnership in primary care. Ann Fam Med 4: pp. 54-62 CrossRef
- Fernandez, A, Wang, F, Braveman, M, Finkas, LK, Hauer, KE (2007) Impact of student ethnicity and primary childhood language on communication skill assessment in a clinical performance examination. J Gen Intern Med 22: pp. 1155-1160 CrossRef
- Speroff, T, O’Connor, GT (2004) Study designs for PDSA quality improvement research. Qual Manag Health Care 13: pp. 17-32
- Shin HB, Bruno R. Language use and English-speaking ability. United States Census, 2000: 1–3, http://www.census.gov/prod/2003pubs/c2kbr-29.pdf. Accessed August 6, 2007.
- Civil Rights Act of 1964, http://usinfo.state.gov/usa/infousa/laws/majorlaw/civilr19.htm, July 2, 1964, Document Number PL 88-352, 88th Congress, H. R. 7152. Accessed August 6, 2007.
- Grubbs, V, Chen, AH, Bindman, AB, Vittinghoff, E, Fernandez, A (2006) Effect of awareness of language law on language access in the health care setting. J Gen Intern Med 21: pp. 683-688 CrossRef
- Validating Measures of Third Year Medical Students’ Use of Interpreters by Standardized Patients and Faculty Observers
- Open Access
- Available under Open Access This content is freely available online to anyone, anywhere at any time.
Journal of General Internal Medicine
Volume 22, Issue 2 Supplement, pp 336-340
- Cover Date
- Print ISSN
- Online ISSN
- Additional Links
- interpreter use
- evaluation of skills
- Industry Sectors
- Author Affiliations
- 1. University of California, Irvine School of Medicine, Irvine, CA, USA
- 3. Department of Family Medicine, 101 The City Drive South, Building 200, Rt 81, Room 512, Orange, CA, 92868, USA
- 2. Stanford University School of Medicine, Stanford, CA, USA