Assessing the Culture of Residency Using the C - Change Resident Survey: Validity Evidence in 34 U.S. Residency Programs
A practical instrument is needed to reliably measure the clinical learning environment and professionalism for residents.
To develop and present evidence of validity of an instrument to assess the culture of residency programs and the clinical learning environment.
During 2014–2015, we surveyed residents using the C - Change Resident Survey to assess residents’ perceptions of the culture in their programs.
Residents in all years of training in 34 programs in internal medicine, pediatrics, and general surgery in 14 geographically diverse public and private academic health systems.
The C - Change Resident Survey assessed residents’ perceptions of 13 dimensions of the culture: Vitality, Self-Efficacy, Institutional Support, Relationships/Inclusion, Values Alignment, Ethical/Moral Distress, Respect, Mentoring, Work–Life Integration, Gender Equity, Racial/Ethnic Minority Equity, and self-assessed Competencies. We measured the internal reliability of each of the 13 dimensions and evaluated response process, content validity, and construct-related evidence validity by assessing relationships predicted by our conceptual model and prior research. We also assessed whether the measurements were sensitive to differences in specialty and across institutions.
A total of 1708 residents completed the survey [internal medicine: n = 956, pediatrics: n = 411, general surgery: n = 311 (51% women; 16% underrepresented in medicine minority)], with a response rate of 70% (range across programs, 51–87%). Internal consistency of each dimension was high (Cronbach α: 0.73–0.90). The instrument was able to detect significant differences in the learning environment across programs and sites. Evidence of validity was supported by a good response process and the demonstration of several relationships predicted by our conceptual model.
The C - Change Resident Survey assesses the clinical learning environment for residents, and we encourage further study of validity in different contexts. Results could be used to facilitate and monitor improvements in the clinical learning environment and resident well-being.
KEY WORDSresidents culture of medicine clinical learning environment quantitative survey resident well-being
- 1.Leach DC. Changing education to improve patient care. Qualitative Health Care. 2001;10(II suppl):54–58.Google Scholar
- 3.Nasca TJ. Aug. 23, 2016. https://www.acgme.org/Portals/0/PDFs/Nasca-Community/August2016NascaLettertoCommunity.pdf (accessed February 17, 2017).
- 5.ACGME Outcomes Project: General Competencies. Accreditation Council for Graduate Medical Education. Chicago, IL; 1999.Google Scholar
- 11.Maslach C, Jackson SE, Leiter MP. Maslach burnout inventory manual. 3rd ed. Palo Alto, CA: Consulting Psychologists Press; 1996.Google Scholar
- 13.Senge P. The fifth discipline: the art and practice of the learning organization. New York: Currency and Doubleday; 1990.Google Scholar
- 16.Weiss KB, Wagner R, Nasca T. Development, Testing and implementation of the ACGME Clinical Learning Environment Review (CLER) Program. J of Grad Med Educ. 2012;396-398.Google Scholar
- 18.Kohn LT, Corrigan JM, Donaldson MS. To Err Is Human: Building a Safer Health System. Institute of Medicine (IOM). Washington, D.C.: National Academies Press; 2000.Google Scholar
- 19.National Initiative on Gender, Culture and Leadership in Medicine (C-Change). www.brandeis.edu/cchange/. (accessed 17 February, 2017).
- 21.Pololi LH, Krupat E, Civian JT, Ash AS, Brennan RT. Why are a quarter of faculty considering leaving academic medicine? A study of their perceptions of institutional cultural and intention to leave in 26 representative medical schools. Acad Med. 2012;89:859–869.Google Scholar
- 32.Fredrickson BL. Love 2.0. New York, NY: Hudson Street Press/Penguin; 2013.Google Scholar
- 34.Through the Eyes of the Workforce: Creating Joy, Meaning, and Safer Health Care. Lucian Leape Institute. Boston, MA: National Patient Safety Foundation; 2013.Google Scholar
- 41.Edmunds LD, Ovseiko PV, Shepperd S, Greenhalgh T, Frith P, Roberts NW, Pololi LH, Buchan AM. Why do women choose or reject careers in academic medicine? A narrative review of empirical evidence. Lancet. 2016.Google Scholar