Abstract
The feasibility of implicitly assessing medical student burnout was explored, using the Implicit Relational Assessment Procedure (IRAP), to measure longitudinal student burnout over the first two years of medical school and directly comparing it with an existing explicit measure of burnout (Maslach Burnout Inventory; MBI). Three successive cohorts of medical students completed both implicit and explicit measures of burnout at several time points during their first two years of medical school. Both assessments were conducted via the internet within a one-week period during the first week of medical school, the end of the first year of medical school, and the end of the second year, though not all cohorts were able to complete the assessments at all time points. Mixed linear models were used to compare the two measures directly, as well as to evaluate changes over time in each measure separately. Minimal correspondence was observed between the implicit and explicit measures of burnout on a within-subject basis. However, when analyzed separately, all subscales of both measures detected significant change over time in the direction of greater levels of burnout, particularly during the first year of medical school. These results provide preliminary evidence the IRAP is able to assess implicit attitudes related to burnout among medical students, though additional research is needed. The IRAP detected consistent improvements in positive implicit attitudes toward medical training during students’ second year of medical school, which was not detected by the MBI. Possible implications of these findings are discussed.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Baker, T. K., Smith, G. S., Jacobs, N. N., Houmanfar, R., Tolles, R., Kuhls, D., & Piasecki, M. (2017). A deeper look at implicit weight bias in medical students. Advances in Health Sciences Education, 22(4), 889–900
Barnes-Holmes, D., Barnes-Holmes, Y., Stewart, I., & Boles, S. (2010). A sketch of the Implicit Relational Assessment Procedure (IRAP) and the relational elaboration and coherence (REC) model. The Psychological Record, 60(3), 527–542
Drake, C. E., Codd, R. T. III, & Terry, C. (2018). Assessing the validity of implicit and explicit measures of stigma toward clients with substance use disorders among mental health practitioners. Journal of Contextual Behavioral Science, 8, 44–54
Dyrbye, L. N., & Shanafelt, T. D. (2016). A narrative review on burnout experienced by medical students and residents. Medical Education, 50(1), 132–149
Dyrbye, L. N., West, C. P., Satele, D., Boone, S., Tan, L., Sloan, J., & Shanafelt, T. D. (2014). Burnout among U.S. medical students, residents, and early career physicians relative to the general U.S. population. Academic Medicine, 89(3), 443–451
Dyrbye, L. N., Eacker, A., Durning, S. J., et al. (2015). The impact of stigma and personal experiences on the help-seeking behaviors of medical students with burnout. Academic Medicine, 90(7), 961–969
Eckleberry-Hunt, J., Kirkpatrick, H., & Barbera, T. (2018). The problems with burnout research. Academic Medicine, 93(3), 367–370
Elkins, C., Plante, K. P., Germain, L. J., & Morley, C. P. (2017). Burnout and depression in MS1 and MS3 years: A comparison of cohorts at one medical school. Family Medicine, 49(6), 1–4
Green, A. R., Carney, D. R., Pallin, D. J., et al. (2007). Implicit bias among physicians and its prediction of thrombolysis decisions for black and white patients. Journal of General Internal Medicine, 22(9), 1231–1238
Greenwald, A. G., Nosek, B. A., & Banaji, M. R. (2003). Understanding and using the implicit association test: I. An improved scoring algorithm. Journal of Personality and Social Psychology, 85(2), 197–216
Haider, A. H., Schneider, E. B., Sriram, N., et al. (2015). Unconscious race and social class bias among acute care surgical clinicians and clinical treatment decisions. JAMA Surgery, 150(5), 457–464
Hox, J. J. (2010). Multilevel analysis: Techniques and applications (2nd ed.). Routledge
Juarascio, A. S., Forman, E. M., Timko, C. A., Herbert, J. D., Butryn, M., & Lowe, M. (2011). Implicit internalization of the thin ideal as a predictor of increases in weight, body dissatisfaction, and disordered eating. Eating Behaviors, 12, 207–213
Kumar, S. (2016). Burnout and doctors: Prevalence, prevention, and intervention. Healthcare (Basel), 4(3), 37. DOI https://doi.org/10.3390/healthcare4030037
Leech, A., Barnes-Holmes, D., & Madden, L. (2016). The Implicit Relational Assessment Procedure (IRAP) as a measure of spider fear, avoidance, and approach. The Psychological Record, 66, 337–349
Leech, A., Barnes-Holmes, D., & McEnteggart, C. (2017). Spider fear and avoidance: A preliminary study of the impact of two verbal rehearsal tasks on a behavior-behavior relation and its implications for an experimental analysis of defusion. The Psychological Record, 67, 387–398
Levin, M. E., Haeger, J., & Smith, G. S. (2016). Examining the role of implicit emotional judgments in social anxiety and experiential avoidance. Journal of Psychopathology and Behavioral Assessment, 39(2), 264–278
Maslach, C., Jackson, S. E., & Leiter, M. P. (1996). Maslach Burnout Inventory Manual (3rd ed.). Palo Alto, CA: Consulting Psychologist Press
Melnikoff, D. E., & Bailey, A. H. (2018). Preferences for moral vs. immoral traits in others are conditional. Proceedings of the National Academy of Sciences of the United States of America, 115(4), E592–E600
Miller, D. P., Jr, Spangler, J. G., Vitolins, M. Z., Davis, S. W., Ip, E. H., Marion, G. S., & Crandall, S. J. (2013). Are medical students aware of their anti-obesity bias? Academic Medicine, 88(7), 978–982
Nicholson, E., & Barnes-Holmes, D. (2012). The Implicit Relational Assessment Procedure (IRAP) as a measure of spider fear. The Psychological Record, 62, 263–278
Nicholson, E., Dempsey, K., & Barnes-Holmes, D. (2014). The role of responsibility and threat appraisals in contamination fear and obsessive-compulsive tendencies at the implicit level. Journal of Contextual Behavioral Science, 3, 31–37
Rotenstein, L. S., Torre, M., Ramos, M. A., Rosales, R. C., Guille, C., Sen, S., & Mata, D. A. (2018). Prevalence of burnout among physicians: A systematic review. Journal of the American Medical Association, 320(11), 1131–1150
Schwenk, T. L. (2018). Physician well-being and the regenerative power of caring. Journal of the American Medical Association, 319(15), 1543–1544
Schwenk, T. L., Davis, L., & Wimsatt, L. A. (2010). Depression, stigma, and suicidal ideation in medical students. Journal of the American Medical Association, 304(11), 1181–1190
Shanafelt, T. D., Bradley, K. A., Wipf, J. E., & Back, A. L. (2002). Burnout and self-reported patient care in an internal medicine residency program. Annals of Internal Medicine, 136(5), 358–367
Smith, G. S. (2013). Exploring the predictive utility of IRAP with respect to performance in organizations. Unpublished doctoral dissertation. University of Nevada, Reno, Reno, NV
Tawfik, D. S., Profit, J., Morganthaler, T. I., et al. (2018). Physician burnout, well-being, and work unit safety grades in relationship to reported medical errors. Mayo Clinic Proceedings, 93(11), 1571-1580. DOI:https://doi.org/10.1016/j.mayocp.2018.05.014
Thomas, L. R., Ripp, J. A., & West, C. P. (2018). Charter on physician well-being. Journal of the American Medical Association, 319(15), 1541–1542
Acknowledgements
The authors wish to thank Maliha S. Nash, Ph.D., research statistician for US EPA, for her assistance with statistical analyses.
Funding
None.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Other disclosures
None.
Conflict of interest
The authors declare that they have no conflict of interest.
Ethics approval
Ethical approval has been granted by the University of Nevada, Reno’s Institutional Review Board on January 24, 2014, reference number 508850-18.
Consent to participate
Informed consent was obtained from all individual participants included in the study.
Disclaimers
None.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Smith, G.S., Houmanfar, R.A., Jacobs, N.N. et al. Assessment of medical student burnout: toward an implicit measure to address current issues. Adv in Health Sci Educ 27, 375–386 (2022). https://doi.org/10.1007/s10459-021-10089-0
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10459-021-10089-0