Abstract
Objective
In the context of an educational program on schizophrenia for psychiatry trainees, this survey study analyzed associations between self-reported training adequacy, experience in providing patient care, and comfort level in performing schizophrenia-related clinical skills. The influence of the education on comfort level was also assessed for each skill.
Methods
Survey respondents were psychiatry residents and fellows who participated in a schizophrenia education program at an in-person workshop or through online videos recorded at the workshop. In a pre-program survey, participants reported their experience in providing schizophrenia patient care and rated their training adequacy and comfort level for performing seven clinical skills involved in diagnosing and treating schizophrenia. The post-program survey included items for reassessing comfort level in performing the skills.
Results
Across the seven clinical skills, the proportion of respondents (n = 79) who agreed or strongly agreed that their training was adequate ranged from 29 to 88 %. The proportion of high ratings for comfort level in skill performance ranged from 45 to 83 %. Comfort level was significantly associated with training adequacy for all seven clinical skills and with experience in providing patient care for four skills. For all skills, comfort level ratings were significantly higher after versus before the educational workshop. Commonly indicated needs for further training included education on new therapies, exposure to a broader range of patients, and opportunities for longitudinal patient management.
Conclusions
Psychiatry trainees’ self-reported, disease-specific training adequacy, experiences, and comfort level have unique applications for developing and evaluating graduate medical curriculum.
References
Crawford A, Sunderji N, López J, Soklaridis S. Defining competencies for the practice of telepsychiatry through an assessment of resident learning needs. BMC Med Educ. 2016;16:28.
Jain S, Lapid MI, Dunn LB, Roberts LW. Psychiatric residents’ needs for education about informed consent, principles of ethics and professionalism, and caring for vulnerable populations: results of a multisite survey. Acad Psychiatry. 2011;35:184–90.
Munshi A, Woods N, Hodges B. Psychiatry, war, and the learning needs of residents. Acad Psychiatry. 2010;34:208–10.
Sockalingam S, Hawa R, Al-Battran M, Abbey SE, Zaretsky A. Preparing international medical graduates for psychiatry residency: a multi-site needs assessment. Acad Psychiatry. 2012;36:277–81.
Nasca TJ, Philibert I, Brigham T, Flynn TC. The next GME accreditation system—rationale and benefits. N Engl J Med. 2012;366:1051–6.
Accreditation Council for Graduate Medical Education. The Psychiatry Milestone Project. Available at: https://www.acgme.org/acgmeweb/Portals/0/PDFs/Milestones/PsychiatryMilestones.pdf. Accessed April 19, 2015.
Thomas CR. Introduction and commentary on the psychiatry milestones. Acad Psychiatry. 2014;38:253–4.
Hunt J, Thomas CR. ACGME milestone development in general psychiatry: patient care and medical knowledge. Acad Psychiatry. 2014;38:261–7.
Swing SR, Cowley DS, Bentman A. Assessing resident performance on the psychiatry milestones. Acad Psychiatry. 2014;38:294–302.
Davis DA, Mazmanian PE, Fordis M, et al. Accuracy of physician self-assessment compared with observed measures of competence: a systematic review. JAMA. 2006;296:1094.
Anderson PA. Giving feedback on clinical skills: are we starving our young? J Grad Med Educ. 2012;4:154–8.
Bradley KE, Andolsek KM. A pilot study of orthopaedic resident self-assessment using a milestones’ survey just prior to milestones implementation. Int J Med Educ. 2016;7:11–8.
Goldflam K, Bod J, Della-Giustina D, Tsyrulnik A. Emergency medicine residents consistently rate themselves higher than attending assessments on ACGME milestones. West J Emerg Med. 2015;16:931–5.
Alameddine MB, Claflin J, Scally CP, et al. Resident surgeons underrate their laparoscopic skills and comfort level when compared with the rating by attending surgeons. J Surg Educ. 2015;72:1240–6.
Lynn DJ, Holzer C, O’Neill P. Relationships between self-assessment skills, test performance, and demographic variables in psychiatry residents. Adv Health Sci Educ Theory Pract. 2006;11:51–60.
Sargeant J, Armson H, Chesluk B, et al. The processes and dimensions of informed self-assessment. Acad Med. 2010;85:1212–20.
Bounds R, Bush C, Aghera A, et al. MERC at CORD Feedback Study Group. Emergency medicine residents’ self-assessments play a critical role when receiving feedback. Acad Emerg Med. 2013;20:1055–61.
Suwanabol PA, McDonald R, Foley E, Weber SM. Is surgical resident comfort level associated with experience? J Surg Res. 2009;156:240–4.
Marel GM, Lyon PM, Barnsley L, et al. Clinical skills in early postgraduate medical trainees: patterns of acquisition of confidence and experience among junior doctors in a university teaching hospital. Med Educ. 2000;34:1013.
Hsieh E, Nunez-Smith M, Henrich JB. Needs and priorities in women’s health training: perspectives from an internal medicine residency program. J Womens Health (Larchmt). 2013;22:667–72.
Acknowledgments
The authors acknowledge Jeffrey Carter for contributing to the analysis of the project data.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
The study methods were reviewed by an independent institutional review board (Sterling IRB, Atlanta, GA; IRB ID# 5507), which granted exempt status.
Disclosures
The authors are employees of, or academic educators/consultants to, PRIME Education, Inc., a health care education company that received an independent continuing medical education (CME) grant from Otsuka America Pharmaceutical, Inc. and Lundbeck to conduct the educational program described in this article. Otsuka America Pharmaceutical, Inc. and Lundbeck had no role in the study design or execution, and the grant did not include support for conducting the surveys or writing this manuscript.
Rights and permissions
About this article
Cite this article
Greene, L., Moreo, K., Nasrallah, H. et al. Self-Reported Training Adequacy, Experience, and Comfort Level in Performing Schizophrenia-Related Clinical Skills among Psychiatry Residents and Fellows. Acad Psychiatry 41, 497–502 (2017). https://doi.org/10.1007/s40596-016-0612-1
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s40596-016-0612-1