Abstract
Objective
Simulations are used extensively in medicine to train clinicians to manage high-risk situations. However, to our knowledge, no studies have determined whether this is an effective means of teaching residents to manage acutely agitated patients. This study aimed to determine whether simulation-based training in the management of acute agitation improves resident knowledge and performance, as compared to didactic-based instruction.
Methods
Following a standard lecture on the management of agitated patients, first-year psychiatry residents were randomized (in clusters of three to four residents) to either the intervention (n = 15) or control arm (n = 11). Residents in the intervention arm then received simulation-based training on the management of acute agitation using a scenario with an agitated standardized patient. Those in the control arm received simulation-based training on a clinical topic unrelated to the management of agitation using a scenario with a non-agitated standardized patient who had suffered a fall. Baseline confidence and knowledge were assessed using pre-intervention self-assessment questionnaires and open-ended clinical case vignettes. Efficacy of the intervention as a teaching tool was assessed with post-intervention open-ended clinical case vignettes and videotaped simulation-based assessment, using a different scenario of an agitated standardized patient.
Results
Residents who received the agitation simulation-based training showed significantly greater improvement in knowledge (intervention = 3.0 vs. control = 0.3, p = 0.007, Cohen’s d = 1.2) and performance (intervention = 39.6 vs control = 32.5, p = 0.001, Cohen’s d = 1.6). Change in self-perceived confidence did not differ significantly between groups.
Conclusions
In this study, simulation-based training appeared to be more effective at teaching knowledge and skills necessary for the management of acutely agitated patients, as compared to didactic-based instruction alone. Subjective evaluations of confidence in these skills did not improve significantly compared to controls, corroborating the need for using objective outcome measures when assessing simulation-based training.
This is a preview of subscription content, log in via an institution to check access.
References
Mason J, Irani T, Fountoulaki F, Warwick S, Davis J, Sudbury P. Psychiatry at night: experience of the senior house officer. Psychiatr Bull. 2006;30:329–33.
Rakhmatullina M, Taub A, Jacob T. Morbidity and mortality associated with the utilization of restraints: a review of literature. Psychiatry Q. 2013;84:499–512.
Dvir Y, Moniwa E, Crisp-Han H, Levy D, Coverdale JH. Survey of threats and assaults by patients on psychiatry residents. Acad Psychiatry. 2012;36(1):39–42.
Bradley P. The history of simulation in medical education and possible future directions. Med Educ. 2006;40(3):254–62.
Cook DA, Brydges R, Hamstra SJ, Zendejas B, Szostek JH, Wang AT, et al. Comparative effectiveness of technology-enhanced simulation versus other instructional methods: a systematic review and meta-analysis. Simul Healthc. 2012;7(5):308–20.
Brenner AM. Uses and limitations of simulated patients in psychiatric education. Acad Psychiatry. 2009;33(2):112–9.
Goldfarb E; Gorrindo T. Simulation in psychiatry. In: Levine A, editor. The Comprehensive Textbook of Healthcare Simulation. New York: Springer Science and Business Media 2013. p. 511–23.
McNaughton N, Ravitz P, Wadell A, Hodges BD. Psychiatric education and simulation: a review of the literature. Can J Psychiatry / La Rev Can Psychiatrie. 2008;53(2):85–93.
Thomson AB, Cross S, Key S, Jaye P, Iversen AC. How we developed an emergency psychiatry training course for new residents using principles of high-fidelity simulation. Med Teach. 2013;35(10):797–800.
Zigman D, Young M, Chalk C. Using simulation to train junior psychiatry residents to work with agitated patients: a pilot study. Acad Psychiatry. 2013;37(1):38–41.
Miller GE. The assessment of clinical skills/competence/performance. Acad Med. 1990;65(9 Suppl):S63–7.
Holloman Jr GH, Zeller SL. Overview of Project BETA: best practices in evaluation and treatment of agitation. West J Emerg Med. 2012;13(1):1–2.
Knox DK, Holloman Jr GH. Use and avoidance of seclusion and restraint: consensus statement of the American Association for Emergency Psychiatry Project Beta Seclusion and Restraint Workgroup. West J Emerg Med. 2012;13(1):35–40.
Nordstrom K, Zun LS, Wilson MP, Md VS, Ng AT, Bregman B, et al. Medical evaluation and triage of the agitated patient: consensus statement of the American Association for Emergency Psychiatry Project Beta Medical Evaluation Workgroup. West J Emerg Med. 2012;13(1):3–10.
Richmond JS, Berlin JS, Fishkind AB, Holloman Jr GH, Zeller SL, Wilson MP, et al. Verbal de-escalation of the agitated patient: consensus statement of the American Association for Emergency Psychiatry Project BETA De-escalation Workgroup. West J Emerg Med. 2012;13(1):17–25.
Stowell KR, Florence P, Harman HJ, Glick RL. Psychiatric evaluation of the agitated patient: consensus statement of the American Association for Emergency Psychiatry Project Beta Psychiatric Evaluation Workgroup. West J Emerg Med. 2012;13(1):11–6.
Wilson MP, Pepper D, Currier GW, Holloman Jr GH, Feifel D. The psychopharmacology of agitation: consensus statement of the American Association for Emergency Psychiatry Project Beta Psychopharmacology Workgroup. West J Emerg Med. 2012;13(1):26–34.
Huffman JC, Freudenreich O, Romeo S, Baer L, Sutton-Skinner K, Petersen T, et al. Assessing clinicians’ management of first episode schizophrenia using clinical case vignettes. Early Interv Psychiatry. 2010;4(1):31–8.
Peabody JW, Luck J, Glassman P, Dresselhaus TR, Lee M. Comparison of vignettes, standardized patients, and chart abstraction: a prospective validation study of 3 methods for measuring quality. JAMA. 2000;283(13):1715–22.
Peabody JW, Luck J, Glassman P, Jain S, Hansen J, Spell M, et al. Measuring the quality of physician practice by using clinical vignettes: a prospective validation study. Ann Intern Med. 2004;141(10):771–80.
McKinley RK, Strand J, Ward L, Gray T, Alun-Jones T, Miller H. Checklists for assessment and certification of clinical procedural skills omit essential competencies: a systematic review. Med Educ. 2008;42(4):338–49.
Regehr G, MacRae H, Reznick RK, Szalay D. Comparing the psychometric properties of checklists and global rating scales for assessing performance on an OSCE-format examination. Acad Med. 1998;73(9):993–7.
Schuwirth LW, van der Vleuten CP. The use of clinical simulations in assessment. Med Educ. 2003;37 Suppl 1:65–71.
Ma IW, Zalunardo N, Pachev G, Beran T, Brown M, Hatala R, et al. Comparing the use of global rating scale with checklists for the assessment of central venous catheterization skills using simulation. Adv Health Sci Educ Theory Pract. 2012;17(4):457–70.
Weller JM, Bloch M, Young S, Maze M, Oyesola S, Wyner J, et al. Evaluation of high fidelity patient simulator in assessment of performance of anaesthetists. Br J Anaesth. 2003;90(1):43–7.
Cohen J. Statistical power analysis for the behavioral sciences. Hillsdale, NJ: Eribaum; 1988.
Kruger J, Dunning D. Unskilled and unaware of it: how difficulties in recognizing one’s own incompetence lead to inflated self-assessments. J Pers Soc Psychol. 1999;77(6):1121–34.
Srinivasan M, Hwang JC, West D, Yellowlees PM. Assessment of clinical skills using simulator technologies. Acad Psychiatry. 2006;30(6):505–15.
Acknowledgments
The authors wish to thank Jeanne McHale and Gail Alexander at the MGH Knight Simulation Center, as well as Quire Healthcare who consulted in the development of the open-ended case vignettes.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Disclosures
On behalf of all authors, the corresponding author states that there is no conflict of interest.
Disclosure of Funding
Grant support was provided by the Partners Centers of Expertise in Medical Education.
Electronic Supplementary Material
Below is the link to the electronic supplementary material.
ESM 1
(PDF 89 kb)
Rights and permissions
About this article
Cite this article
Vestal, H.S., Sowden, G., Nejad, S. et al. Simulation-Based Training for Residents in the Management of Acute Agitation: A Cluster Randomized Controlled Trial. Acad Psychiatry 41, 62–67 (2017). https://doi.org/10.1007/s40596-016-0559-2
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s40596-016-0559-2