Abstract
Objective
Interactive educational tools are thought to convey material effectively. Audience Response Systems (ARSs), in particular, have been shown to improve written test scores in several residency fields but have not been previously reported in psychiatry. Such an approach may prove a valuable tool in improving test performance and medical knowledge.
Methods
Psychiatry residents were required to attend 12 90-min review sessions throughout the summer that utilized previous Psychiatry Residency In-Training Exam (PRITE) questions and an ARS to provide immediate feedback and a stimulus for discussion. Preparation for these sessions was either unsupervised (phase I) or involved a personalized reading program for residents who scored below the 50th percentile. Data were evaluated with ANOVA and unpaired 2-tail tests.
Results
Overall performance on the PRITE examination improved significantly as compared to pre-intervention controls (change in score 17.0 ± SD 16.6 vs 6.4 ± 12.6, P = 0.0068). The addition of a personalized reading program did not improve raw score performance significantly beyond the improvement seen with ARS alone but did slightly improve percentile rank and STD score.
Conclusions
Utilization of the interactive ARS may improve performance on PRITE examination for residents.
Similar content being viewed by others
References
The American College of Psychiatrists: http://www.acpsych.org/prite, accessed 11 November 2013.
Juul D, Schneidman BS, Sexson SB, Fernandez F, Beresin EV, Ebert MH, et al. Relationship between resident-in-training examination in psychiatry and subsequent certification examination performances. Acad Psychiatry. 2009;33(5):404–6.
Shiroma PR, Alarcon RD. Selection factors among international medical graduates and psychiatric residency performance. Acad Psychiatry. 2010;34(2):128–31.
Webb LC, Sexson S, Scully J, Reynolds 3rd CF, Shore MF. Training directors' opinions about the psychiatry resident in-training examination (PRITE). Am J Psychiatry. 1992;149(4):521–4.
Strauss GD, Yager J, Liston EH. A comparison of national and in-house examinations of psychiatric knowledge. Am J Psychiatry. 1984;141(7):882–4.
Accreditation Council for Graduate Medical Education and the American Board of Psychiatry and Neurology. The psychiatry milestone project (draft). April 2013 http://www.acgme.org/acgmeweb/Portals/0/PDFs/Milestones/PsychiatryMilestones.pdf.
Krain LP. "It's high-tech, but is it better?": applications of technology in psychiatry education. Acad Psychiatry. 2007;31(1):40–9 (Erratum in: Acad Psychiatry 2007;31(2):172. Bostwick JM [removed]; Sampson S [removed]).
Gorrindo T, Baer L, Sanders KM, Birnbaum RJ, Fromson JA, Sutton-Skinner KM, et al. Web-based simulation in psychiatry residency training: a pilot study. Acad Psychiatry. 2011;35(4):232–7.
Rohrbaugh R, Federman DG, Borysiuk L, Sernyak M. Utilizing VA information technology to develop psychiatric resident prescription profiles. Acad Psychiatry. 2009;33(1):27–30.
Boscardin C, Penuel W. Exploring benefits of audience-response systems on learning: a review of the literature. Acad Psychiatry. 2012;36:401–7.
Nelson C, Hartling L, Campbell S, Oswald AE. The effects of audience response systems on learning outcomes in health professions education. A BEME systematic review: BEME Guide No. 21. Med Teach. 2012;34:386–405.
Schackow TE, Chavez M, Loya L, Friedman M. Audience response systems = effect on learning in family medicine residents. Fam Med. 2004;36(7):496–504.
Pradhan A, Sparano D, Ananth CV. The influence of audience response system on knowledge retention: an application to resident education. Am J Obstet Gynecol. 2005;193(5):1827–30.
Woodman C, Schultz SK. Faculty assessment of residents and the psychiatry resident in-training examination: is there a correlation? Acad Psychiatry. 1999;23:137–41.
Smeltzer DJ, Jones JA. Reliability and validity of the psychiatry in-training examination. Acad Psychiatry. 1990;14:115–21.
Disclosure
This study did not receive any extramural funding. Dr. El-Mallakh is a speaker and receives honoraria from AstraZeneca, Sunovion, and Otsuka. The other authors do not have any disclosures.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Hettinger, A., Spurgeon, J., El-Mallakh, R. et al. Using Audience Response System Technology and PRITE Questions to Improve Psychiatric Residents’ Medical Knowledge. Acad Psychiatry 38, 205–208 (2014). https://doi.org/10.1007/s40596-014-0058-2
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s40596-014-0058-2