Abstract
Objectives
Although clinical reasoning is a major component of psychiatric training, most evaluating tools do not assess this skill properly. Clinicians mobilize networks of organized knowledge (scripts) to assess ambiguous or uncertain situations. The Script Concordance Test (SCT) was developed to assess clinical reasoning in an uncertainty context. The objective of this study was to test the usefulness of the SCT to assess the reasoning capacities of interns (7th year medical students) during the psychiatry training.
Methods
The authors designed a SCT for psychiatry teaching, adapted to interns. The test contained 20 vignettes of five questions each. A reference panel of senior psychiatrists underwent the test, and we used their scoring as a reference for the student group. The SCT assessed the competence of students at the beginning and the end of their training in psychiatry.
Results
A panel of 10 psychiatrists and 47 interns participated to this study. As expected, the reference panel performed significantly (p<0.001) better (79.4±5.1) than the students on the SCT. Interns improved significantly (p<0.001) their scores between the beginning (58.5±6.2) and the end (65.0±5.3) of their psychiatry rotation. The students improved significantly (p<0.001) their scores between the beginning and the end of the training (6.4±4.8).
Conclusions
This is the first study using the SCT in psychiatry. This study shows the feasibility of this procedure and its utility in the field of psychiatry for evaluating medical students in their clinical reasoning competence. It can provide a valid alternative to classical evaluation methods.
References
Charlin B, Roy L, Brailovsky C, Goulet F, van der Vleuten C. The script concordance test: a tool to assess the reflective clinician. Teach Learn Med. 2000;12(4):189–95.
Fournier JP, Thiercelin D, Pulcini C, et al. Evaluation du raisonnement clinique en medicine d’urgence: les tests de concordance de script décèlent mieux l’expérience que les questions a choix multiples a contexte riche. Pédagogie Médicale. 2006;7:20–30.
Bursztejn AC, Cuny JF, Adam JL, Sido L, Schmutz JL, de Korwin JD, et al. Usefulness of the script concordance test in dermatology. J Eur Acad Dermatol Venereol. 2011;25(12):1471–5.
Lambert C, Gagnon R, Nguyen D, et al. The script concordance test in radiation oncology: validation study of a new tool to assess clinical reasoning. Radiat Oncol. 2009;4:7.
Fournier JP, Demeester A, Charlin B. Script concordance tests: guidelines for construction. BMC Med Inform Decis Making. 2008;8:18.
Charlin B, Gagnon R, Sibert L, et al. Le test de concordance de script, un instrument d’évaluation du raisonnement clinique. Pédagogie Médicale. 2002;3:135–44.
Richa S, Baladi A, Kesrouani A, Baddoura C. Teaching psychiatry for fifth-year medical students at Saint-Joseph University, Beirut: evaluation of the four-step method. Acad Psychiatry. 2009;33(4):344–5.
LaDuca A. Validation of professional licensure examinations: profession, theory, test design and construct validity. Eval Health Prof. 1994;17:178–97.
Haddad FG, Gaspard D, Nasr M, Abou Jaoude S, Nemr E. Etude exploratoire de l’utilisation du test de concordance de script pour l’évaluation des apprentissages de résidents de médecine interne au Liban. Pédagogie Médicale. 2008;3:135–40.
Lineberry M, Kreiter CD, Bordage G. Threats to validity in the use and interpretation of script concordance test scores. Med Educ. 2013;47(12):1175–83.
See KC, Tan KL, Lim TK. The script concordance test for clinical reasoning: re-examining its utility and potential weakness. Med Educ. 2014;48(11):1069–77.
Lebanese Psychiatric Society. Retrieved on December 12, 2015 from : http://www.lpsonline.org/psychiatrists-psychiatres/.
Acknowledgments
The authors are grateful to the Psychiatric Hospital of the Cross for providing the training field for students who participated to this study.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Disclosures
On behalf of all authors, the corresponding author states that there is no conflict of interest.
Rights and permissions
About this article
Cite this article
Kazour, F., Richa, S., Zoghbi, M. et al. Using the Script Concordance Test to Evaluate Clinical Reasoning Skills in Psychiatry. Acad Psychiatry 41, 86–90 (2017). https://doi.org/10.1007/s40596-016-0539-6
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s40596-016-0539-6