Advertisement

Academic Psychiatry

, Volume 41, Issue 1, pp 86–90 | Cite as

Using the Script Concordance Test to Evaluate Clinical Reasoning Skills in Psychiatry

  • François KazourEmail author
  • Sami Richa
  • Marouan Zoghbi
  • Wissam El-Hage
  • Fady G. Haddad
In Brief Report

Abstract

Objectives

Although clinical reasoning is a major component of psychiatric training, most evaluating tools do not assess this skill properly. Clinicians mobilize networks of organized knowledge (scripts) to assess ambiguous or uncertain situations. The Script Concordance Test (SCT) was developed to assess clinical reasoning in an uncertainty context. The objective of this study was to test the usefulness of the SCT to assess the reasoning capacities of interns (7th year medical students) during the psychiatry training.

Methods

The authors designed a SCT for psychiatry teaching, adapted to interns. The test contained 20 vignettes of five questions each. A reference panel of senior psychiatrists underwent the test, and we used their scoring as a reference for the student group. The SCT assessed the competence of students at the beginning and the end of their training in psychiatry.

Results

A panel of 10 psychiatrists and 47 interns participated to this study. As expected, the reference panel performed significantly (p<0.001) better (79.4±5.1) than the students on the SCT. Interns improved significantly (p<0.001) their scores between the beginning (58.5±6.2) and the end (65.0±5.3) of their psychiatry rotation. The students improved significantly (p<0.001) their scores between the beginning and the end of the training (6.4±4.8).

Conclusions

This is the first study using the SCT in psychiatry. This study shows the feasibility of this procedure and its utility in the field of psychiatry for evaluating medical students in their clinical reasoning competence. It can provide a valid alternative to classical evaluation methods.

Keywords

Script concordance test Psychiatry Evaluation Reasoning Intern 

Notes

Acknowledgments

The authors are grateful to the Psychiatric Hospital of the Cross for providing the training field for students who participated to this study.

Compliance with Ethical Standards

Disclosures

On behalf of all authors, the corresponding author states that there is no conflict of interest.

References

  1. 1.
    Charlin B, Roy L, Brailovsky C, Goulet F, van der Vleuten C. The script concordance test: a tool to assess the reflective clinician. Teach Learn Med. 2000;12(4):189–95.CrossRefPubMedGoogle Scholar
  2. 2.
    Fournier JP, Thiercelin D, Pulcini C, et al. Evaluation du raisonnement clinique en medicine d’urgence: les tests de concordance de script décèlent mieux l’expérience que les questions a choix multiples a contexte riche. Pédagogie Médicale. 2006;7:20–30.CrossRefGoogle Scholar
  3. 3.
    Bursztejn AC, Cuny JF, Adam JL, Sido L, Schmutz JL, de Korwin JD, et al. Usefulness of the script concordance test in dermatology. J Eur Acad Dermatol Venereol. 2011;25(12):1471–5.CrossRefPubMedGoogle Scholar
  4. 4.
    Lambert C, Gagnon R, Nguyen D, et al. The script concordance test in radiation oncology: validation study of a new tool to assess clinical reasoning. Radiat Oncol. 2009;4:7.CrossRefPubMedPubMedCentralGoogle Scholar
  5. 5.
    Fournier JP, Demeester A, Charlin B. Script concordance tests: guidelines for construction. BMC Med Inform Decis Making. 2008;8:18.CrossRefGoogle Scholar
  6. 6.
    Charlin B, Gagnon R, Sibert L, et al. Le test de concordance de script, un instrument d’évaluation du raisonnement clinique. Pédagogie Médicale. 2002;3:135–44.CrossRefGoogle Scholar
  7. 7.
    Richa S, Baladi A, Kesrouani A, Baddoura C. Teaching psychiatry for fifth-year medical students at Saint-Joseph University, Beirut: evaluation of the four-step method. Acad Psychiatry. 2009;33(4):344–5.CrossRefPubMedGoogle Scholar
  8. 8.
    LaDuca A. Validation of professional licensure examinations: profession, theory, test design and construct validity. Eval Health Prof. 1994;17:178–97.CrossRefPubMedGoogle Scholar
  9. 9.
    Haddad FG, Gaspard D, Nasr M, Abou Jaoude S, Nemr E. Etude exploratoire de l’utilisation du test de concordance de script pour l’évaluation des apprentissages de résidents de médecine interne au Liban. Pédagogie Médicale. 2008;3:135–40.CrossRefGoogle Scholar
  10. 10.
    Lineberry M, Kreiter CD, Bordage G. Threats to validity in the use and interpretation of script concordance test scores. Med Educ. 2013;47(12):1175–83.CrossRefPubMedGoogle Scholar
  11. 11.
    See KC, Tan KL, Lim TK. The script concordance test for clinical reasoning: re-examining its utility and potential weakness. Med Educ. 2014;48(11):1069–77.CrossRefPubMedGoogle Scholar
  12. 12.
    Lebanese Psychiatric Society. Retrieved on December 12, 2015 from : http://www.lpsonline.org/psychiatrists-psychiatres/.

Copyright information

© Academic Psychiatry 2016

Authors and Affiliations

  • François Kazour
    • 1
    Email author
  • Sami Richa
    • 1
  • Marouan Zoghbi
    • 1
  • Wissam El-Hage
    • 2
  • Fady G. Haddad
    • 1
  1. 1.Faculty of MedicineSaint Joseph UniversityBeirutLebanon
  2. 2.Université François-Rabelais de Tours, Inserm UMR U930ToursFrance

Personalised recommendations