Skip to main content
Log in

Using the Script Concordance Test to Evaluate Clinical Reasoning Skills in Psychiatry

  • In Brief Report
  • Published:
Academic Psychiatry Aims and scope Submit manuscript

Abstract

Objectives

Although clinical reasoning is a major component of psychiatric training, most evaluating tools do not assess this skill properly. Clinicians mobilize networks of organized knowledge (scripts) to assess ambiguous or uncertain situations. The Script Concordance Test (SCT) was developed to assess clinical reasoning in an uncertainty context. The objective of this study was to test the usefulness of the SCT to assess the reasoning capacities of interns (7th year medical students) during the psychiatry training.

Methods

The authors designed a SCT for psychiatry teaching, adapted to interns. The test contained 20 vignettes of five questions each. A reference panel of senior psychiatrists underwent the test, and we used their scoring as a reference for the student group. The SCT assessed the competence of students at the beginning and the end of their training in psychiatry.

Results

A panel of 10 psychiatrists and 47 interns participated to this study. As expected, the reference panel performed significantly (p<0.001) better (79.4±5.1) than the students on the SCT. Interns improved significantly (p<0.001) their scores between the beginning (58.5±6.2) and the end (65.0±5.3) of their psychiatry rotation. The students improved significantly (p<0.001) their scores between the beginning and the end of the training (6.4±4.8).

Conclusions

This is the first study using the SCT in psychiatry. This study shows the feasibility of this procedure and its utility in the field of psychiatry for evaluating medical students in their clinical reasoning competence. It can provide a valid alternative to classical evaluation methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

References

  1. Charlin B, Roy L, Brailovsky C, Goulet F, van der Vleuten C. The script concordance test: a tool to assess the reflective clinician. Teach Learn Med. 2000;12(4):189–95.

    Article  CAS  PubMed  Google Scholar 

  2. Fournier JP, Thiercelin D, Pulcini C, et al. Evaluation du raisonnement clinique en medicine d’urgence: les tests de concordance de script décèlent mieux l’expérience que les questions a choix multiples a contexte riche. Pédagogie Médicale. 2006;7:20–30.

    Article  Google Scholar 

  3. Bursztejn AC, Cuny JF, Adam JL, Sido L, Schmutz JL, de Korwin JD, et al. Usefulness of the script concordance test in dermatology. J Eur Acad Dermatol Venereol. 2011;25(12):1471–5.

    Article  PubMed  Google Scholar 

  4. Lambert C, Gagnon R, Nguyen D, et al. The script concordance test in radiation oncology: validation study of a new tool to assess clinical reasoning. Radiat Oncol. 2009;4:7.

    Article  PubMed  PubMed Central  Google Scholar 

  5. Fournier JP, Demeester A, Charlin B. Script concordance tests: guidelines for construction. BMC Med Inform Decis Making. 2008;8:18.

    Article  Google Scholar 

  6. Charlin B, Gagnon R, Sibert L, et al. Le test de concordance de script, un instrument d’évaluation du raisonnement clinique. Pédagogie Médicale. 2002;3:135–44.

    Article  Google Scholar 

  7. Richa S, Baladi A, Kesrouani A, Baddoura C. Teaching psychiatry for fifth-year medical students at Saint-Joseph University, Beirut: evaluation of the four-step method. Acad Psychiatry. 2009;33(4):344–5.

    Article  PubMed  Google Scholar 

  8. LaDuca A. Validation of professional licensure examinations: profession, theory, test design and construct validity. Eval Health Prof. 1994;17:178–97.

    Article  CAS  PubMed  Google Scholar 

  9. Haddad FG, Gaspard D, Nasr M, Abou Jaoude S, Nemr E. Etude exploratoire de l’utilisation du test de concordance de script pour l’évaluation des apprentissages de résidents de médecine interne au Liban. Pédagogie Médicale. 2008;3:135–40.

    Article  Google Scholar 

  10. Lineberry M, Kreiter CD, Bordage G. Threats to validity in the use and interpretation of script concordance test scores. Med Educ. 2013;47(12):1175–83.

    Article  PubMed  Google Scholar 

  11. See KC, Tan KL, Lim TK. The script concordance test for clinical reasoning: re-examining its utility and potential weakness. Med Educ. 2014;48(11):1069–77.

    Article  PubMed  Google Scholar 

  12. Lebanese Psychiatric Society. Retrieved on December 12, 2015 from : http://www.lpsonline.org/psychiatrists-psychiatres/.

Download references

Acknowledgments

The authors are grateful to the Psychiatric Hospital of the Cross for providing the training field for students who participated to this study.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to François Kazour.

Ethics declarations

Disclosures

On behalf of all authors, the corresponding author states that there is no conflict of interest.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kazour, F., Richa, S., Zoghbi, M. et al. Using the Script Concordance Test to Evaluate Clinical Reasoning Skills in Psychiatry. Acad Psychiatry 41, 86–90 (2017). https://doi.org/10.1007/s40596-016-0539-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s40596-016-0539-6

Keywords

Navigation