Academic Psychiatry

, Volume 27, Issue 3, pp 174–181

How Competent Are We to Assess Psychotherapeutic Competence in Psychiatric Residents?

Original Article

Abstract

Background: The Residency Review Committee (RRC) for Psychiatry has mandated that training programs “must demonstrate that residents have achieved competency in at least the following forms of treatment: brief therapy, cognitive-behavioral therapy, combined psychotherapy and psychopharmacology, psychodynamic therapy, and supportive therapy.” Aim: To analyze the extent to which programs can realistically demonstrate that residents have achieved summative competency in these modalities. Method: We briefly review methods from other fields for assuring procedural competence, review methods available to psychiatric educators for assuring competencies in psychotherapy, and assess these methods for their adequacy. Results: Available and foreseeable assessment methods are incapable of demonstrating that residents achieve summative competency in the five specified psychotherapies or of definitively distinguishing potentially dangerous practitioners from safe practitioners. At best, educators may be able to assure formative competencies, including mastery of core knowledge of the psychotherapies, actual undertaking of these psychotherapies, and adequate performance in selected elements of these psychotherapies. Conclusions: Since it is unrealistic to assume that training programs will ever be able to confirm summative competencies in these psychotherapies, we advise programs to define precisely the levels of formative competence they expect, and design curriculum and measures accordingly. Further, we urge the RRC to revise their requirements to address expectations more honestly, and to re-state the expected competencies more modestly. We believe that the RRC can expect programs to show that all residents can demonstrate knowledge about the evidence base, theories and rules of practice supporting at least the following forms of treatment: brief therapy, cognitive-behavioral therapy, combined psychotherapy and psychopharmacology, psychodynamic therapy, and supportive therapy. We also believe that programs might be asked to demonstrate by means of patient logs and other forms of documentation that all residents have at least conducted such types of psychotherapy under qualified supervision.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Wolf R. Evaluation in Education: Foundations of competency assessment and program review (3rd Ed.). New York, West-port, London: Prager, 1990Google Scholar
  2. 2.
    Marshall J. Assessment during postgraduate training. In JS Gonella, M Hojat, JB Erdmann, JJ Veloski (eds.), Assessment Measures in Medical School, Residency and Practice. New York: Springer 1993Google Scholar
  3. 2a.
    Monjan SV, Gassner SM. Critical Issues in Competency Based Education. New York, Oxford, Toronto, Sydney, Frankfurt, Paris: Pergamon Press, 1979Google Scholar
  4. 2b.
    McClelland DC. Testing for competence rather than for “intelligence.” American Psychologist 1973; 28: 1–14CrossRefPubMedGoogle Scholar
  5. 3.
    Goleman D. The new competency tests: matching the right people to the right jobs. Psychology Today, 35–46, January 1981Google Scholar
  6. 3a.
    Slogoff S, Hughes FP. Validity of scoring ‘dangerous answers’ on a written certification examination. J Med Educ 1987; 62: 625–31PubMedGoogle Scholar
  7. 3b.
    Karasu TB: The advanced practice of psychotherapy. Harvard Rev Psychiatry 2001; 9: 118–123CrossRefGoogle Scholar
  8. 4.
    Lurhman T. Of Two Minds. New York, Knopf, 2001Google Scholar
  9. 5.
    Liston E, Yager J, Strauss GD. Assessment of psychotherapy skills: The problem of interrater agreement. Am J Psychiatry 1981; 138: 1069–1074CrossRefPubMedGoogle Scholar
  10. 6.
    Jacobson NS, Hollon SD. Prospects for future comparisons between drugs and psychotherapy: Lessons from the CBT-Versus Pharmacotherapy Exchange. J Consulting and Clinical Psychology 1996; 64: 104–108CrossRefPubMedGoogle Scholar
  11. 7.
    Milne D, James I. A systematic review of effective cognitive-behavioural supervision. Br J Clin Psychol 2000; 39 (Pt 2): 111–127CrossRefPubMedGoogle Scholar
  12. 8.
    Milne DL, Baker C, Blackburn IM, James I, Reichelt K. Effectiveness of cognitive therapy training. J Behav Ther Exp Psychiatry 1999; 30(2): 81–92CrossRefPubMedGoogle Scholar
  13. 9.
    Hill CE, O’Grady KE, Elkin I. Applying the Collaborative Study Psychotherapy Rating Scale to rate therapist adherence in cognitive-behavior therapy, interpersonal therapy and clinical management. J Consult Clin Psychol 1992; 60(1): 73–9CrossRefPubMedGoogle Scholar
  14. 10.
    Dobson KS, Shaw BF, Vallis TM. Reliability of a measure of the quality of cognitive therapy. Br J Clin Psychol 1985; 24 (Pt 4): 295–300CrossRefPubMedGoogle Scholar
  15. 11.
    Margolis MJ, De Champlain AF, Klass DJ. Setting examination-level standards for a performance-based assessment of physician’s clinical skills. Academic Medicine 1998; 73, Oct–Nov supplement; S114–S116CrossRefPubMedGoogle Scholar
  16. 12.
    Wass V. Ven der Vieuten C, Shatzer J, Jones R. Assessment of clinical competence. Lancet 2001; 945–949Google Scholar
  17. 13.
    Southgate L, Hays RB, Norcini J et al. Setting performance standards for medical practice: a theoretical framework. Medical Education 2001; 35: 474–481CrossRefPubMedGoogle Scholar
  18. 14.
    Yager J, Borus JF, Robinowitz CB, Shore JH. Developing minimal national standards for clinical experience in psychiatric training. Am J Psychiatry 1988;145: 1409–13CrossRefPubMedGoogle Scholar
  19. 15.
    Bienenfeld D, Klykylo W, Knapp V. Process and product: Development of competency-based measures for a psychiatry residency. Acad Psychiatry 2000; 24(2): 68–76CrossRefGoogle Scholar
  20. 16.
    Brearley S. Seriously deficient professional performance. British Medical Journal 1996; 312: 1180–1181CrossRefPubMedPubMedCentralGoogle Scholar

Copyright information

© Academic Psychiatry 2003

Authors and Affiliations

  1. 1.Department of PsychiatryUniversity of New Mexico School of MedicineAlbuquerqueUSA
  2. 2.Department of Psychiatry and Biobehavioral SciencesUniversity of California, Los Angeles School of MedicineLos AngelesUSA
  3. 3.American Psychiatric Institute for Research and Education (APIRE)ArlingtonUSA
  4. 4.Department of PsychiatryWright State UniversityDaytonUSA

Personalised recommendations