Skip to main content
Log in

How Competent Are We to Assess Psychotherapeutic Competence in Psychiatric Residents?

  • Original Article
  • Published:
Academic Psychiatry Aims and scope Submit manuscript

Abstract

Background: The Residency Review Committee (RRC) for Psychiatry has mandated that training programs “must demonstrate that residents have achieved competency in at least the following forms of treatment: brief therapy, cognitive-behavioral therapy, combined psychotherapy and psychopharmacology, psychodynamic therapy, and supportive therapy.” Aim: To analyze the extent to which programs can realistically demonstrate that residents have achieved summative competency in these modalities. Method: We briefly review methods from other fields for assuring procedural competence, review methods available to psychiatric educators for assuring competencies in psychotherapy, and assess these methods for their adequacy. Results: Available and foreseeable assessment methods are incapable of demonstrating that residents achieve summative competency in the five specified psychotherapies or of definitively distinguishing potentially dangerous practitioners from safe practitioners. At best, educators may be able to assure formative competencies, including mastery of core knowledge of the psychotherapies, actual undertaking of these psychotherapies, and adequate performance in selected elements of these psychotherapies. Conclusions: Since it is unrealistic to assume that training programs will ever be able to confirm summative competencies in these psychotherapies, we advise programs to define precisely the levels of formative competence they expect, and design curriculum and measures accordingly. Further, we urge the RRC to revise their requirements to address expectations more honestly, and to re-state the expected competencies more modestly. We believe that the RRC can expect programs to show that all residents can demonstrate knowledge about the evidence base, theories and rules of practice supporting at least the following forms of treatment: brief therapy, cognitive-behavioral therapy, combined psychotherapy and psychopharmacology, psychodynamic therapy, and supportive therapy. We also believe that programs might be asked to demonstrate by means of patient logs and other forms of documentation that all residents have at least conducted such types of psychotherapy under qualified supervision.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Wolf R. Evaluation in Education: Foundations of competency assessment and program review (3rd Ed.). New York, West-port, London: Prager, 1990

    Google Scholar 

  2. Marshall J. Assessment during postgraduate training. In JS Gonella, M Hojat, JB Erdmann, JJ Veloski (eds.), Assessment Measures in Medical School, Residency and Practice. New York: Springer 1993

    Google Scholar 

  3. Monjan SV, Gassner SM. Critical Issues in Competency Based Education. New York, Oxford, Toronto, Sydney, Frankfurt, Paris: Pergamon Press, 1979

    Google Scholar 

  4. McClelland DC. Testing for competence rather than for “intelligence.” American Psychologist 1973; 28: 1–14

    Article  CAS  PubMed  Google Scholar 

  5. Goleman D. The new competency tests: matching the right people to the right jobs. Psychology Today, 35–46, January 1981

  6. Slogoff S, Hughes FP. Validity of scoring ‘dangerous answers’ on a written certification examination. J Med Educ 1987; 62: 625–31

    CAS  PubMed  Google Scholar 

  7. Karasu TB: The advanced practice of psychotherapy. Harvard Rev Psychiatry 2001; 9: 118–123

    Article  CAS  Google Scholar 

  8. Lurhman T. Of Two Minds. New York, Knopf, 2001

    Google Scholar 

  9. Liston E, Yager J, Strauss GD. Assessment of psychotherapy skills: The problem of interrater agreement. Am J Psychiatry 1981; 138: 1069–1074

    Article  CAS  PubMed  Google Scholar 

  10. Jacobson NS, Hollon SD. Prospects for future comparisons between drugs and psychotherapy: Lessons from the CBT-Versus Pharmacotherapy Exchange. J Consulting and Clinical Psychology 1996; 64: 104–108

    Article  CAS  PubMed  Google Scholar 

  11. Milne D, James I. A systematic review of effective cognitive-behavioural supervision. Br J Clin Psychol 2000; 39 (Pt 2): 111–127

    Article  PubMed  Google Scholar 

  12. Milne DL, Baker C, Blackburn IM, James I, Reichelt K. Effectiveness of cognitive therapy training. J Behav Ther Exp Psychiatry 1999; 30(2): 81–92

    Article  CAS  PubMed  Google Scholar 

  13. Hill CE, O’Grady KE, Elkin I. Applying the Collaborative Study Psychotherapy Rating Scale to rate therapist adherence in cognitive-behavior therapy, interpersonal therapy and clinical management. J Consult Clin Psychol 1992; 60(1): 73–9

    Article  CAS  PubMed  Google Scholar 

  14. Dobson KS, Shaw BF, Vallis TM. Reliability of a measure of the quality of cognitive therapy. Br J Clin Psychol 1985; 24 (Pt 4): 295–300

    Article  PubMed  Google Scholar 

  15. Margolis MJ, De Champlain AF, Klass DJ. Setting examination-level standards for a performance-based assessment of physician’s clinical skills. Academic Medicine 1998; 73, Oct–Nov supplement; S114–S116

    Article  CAS  PubMed  Google Scholar 

  16. Wass V. Ven der Vieuten C, Shatzer J, Jones R. Assessment of clinical competence. Lancet 2001; 945–949

  17. Southgate L, Hays RB, Norcini J et al. Setting performance standards for medical practice: a theoretical framework. Medical Education 2001; 35: 474–481

    Article  CAS  PubMed  Google Scholar 

  18. Yager J, Borus JF, Robinowitz CB, Shore JH. Developing minimal national standards for clinical experience in psychiatric training. Am J Psychiatry 1988;145: 1409–13

    Article  CAS  PubMed  Google Scholar 

  19. Bienenfeld D, Klykylo W, Knapp V. Process and product: Development of competency-based measures for a psychiatry residency. Acad Psychiatry 2000; 24(2): 68–76

    Article  Google Scholar 

  20. Brearley S. Seriously deficient professional performance. British Medical Journal 1996; 312: 1180–1181

    Article  CAS  PubMed  PubMed Central  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Joel Yager M.D..

Rights and permissions

Reprints and permissions

About this article

Cite this article

Yager, J., Bienenfeld, D. How Competent Are We to Assess Psychotherapeutic Competence in Psychiatric Residents?. Acad Psychiatry 27, 174–181 (2003). https://doi.org/10.1176/appi.ap.27.3.174

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1176/appi.ap.27.3.174

Keywords

Navigation