Abstract
Background: The Residency Review Committee (RRC) for Psychiatry has mandated that training programs “must demonstrate that residents have achieved competency in at least the following forms of treatment: brief therapy, cognitive-behavioral therapy, combined psychotherapy and psychopharmacology, psychodynamic therapy, and supportive therapy.” Aim: To analyze the extent to which programs can realistically demonstrate that residents have achieved summative competency in these modalities. Method: We briefly review methods from other fields for assuring procedural competence, review methods available to psychiatric educators for assuring competencies in psychotherapy, and assess these methods for their adequacy. Results: Available and foreseeable assessment methods are incapable of demonstrating that residents achieve summative competency in the five specified psychotherapies or of definitively distinguishing potentially dangerous practitioners from safe practitioners. At best, educators may be able to assure formative competencies, including mastery of core knowledge of the psychotherapies, actual undertaking of these psychotherapies, and adequate performance in selected elements of these psychotherapies. Conclusions: Since it is unrealistic to assume that training programs will ever be able to confirm summative competencies in these psychotherapies, we advise programs to define precisely the levels of formative competence they expect, and design curriculum and measures accordingly. Further, we urge the RRC to revise their requirements to address expectations more honestly, and to re-state the expected competencies more modestly. We believe that the RRC can expect programs to show that all residents can demonstrate knowledge about the evidence base, theories and rules of practice supporting at least the following forms of treatment: brief therapy, cognitive-behavioral therapy, combined psychotherapy and psychopharmacology, psychodynamic therapy, and supportive therapy. We also believe that programs might be asked to demonstrate by means of patient logs and other forms of documentation that all residents have at least conducted such types of psychotherapy under qualified supervision.
Similar content being viewed by others
References
Wolf R. Evaluation in Education: Foundations of competency assessment and program review (3rd Ed.). New York, West-port, London: Prager, 1990
Marshall J. Assessment during postgraduate training. In JS Gonella, M Hojat, JB Erdmann, JJ Veloski (eds.), Assessment Measures in Medical School, Residency and Practice. New York: Springer 1993
Monjan SV, Gassner SM. Critical Issues in Competency Based Education. New York, Oxford, Toronto, Sydney, Frankfurt, Paris: Pergamon Press, 1979
McClelland DC. Testing for competence rather than for “intelligence.” American Psychologist 1973; 28: 1–14
Goleman D. The new competency tests: matching the right people to the right jobs. Psychology Today, 35–46, January 1981
Slogoff S, Hughes FP. Validity of scoring ‘dangerous answers’ on a written certification examination. J Med Educ 1987; 62: 625–31
Karasu TB: The advanced practice of psychotherapy. Harvard Rev Psychiatry 2001; 9: 118–123
Lurhman T. Of Two Minds. New York, Knopf, 2001
Liston E, Yager J, Strauss GD. Assessment of psychotherapy skills: The problem of interrater agreement. Am J Psychiatry 1981; 138: 1069–1074
Jacobson NS, Hollon SD. Prospects for future comparisons between drugs and psychotherapy: Lessons from the CBT-Versus Pharmacotherapy Exchange. J Consulting and Clinical Psychology 1996; 64: 104–108
Milne D, James I. A systematic review of effective cognitive-behavioural supervision. Br J Clin Psychol 2000; 39 (Pt 2): 111–127
Milne DL, Baker C, Blackburn IM, James I, Reichelt K. Effectiveness of cognitive therapy training. J Behav Ther Exp Psychiatry 1999; 30(2): 81–92
Hill CE, O’Grady KE, Elkin I. Applying the Collaborative Study Psychotherapy Rating Scale to rate therapist adherence in cognitive-behavior therapy, interpersonal therapy and clinical management. J Consult Clin Psychol 1992; 60(1): 73–9
Dobson KS, Shaw BF, Vallis TM. Reliability of a measure of the quality of cognitive therapy. Br J Clin Psychol 1985; 24 (Pt 4): 295–300
Margolis MJ, De Champlain AF, Klass DJ. Setting examination-level standards for a performance-based assessment of physician’s clinical skills. Academic Medicine 1998; 73, Oct–Nov supplement; S114–S116
Wass V. Ven der Vieuten C, Shatzer J, Jones R. Assessment of clinical competence. Lancet 2001; 945–949
Southgate L, Hays RB, Norcini J et al. Setting performance standards for medical practice: a theoretical framework. Medical Education 2001; 35: 474–481
Yager J, Borus JF, Robinowitz CB, Shore JH. Developing minimal national standards for clinical experience in psychiatric training. Am J Psychiatry 1988;145: 1409–13
Bienenfeld D, Klykylo W, Knapp V. Process and product: Development of competency-based measures for a psychiatry residency. Acad Psychiatry 2000; 24(2): 68–76
Brearley S. Seriously deficient professional performance. British Medical Journal 1996; 312: 1180–1181
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Yager, J., Bienenfeld, D. How Competent Are We to Assess Psychotherapeutic Competence in Psychiatric Residents?. Acad Psychiatry 27, 174–181 (2003). https://doi.org/10.1176/appi.ap.27.3.174
Published:
Issue Date:
DOI: https://doi.org/10.1176/appi.ap.27.3.174