Academic Psychiatry

, Volume 27, Issue 3, pp 136–144

Evaluating Competence in Psychotherapy

  • John Manring
  • Bernard D. Beitman
  • Mantosh J. Dewan
Original Article

Abstract

Background: The Residency Review Committee (RRC) for Psychiatry has recently charged psychiatry training programs with developing methods to demonstrate competence of trainees in five areas of psychotherapy. Each program must decide what specific skills are essential for competence in each of the five listed psychotherapies. This requires determining whether those skills that are necessary are also sufficient for effective psychotherapy and whether additional specific skills are required for each one. Method: Two lists of general skills for psychotherapy are compared, one from the perspective of specific “schools” of psychotherapy and one from a more eclectic “integrative” approach. The issue of measuring competence is addressed by placing ratings of “competent” midway on a continuum from “novice” to “expert.” Thirteen methods for measuring competence from the Accreditation Council for Graduate medical Education (ACGME) “tool-box” are described and reviewed with respect to applicability to psychotherapy. Examples of toolbox implementation are described based on a functioning psychotherapy evaluation program at the University of Missouri. Results and Conclusions: The authors found both theoretical as well as practical problems in measuring competence in psychotherapy. We propose that global rather than highly specific assessment methods may be more practical in these early stages of development, and we offer specific suggestions for assessment components that can currently be implemented.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    ACGME Outcome Project: ACGME General Competencies Version 1.3 (9.28.99), 2000Google Scholar
  2. 2.
    ACGME Program Requirements for Residency Training in Psychiatry (effective January, 2001), 2002Google Scholar
  3. 3.
    Lambert J, Bergin AE: The effectiveness of psychotherapy, in Handbook of Psychotherapy and Behavior Change. Edited by Bergin AE, Garfield SL. New York, Wiley, 1994, pp 143–189Google Scholar
  4. 4.
    Klerman GL, Weissman MM, Markowitz JC, Glick I, Wilner PJ, Mason B, Shear K: Medication and Psychotherapy, in Handbook of Psychotherapy and Behavior Change. Edited by Bergin AE, Garfield SL. New York, Wiley, 1994, pp 734–783Google Scholar
  5. 5.
    Hill CE, Helm JE, Spiegel SB, Tichenor V: Development of a system for categorizing client reactions to therapist interventions. J Counseling Psychology 1988; 35: 27–36CrossRefGoogle Scholar
  6. 6.
    Gelso C, Carter JA: The relationship in counseling and psychotherapy: components, consequences and theoretical antecedents. Counseling Psychologist 1985; 13: 155–243CrossRefGoogle Scholar
  7. 7.
    Horvath AO, Greenberg LS: Development and validation of the working alliance. J Consulting Psychology 1989; 36: 223–233CrossRefGoogle Scholar
  8. 8.
    Moras K, Strupp HH: Pretherapy interpersonal relations, patient’s alliance and outcome of brieftherapy. Arch Genl Psychiatry 1982; 39: 405–409CrossRefGoogle Scholar
  9. 9.
    Foreman SA, Marmar CR: Therapist actions that address initially poor therapeutic alliance in psychotherapy. Am J Psychiatry 1985; 142: 922–926CrossRefPubMedGoogle Scholar
  10. 10.
    Kivlighan DM: Relationship between counselor use of intentions and clients perception of working alliance. J Counseling Psychology 1990; 37: 27–32CrossRefGoogle Scholar
  11. 11.
    Kivlighan DM, Schmitz PJ: Counselor technical activity in cases with improving working alliances and continuing-poor working alliance. J Counseling Psychology 1992; 39: 32–38CrossRefGoogle Scholar
  12. 12.
    Lazarus AA: The utility and futility of combining treatments in psychotherapy. Clinical Psychology - Science and Practice 1996; 3: 59–68CrossRefGoogle Scholar
  13. 13.
    Beutler L, Consoli A: Systemic eclectic psychotherapy, in Handbook of Psychotherapy Integration. Edited by Norcross J, Goldfried MR. New York, Basic Books, 1992Google Scholar
  14. 14.
    Bienenfeld D, Klykylo W, Knapp V: Process and product: Development of competency-based measures for psychiatryresidency. Acad Psychiatry 2000; 24: 68–76CrossRefGoogle Scholar
  15. 15.
    Mellman L, Beresin E, co-chairs AADPRT Psychotherapy Task Force: David Goldberg, Ron Reider, Ron Krasner and Lisa Mellman: Psychotherapy competencies. Further refined by Carol Bernstein and NYU faculty and Hinda Dubin and University of Maryland faculty. Received from aadprt-list@aadprt.org, July 3, 2000Google Scholar
  16. 16.
    Beitman B, Yue D: Learning Psychotherapy, New York, W W Norton & Company, 1999Google Scholar
  17. 17.
    Dreyfus HL, Dreyfus SE: Mind Over Machine: the Power of Human Intuition and Expertise in the Era of the Computer. Free Press, 1986; as cited by Leach D: Competencies in graduate medical education. Keynote address to AADPRT annual meeting, March 1, 2001Google Scholar
  18. 18.
    ACGME Outcome Project: Toolbox of Assessment Methods, Version 1.1, September, 2000Google Scholar
  19. 19.
    Meyers H, Dorsey K, Benz, E: DxR Patient Simulation Software. DxR Development Group, Copyright 1992–9. Available at www.dxrgroup.com
  20. 20.
    Satish U, Streufert S, Barach, P: Assessing and improving medical competency: using strategic management simulations. Simulation and Gaming 2001; 32: 156–163CrossRefGoogle Scholar
  21. 21.
    Streufert S, Satish U, Barach P: Improving medical care: the use of simulation technology. Simulation and Gaming 2001; 32: 164–174CrossRefGoogle Scholar

Copyright information

© Academic Psychiatry 2003

Authors and Affiliations

  • John Manring
    • 1
  • Bernard D. Beitman
    • 2
  • Mantosh J. Dewan
    • 1
  1. 1.Department of PsychiatryState University of New York, Upstate Medical UniversitySyracuseUSA
  2. 2.Department of PsychiatryUniversity of MissouriColumbiaUSA

Personalised recommendations