A Critical Review of Psychotherapy Research

  • Alan Eppel


Key conceptual and methodological issues in psychotherapy research are reviewed. The difficulties in carrying out empirical research in psychotherapy are examined. Principles of evidence-based medicine, randomized controlled trials and meta-analysis are described. Several important studies are summarized as well as general critiques of the current state of research. Recommendations are made for the optimal requirements for future research.


Meta-analyses Randomized controlled trials Research methodology Evidence-based medicine Empirically -supported psychotherapy Effect size 


  1. 1.
    Haynes RB. Of studies, syntheses, synopses, summaries, and systems: the “5S” evolution of information services for evidence-based healthcare decisions. Evid Based Med. 2006;11(6):162–4.CrossRefPubMedGoogle Scholar
  2. 2.
    Murad MH, Montori VM, Ioannidis JP, Jaeschke R, Devereaux PJ, Prasad K, Neumann I, Carrasco-Labra A, Agoritsas T, Hatala R, Meade MO, Wyer P, Cook DJ, Guyatt G. How to read a systematic review and meta-analysis and apply the results to patient care: users’ guides to the medical literature. JAMA. 2014;312(2):171–9. Scholar
  3. 3.
    Guyatt G. How to read a systematic review and meta-analysis and apply the results to patient care: users’ guides to the medical literature. JAMA. 2014; 312(2):171–9.
  4. 4.
    APA Presidential Task Force on Evidence-Based Practice. Evidence-based practice in psychology. Am Psychol. 2006;61(4):271–85.CrossRefGoogle Scholar
  5. 5.
    Ioannidis JP. Why most published research findings are false. PLoS Med. 2005;2(8):0696–701.CrossRefGoogle Scholar
  6. 6.
    Popper K. Conjectures and refutations: the growth of scientific knowledge. 5th ed. London: Routledge; 1989.Google Scholar
  7. 7.
    Lilienfeld SO. Introduction to special section on pseudoscience in psychiatry. Can J Psychiatr. 2015;60(12):531–3.CrossRefGoogle Scholar
  8. 8.
    Meshikhes AN. Evidence-based surgery: the obstacles and solutions. Int J Surg. 2015;18:159–62.CrossRefPubMedGoogle Scholar
  9. 9.
    Ulberg R, Ness E, Dahl HS, Høglend PA, Critchfield K, Blayvas P, Amlo S. Relational interventions in psychotherapy: development of a therapy process rating scale. BMC Psychiatry. 2016;16(1):310. Scholar
  10. 10.
    Ulberg R, Amlo S, Høglend P. Manual for transference work scale: a micro-analytical tool for therapy process analyses. BMC Psychiatry. 2014;14:291. Scholar
  11. 11.
    Høglend P. Exploration of the patient-therapist relationship in psychotherapy. Am J Psychiatry. 2014;171(10):1056–66. Scholar
  12. 12.
    Ulberg R, Amlo S, Critchfield KL, Marble A, Høglend P. Transference interventions and the process between therapist and patient. Psychotherapy (Chic). 2014;51(2):258–69. Scholar
  13. 13.
    Hersoug AG, Høglend P, Gabbard GO, Lorentzen S. The combined predictive effect of patient characteristics and alliance on long-term dynamic and interpersonal functioning after dynamic psychotherapy. Clin Psychol Psychother. 2013;20(4):297–307. Scholar
  14. 14.
    Høglend P, Hersoug AG, Bøgwald KP, Amlo S, Marble A, Sørbye Ø, Røssberg JI, Ulberg R, Gabbard GO, Crits-Christoph P. Effects of transference work in the context of therapeutic alliance and quality of object relations. J Consult Clin Psychol. 2011;79(5):697–706. Scholar
  15. 15.
    Johansson P, Høglend P, Hersoug AG. Therapeutic alliance mediates the effect of patient expectancy in dynamic psychotherapy. Br J Clin Psychol. 2011;50(3):283–97. Scholar
  16. 16.
    Høglend P, Dahl HS, Hersoug AG, Lorentzen S, Perry JC. Long-term effects of transference interpretation in dynamic psychotherapy of personality disorders. Eur Psychiatry. 2011;26(7):419–24. Scholar
  17. 17.
    Kallestad H, Valen J, McCullough L, Svartberg M, Høglend P, Stiles TC. The relationship between insight gained during therapy and long-term outcome in short-term dynamic psychotherapy and cognitive therapy for cluster C personality disorders. Psychother Res. 2010;20(5):526–34. Scholar
  18. 18.
    Hersoug AG, Høglend P, Havik OE, Monsen JT. Development of working alliance over the course of psychotherapy. Psychol Psychother. 2010;83(Pt 2):145–59. Scholar
  19. 19.
    Hersoug AG, Høglend P, Havik OE, von der Lippe A, Monsen JT. Pretreatment patient characteristics related to the level and development of working alliance in long-term psychotherapy. Psychother Res. 2009;19(2):172–80. Scholar
  20. 20.
    Hersoug AG, Høglend P, Havik O, von der Lippe A, Monsen J. Therapist characteristics influencing the quality of alliance in long-term psychotherapy. Clin Psychol Psychother. 2009;16(2):100–10. Scholar
  21. 21.
    Høglend P, Bøgwald KP, Amlo S, Marble A, Ulberg R, Sjaastad MC, Sørbye O, Heyerdahl O, Johansson P. Transference interpretations in dynamic psychotherapy: do they really yield sustained effects? Am J Psychiatry. 2008;165(6):763–71. Scholar
  22. 22.
    McCullogh L, Kuhn N, Andrews, et al. Treating affect phobia a manual for short term dynamic psychotherapy. New York: Guilford press; 2003.Google Scholar
  23. 23.
    Gupta M. Is evidence-based psychiatry ethical? Oxford: Oxford University Press; 2014.CrossRefGoogle Scholar
  24. 24.
    Cuthbert BN. Research domain criteria: toward future psychiatric nosologies. Dialogues Clin Neurosci. 2015;17(1):89–97.PubMedPubMedCentralGoogle Scholar
  25. 25.
    Dragioti E, Karatnanos V, Gerdle B, Evangelou E. Does psychotherapy work? An umbrella review of meta-analyses of randomized controlled trials. Acta Psychiatr Scand. 2017;136:236–46.CrossRefPubMedGoogle Scholar
  26. 26.
    Scott J. The science and practice of psychotherapy: the critical need for quality assurance and vigilance to monitor and the ratio of benefits to risks of therapies. Acta Psychiatr Scand. 2017;136:233–5.CrossRefPubMedGoogle Scholar
  27. 27.
    Cuijpers P. Four decades of outcome research on psychotherapies for adult depression: an overview of a series of meta-analyses. Can Psychol/Psychologie Canadienne. 2017;58:7–19.CrossRefGoogle Scholar
  28. 28.
    Carroll L. Alice’s adventures in wonderland. London: Oxford University Press; 1971.Google Scholar
  29. 29.
    Frank JD, Frank J. Persuasion and healing: a comparative study of psychotherapy. 3rd ed. Baltimore: John Hopkins University Press; 1991.Google Scholar
  30. 30.
    Rosenzweig S. Some implicit common factors in diverse methods of psychotherapy. Am J Psychiatr. 1936;6:412–5.Google Scholar
  31. 31.
    Luborsky L, Rosenthal R, Diguer L, Andrusyna TP, Berman JS, Levitt JT, Seligman DA, Krause ED. The Dodo bird verdict is alive and well – mostly. Clin Psychol Sci Pract. 2002;9(1):2–12.CrossRefGoogle Scholar
  32. 32.
    Messer SB, Wampold BE. Let’s face facts: common factors are more potent than specific therapy ingredients. Clin Psychol Sci Pract. 2002;9(1):18–22.CrossRefGoogle Scholar
  33. 33.
    Abbass AA, Kisely SR, Town JM, Leichsenring F, Driessen E, De Maat S, Gerber A, Dekker J, Rabung S, Rusalovska S, Crowe E. Short-term psychodynamic psychotherapies for common mental disorders. Cochrane Database of Systematic Reviews 2014, Issue 7. No.: CD004687. John Wiley & Sons.
  34. 34.
    Driessen E, Hegelmaier LM, Abbass AA, Barber JP, Dekker JJ, Van HL, Jansma EP, Cuijpers P. The efficacy of short-term psychodynamic psychotherapy for depression: a meta-analysis update. Clin Psychol Rev. 2015;42:1–15. Scholar
  35. 35.
    Driessen E, Van HL, Don FJ, et al. The efficacy of cognitive behavioral therapy and psychodynamic therapy in the outpatient treatment of major depression: a randomized clinical trial. Am J Psychiatr. 2013;170:1041–50.CrossRefPubMedGoogle Scholar
  36. 36.
    Driessen E, Van HL, Peen J, Don FJ, Twisk JWR, Cuijpers P, Dekker JM. Cognitive-behavioral versus psychodynamic therapy for major depression: secondary outcomes of a randomized clinical trial. J Consult Clin Psychol. 2017;85:653–63. Scholar
  37. 37.
    Steinert C, Munder T, Rabung S, Hoyer J, Leichsenring D. Psychodynamic therapy: as efficacious as other empirically supported treatments? A meta-analysis testing equivalence of outcomes. Am J Psychiatr Online.
  38. 38.
    Connelly Gibbons MB, Gallup R, Thompson D, et al. Comparative effectiveness of cognitive therapy and dynamic psychotherapy for major depressive disorder in a community mental health setting: a randomized clinical noninferiority trial. JAMA Psychiatr. 2016;73:904–11.CrossRefGoogle Scholar
  39. 39.
    Pybis J, Saxon D, Hill A, Barkham M. The comparative effectiveness and efficiency of cognitive behaviour therapy and generic counselling in the treatment of depression: evidence from the 2nd UK National Audit of psychological therapies. PMC Psychiatr. 2017;17:215.Google Scholar
  40. 40.
    Kocsis JH, Gerber AJ, Milrod B, Roose SP, Thase ME, Perkins P, Leon AC. A new scale for assessing the quality of randomized clinical trials of psychotherapy. Compr Psychiatry. 2010;51:319–24.CrossRefPubMedGoogle Scholar
  41. 41.
    Thoma N, McKay D, Gerber A, Milrod B, Edwards A, Kocsis J. A quality- based review of randomized controlled trials of cognitive – behavioral therapy for depression: an assessment and meta-regression. Am J Psychiatr. 2012;169:22–30.CrossRefPubMedGoogle Scholar
  42. 42.
    Gerber AJ, Kocsis JH, Milrod B, Roose SP, Barber J, Thase ME, Perkins P, Leon AC. A quality- based review of randomized controlled trials of psychodynamic psychotherapy. Am J Psychiatr. 2011;168(1):19–28.CrossRefPubMedGoogle Scholar

Copyright information

© Springer International Publishing AG, part of Springer Nature 2018

Authors and Affiliations

  • Alan Eppel
    • 1
  1. 1.McMaster UniversityHamiltonCanada

Personalised recommendations