Clinicians and outcome measurement: What's the use?

Regular Articles

Abstract

The goal of this study was to learn more about clinicians' experiences with, and perceptions of the utility, validity, and feasibility of standardized outcome measures in practice. Fifty randomly selected clinicians from multiple disciplines and multiple service agencies in a large children's public mental health service system were interviewed individually (n=30) or in focus groups (n=20) using semistructured interviews. There was great variability across clinicians in attitudes about empirical methods of treatment evaluation. There was consensus regarding feasibility challenges of administering standardized measures, including time burden and literacy barriers. Although all participants had received scored assessment profiles for their clients, the vast majority reported that they did not use the scores in treatment planning or monitoring. Their suggestions for improved clinical utility of outcome measurement are included. With increased attention and resources devoted to performance outcome assessment, it is concerning that most clinicians perceive little clinical utility of outcome measurement.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Koch JR, Lewis A, McCall D. A multistakeholder-driven model for developing an outcome management system.The Journal of Behavioral Health Services & Research. 1998;25:151–162.Google Scholar
  2. 2.
    Cesare-Murphy M, McMahill C, Schyve P. Joint commission evaluation of behavioral health care organizations.Evaluation Review: Measuring Quality in Mental Health Services. 1997;21:322–329.Google Scholar
  3. 3.
    Bickman L, Rosof J, Salzer MS, et al. What information do clinicians value for monitoring adolescent client progress?Professional Psychology: Research and Practice. 2000;31:70–74.Google Scholar
  4. 4.
    Addis ME, Krasnow AD. A national survey of practicing psychologists' attitudes toward psychotherapy treatment manuals.Journal of Consulting and Clinical Psychology. 2000;68:331–339.Google Scholar
  5. 5.
    Lueger RJ, Howard KI, Martinovich Z, et al. Assessing treatment progress of individual patients using expected treatment response models.Journal of Consulting and Clinical Psychology. 2001;69:150–158.Google Scholar
  6. 6.
    Burnam MA. Measuring outcomes of care for substance use and mental disorders. In: Steinwachs DM, Flynn LM, Norquist GS, et al, eds.New Directions for Mental Health Services, No. 71: Using Client Outcomes Information to Improve Mental Health and Substance Abuse Treatment. San Francisco, Calif: Jossey-Bass; 1996:3–18.Google Scholar
  7. 7.
    Smith RG. State of the science of mental health and substance abuse patient outcomes assessment. In: Steinwachs DM, Flynn LM, Norquist GS, et al, eds.New Directions for Mental Health Services, No. 71: Using Client Outcomes Information to Improve Mental Health and Substance Abuse Treatment. San Francisco, Calif: Jossey-Bass; 1996:59–67.Google Scholar
  8. 8.
    Goebel L. A peer review of feedback method of promoting compliance with preventive care guidelines in a resident ambulatory care clinic.Joint Commission Journal on Quality Improvement. 1997;23:196–202.Google Scholar
  9. 9.
    Dawes RM.House of Cards: Psychology and Psychotherapy Built on Myth. New York: Free Press; 1994.Google Scholar
  10. 10.
    Garb HN.Studying the Clinician: Judgment Research and Psychological Assessment. Washington, DC: American Psychological Association; 1998.Google Scholar
  11. 11.
    Meehl PE.Clinical Versus Statistical Prediction: A Theoretical Analysis and a Review of the Evidence. Minneapolis, Minn: University of Minnesota Press; 1954.Google Scholar
  12. 12.
    California Mental Health Planning Council (CMHPC).Adult Performance Outcome Study: Wave 1 to Wave 2. Sacramento, Calif: CMHPC; 1997.Google Scholar
  13. 13.
    Achenbach TM.Manual for the Child Behavior Checklist/4–18 and 1991 Profile. Burlington, VT: University of Vermont Department of Psychiatry; 1991.Google Scholar
  14. 14.
    Achenbach TM.Manual for the Youth Self-Report and 1991 Profile. Burlington: University of Vermont, Department of Psychiatry; 1991.Google Scholar
  15. 15.
    Hodges K. Child and Adolescent Functional Assessment Scale (CAFAS). In: Maruish ME, ed.The Use of Psychological Testing for Treatment Planning and Outcomes Assessment. 2nd ed. Mahwah, NJ: Erlbaum; 1999:631–664.Google Scholar
  16. 16.
    Attkisson CC, Zwick R. The Client Satisfaction Questionnaire. Psychometric properties and correlations with service utilization and psychotherapy outcome.Evaluation and Program Planning. 1982;5:233–237.Google Scholar
  17. 17.
    Breda CS. Methodological issues in evaluating mental health outcomes of a children's mental health managed care demonstration.The Journal Of Mental Health Administration. 1996;23:40–50.Google Scholar
  18. 18.
    Hoagwood K, Burns BJ, Kiser L, et al. Evidence-based practice in child and adolescent mental health services.Psychiatric Services. 2001;52:1179–1189.Google Scholar
  19. 19.
    National Advisory Mental Health Council (NAMHC).Blueprint for Change: Research on Child and Adolescent Mental Health. A Report by the National Advisory Mental Health Council's Workgroup on Child and Adolescent Mental Health Intervention Development and Deployment. Bethesda, Md: National Institutes of Health/National Institute of Mental Health; 2001.Google Scholar
  20. 20.
    Abrahamson DJ. Outcomes, guidelines, and manuals: on leading horses to water.Clinical Psychology: Science and Practice. 1999;6:467–471.Google Scholar
  21. 21.
    Addis ME, Wade WA, Hatgis C. Barriers to dissemination of evidence-based practices: addressing practitioners' concerns about manual-based psychotherapies.Clinical Psychology: Science and Practice. 1999;6:430–441.Google Scholar
  22. 22.
    Aarons GA. Clinician personality and attitudes toward adoption of empirically supported treatments. Presented at the 15th International Conference on Mental Health Services Research. Evidence in Mental Health Services Research: What Types, How Much, and Then What? National Institute of Mental Health; April 2002; Washington, DC.Google Scholar
  23. 23.
    Hoagwood K, Jensen PS, Petti T, et al. Outcomes of mental health care for children and adolescents, I: A comprehensive conceptual model.Journal of the American Academy of Child and Adolescent Psychiatry. 1996;35:1055–1062.Google Scholar
  24. 24.
    QSR Nudist Vivo 1.0 [computer software]. Melbourne, Australia: Qualitative Solutions & Research Pty Ltd; 1999.Google Scholar
  25. 25.
    Beutler LE. David and Goliath: when empirical and clinical standards of practice meet.American Psychologist. 2000;55:997–1007.Google Scholar
  26. 26.
    Achenbach TM.Manual for the CBCL/4–18 and Profile. Burlington: University of Vermont Department of Psychiatry; 1991.Google Scholar
  27. 27.
    Beutler LE. Comparisons among quality assurance systems: from outcome assessment to clinical utility.Journal of Consulting and Clinical Psychology. 2001;69:197–204.Google Scholar
  28. 28.
    Persons JB. Conducting effectiveness studies in the context of evidence-based clinical practice.Clinical Psychology: Science and Practice. 2001;8:168–172.Google Scholar
  29. 29.
    Lambert MJ, Hansen NB, Finch AE. Patient-focused research: using patient outcome data to enhance treatment effects.Journal of Consulting and Clinical Psychology. 2001;69:159–172.Google Scholar

Copyright information

© National Council for Community Behavioral Healthcare 2003

Authors and Affiliations

  • Ann F. Garland
    • 1
  • Marc Kruse
    • 2
  • Gregory A. Aarons
    • 3
  1. 1.University of California, San DiegoSan Diego
  2. 2.the Department of Psychologythe University of TexasAustin
  3. 3.the University of CaliforniaSan Diego

Personalised recommendations