Mental Health Services Research

, Volume 7, Issue 2, pp 103–112 | Cite as

Clinical Improvement Associated with Conformance to HEDIS-Based Depression Care

  • Kathryn RostEmail author
  • L. Miriam Dickinson
  • John Fortney
  • John Westfall
  • Richard C. Hermann


Background: Employers recently requested a valid metric of depression treatment quality. Such an indicator needs to measure the proportion of the population in need who receive high-quality care, and to predict clinical improvement.Methods: We constructed an administrative database indicator derived from HEDIS criteria for antidepressant medication management, and tested it in 230 employed patients in five health plans.Results: Indicator rates were 7.0% in the population in need. Conformance to indicator criteria in this population was associated with 23.0% improvement in depression severity over 1 year (p =.02).Conclusions: Administrative database indicators that predict clinical improvement are a very rare accomplishment. Existing depression indicators may need to be calculated for the population in need to provide a valid metric for employer purchasers.


HEDIS primary care depression outcomes quality 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Ahmed, F., Elbasha, E. E., Thompson, B. L., Harris, J. R., & Sneller, V. P. (2002). Cost-benefit analysis of a new HEDIS performance measure for pneumococcal vaccination. Medical Decision Making, 22, S58–S66.CrossRefPubMedGoogle Scholar
  2. Apgar, K. R. (2002). Linking pharmacy and mental health benefits: Collaborating to improve depression care. Washington, DC.Google Scholar
  3. Bloom, S. A., Harris, J. R., Thompson, B. L., Ahmed, F., & Thompson, J. (2000). Tracking clinical preventive service use: A comparison of the health plan employer data and information set with the behavioral risk factor surveillance system. Medical Care, 38, 187–194.CrossRefPubMedGoogle Scholar
  4. Buchanan, R. W., Kreyenbuhl, J., Zito, J. M., & Lehman, A. (2002). The schizophrenia PORT pharmacological treatment recommendations: Conformance and implications for symptoms and functional outcome. Schizophrenia Bulletin, 28, 63–73.PubMedGoogle Scholar
  5. Bull, S. A., Hu, X. H., Hunkeler, E. M., Lee, J. Y., Ming, E. E., & Fireman, B. (2002). Discontinuation of use and switching of antidepressants: Influence of patient-physician communication. JAMA, 288, 1403–1409.CrossRefPubMedGoogle Scholar
  6. Burton, W. N., Conti, D. J., Chen, C., Schultz, A. B., & Edington, D. W. (1999). The role of health risk factors and disease on worker productivity. Journal of Occupational and Environmental Medicine, 41, 863–877.PubMedGoogle Scholar
  7. Cotter, J. J., Smith, W. R., Rossiter, L. F., Pugh, C. B., & Bramble, J. D. (1999). Combining state administrative databases and provider records to assess the quality of care for children enrolled in Medicaid. American Journal of Medical Quality, 14, 98–104.PubMedGoogle Scholar
  8. Depression Guideline Panel. (1993). Depression in Primary Care: Vol. 2. Treatment of Major Depression. Clinical Practice Guideline, Number 5. (AHCPR Publication No. 93-0551). Rockville, MD: US Department of Health and Human Services, Public Health Service, Agency for Health Care Policy and Research.Google Scholar
  9. Druss, B. G., Marcus, S. C., Olfson, M., Tanielian, T., Elinson, L., & Pincus, H. A. (2001). Comparing the national economic burden of five chronic conditions. Health Affairs, 20, 233– 241.CrossRefGoogle Scholar
  10. Duan, N. (1983). Smearing estimate: A nonparametric retransformation method. Journal of the American Statistical Association, 78, 605–610.Google Scholar
  11. Ettner, S. L., Frank, R. G., & Kessler, R. C. (1997). The impact of psychiatric disorders on labor market outcomes. Industrial and Labor Relations Review, 51, 64–81.Google Scholar
  12. Fortney, J., Rost, K., Zhang, M., & Pyne, J. (2001). The relationship between quality and outcomes in routine depression care. Psychiatric Services, 52, 56–62.CrossRefPubMedGoogle Scholar
  13. Gibbons, R. D., & Hedeker, D. (1994). Application of random-effects probit regression models. Journal of Consulting and Clinical Psychology, 62, 285–296.CrossRefPubMedGoogle Scholar
  14. Greenberg, P. E., Kessler, R. C., Nells, T. L., Finkelstein, S. N., & Berndt, E. R. (1996). Depression in the workplace: An economic perspective. In J. P. Feighner & W. F. Boyer (Eds.), Selective Serotonin Re-Uptake Inhibitors: Advances in Basic Research and Clinical Practice (2nd ed.). Chichester, West Sussex England: John Wiley and Sons, Ltd.Google Scholar
  15. Hermann, R. (2002). Linking outcome measurement with process measurement for quality improvement. In W. B. T. IsHak & L. Sederer (Eds.), Outcome Measurement in Psychiatry: A Critical Review. Washington, DC.Google Scholar
  16. Hermann, R. C., Leff, S., Palmer, H., Yang, D., Teller, T., Provost, S., Jakubiak, C., & Chan, J. (2000). Quality measures for mental health care: Research from a national inventory. Medical Care Research and Review, 57(Suppl. 2), 136–154.CrossRefPubMedGoogle Scholar
  17. Hermann, R. C., & Palmer, R. H. (2002). Common ground: A framework for selecting core quality measures for mental health and substance abuse care. Psychiatric Services, 53, 281–287.CrossRefPubMedGoogle Scholar
  18. Hoffman, L., Enders, J., Luo, J., Segal, R., Pippins, J., & Kimberlin, C. (2003). Impact of an antidepressant management program on medication adherence. American Journal of Managed Care, 9, 70–80.PubMedGoogle Scholar
  19. Hunkeler, E. M., Meresman, J. F., Hargreaves, W. A., Fireman, B., Berman, W. H., Kirsch, A. J., Groebe, J., Hurt, S. W., Braden, P., Getzell, M., Feigenbaum, P. A., Peng, T., & Salzer, M. (2000). Efficacy of nurse telehealth care and peer support in augmenting treatment of depression in primary care. Archives of Family Medicine, 9, 700–708.CrossRefPubMedGoogle Scholar
  20. Hunt, J. P., Cherr, G. S., Hunter, C., Wright, M. J., Wang, Y. Z., Steeb, G., Buechter, K. J., Meyer, A. A., & Baker, C. C. (2000). Accuracy of administrative data in trauma: Splenic injuries as an example. Journal of Trauma, Injury, Infection and Critical Care, 49, 679–686.Google Scholar
  21. Jones, D., Hendricks, A., Comstock, C., Rosen, A., Chang, B. H., Rothendler, J., Hankin, C., & Prashker, M. (2000). Eye examinations for VA patients with diabetes: Standardizing performance measures. International Journal for Quality in Heath Care, 12, 97–104.CrossRefGoogle Scholar
  22. Katon, W., Robinson, P., Von Korff, M., Lin, E., Bush, T., Ludman, E., Simon, G., & Walker, E. (1996). A multifaceted intervention to improve treatment of depression in primary care. Archives of General Psychiatry, 53, 924–932.PubMedGoogle Scholar
  23. Katon, W., Rutter, C. M., Lin, E., Simon, G., Von Korff, M., Bush, T., Walker, E., & Ludman, E. (2000). Are there detectable differences in quality of care or outcome of depression across primary care providers? Medical Care, 38, 552–561.CrossRefPubMedGoogle Scholar
  24. Katon, W., Von Korff, M., Lin, E., Simon, G., Walker, E., Unutzer, J., Bush, T., Russo, J., & Ludman, E. (1999). Stepped collaborative care for primary care patients with persistent symptoms of depression: A randomized trial. Archives of General Psychiatry, 56, 1109–1115.CrossRefPubMedGoogle Scholar
  25. Katon, W., Von Korff, M., Lin, E., Walker, E., Simon, G. E., Bush, T., Robinson, P., & Russo, J. (1995). Collaborative management to achieve treatment guidelines: Impact on depression in primary care. JAMA, 273, 1026–1031.CrossRefPubMedGoogle Scholar
  26. Katzelnick, D. J., Simon, G. E., Pearson, S. D., Manning, W. G., Helstad, C. P., Henk, H. J., Cole, S. M., Lin, E. H. B., Taylor, L. H., & Kobak, K. A. (2000). Randomized trial of a depression management program in high utilizers of medical care. Archives of Family Medicine, 9, 345–351.CrossRefPubMedGoogle Scholar
  27. Kessler, R. C., Barber, C., Birnbaum, H. G., Frank, R. G., Greenberg, P. E., Rose, R. M., Simon, G. E., & Wang, P. (1999). Depression in the workplace: Effects on short-term disability. Health Affairs, 18, 163–171.CrossRefPubMedGoogle Scholar
  28. Kessler, R. C., & Frank, R. G. (1997). The impact of psychiatric disorders on work loss days. Psychological Medicine, 27, 861–873.CrossRefPubMedGoogle Scholar
  29. Kobak, K. A., Taylor, L., Katzelnick, D. J., Olson, N., Clagnaz, P., & Henk, H. J. (2002). Antidepressant medication management and Health Plan Employer Data Information Set (HEDIS) criteria: Reasons for nonadherence. Journal of Clinical Psychiatry, 63, 727–732.PubMedGoogle Scholar
  30. Kraemer, H. C., Wilson, T., Fairburn, C. G., & Agras, W. S. (2002). Mediators and moderators of treatment effects in randomized clinical trials. Archives of General Psychiatry, 59, 877– 883.CrossRefPubMedGoogle Scholar
  31. Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001). The PHQ: Validity of a brief depression severity measure. Journal of General Internal Medicine, 16, 606–613.CrossRefPubMedGoogle Scholar
  32. Krumholz, H. M., Radford, M. J., Wang, Y., Chen, J., Heiat, A., & Marciniak, T. A. (1998). National use and effectiveness of beta-blockers for the treatment of elderly patients after acute myocardial infarction: National Cooperative Cardiovascular Project. JAMA, 280, 623–629.CrossRefPubMedGoogle Scholar
  33. Lave, J. R., Frank, R. G., Schulberg, H. C., & Kamlet, M. S. (1998). Cost-effectiveness of treatments for major depression in primary care practice. Archives of General Psychiatry, 55, 645–651.CrossRefPubMedGoogle Scholar
  34. Marcotte, D. E., & Wilcox-Gok, V. (2001). Estimating the employment and earnings costs of mental illness: Recent developments in the United States. Social Science and Medicine, 53, 21–27.CrossRefPubMedGoogle Scholar
  35. Martin, J. K., Blum, T. C., Beach, S. R. H., & Roman, P. M. (1996). Subclinical depression and performance at work. Social Psychiatry and Psychiatric Epidemiology, 31, 3–9.PubMedGoogle Scholar
  36. Melfi, C. A., Chawla, A. J., Croghan, T. W., Hanna, M. P., Kennedy, S., & Sredl, K. (1998). The effects of adherence to antidepressant treatment guidelines on relapse and recurrence of depression. Archives of General Psychiatry, 55, 1128–1132.CrossRefPubMedGoogle Scholar
  37. NCQA (2003). Antidepressant Medication Management: The State of Health Care Quality 2002.Accessed May 2003. [On-line]. Available:
  38. Newhouse, J. P., & McClellan, M. (1998). Econometrics in outcomes research: The use of instrumental variables. Annual Review of Public Health, 19, 17–34.CrossRefPubMedGoogle Scholar
  39. Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical Linear Models: Applications and Data Analysis Methods. (2nd ed.) Thousand Oaks, CA: Sage.Google Scholar
  40. Roberts, K., Cockerham, T. R., & Waugh, W. J. (2002). An innovative approach to managing depression: Focus on HEDIS standards. Journal for Healthcare Quality, 24, 11–17.Google Scholar
  41. Rost, K., Nutting, P., Smith, J., Werner, J., & Duan, N. (2001). Improving depression outcomes in community primary care practice: A randomized trial of the QuEST intervention. Journal of General Internal Medicine, 16, 143–149.PubMedGoogle Scholar
  42. Rost, K., Nutting, P., Smith, J. L., Elliott, C. E., & Dickinson, M. (2002). Managing depression as a chronic disease: A randomised trial of ongoing treatment in primary care. BMJ, 325, 934–939.CrossRefPubMedGoogle Scholar
  43. Rost, K., Smith, G. R., Guise, B., & Matthews, D. B. (1994). The deliberate misdiagnosis of major depression in primary care. Archives of Family Medicine, 3, 333–337.CrossRefPubMedGoogle Scholar
  44. Rost, K., Smith, J., & Fortney, J. (2000). Large employers’ selection criteria in purchasing behavioral health benefits. Journal of Behavioral Health Services and Research, 27, 334–338.Google Scholar
  45. Rost, K., Williams, C., Wherry, J., & Smith, G. R., Jr. (1995). The process and outcomes of care for major depression in rural family practice settings. Journal of Rural Health, 11, 114–121.PubMedGoogle Scholar
  46. Rost, K. M., Duan, N., Rubenstein, L. V., Ford, D. E., Sherbourne, C. D., Meredith, L. S., & Wells, K. B. (2001). The Quality Improvement for Depression collaboration: General analytic strategies for a coordinated study of quality improvement in depression care. General Hospital Psychiatry, 23, 239–253.CrossRefPubMedGoogle Scholar
  47. Rost, K. M., Smith J. L., & Dickinson, L. M. (2004). The effect of improving primary care depression management on employee absenteeism and productivity: A randomized trial. Medical Care, 42, 1202–1210.CrossRefPubMedGoogle Scholar
  48. Rost, K. M., Pyne, J. M., Dickinson, L. M., & LoSasso, T. (2005). Cost-effectiveness of enhancing primary care depression management on an ongoing basis. Annals of Family Medicine, 3, 15–22.CrossRefPubMedGoogle Scholar
  49. Rost, K. M., Zhang, M., Fortney, J., Smith, J., & Smith, G. R., Jr. (1998). Rural-urban differences in depression treatment and suicidality. Medical Care, 36, 1098–1107.CrossRefPubMedGoogle Scholar
  50. Russell, J. M., Patterson, J., & Baker, A. M. (1998). Depression in the workplace: Epidemiology, economics and effects of treatment. Disease Management and Health Outcomes, 4, 135– 142.Google Scholar
  51. Schoenbaum, M., Unutzer, J., McCaffrey, D., Duan, N., Sherbourne, C., & Wells, K. B. (2002). The effects of primary care depression treatment on patients’ clinical status and employment. Health Services Research, 37, 1145–1158.CrossRefPubMedGoogle Scholar
  52. Schoenbaum, M., Unutzer, J., Sherbourne, C., Duan, N., Rubenstein, L. V., Miranda, J., Meredith, L. S., Carney, M. F., & Wells, K. (2001). Cost-effectiveness of practice-initiated quality improvement for depression: Results of a randomized, controlled trial. JAMA, 286, 1325–1330.CrossRefPubMedGoogle Scholar
  53. Schulberg, H. C., Block, M. R., Madonia, M. J., Scott, C. P., Rodriguez, E., Imber, S. D., Perel, J., Lave, J., Houck, P. R., & Coulehan, J. L. (1996). Treating major depression in primary care practice: Eight-month clinical outcomes. Archives of General Psychiatry, 53, 913–919.PubMedGoogle Scholar
  54. Simon, G. E., Lin, E. H. B., Katon, W., Saunders, K., VonKorff, M., Walker, E., Bush, T., & Robinson, P. (1995). Outcomes of “inadequate” antidepressant treatment. Journal of General Internal Medicine, 10, 663–670.PubMedGoogle Scholar
  55. Simon, G. E., Manning, W. G., Katzelnick, D. J., Pearson, S. D., Henk, H. J., & Helstad, C. P. (2001). Cost-effectiveness of systematic depression treatment for high utilizers of general medical care. Arch General Psychiatry, 58, 181–187.CrossRefGoogle Scholar
  56. Simon, G. E., VonKorff, M., Rutter, C., & Wagner, E. (2000). Randomised trial of monitoring, feedback, and management of care by telephone to improve treatment of depression in primary care. BMJ, 320, 550–554.CrossRefPubMedGoogle Scholar
  57. Singer, J. D. (1998). Using SAS PROC MIXED to fit multilevel models, hierarchical models, and individual growth models. Journal of Educational and Behavioral Statistics, 23, 323–355.Google Scholar
  58. Sturm, R., Unutzer, J., & Katon, W. (1999). Effectiveness research and implications for study design: Sample size and statistical power. General Hospital Psychiatry, 21, 274–283.CrossRefPubMedGoogle Scholar
  59. Thompson, J. W., Bost, J., Ahmed, F., Ingalls, C. E., & Sennett, C. (1998). The NCQA’s quality compass: Evaluating managed care in the United States: A brief look at the NCQA’s comparison of health plan performance. Health Affairs, 17, 152–158.CrossRefGoogle Scholar
  60. Walsh, B. T., Seidman, S. N., Sysko, R., & Gould, M. (2002). Placebo response in studies of major depression: Variable, substantial, and growing. JAMA, 287, 1840–1847.CrossRefPubMedGoogle Scholar
  61. Wells, K. B. (1999). The design of partners in care: Evaluating the cost-effectiveness of improving care for depression in primary care. Social Psychiatry and Psychiatric Epidemiology, 34, 20–29.CrossRefPubMedGoogle Scholar
  62. Wells, K. B., Sherbourne, C. D., Schoenbaum, M., Duan, N., Meredith, L. S., Unutzer, J., Miranda, J., Carney, M. F., & Rubenstein, L. V. (2000). Impact of disseminating quality improvement programs for depression in managed primary care: A randomized controlled trial. JAMA, 283, 212–220.CrossRefPubMedGoogle Scholar

Copyright information

© Springer Science + Business Media, Inc. 2005

Authors and Affiliations

  • Kathryn Rost
    • 1
    • 4
    Email author
  • L. Miriam Dickinson
    • 1
  • John Fortney
    • 2
  • John Westfall
    • 1
  • Richard C. Hermann
    • 3
  1. 1.Center for Studies in Family Medicine, Department of Family MedicineUniversity of Colorado Health Sciences CenterU.S.A.
  2. 2.Health Services Research and Development, Center for Mental Health and Outcomes Research, Central Arkansas Veterans Healthcare System, North Little Rock, AR and Centers for Mental Healthcare Research, Department of PsychiatryUniversity of Arkansas for Medical SciencesLittle Rock
  3. 3.Center for Quality Assessment and Improvement in Mental Health, Department of Psychiatry, Research Scientist, Health InstituteTufts-New England Medical CenterBoston
  4. 4.Center for Studies in Family Medicine, Department of Family MedicineUniversity of Colorado Health Sciences Center, UCHSC at FitzsimonsAurora

Personalised recommendations