Abstract
Background: Employers recently requested a valid metric of depression treatment quality. Such an indicator needs to measure the proportion of the population in need who receive high-quality care, and to predict clinical improvement.Methods: We constructed an administrative database indicator derived from HEDIS criteria for antidepressant medication management, and tested it in 230 employed patients in five health plans.Results: Indicator rates were 7.0% in the population in need. Conformance to indicator criteria in this population was associated with 23.0% improvement in depression severity over 1 year (p =.02).Conclusions: Administrative database indicators that predict clinical improvement are a very rare accomplishment. Existing depression indicators may need to be calculated for the population in need to provide a valid metric for employer purchasers.
Similar content being viewed by others
References
Ahmed, F., Elbasha, E. E., Thompson, B. L., Harris, J. R., & Sneller, V. P. (2002). Cost-benefit analysis of a new HEDIS performance measure for pneumococcal vaccination. Medical Decision Making, 22, S58–S66.
Apgar, K. R. (2002). Linking pharmacy and mental health benefits: Collaborating to improve depression care. Washington, DC.
Bloom, S. A., Harris, J. R., Thompson, B. L., Ahmed, F., & Thompson, J. (2000). Tracking clinical preventive service use: A comparison of the health plan employer data and information set with the behavioral risk factor surveillance system. Medical Care, 38, 187–194.
Buchanan, R. W., Kreyenbuhl, J., Zito, J. M., & Lehman, A. (2002). The schizophrenia PORT pharmacological treatment recommendations: Conformance and implications for symptoms and functional outcome. Schizophrenia Bulletin, 28, 63–73.
Bull, S. A., Hu, X. H., Hunkeler, E. M., Lee, J. Y., Ming, E. E., & Fireman, B. (2002). Discontinuation of use and switching of antidepressants: Influence of patient-physician communication. JAMA, 288, 1403–1409.
Burton, W. N., Conti, D. J., Chen, C., Schultz, A. B., & Edington, D. W. (1999). The role of health risk factors and disease on worker productivity. Journal of Occupational and Environmental Medicine, 41, 863–877.
Cotter, J. J., Smith, W. R., Rossiter, L. F., Pugh, C. B., & Bramble, J. D. (1999). Combining state administrative databases and provider records to assess the quality of care for children enrolled in Medicaid. American Journal of Medical Quality, 14, 98–104.
Depression Guideline Panel. (1993). Depression in Primary Care: Vol. 2. Treatment of Major Depression. Clinical Practice Guideline, Number 5. (AHCPR Publication No. 93-0551). Rockville, MD: US Department of Health and Human Services, Public Health Service, Agency for Health Care Policy and Research.
Druss, B. G., Marcus, S. C., Olfson, M., Tanielian, T., Elinson, L., & Pincus, H. A. (2001). Comparing the national economic burden of five chronic conditions. Health Affairs, 20, 233– 241.
Duan, N. (1983). Smearing estimate: A nonparametric retransformation method. Journal of the American Statistical Association, 78, 605–610.
Ettner, S. L., Frank, R. G., & Kessler, R. C. (1997). The impact of psychiatric disorders on labor market outcomes. Industrial and Labor Relations Review, 51, 64–81.
Fortney, J., Rost, K., Zhang, M., & Pyne, J. (2001). The relationship between quality and outcomes in routine depression care. Psychiatric Services, 52, 56–62.
Gibbons, R. D., & Hedeker, D. (1994). Application of random-effects probit regression models. Journal of Consulting and Clinical Psychology, 62, 285–296.
Greenberg, P. E., Kessler, R. C., Nells, T. L., Finkelstein, S. N., & Berndt, E. R. (1996). Depression in the workplace: An economic perspective. In J. P. Feighner & W. F. Boyer (Eds.), Selective Serotonin Re-Uptake Inhibitors: Advances in Basic Research and Clinical Practice (2nd ed.). Chichester, West Sussex England: John Wiley and Sons, Ltd.
Hermann, R. (2002). Linking outcome measurement with process measurement for quality improvement. In W. B. T. IsHak & L. Sederer (Eds.), Outcome Measurement in Psychiatry: A Critical Review. Washington, DC.
Hermann, R. C., Leff, S., Palmer, H., Yang, D., Teller, T., Provost, S., Jakubiak, C., & Chan, J. (2000). Quality measures for mental health care: Research from a national inventory. Medical Care Research and Review, 57(Suppl. 2), 136–154.
Hermann, R. C., & Palmer, R. H. (2002). Common ground: A framework for selecting core quality measures for mental health and substance abuse care. Psychiatric Services, 53, 281–287.
Hoffman, L., Enders, J., Luo, J., Segal, R., Pippins, J., & Kimberlin, C. (2003). Impact of an antidepressant management program on medication adherence. American Journal of Managed Care, 9, 70–80.
Hunkeler, E. M., Meresman, J. F., Hargreaves, W. A., Fireman, B., Berman, W. H., Kirsch, A. J., Groebe, J., Hurt, S. W., Braden, P., Getzell, M., Feigenbaum, P. A., Peng, T., & Salzer, M. (2000). Efficacy of nurse telehealth care and peer support in augmenting treatment of depression in primary care. Archives of Family Medicine, 9, 700–708.
Hunt, J. P., Cherr, G. S., Hunter, C., Wright, M. J., Wang, Y. Z., Steeb, G., Buechter, K. J., Meyer, A. A., & Baker, C. C. (2000). Accuracy of administrative data in trauma: Splenic injuries as an example. Journal of Trauma, Injury, Infection and Critical Care, 49, 679–686.
Jones, D., Hendricks, A., Comstock, C., Rosen, A., Chang, B. H., Rothendler, J., Hankin, C., & Prashker, M. (2000). Eye examinations for VA patients with diabetes: Standardizing performance measures. International Journal for Quality in Heath Care, 12, 97–104.
Katon, W., Robinson, P., Von Korff, M., Lin, E., Bush, T., Ludman, E., Simon, G., & Walker, E. (1996). A multifaceted intervention to improve treatment of depression in primary care. Archives of General Psychiatry, 53, 924–932.
Katon, W., Rutter, C. M., Lin, E., Simon, G., Von Korff, M., Bush, T., Walker, E., & Ludman, E. (2000). Are there detectable differences in quality of care or outcome of depression across primary care providers? Medical Care, 38, 552–561.
Katon, W., Von Korff, M., Lin, E., Simon, G., Walker, E., Unutzer, J., Bush, T., Russo, J., & Ludman, E. (1999). Stepped collaborative care for primary care patients with persistent symptoms of depression: A randomized trial. Archives of General Psychiatry, 56, 1109–1115.
Katon, W., Von Korff, M., Lin, E., Walker, E., Simon, G. E., Bush, T., Robinson, P., & Russo, J. (1995). Collaborative management to achieve treatment guidelines: Impact on depression in primary care. JAMA, 273, 1026–1031.
Katzelnick, D. J., Simon, G. E., Pearson, S. D., Manning, W. G., Helstad, C. P., Henk, H. J., Cole, S. M., Lin, E. H. B., Taylor, L. H., & Kobak, K. A. (2000). Randomized trial of a depression management program in high utilizers of medical care. Archives of Family Medicine, 9, 345–351.
Kessler, R. C., Barber, C., Birnbaum, H. G., Frank, R. G., Greenberg, P. E., Rose, R. M., Simon, G. E., & Wang, P. (1999). Depression in the workplace: Effects on short-term disability. Health Affairs, 18, 163–171.
Kessler, R. C., & Frank, R. G. (1997). The impact of psychiatric disorders on work loss days. Psychological Medicine, 27, 861–873.
Kobak, K. A., Taylor, L., Katzelnick, D. J., Olson, N., Clagnaz, P., & Henk, H. J. (2002). Antidepressant medication management and Health Plan Employer Data Information Set (HEDIS) criteria: Reasons for nonadherence. Journal of Clinical Psychiatry, 63, 727–732.
Kraemer, H. C., Wilson, T., Fairburn, C. G., & Agras, W. S. (2002). Mediators and moderators of treatment effects in randomized clinical trials. Archives of General Psychiatry, 59, 877– 883.
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001). The PHQ: Validity of a brief depression severity measure. Journal of General Internal Medicine, 16, 606–613.
Krumholz, H. M., Radford, M. J., Wang, Y., Chen, J., Heiat, A., & Marciniak, T. A. (1998). National use and effectiveness of beta-blockers for the treatment of elderly patients after acute myocardial infarction: National Cooperative Cardiovascular Project. JAMA, 280, 623–629.
Lave, J. R., Frank, R. G., Schulberg, H. C., & Kamlet, M. S. (1998). Cost-effectiveness of treatments for major depression in primary care practice. Archives of General Psychiatry, 55, 645–651.
Marcotte, D. E., & Wilcox-Gok, V. (2001). Estimating the employment and earnings costs of mental illness: Recent developments in the United States. Social Science and Medicine, 53, 21–27.
Martin, J. K., Blum, T. C., Beach, S. R. H., & Roman, P. M. (1996). Subclinical depression and performance at work. Social Psychiatry and Psychiatric Epidemiology, 31, 3–9.
Melfi, C. A., Chawla, A. J., Croghan, T. W., Hanna, M. P., Kennedy, S., & Sredl, K. (1998). The effects of adherence to antidepressant treatment guidelines on relapse and recurrence of depression. Archives of General Psychiatry, 55, 1128–1132.
NCQA (2003). Antidepressant Medication Management: The State of Health Care Quality 2002.Accessed May 2003. [On-line]. Available: http://www.ncqa.org/sohc2002/sohc_2002_amm.html
Newhouse, J. P., & McClellan, M. (1998). Econometrics in outcomes research: The use of instrumental variables. Annual Review of Public Health, 19, 17–34.
Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical Linear Models: Applications and Data Analysis Methods. (2nd ed.) Thousand Oaks, CA: Sage.
Roberts, K., Cockerham, T. R., & Waugh, W. J. (2002). An innovative approach to managing depression: Focus on HEDIS standards. Journal for Healthcare Quality, 24, 11–17.
Rost, K., Nutting, P., Smith, J., Werner, J., & Duan, N. (2001). Improving depression outcomes in community primary care practice: A randomized trial of the QuEST intervention. Journal of General Internal Medicine, 16, 143–149.
Rost, K., Nutting, P., Smith, J. L., Elliott, C. E., & Dickinson, M. (2002). Managing depression as a chronic disease: A randomised trial of ongoing treatment in primary care. BMJ, 325, 934–939.
Rost, K., Smith, G. R., Guise, B., & Matthews, D. B. (1994). The deliberate misdiagnosis of major depression in primary care. Archives of Family Medicine, 3, 333–337.
Rost, K., Smith, J., & Fortney, J. (2000). Large employers’ selection criteria in purchasing behavioral health benefits. Journal of Behavioral Health Services and Research, 27, 334–338.
Rost, K., Williams, C., Wherry, J., & Smith, G. R., Jr. (1995). The process and outcomes of care for major depression in rural family practice settings. Journal of Rural Health, 11, 114–121.
Rost, K. M., Duan, N., Rubenstein, L. V., Ford, D. E., Sherbourne, C. D., Meredith, L. S., & Wells, K. B. (2001). The Quality Improvement for Depression collaboration: General analytic strategies for a coordinated study of quality improvement in depression care. General Hospital Psychiatry, 23, 239–253.
Rost, K. M., Smith J. L., & Dickinson, L. M. (2004). The effect of improving primary care depression management on employee absenteeism and productivity: A randomized trial. Medical Care, 42, 1202–1210.
Rost, K. M., Pyne, J. M., Dickinson, L. M., & LoSasso, T. (2005). Cost-effectiveness of enhancing primary care depression management on an ongoing basis. Annals of Family Medicine, 3, 15–22.
Rost, K. M., Zhang, M., Fortney, J., Smith, J., & Smith, G. R., Jr. (1998). Rural-urban differences in depression treatment and suicidality. Medical Care, 36, 1098–1107.
Russell, J. M., Patterson, J., & Baker, A. M. (1998). Depression in the workplace: Epidemiology, economics and effects of treatment. Disease Management and Health Outcomes, 4, 135– 142.
Schoenbaum, M., Unutzer, J., McCaffrey, D., Duan, N., Sherbourne, C., & Wells, K. B. (2002). The effects of primary care depression treatment on patients’ clinical status and employment. Health Services Research, 37, 1145–1158.
Schoenbaum, M., Unutzer, J., Sherbourne, C., Duan, N., Rubenstein, L. V., Miranda, J., Meredith, L. S., Carney, M. F., & Wells, K. (2001). Cost-effectiveness of practice-initiated quality improvement for depression: Results of a randomized, controlled trial. JAMA, 286, 1325–1330.
Schulberg, H. C., Block, M. R., Madonia, M. J., Scott, C. P., Rodriguez, E., Imber, S. D., Perel, J., Lave, J., Houck, P. R., & Coulehan, J. L. (1996). Treating major depression in primary care practice: Eight-month clinical outcomes. Archives of General Psychiatry, 53, 913–919.
Simon, G. E., Lin, E. H. B., Katon, W., Saunders, K., VonKorff, M., Walker, E., Bush, T., & Robinson, P. (1995). Outcomes of “inadequate” antidepressant treatment. Journal of General Internal Medicine, 10, 663–670.
Simon, G. E., Manning, W. G., Katzelnick, D. J., Pearson, S. D., Henk, H. J., & Helstad, C. P. (2001). Cost-effectiveness of systematic depression treatment for high utilizers of general medical care. Arch General Psychiatry, 58, 181–187.
Simon, G. E., VonKorff, M., Rutter, C., & Wagner, E. (2000). Randomised trial of monitoring, feedback, and management of care by telephone to improve treatment of depression in primary care. BMJ, 320, 550–554.
Singer, J. D. (1998). Using SAS PROC MIXED to fit multilevel models, hierarchical models, and individual growth models. Journal of Educational and Behavioral Statistics, 23, 323–355.
Sturm, R., Unutzer, J., & Katon, W. (1999). Effectiveness research and implications for study design: Sample size and statistical power. General Hospital Psychiatry, 21, 274–283.
Thompson, J. W., Bost, J., Ahmed, F., Ingalls, C. E., & Sennett, C. (1998). The NCQA’s quality compass: Evaluating managed care in the United States: A brief look at the NCQA’s comparison of health plan performance. Health Affairs, 17, 152–158.
Walsh, B. T., Seidman, S. N., Sysko, R., & Gould, M. (2002). Placebo response in studies of major depression: Variable, substantial, and growing. JAMA, 287, 1840–1847.
Wells, K. B. (1999). The design of partners in care: Evaluating the cost-effectiveness of improving care for depression in primary care. Social Psychiatry and Psychiatric Epidemiology, 34, 20–29.
Wells, K. B., Sherbourne, C. D., Schoenbaum, M., Duan, N., Meredith, L. S., Unutzer, J., Miranda, J., Carney, M. F., & Rubenstein, L. V. (2000). Impact of disseminating quality improvement programs for depression in managed primary care: A randomized controlled trial. JAMA, 283, 212–220.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Rost, K., Dickinson, L.M., Fortney, J. et al. Clinical Improvement Associated with Conformance to HEDIS-Based Depression Care. Ment Health Serv Res 7, 103–112 (2005). https://doi.org/10.1007/s11020-005-3781-1
Issue Date:
DOI: https://doi.org/10.1007/s11020-005-3781-1