Comparison of Self-report and Clinician-rated Measures of Psychiatric Symptoms and Functioning in Predicting 1-year Hospital Readmission

  • Karen M. Clements
  • Jane M. Murphy
  • Susan V. Eisen
  • Sharon-Lise T. Normand
Original paper

Abstract

This study compared the self-report Behavior and Symptom Identification Scale (BASIS-32) and clinician-rated Global Assessment of Functioning (GAF) in their ability to predict a measure of psychiatric outcome, 1-year psychiatric hospital readmission. BASIS-32 and GAF were completed at admission for 1034 patients in an inpatient psychiatric facility. Multiple informants analysis was used to determine the difference between the two in predicting readmission within 1 year. We also examined sensitivity, specificity, and predictive value positive of the two measures, and whether self-report added information above clinician rating in predicting outcome. While the odds of 1-year readmission decreased with increasing BASIS-32 score, there was no association between change in GAF score and 1-year readmission. Although neither measure used alone demonstrated high predictive value, using both scores improved predictive ability over using clinician rating alone. In this setting, self-report was better than clinician rating in predicting psychiatric outcome. Differences between the two in relation to other outcomes need to be examined.

Keywords

Psychiatric rehospitalization self-report Clinician rating BASIS-32 GAF Multiple informant analysis 

References

  1. Atkinson, M., Zibin, S., & Chuang, H. (1997). Characterizing quality of life among patients with chronic mental illness: A critical examination of the self-report methodology. American Journal of Psychiatry, 154(1), 99–105.PubMedGoogle Scholar
  2. Caldecott-Hazard, S., & Hall, R. C. (1995). Outcome assessment in depressed hospitalized patient. Journal of the Florida Medical Association, 82(1), 24–29.Google Scholar
  3. Coffey, M., Jones, S. H., & Thornicroft, G. (1996). A brief mental health outcome scale: Relationships between scale scores and diagnostic/sociodemographic variables in the long-term mentally ill. Journal of Psychiatric and Mental Health Nursing, 3(2), 89–93.PubMedCrossRefGoogle Scholar
  4. Dickey, B., & Wagenaar, H. (1996). Evaluating health status. In L. I. Sederer & B. Dickey (Eds.), Outcomes assessment in clinical practice (pp. 56–57). Philadelphia, PA: Lippincott Williams & Wilkins.Google Scholar
  5. DSM-IV (1994). Diagnostic and statistical manual of mental disorders, fourth edition. Washington, DC: American Psychiatric Association.Google Scholar
  6. Eisen, S. V., & Culhane, M. A. (1999). Behavior and Symptom Identification Scale (BASIS-32). In M. E. Maruish (Ed.), The use of psychological testing for treatment planning and outcomes asessment second edition (pp. 759–790). Mahway NJ: Lawrence Erlbaum Associates.Google Scholar
  7. Eisen, S., Dill, D., & Grob, M. C. (1994). Reliability and validity of a brief patient-report instrument for psychiatric outcome evaluation. Hospital and Community Psychiatry, 45(3), 242–247.PubMedGoogle Scholar
  8. Eisen, S. V., Grob, M. C., & Dill, D. L. (1991). Outcome measurement: Tapping the patient’s perspective. In S. M. Mirin, J. Gossett, & M. C. Grob (Eds.), Psychiatric treatment: Advances in outcome research (pp. 213–235). Washington, DC: American Psychiatric Press.Google Scholar
  9. Garb, H. N. (2003). Incremental validity and the assessment of psychopathology in adults. Psychological Assessment, 15(4), 508–520PubMedCrossRefGoogle Scholar
  10. Goethe, J. W., Fischer, E. H., & Dornelas, E. A. (1997). Assessing outcomes: Identifying psychiatric patients with severe and persistent illness. Connecticut Medicine, 61(9), 559–564PubMedGoogle Scholar
  11. Goldman, H. H., Skodol, A. E., & Lave, T. R. (1992). Revising axis V for DSM-IV: A review of measures of social functioning. American Journal of Psychiatry, 149(9), 1148–1156PubMedGoogle Scholar
  12. Goldstein, J. M., & Simpson, J. C. (1995). Validity: Definitions and applications to psychiatric research. In M. T. Tsuang, M. Tohen, & G. E. Zahner (Eds.), Textbook of psychiatric epidemiology (pp. 229–242). New York: John Wiley and sons, Inc.Google Scholar
  13. Hall, R. C. (1995). Global assessment of functioning, a modified scale. Psychosomatics 36(3), 267–274.PubMedGoogle Scholar
  14. Hanley, J. A., & McNeil, B. J. (1983). A method of comparing the areas under the Receiver Operating Characteristic Curves derived from the same cases. Radiology, 148(3), 839–843.PubMedGoogle Scholar
  15. Hendryx, M. S., Russo, J. E., Stegner, B., Dyck, D. G., Ries, R. K., & Roy-Byrne, P. (2003). Predicting rehospitalization and outpatient services from administration and clinical databases. Journal of Behavioral Health Services Research, 30(3), 342–351.PubMedCrossRefGoogle Scholar
  16. Horton, N. J., Laird, N. M., Murphy, J. M., Monson, R. R., Sobol, A. M., & Leighton, A. H. (2001). Multiple informants: Mortality associated with psychiatric disorders in the Stirling County Study. American Journal of Epidemiology, 154(7), 649–656.PubMedCrossRefGoogle Scholar
  17. Horton, N. J., Laird, N. M., & Zahner, G. E. (1999). Use of multiple informant data as a predictor in psychiatric epidemiology. International Journal of Methods in Psychiatric Research, 8(1), 6–18.CrossRefGoogle Scholar
  18. Hudson, C. G., Dorwart, R. A., & Wieman, D. A. (1998). Impact of Medicaid Behavioral Carve-out program on patterns of acute psychiatric hospitalization, the Massachusetts experience FY 1996–FY 1997. Retrieved September, 2002, from http://www.salemstate.edu/socialwork/casemix.pdfGoogle Scholar
  19. Hunsley, J., & Meyer, G. (2003). The incremental validity of psychological testing and assessment: Conceptual, methodological, and statistical issues. Psychological Assessment, 15(4), 446–455.PubMedCrossRefGoogle Scholar
  20. Jones, S. H., Thornicroft, G., Coffey, M., & Dunn, G. (1995). A brief mental health outcome scale-reliability and validity of the Global Assessment of Functioning (GAF). British Journal of Psychiatry, 166(5), 654–659.PubMedCrossRefGoogle Scholar
  21. Kroenke, K., West, S. L., Swindle, R., Gilsenan, A., Eckert, G. J., Dolor, R., Stang, P., Zhou, X. H., Hays, R., & Weinberger, M. (2001). Similar effectiveness of paroxetine, fluoxetine, and sertraline in primary care: A randomized trial. Journal of the American Medical Association, 286(23), 2947–2955.PubMedCrossRefGoogle Scholar
  22. Lash, T. L., Thwin, S. S., Horton, N. J., Guadagnoli, E., & Silliman, R. A. (2003). Multiple informants: A new method to assess breast cancer patients’ comorbidity. American Journal of Epidemiology, 157(3), 249–257.PubMedCrossRefGoogle Scholar
  23. Merchant, D. J., & Henfling, P. A. (1994). Scheduled brief admissions: Patient “tueneups”. The Journal of Psychosocial Nursing and Mental Health Services, 32(12), 7–10.Google Scholar
  24. Miller, J. S., O’Mahoney, M. T., Miller, S. I., Neme, J., Kabut, J., & Miller, F. (1997). Predicting readmission to the psychiatric Hospital in a managed care environment: Implications for quality indicators. American Journal of Psychiatry, 154(3), 337–340.PubMedGoogle Scholar
  25. Mirin, S. M., & Namerow, M. J. (1991). Why study treatment outcome? Hospital and Community Psychiatry, 42(10), 1007–1013.PubMedGoogle Scholar
  26. Monnelly, E. P. (1997). Instability before discharge and previous psychiatric admissions as predictors of early readmission. Psychiatric Services, 48(12), 1584–1586.PubMedGoogle Scholar
  27. Moos, R. H., McCoy, L., & Moos, B. S. (2000). Global assessment of functioning (GAF) ratings: Determinants and role as predictors of one-year treatment outcomes. Journal of Clinical Psychology, 56(4), 449–461.PubMedCrossRefGoogle Scholar
  28. Moos, R. H., Nichol, A. C., & Moos, B. S. (2002). Global assessment of functioning ratings and the allocation and outcomes of mental health services. Psychiatric Services, 53(6), 730–737.PubMedCrossRefGoogle Scholar
  29. Oiesvold, T., Saarento, O., Sytema, S., Vinding, H., Gostas, G., Lonnerberg, O., Muus, S., Sandlund, M., & Hansson, L. (2000). Predictors for readmission risk of new patients: The Nordic comparative study on sectorized psychiatry. Acta Psychiatrica Scandinavica, 101(5), 367–373.PubMedCrossRefGoogle Scholar
  30. Parker, G., O’Donnell, M., Hadzi-Pavlovic, D., & Proberts, M. (2002). Assessing outcome in community mental health patients: A comparative analysis of measures. International Journal of Social Psychiatry, 48(1), 11–19.PubMedCrossRefGoogle Scholar
  31. Pepe, M. S., Whitaker, R. C., & Seidel, K. (1999). Estimating and comparing univariate associations with application to the prediction of adult obesity. Statistics in Medicine, 18(2), 163–173.PubMedCrossRefGoogle Scholar
  32. Piersma, H. L., & Boes, J. L. (1997). The GAF and Psychiatric outcome: A descriptive report. Community Mental Health Journal, 33(1), 35–40.PubMedCrossRefGoogle Scholar
  33. Ruggeri, M., Biggeri, A., Rucci, P., & Tansella, M. (1998). Multivariate analysis of outcome of mental health care using graphical chain models: The South-Verona Outcome Project 1. Psychological Medicine, 28(6), 1421–1431.PubMedCrossRefGoogle Scholar
  34. Russo, J., Roy-Byrne, P., Jaffe, C., Ries, R., Dagadakis, C., Dwyer-O’Connor, E., & Reeder, D. (1997a). The relationship of patient-administered outcome assessments to quality of life and clinician ratings: Validity of the BASIS-32. Journal of Mental Health Administration, 24(2), 199–214.CrossRefGoogle Scholar
  35. Russo, J., Roy-Byrne, P., Jaffe, C., Ries, R., Dagadakis, C., & Avery, D. (1997b). Psychiatric status, quality of life and level of care as predictors of outcomes of acute inpatient treatment. Psychiatric Services, 48(11), 1427–1433.Google Scholar
  36. SAS Institute, Inc. SAS/Stat user’s guide: version 8. Carry, NC: SAS Institute.Google Scholar
  37. Sederer, L. I., Dickey, B., & Hermann, R. C. (1996). The imperative of outcomes assessment in psychiatry. In L. I. Sederer & B. Dickey (Eds.), Outcomes assessment in clinical practice (pp. 1–7). Baltimore MD: Lippincott Williams & Wilkins.Google Scholar
  38. Sohlberg, S. (1989). There’s more in a number than you think: New validity data for the Global Assessment Scale. Psychological Reports, 64(2), 455–461.PubMedGoogle Scholar
  39. Spitzer, R. L., Williams, J. B. W., Gibbon, M., & First, M. B. (1992). The Structured Clinical Interview for DSM-III-R (SCID) 1: History, rational and description. Archives of General Psychiatry, 49(8), 624–662.PubMedGoogle Scholar
  40. Thornicroft, G., Gooch, C., & Dayson, D. (1992). Readmission to hospital for long term psychiatric patients after discharge to the community. British Medical Journal 305(6860), 996–998.PubMedCrossRefGoogle Scholar
  41. Vetter, P., & Koller, O. (1996). Clinical and psychosocial variables in different diagnostic groups: Their interrelationships and value as predictors of course and outcome during a 14-year follow-up. Psychopathology, 29(3), 159–168.PubMedCrossRefGoogle Scholar
  42. Walker, R., Minor-Schork, D., Bloch, R., & Esinhart, J. (1996). High risk factors for rehospitalization within six months. Psychiatric Quarterly, 67(3), 235–243.PubMedCrossRefGoogle Scholar
  43. Zeger, S. L., & Liang, K. Y. (1986). Longitudinal data analysis for discrete and continuous outcomes. Biometrics, 42(1), 121–130.PubMedCrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, Inc. 2006

Authors and Affiliations

  • Karen M. Clements
    • 1
    • 7
  • Jane M. Murphy
    • 1
    • 2
    • 8
  • Susan V. Eisen
    • 3
    • 4
  • Sharon-Lise T. Normand
    • 5
    • 6
  1. 1.Department of EpidemiologyHarvard School of Public HealthBostonUSA
  2. 2.Department of PsychiatryHarvard Medical SchoolBostonUSA
  3. 3.Center for Health Quality, Outcomes & Economic ResearchEN Rogers Memorial Veterans HospitalBedfordUSA
  4. 4.Health Services DepartmentBoston University School of Public HealthBostonUSA
  5. 5.Department of BiostatisticsHarvard School of Public HealthBostonUSA
  6. 6.Department of Health Care PolicyHarvard Medical SchoolBostonUSA
  7. 7.Massachusetts Department of Public HealthApplied Statistics, Evaluation and Technical ServicesBostonUSA
  8. 8.Department of PsychiatryMass General Hospital-EastCharlestownUSA

Personalised recommendations