Mental Health Services Research

, Volume 3, Issue 3, pp 141–153

Reliability and Validity of a Modified Colorado Symptom Index in a National Homeless Sample

  • Kendon J. Conrad
  • John R. Yagelka
  • Michael D. Matters
  • Alexander R. Rich
  • Valerie Williams
  • Mary Buchanan
Article

Abstract

This study examined the reliability and construct validity of a modified version of the Colorado Symptom Index (MCSI), a brief, self-report measure of psychological symptomatology, in a study of interventions to prevent homelessness. Eight projects in a national, cooperative study collected new data at baseline, 6, and 12 months using a set of common measures as well as site-specific instruments. The pooled sample consisted of 1,381 persons in treatment for mental illness or substance abuse (or both), of which 84% had a history of homelessness. The analyses employed classical and Rasch methods to examine the MCSI's content validity, internal consistency and item quality, test/retest reliability, dimensionality, appropriateness for the sample, construct validity, and responsiveness to change. This 14-item scale was found to be a reliable and valid measure of psychological symptoms in this sample. Its content was consistent with other symptom measures, its high internal consistency and test-retest coefficients supported its reliability, its relationships to other measures indicated that it had good construct validity, and it was responsive to change. We conclude that the MCSI performed similarly to longer, more widely used measures of psychological symptomatology and could be useful in other studies targeting homeless adults with severe mental illness, substance use disorders, or both.

psychometrics Rasch analysis psychological symptoms homeless 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

REFERENCES

  1. Bassuk, E. L., Rubin, L., & Lauriat, M. A. (1984). Is homelessness a mental health problem? American Journal of Psychiatry, 141, 1546–1550.Google Scholar
  2. Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56(2), 81–105.Google Scholar
  3. Cattell, R. B. (1966). The meaning and strategic use of factor analysis. In R. B. Cattell (ed.), Handbook of multivariate experimental psychology. Chicago: Rand McNally.Google Scholar
  4. Ciarlo, J. A., Edwards, D. W., Kiresuk, T. J., Newman, F. L., & Brown, T. R. (1981). The assessment of client /patient outcome techniques for use in mental health.Washington, DC: National Institute of Mental health. (Contract No. 278-80-0005)Google Scholar
  5. Ciarlo, J. A., & Riehman, J. (1977). The Denver Community Mental Health Questionnaire: Development of a multidimensional program evaluation instrument. In R. Coursey, G. Spector, S. Morell, & D. Hunt (Eds.), Program evaluation for mental health: Methods, strategies and participants. New York: Grune and Stratton.Google Scholar
  6. Cohen, J. (1977). Statistical power analysis for the behavioral science. New York: Academic Press.Google Scholar
  7. Conrad, K. J., Matters, M. D., Hanrahan, P., & Luchins, D. J. (Eds.). (1999). Homelessness prevention in treatment of substance abuse and mental illness: Logic models and implementation of eight American projects. New York: Haworth Press. (Co-published as Alcoholism Treatment Quarterly, 17(1/2))Google Scholar
  8. Conrad, K. J., Quasius, D. L., Matters, M. D., Hanrahan, P., & Luchins, D. J. (in press). A money management outcome measure. Chicago, IL: University of Illinois at Chicago, School of Public Health.Google Scholar
  9. Derogatis, L.R. (1993). Brief Symptom Inventory (BSI) administration, scoring, and procedures manual (3rd ed.). Minneapolis: National Computer Systems.Google Scholar
  10. Derogatis, L.R. (1994). SCL-90-R administration, scoring, and procedures manual. Minneapolis: National Computer Systems.Google Scholar
  11. Green, R. S., & Gracely, E. J. (1987). Selecting a rating scale for evaluation services to the chronically mentally ill. Community Mental Health Journal, 23(2), 91–102.Google Scholar
  12. Hedges, L. V., & Olkin, I. (1985). Statistical methods for metaanalysis. Orlando, FL: Academic Press.Google Scholar
  13. Hedlund, J. L., & Vieweg, B.W. (1980). The Brief Psychiatric Rating Scale (BPRS): A comprehensive review. Journal of Operational Psychiatry, 11(1), 48–65.Google Scholar
  14. Jennrich, R. I., & Sampson, P. F. (1966). Rotation for simple loadings. Psychometrika, 31, 313–323.Google Scholar
  15. Kaiser, H. F. (1958). The varimax criterion for analytic rotation in factor analysis. Psychometrika, 23, 187–200.Google Scholar
  16. Kaiser, H. F. (1960). The application of electronic computers to factor analysis. Educational Psychological Measurement, 20, 141–151.Google Scholar
  17. Koegel, P., Burnam, A., & Farr, R. K. (1988). The prevalence of specific psychiatric disorders among homeless individuals in the inner city of Los Angeles. Archives of General Psychiatry, 45, 1085–1092.Google Scholar
  18. Lee, B., Shern, D., & Coen, A. (1999). Reliability, stability, and sensitivity of the Colorado Symptom Index. Unpublished manuscript.Google Scholar
  19. Lehman, A. F. (1991). Quality of life interview core version. Baltimore, MD: Johns Hopkins University.Google Scholar
  20. Linacre, J. M., & Wright, B.D. (1998).Auser's guide to WINSTEPS, BIGSTEPS, and MINISTEPS. Chicago: Mesa Press.Google Scholar
  21. Lipsey, M. W., & Wilson, D. B. (1996). Toolkit for practical metaanalysis. Boston: HSRI.Google Scholar
  22. Lyons, J. S., Coleta, J., Devens, M., & Finkel, S. I. (1995). The validity of the Severity of Psychiatric Illness in a sample of psychogeriatric patients. International Journal of Psychogeriatrics, 7, 407–412.Google Scholar
  23. Lyons, J. S., O'Mahoney, M. T., Doheny, K. M., Dworkin, L. N., & Miller, S. I. (1995). The prediction of short stay psychiatric inpatients. Administration and Policy in Mental Health, 23, 17–25.Google Scholar
  24. Lyons, J. S., O'Mahoney, M. T., Miller, S. I., Neme, J., Kabat, J., & Miller, F. (1997). Predicting readmission to the psychiatric hospital in a managed care environment: Implications for quality indicators. American Journal of Psychiatry, 154, 337–340.Google Scholar
  25. Lyons, J. S., Stutesman, J., Neme, J., Vessey, J. T., O'Mahoney, M. T., & Camper, J. (1997). Predicting psychiatric emergency admissions and hospital outcomes. Medical Care, 35(8), 792–800.Google Scholar
  26. McLellan, A. T., Alterman, A. I., Woody, G. E., & Metzer, D. (1992). Treatment services review. Philadelphia: University of Pennsylvania.Google Scholar
  27. Mercer-McFadden, C., & Drake, R.E. (1992).AReview of outcome measures for assessing homeless populations with severe mental illness and co-occurring substance abuse. Dartmouth, NH: New Hampshire-Dartmouth Psychiatric Research Center. (NIMH Contract Order No. 91MF45295301D)Google Scholar
  28. New Hampshire-Dartmouth Psychiatric Research Center. (1995). Residential follow-back calendar, version - 6/1/95. Lebanon, NH: Dartmouth Medical School.Google Scholar
  29. Overall, J. E., & Gorham, D. R. (1962).The Brief Psychiatric Rating Scale. Psychological Reports, 10, 799–812.Google Scholar
  30. Policy Research Associates. (2000). Draft final report on the crosssite evaluation of the collaborative program to prevent homelessness. Delmar, NY. Author. (DRAFT)Google Scholar
  31. Reckase, M. (1979). Unifactor latent trait models applied to multifactor tests: Results and implications. Journal of Educational Statistics, 4, 207–230.Google Scholar
  32. Rich, A., & Clark, C. (1997).Treatment services needed and received. Tampa, (FL): Louis de la Parte Florida Mental Health Center.Google Scholar
  33. Rickards, L. D., Leginski, W., Randolph, F. L., Oakley, D., Herrell, J. M., & Gallagher, C. (1999). Cooperative agreements for CMHS/CSATcollaborative program to prevent homelessness: An overview. In K. J. Conrad, M. D. Matters, P. Hanrahan, & D. J. Luchins (Eds.), Homelessness prevention in treatment of substance abuse and mental illness: Logic models and implementation of eight American projects (pp. 1–15). New York: Haworth Press. (Co-published as Alcoholism Treatment Quarterly, 17, (1/2))Google Scholar
  34. Rosenberg, M. (1989). Society and the adolescent self-image. Middleton, CT: Wesleyan University Press.Google Scholar
  35. Shern, D. L., Wilson, N. Z., & Coen, A. S. (1994). Client outcomes II: Longitudinal client data from the Colorado treatment outcome study. Milbank Quarterly, 72(1), 123–148.Google Scholar
  36. Shorkey, C. T., & Whiteman, V. L. (1978). Correlations between standard English and dialectical Spanish versions of five personality tests. Psychological Reports, 4(3), 910.Google Scholar
  37. Silber, E., & Tippett, J. (1965). Self-esteem: Clinical assessment and measurement validation. Psychological Reports, 16, 1017–1071.Google Scholar
  38. Toro, P. A., & Wall, D.D. (1991). Research on homeless persons: Diagnostic comparisons and practice implications. Professional Psychology: Research and practice, 22(6), 479–488.Google Scholar
  39. Wilcoxon, F. (1945). Individual comparisons by ranking methods. Biometrics, 1, 80–83.Google Scholar
  40. Wright, B. D., & Masters, G. N. (1982). Rating scale analysis: Rasch measurement. Chicago: Mesa Press.Google Scholar

Copyright information

© Plenum Publishing Corporation 2001

Authors and Affiliations

  • Kendon J. Conrad
    • 1
  • John R. Yagelka
    • 2
  • Michael D. Matters
    • 3
  • Alexander R. Rich
    • 4
  • Valerie Williams
    • 5
  • Mary Buchanan
    • 6
  1. 1.Department of Veterans AffairsHines VA HospitalHines
  2. 2.Center for Therapeutic Community Research, National Development Research InstituteNew York
  3. 3.Health Policy and Administration, School of Public HealthUniversity of Illinois at ChicagoChicago
  4. 4.Department of Community Mental HealthUniversity of South FloridaTampa
  5. 5.Policy Research Associates, Inc.Delmar
  6. 6.Philadelphia Health Management CorporationPhiladelphia

Personalised recommendations