Skip to main content

Advertisement

SpringerLink
Log in

Reliability and Validity of the BASIS-24© Mental Health Survey for Whites, African-Americans, and Latinos

  • Regular Article
  • Published:
The Journal of Behavioral Health Services & Research Aims and scope Submit manuscript

Abstract

Increasing racial and ethnic diversity calls for mental health assessment instruments that are appropriate, reliable, and valid for the wide range of cultures that comprise the current US population. However, most assessment instruments have not been tested on diverse samples. This study assessed psychometric properties and sensitivity to change of the revised Behavior and Symptom Identification Scale (BASIS-24©) among the three largest race/ethnicity groups in the USA: Whites, African-Americans, and Latinos. BASIS-24© assessments were obtained for 2436 inpatients and 2975 outpatients treated at one of 27 mental health and/or substance abuse programs. Confirmatory factor analysis and several psychometric tests supported the factor structure, reliability, concurrent validity, and sensitivity of the instrument within each race/ethnicity group, although discriminant validity may be weaker for African-Americans and Latinos than for Whites. Further research is needed to test and validate assessment instruments with other race/ethnicity groups.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Donabedian A. Explorations in quality assessment and monitoring, Vol. I: The definition of quality and approaches to it's assessment. Ann Arbor, MI: Health Administration Press; 1980.

    Google Scholar 

  2. Mirin SM, Namerow MJ. Why study treatment outcome? Hospital and Community Psychiatry. 1991;42:1007–1013.

    CAS  PubMed  Google Scholar 

  3. Eisen SV, Dickey B. Mental health outcome assessment: the new agenda. Psychotherapy. 1996;33:181–189.

    Google Scholar 

  4. Sederer LI, Dickey B, Hermann RC. The imperative of outcomes assessment in psychiatry. In: Sederer LI, Dickey B, eds. Outcomes Assessment in Clinical Practice. Baltimore, MD: Williams & Wilkins; 1996:1–7.

    Google Scholar 

  5. Smith GR, Fischer EP, Nordquist CR, et al. Implementing outcomes management systems in mental health settings. Psychiatric Services. 1997;48:364–368.

    PubMed  Google Scholar 

  6. Smith GR, Manderscheid RW, Flynn LM, et al. Principles for assessment of patient outcomes in mental health care. Psychiatric Services. 1997;48:1033–1036.

    PubMed  Google Scholar 

  7. Hodges K, Wotring J. The role of monitoring outcomes in initiating implementation of evidence-based treatments at the state level. Psychiatric Services. 2004;55:396–400.

    Article  PubMed  Google Scholar 

  8. Brown GS, Burlingame GM, Lambert MJ. Pushing the quality envelope: a new outcomes management system. Psychiatric Services. 2001;52:925–934.

    Article  PubMed  CAS  Google Scholar 

  9. Joint Commission on Accreditation of Healthcare Organizations. Oryx Outcomes: The Next Evolution in Accreditation. Oakbrook Terrace, IL; 1997.

  10. National Committee for Quality Assurance. 2001 Standards and Surveyor Guidelines for the Accreditation of MBHO's. Washington, DC; 2000.

  11. Sechrest L, McKnight P, McKnight K. Calibration of measures for psychotherapy outcome studies. American Psychologist. 1996;51:1065–1071.

    Article  PubMed  CAS  Google Scholar 

  12. Lambert MJ, Gregersen AT, Burlingame GM. The Outcome Questionnaire-45. In: Maruish MM, ed. The Use of Psychological Testing for Treatment Planning and Outcome Assessment, Third Edition. Volume 3. Mahwah, NJ: Lawrence Erlbaum Associates; 2004:191–234.

    Google Scholar 

  13. McLellan AT, Cacciola J. Kushner H, et al. The fifth edition of the addiction severity index: cautions, additions and normative data. Journal of Substance Abuse and Treatment. 1992;9:461–480.

    Article  Google Scholar 

  14. Derogatis LR, Fitzpatrick M. The SCL-90-R, the Brief Symptom Inventory (BSI) and the BSI-18. In: Maruish MM, ed. The Use of Psychological Testing for Treatment Planning and Outcome Assessment, Third Edition. Volume 3. Mahwah, NJ: Lawrence Erlbaum Associates; 2004:1–41.

    Google Scholar 

  15. McHorney CA, Ware JE, Lu, et al. The MOS 36-item short-form health survey (SF-36): III. Tests of data quality, scaling assumptions, and reliability across diverse patient groups. Medical Care. 1994;32:40–66.

    Article  PubMed  CAS  Google Scholar 

  16. Chow JC-C, Snowden LR, McConnell W. A confirmatory factor analysis of the BASIS-32 in racial and ethnic samples. Journal of Behavioral Health Services & Research. 2001;28:400–411.

    Article  CAS  Google Scholar 

  17. Stewart AL, Nápoles-Springer A. Health-related quality of life assessments in diverse population groups in the United States. Medical Care. 2000;38(Supplement II):II102–II124.

    Article  PubMed  CAS  Google Scholar 

  18. Canino G, Bravo M. The adaptation and testing of diagnostic and outcome measures for cross-cultural research. International Review of Psychiatry. 1994;6:281–286.

    Article  Google Scholar 

  19. U.S. Department of Health & Human Services. Culture, Race and Ethnicity. A Supplement to Mental Health: A Report of the Surgeon General. Chapter 6. Mental Health Care for Hispanic Americans. Office of the Surgeon General. Substance Abuse and Mental Health Services Administration, Center for Mental Health Services; 2001:129–155.

  20. Shrout PE, Canino GJ, Bird HR, et al. Mental health status among Puerto Ricans, Mexican Americans and non-Hispanic whites. American Journal of Community Psychology. 1993;21:383–395.

    Article  Google Scholar 

  21. Phillips D, Leff HS, Kaniasty E, et al. Culture, Race and Ethnicity in Performance Measurement: A Compendium of Resources. The Evaluation Center @ HSRI. Cambridge, MA: Human Services Research Institute; 1999.

    Google Scholar 

  22. Eisen SV, Dill DL, Grob MC. Reliability and validity of a brief patient-report instrument for psychiatric outcome evaluation. Hospital and Community Psychiatry. 1994;45:242–247.

    CAS  PubMed  Google Scholar 

  23. Eisen SV, Normand SLT, Belanger AJ, et al. BASIS-32® and the Revised Behavior and Symptom Identification Scale (BASIS-R). In: Maruish MM, ed. The Use of Psychological Testing for Treatment Planning and Outcome Assessment, Third Edition. Volume 3. Mahwah, NJ: Lawrence Erlbaum Associates; 2004:79–115.

    Google Scholar 

  24. Eisen SV, Normand SLT, Belanger AJ, et al. The revised Behavior and Symptom Identification Scale (BASIS-24): reliability and validity. Medical Care. 2004;42:1230–1241.

    Article  PubMed  Google Scholar 

  25. Lessler JT. Choosing questions that people can understand and answer. Medical Care. 1995;33:AS203–AS208.

    PubMed  CAS  Google Scholar 

  26. DeMaio TJ, Rothgeb JM. Cognitive interviewing techniques: in the lab and in the field. In: Schwarz N, Sudman S, eds. Answering Questions: Methodology for Determining Cognitive and Communicative Processes in Survey Research. San Francisco: Jossey-Bass; 1996:177–195.

    Google Scholar 

  27. Nunnaly JC, Bernstein IH. Psychometric Theory. 3rd ed. New York: McGraw-Hill; 1994.

    Google Scholar 

  28. Embretson SE. The new rules of measurement. Psychological Assessment. 1996;8:341–349.

    Article  Google Scholar 

  29. Hays RD, Morales LS, Reise SP. Item response theory and health outcomes measurement in the 21st century. Medical Care. 2000;38(9 Suppl): II28–II42.

    PubMed  CAS  Google Scholar 

  30. Hambleton RK. Emergence of item response modeling in instrument development and data analysis. Medical Care. 2000;38(9 suppl):II60–II65.

    PubMed  CAS  Google Scholar 

  31. McHorney CA. Generic health measurement: past accomplishments and a measurement paradigm for the 21st century. Annals of Internal Medicine. 1997;127:743–750.

    PubMed  CAS  Google Scholar 

  32. Ware JE, Kosinksi M, Keller S. A 12-item short-form health survey (SF-12): construction of scales and preliminary tests of reliability and validity. Medical Care. 1996;24:220–233.

    Article  Google Scholar 

  33. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders. Fourth Edition (DSM-IV). Washington, DC: American Psychiatric Association; 1994.

    Google Scholar 

  34. Spitzer RL, Gibbon M, Endicott J. Global Assessment Scale (GAS), Global Assessment of Functioning (GAF) Scale, Social and Occupational Functioning Assessment Scale (SOFAS). In: Handbook of Psychiatric Measures. Washington, DC: American Psychiatric Association; 2000:96–100.

  35. Friedman DJ, Cohen BB, Averbach AR, et al. Race/ethnicity and OMB directive 15: implications for state public health practice. American Journal of Public Health. 2000;90:1714–1719.

    Article  PubMed  CAS  Google Scholar 

  36. Little RJA. Regression with missing X's: a review. Journal of the American Statistical Association. 1992;87:1227–1237.

    Article  Google Scholar 

  37. Joreskog K, Sorbom D. LISREL 8.53: Structural Equation Modeling with the SIMPLIS Command Language. Chicago: Scientific Software International; 2002.

    Google Scholar 

  38. Cronbach LJ. Coefficient alpha and the internal structure of tests. Psychometrika. 1951;16:297–334.

    Article  Google Scholar 

  39. Hu L, Bentler PM. Cutoff criterion for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Structural Equation Modeling. 1999;6:1–55.

    Article  Google Scholar 

  40. Browne MS, Cudeck R. Alternative ways of assessing model fit. In: Bollen KA, Long JS, eds. Testing Structural Equation Models. Newbury Park, CA: Sage; 1993:136–162.

    Google Scholar 

  41. Cohen J. Statistical Power Analysis for the Behavioral Sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum Associates; 1988.

    Google Scholar 

  42. Eisen SV, Culhane MA. Behavior and Symptom Identification Scale (BASIS-32). In: Maruish MM, ed. The Use of Psychological Testing for Treatment Planning and Outcome Assessment, Second Edition. Mahwah, NJ: Lawrence Erlbaum Associates; 1999:759–790.

    Google Scholar 

  43. Canino G, Bravo M. The adaptation and testing of diagnostic and outcome measures for cross-cultural research. International Review of Psychiatry. 1994;6:281–286.

    Article  Google Scholar 

  44. U.S. Department of Health & Human Services. Culture, Race and Ethnicity. A Supplement to Mental Health: A Report of the Surgeon General. Chapter 6, Mental health care for Hispanic Americans. Office of the Surgeon General. Substance Abuse and Mental Health Services Administration, Center for Mental Health Services; 2001:129–155.

  45. Canino G, Lewis-Fernandez R, Bravo M. Methodological challenges in cross-cultural mental health research. Transcultural Research. 1997;23:163–184.

    Article  Google Scholar 

  46. Moos RH, McCoy L, Moos BS. Global assessment of functioning (GAF) ratings: determinants and role as predictors of one-year treatment outcomes. Journal of Clinical Psychology. 2000;56:449–460.

    Article  PubMed  CAS  Google Scholar 

  47. Moos RH, Nichol AC, Moos BS. Global assessment of functioning ratings and the allocation and outcomes of mental health services. Psychiatric Services. 2002;53:730–737.

    Article  PubMed  Google Scholar 

  48. Wang PS, Lane ML, Olfson M, et al. Twelve-month use of mental health services in the United States. Results from the national comorbidity survey replication. Archives of General Psychiatry. 2005;62:629–640.

    Article  PubMed  Google Scholar 

  49. Wang PS, Berglund P, Olfson M. Failure and delay in initial treatment contact after first onset of mental disorders in the national comorbidity survey replication. Archives of General Psychiatry. 2005;62:603–613.

    Article  PubMed  Google Scholar 

Download references

Acknowledgments

This research was supported by grant R01 MH58240 from the National Institute of Mental Health and by the Veterans Administration Health Services Research & Development program. The views expressed in this article are those of the authors and do not necessarily represent the views of the Department of Veterans Affairs. The authors thank the clinical programs that participated in this research and colleagues Barbara Bokhour, Ph.D., Rani Elwy, Ph.D. Donald Miller, Sc.D., and Avron Spiro III, Ph.D., for their comments on earlier versions of this manuscript.

Author information

Authors and Affiliations

  1. Health Services Department, Boston University School of Public Health, Boston, MA, USA

    Susan V. Eisen PhD (Associate Professor, health research scientist)

  2. Center for Health Quality, Outcomes & Economic Research (CHQOER), Edith Nourse Rogers Memorial Veterans Hospital, 200 Springs Road (152), Bedford, MA, 01730, USA

    Susan V. Eisen PhD (Associate Professor, health research scientist)

Authors
  1. Susan V. Eisen PhD
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mariana Gerena PhD
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Gayatri Ranganathan MS
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. David Esch PhD
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Thomas Idiculla MSW
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Susan V. Eisen PhD.

Additional information

Mariana Gerena, PhD, is a senior research scientist at the Institute on Urban Health Research, 503 Stearns, Northeastern University, 360 Huntington Avenue, Boston, MA 02115, USA. Phone: +1-617-3735177. Fax: +1-617-3737309. E-mail: gerena@neu.edu.

Gayatri Ranganathan, MS, is a biostatistician at MetaWorks Inc., 10 President’s Landing, Medford, MA 02155, USA. Phone: +1-781-3950700. Fax: +1-781-3957336. E-mail: gayatrir@bu.edu.

David Esch, PhD, is an analyst at MDT Advisers, 125 Cambridge Park Drive, Cambridge, MA 02140-2329, USA. Phone: +1-617-2342200. Fax: +1-617-2342210. E-mail: esch@mdtai.com.

Thomas Idiculla, MSW, is a doctoral candidate at the Boston College Graduate School of Social Work and Quality Indicators Data Manager, Department of Mental Health Services Evaluation, McLean Hospital, 115 Mill Street, Belmont, MA 02478, USA. Phone: +1-617-8552432. Fax: +1-617-8552948. E-mail: idicult@mcleanpo.mclean.org.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Eisen, S.V., Gerena, M., Ranganathan, G. et al. Reliability and Validity of the BASIS-24© Mental Health Survey for Whites, African-Americans, and Latinos. JBHSR 33, 304–323 (2006). https://doi.org/10.1007/s11414-006-9025-3

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11414-006-9025-3

Keywords

Search

Navigation