Skip to main content

Advertisement

SpringerLink
Log in

Keeping Clubhouses Open: Toward a Roadmap for Sustainability

  • Original Article
  • Published:
Administration and Policy in Mental Health and Mental Health Services Research Aims and scope Submit manuscript

Abstract

Clubhouses are recovery centers that help persons with serious mental illness obtain and maintain community-based employment, education, housing, social integration, and other services. Key informants from U.S. clubhouses were interviewed to create a conceptual framework for clubhouse sustainability. Survival analyses tested this model for 261 clubhouses. Clubhouses stayed open significantly longer if they had received full accreditation, had more administrative autonomy, and received funding from multiple rather than sole sources. Cox regression analyses showed that freestanding clubhouses which were accredited endured the longest. Budget size, clubhouse size, and access to managed care did not contribute significantly to sustainability.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  • Aquila, R., Santos, G., Malamud, T. J., & McCrory, D. (1999). The rehabilitation alliance in practice: The clubhouse connection. Psychiatric Rehabilitation Journal, 23, 19–24. doi:10.1037/h0095199.

    Article  Google Scholar 

  • Auerbach, C., & Silverstein, L. B. (2003). Qualitative data: An introduction to coding and analysis. New York: New York University Press.

    Google Scholar 

  • Bagdonavicus, V., Kruopis, J., & Nikulin, M. (2013). Nonparametric tests for censored data. Hoboken, NJ: John Wiley & Sons.

    Google Scholar 

  • Bamberger, M., & Cheema, S. (1990). Case studies of project sustainability: Implications for policy and operations from Asian experience. Washington, DC: Economic Development Institute, World Bank.

    Book  Google Scholar 

  • Banerjee, M., Capozzoli, M., McSweeney, L., & Sinha, D. (1999). Beyond kappa: A review of interrater agreement measures. Canadian Journal of Statistics, 27(1), 3–23.

    Article  Google Scholar 

  • Bellera, C. A., MacGrogan, G., Debled, M., de Lara, C. T., Brouste, V., & Mathoulin-Pélissier, S. (2010). Variables with time-varying effects and the Cox model: Some statistical concepts illustrated with a prognostic factor study in breast cancer. BMC Medical Research Methodology, 10, 20. doi:10.1186/1471-2288-10-20.

    Article  PubMed  PubMed Central  Google Scholar 

  • Bond, G. R., Peterson, A. E., Becker, D. R., & Drake, R. E. (2012). Validation of the revised individual placement and support fidelity scale (IPS-25). Psychiatric Services, 63(8), 758–763. 10.1176/appi.ps.201100476.

    Article  PubMed  Google Scholar 

  • Brod, M., Tesler, L. E., & Christensen, T. L. (2009). Qualitative research and content validity: Developing best practices based on science and experience. Quality of Life Research, 18, 1263–1278. doi:10.1007/s11136-009-9540-9.

    Article  PubMed  Google Scholar 

  • Bureau of Labor Statistics. (2014). CPI inflation calculator. Retrieved from http://www.bls.gov/data/inflation_calculator.htm.

  • Clubhouse International. (2013). Clubhouse Profile Questionnaire (CPQ). Retrieved from CPQ database.

  • Clubhouse International (2014). International directory. Retrieved from http://www.iccd.org/clubhouseDirectory.php.

  • Clubhouse International. (2015a). About us. Retrieved from http://www.iccd.org/about.html.

  • Clubhouse International. (2015b). Training base clubhouses. Retrieved form http://www.iccd.org/training_base.html.

  • Clubhouse International. (2015c). Accreditation. Retrieved from http://www.iccd.org/certification.html.

  • Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20, 37–46. doi:10.1177/001316446002000104.

    Article  Google Scholar 

  • Collett, D. (2003). Modeling survival data in medical research (Vol. 57). Boca Raton, FL: CRC Press.

    Google Scholar 

  • Crittenden, W. F. (2000). Spinning straw into gold: The tenuous strategy, funding, and financial performance linkage. Nonprofit and Voluntary Sector Quarterly, 29(Supplement 1), 164–182. doi:10.1177/089976400773746382.

    Article  Google Scholar 

  • Glickman, M. (1992). The voluntary nature of the clubhouse. Psychosocial Rehabilitation Journal, 16, 39–40. doi:10.1037/h0095708.

    Article  Google Scholar 

  • Gorman, J. A. (2012). Cost-benefit and cost-effectiveness analysis of employment services offered by the clubhouse model (Master’s Thesis). Retrieved from http://aladinrc.wrlc.org/bitstream/handle/1961/14036/Gorman_american_0008N_10341display.pdf?sequence=1.

  • Hruschka, D. J., Schwartz, D., John, D. C. S., Picone-Decaro, E., Jenkins, R. A., & Carey, J. W. (2004). Reliability in coding open-ended data: Lessons learned from HIV behavioral research. Field Methods, 16, 307–331. doi:10.1177/1525822X04266540.

    Article  Google Scholar 

  • IBM Corp. Released. (2013). IBM SPSS statistics for Windows, Version 20.0. Armonk, NY: IBM Corp.

    Google Scholar 

  • Johnson, R. B., & Onwuegbuzie, A. J. (2004). Mixed methods research: A research paradigm whose time has come. Educational Researcher, 33, 14–26. Available from http://www.jstor.org/stable/3700093.

  • Kaplan, E. L., & Meier, P. (1958). Nonparametric estimation from incomplete observations. Journal of the American Statistical Association, 53, 457–481. doi:10.1080/01621459.1958.10501452.

    Article  Google Scholar 

  • Kleinbaum, D. G., & Klein, M. (2012). Survival analysis (3rd ed.). New York: Springer.

    Book  Google Scholar 

  • Leidy, N. K., & Vernon, M. (2008). Perspectives on patient-reported outcomes: Content validity and qualitative research in a changing clinical trial environment. PharmacoEconomics, 26, 363–370. doi:10.2165/00019053-200826050-00002.

    Article  PubMed  Google Scholar 

  • Levin, A. (2012). Clubhouse members check mental illness at the door. Psychiatric News. Retrieved Oct 10, 2012, from http://psychnews.psychiatryonline.org/doi/full/10.1176%2Fpn.47.10.psychnews_47_10_6-a.

  • Macias, C., Barreira, P., Alden, M., & Boyd, J. (2001). The ICCD benchmarks for clubhouses: A practical approach to quality improvement in psychiatric rehabilitation. Psychiatric Services, 52, 207–213. doi:10.1176/appi.ps.52.2.207.

    Article  CAS  PubMed  Google Scholar 

  • Macias, C., Harding, C., Alden, M., Geertsen, D., & Barreira, P. (1999). The value of program certification for performance contracting. Administration and Policy in Mental Health and Mental Health Services Research, 26, 345–360. doi:10.1023/A:1021231217821.

    Article  CAS  PubMed  Google Scholar 

  • Macias, C., Propst, R. N., Rodican, C., & Boyd, J. (2001). Strategic planning for ICCD clubhouse implementation: Development of the clubhouse research and evaluation screening survey (CRESS). Mental Health Services Research, 3, 155–167.

    Article  CAS  PubMed  Google Scholar 

  • MacQueen, K. M., McLellan, E., Kay, K., & Milstein, B. (1998). Codebook development for team-based qualitative analysis. Cultural Anthropology Methods, 10(2), 31–36. Available from http://www.sagepub.com/journals/Journal200810.

  • Mantel, N. (1966). Evaluation of survival data and two new rank order statistics arising in its consideration. Cancer Chemotherapy Reports. Part 1, 50(3), 163–170.

    CAS  PubMed  Google Scholar 

  • McKay, C. E., Johnsen, M., & Stein, R. (2005). Employment outcomes in Massachusetts Clubhouses. Psychiatric Rehabilitation Journal, 29(1), 25. doi:10.2975/29.2005.25.33.

    Article  PubMed  Google Scholar 

  • McKay, C. E., Yates, B. T., & Johnsen, M. (2007). Costs of clubhouses: An international perspective. Administration and Policy in Mental Health and Mental Health Services Research, 34, 62–72. doi:10.1007/s10488-005-0008-0.

    Article  PubMed  Google Scholar 

  • Meyer, J. W., & Rowan, B. (1977). Institutionalized organizations: Formal structure as myth and ceremony. American Journal of Sociology, 83, 340–363. Available from http://www.jstor.org/stable/2778293.

  • Miles, M. B., & Huberman, A. M. (1994). Qualitative data analysis: An expanded sourcebook. Thousand Oaks, CA: Sage Publications.

    Google Scholar 

  • Mills, M. (2011). Introducing survival and event history analysis. Thousand Oaks, CA: Sage Publications.

    Book  Google Scholar 

  • Mowbray, C. T., Lewandowski, L., Holter, M., & Bybee, D. (2006). The clubhouse as an empowering setting. Health & Social Work, 31, 167–179. doi:10.1093/hsw/31.3.167.

    Article  Google Scholar 

  • NVivo Qualitative Analysis Software. (2010). (Version 9) [Computer software]. Burlington, MA: QSR International.

    Google Scholar 

  • Pluye, P., Potvin, L., & Denis, J. L. (2004). Making public health programs last: Conceptualizing sustainability. Evaluation and Program Planning, 27, 121–133. doi:10.1016/j.evalprogplan.2004.01.001.

    Article  Google Scholar 

  • Rich, J. T., Neely, J. G., Paniello, R. C., Voelker, C. C., Nussenbaum, B., & Wang, E. W. (2010). A practical guide to understanding Kaplan–Meier curves. Otolaryngology-Head and Neck Surgery, 143(3), 331–336. Available from http://www.sciencedirect.com/science/article/pii/S0194599810007102.

  • Savaya, R., & Spiro, S. E. (2012). Predictors of sustainability of social programs. American Journal of Evaluation, 33, 26–43. doi:10.1177/1098214011408066.

    Article  Google Scholar 

  • Scheirer, M. A. (2005). Is sustainability possible? A review and commentary on empirical studies of program sustainability. American Journal of Evaluation, 26, 320–347. doi:10.1177/1098214005278752.

    Article  Google Scholar 

  • Scheirer, M. A., & Dearing, J. W. (2011). An agenda for research on the sustainability of public health programs. American Journal of Public Health, 101(11), 2059.

    Article  PubMed  PubMed Central  Google Scholar 

  • Swain, K., Whitley, R., McHugo, G. J., & Drake, R. E. (2010). The sustainability of evidence-based practices in routine mental health agencies. Community Mental Health Journal, 46, 119–129.

    Article  PubMed  Google Scholar 

  • U.S. Department of Health and Human Services, Substance Abuse and Mental Health Services Administration. (2015). ICCD clubhouse model. Retrieved from http://nrepp.samhsa.gov/ViewIntervention.aspx?id=189.

  • Wang, Q., Macias, C., & Jackson, R. (1999). First step in the development of a clubhouse fidelity instrument: Content analysis of clubhouse certification reports. Psychiatric Rehabilitation Journal, 22, 294–301.

    Article  Google Scholar 

  • Wholey, J. S., Hatry, H. P., & Newcomer, K. E. (2010). Handbook of practical program evaluation (3rd ed.). San Francisco, CA: Jossey-Bass.

    Google Scholar 

  • Wright, R. E. (2000). Survival analysis. In L. G. Grimm & P. R. Yarnold (Eds.), Reading and understanding more multivariate statistics (pp. 363–407). Washington, DC: American Psychological Association.

    Google Scholar 

  • Yin, R. K., & Quick, S. K. (1979). Changing urban bureaucracies: How new practices become routinized. Lexington, MA: Lexington Books.

    Google Scholar 

Download references

Acknowledgments

We thank Kathleen Calcerano for her research assistance in the qualitative study, Clubhouse Faculty for their participation in interviews, and all U.S. clubhouses for their contributions to the CPQ.

Author information

Authors and Affiliations

  1. Edith Nourse Rogers Memorial VA Medical Center, Bedford, MA, USA

    Jay A. Gorman

  2. Department of Psychiatry, The Program for Clubhouse Research, Systems and Psychosocial Advances Research Center, University of Massachusetts Medical School, Worcester, MA, USA

    Colleen E. McKay

  3. Department of Psychology, American University, 4400 Massachusetts Avenue, NW, Washington, DC, 20016-8062, USA

    Brian T. Yates

  4. School of Criminology and Justice Studies, University of Massachusetts Lowell, Lowell, USA

    William H. Fisher

Authors
  1. Jay A. Gorman
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Colleen E. McKay
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Brian T. Yates
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. William H. Fisher
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Brian T. Yates.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (DOCX 512 KB)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Gorman, J.A., McKay, C.E., Yates, B.T. et al. Keeping Clubhouses Open: Toward a Roadmap for Sustainability. Adm Policy Ment Health 45, 81–90 (2018). https://doi.org/10.1007/s10488-016-0766-x

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10488-016-0766-x

Keywords

Search

Navigation