Keeping Clubhouses Open: Toward a Roadmap for Sustainability

Abstract

Clubhouses are recovery centers that help persons with serious mental illness obtain and maintain community-based employment, education, housing, social integration, and other services. Key informants from U.S. clubhouses were interviewed to create a conceptual framework for clubhouse sustainability. Survival analyses tested this model for 261 clubhouses. Clubhouses stayed open significantly longer if they had received full accreditation, had more administrative autonomy, and received funding from multiple rather than sole sources. Cox regression analyses showed that freestanding clubhouses which were accredited endured the longest. Budget size, clubhouse size, and access to managed care did not contribute significantly to sustainability.

This is a preview of subscription content, log in to check access.

Fig. 1
Fig. 2
Fig. 3

References

  1. Aquila, R., Santos, G., Malamud, T. J., & McCrory, D. (1999). The rehabilitation alliance in practice: The clubhouse connection. Psychiatric Rehabilitation Journal, 23, 19–24. doi:10.1037/h0095199.

    Article  Google Scholar 

  2. Auerbach, C., & Silverstein, L. B. (2003). Qualitative data: An introduction to coding and analysis. New York: New York University Press.

    Google Scholar 

  3. Bagdonavicus, V., Kruopis, J., & Nikulin, M. (2013). Nonparametric tests for censored data. Hoboken, NJ: John Wiley & Sons.

    Google Scholar 

  4. Bamberger, M., & Cheema, S. (1990). Case studies of project sustainability: Implications for policy and operations from Asian experience. Washington, DC: Economic Development Institute, World Bank.

    Google Scholar 

  5. Banerjee, M., Capozzoli, M., McSweeney, L., & Sinha, D. (1999). Beyond kappa: A review of interrater agreement measures. Canadian Journal of Statistics, 27(1), 3–23.

    Article  Google Scholar 

  6. Bellera, C. A., MacGrogan, G., Debled, M., de Lara, C. T., Brouste, V., & Mathoulin-Pélissier, S. (2010). Variables with time-varying effects and the Cox model: Some statistical concepts illustrated with a prognostic factor study in breast cancer. BMC Medical Research Methodology, 10, 20. doi:10.1186/1471-2288-10-20.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Bond, G. R., Peterson, A. E., Becker, D. R., & Drake, R. E. (2012). Validation of the revised individual placement and support fidelity scale (IPS-25). Psychiatric Services, 63(8), 758–763. 10.1176/appi.ps.201100476.

    Article  PubMed  Google Scholar 

  8. Brod, M., Tesler, L. E., & Christensen, T. L. (2009). Qualitative research and content validity: Developing best practices based on science and experience. Quality of Life Research, 18, 1263–1278. doi:10.1007/s11136-009-9540-9.

    Article  PubMed  Google Scholar 

  9. Bureau of Labor Statistics. (2014). CPI inflation calculator. Retrieved from http://www.bls.gov/data/inflation_calculator.htm.

  10. Clubhouse International. (2013). Clubhouse Profile Questionnaire (CPQ). Retrieved from CPQ database.

  11. Clubhouse International (2014). International directory. Retrieved from http://www.iccd.org/clubhouseDirectory.php.

  12. Clubhouse International. (2015a). About us. Retrieved from http://www.iccd.org/about.html.

  13. Clubhouse International. (2015b). Training base clubhouses. Retrieved form http://www.iccd.org/training_base.html.

  14. Clubhouse International. (2015c). Accreditation. Retrieved from http://www.iccd.org/certification.html.

  15. Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20, 37–46. doi:10.1177/001316446002000104.

    Article  Google Scholar 

  16. Collett, D. (2003). Modeling survival data in medical research (Vol. 57). Boca Raton, FL: CRC Press.

    Google Scholar 

  17. Crittenden, W. F. (2000). Spinning straw into gold: The tenuous strategy, funding, and financial performance linkage. Nonprofit and Voluntary Sector Quarterly, 29(Supplement 1), 164–182. doi:10.1177/089976400773746382.

    Article  Google Scholar 

  18. Glickman, M. (1992). The voluntary nature of the clubhouse. Psychosocial Rehabilitation Journal, 16, 39–40. doi:10.1037/h0095708.

    Article  Google Scholar 

  19. Gorman, J. A. (2012). Cost-benefit and cost-effectiveness analysis of employment services offered by the clubhouse model (Master’s Thesis). Retrieved from http://aladinrc.wrlc.org/bitstream/handle/1961/14036/Gorman_american_0008N_10341display.pdf?sequence=1.

  20. Hruschka, D. J., Schwartz, D., John, D. C. S., Picone-Decaro, E., Jenkins, R. A., & Carey, J. W. (2004). Reliability in coding open-ended data: Lessons learned from HIV behavioral research. Field Methods, 16, 307–331. doi:10.1177/1525822X04266540.

    Article  Google Scholar 

  21. IBM Corp. Released. (2013). IBM SPSS statistics for Windows, Version 20.0. Armonk, NY: IBM Corp.

    Google Scholar 

  22. Johnson, R. B., & Onwuegbuzie, A. J. (2004). Mixed methods research: A research paradigm whose time has come. Educational Researcher, 33, 14–26. Available from http://www.jstor.org/stable/3700093.

  23. Kaplan, E. L., & Meier, P. (1958). Nonparametric estimation from incomplete observations. Journal of the American Statistical Association, 53, 457–481. doi:10.1080/01621459.1958.10501452.

    Article  Google Scholar 

  24. Kleinbaum, D. G., & Klein, M. (2012). Survival analysis (3rd ed.). New York: Springer.

    Google Scholar 

  25. Leidy, N. K., & Vernon, M. (2008). Perspectives on patient-reported outcomes: Content validity and qualitative research in a changing clinical trial environment. PharmacoEconomics, 26, 363–370. doi:10.2165/00019053-200826050-00002.

    Article  PubMed  Google Scholar 

  26. Levin, A. (2012). Clubhouse members check mental illness at the door. Psychiatric News. Retrieved Oct 10, 2012, from http://psychnews.psychiatryonline.org/doi/full/10.1176%2Fpn.47.10.psychnews_47_10_6-a.

  27. Macias, C., Barreira, P., Alden, M., & Boyd, J. (2001). The ICCD benchmarks for clubhouses: A practical approach to quality improvement in psychiatric rehabilitation. Psychiatric Services, 52, 207–213. doi:10.1176/appi.ps.52.2.207.

    CAS  Article  PubMed  Google Scholar 

  28. Macias, C., Harding, C., Alden, M., Geertsen, D., & Barreira, P. (1999). The value of program certification for performance contracting. Administration and Policy in Mental Health and Mental Health Services Research, 26, 345–360. doi:10.1023/A:1021231217821.

    CAS  Article  PubMed  Google Scholar 

  29. Macias, C., Propst, R. N., Rodican, C., & Boyd, J. (2001). Strategic planning for ICCD clubhouse implementation: Development of the clubhouse research and evaluation screening survey (CRESS). Mental Health Services Research, 3, 155–167.

    CAS  Article  PubMed  Google Scholar 

  30. MacQueen, K. M., McLellan, E., Kay, K., & Milstein, B. (1998). Codebook development for team-based qualitative analysis. Cultural Anthropology Methods, 10(2), 31–36. Available from http://www.sagepub.com/journals/Journal200810.

  31. Mantel, N. (1966). Evaluation of survival data and two new rank order statistics arising in its consideration. Cancer Chemotherapy Reports. Part 1, 50(3), 163–170.

    CAS  PubMed  Google Scholar 

  32. McKay, C. E., Johnsen, M., & Stein, R. (2005). Employment outcomes in Massachusetts Clubhouses. Psychiatric Rehabilitation Journal, 29(1), 25. doi:10.2975/29.2005.25.33.

    Article  PubMed  Google Scholar 

  33. McKay, C. E., Yates, B. T., & Johnsen, M. (2007). Costs of clubhouses: An international perspective. Administration and Policy in Mental Health and Mental Health Services Research, 34, 62–72. doi:10.1007/s10488-005-0008-0.

    Article  PubMed  Google Scholar 

  34. Meyer, J. W., & Rowan, B. (1977). Institutionalized organizations: Formal structure as myth and ceremony. American Journal of Sociology, 83, 340–363. Available from http://www.jstor.org/stable/2778293.

  35. Miles, M. B., & Huberman, A. M. (1994). Qualitative data analysis: An expanded sourcebook. Thousand Oaks, CA: Sage Publications.

    Google Scholar 

  36. Mills, M. (2011). Introducing survival and event history analysis. Thousand Oaks, CA: Sage Publications.

    Google Scholar 

  37. Mowbray, C. T., Lewandowski, L., Holter, M., & Bybee, D. (2006). The clubhouse as an empowering setting. Health & Social Work, 31, 167–179. doi:10.1093/hsw/31.3.167.

    Article  Google Scholar 

  38. NVivo Qualitative Analysis Software. (2010). (Version 9) [Computer software]. Burlington, MA: QSR International.

    Google Scholar 

  39. Pluye, P., Potvin, L., & Denis, J. L. (2004). Making public health programs last: Conceptualizing sustainability. Evaluation and Program Planning, 27, 121–133. doi:10.1016/j.evalprogplan.2004.01.001.

    Article  Google Scholar 

  40. Rich, J. T., Neely, J. G., Paniello, R. C., Voelker, C. C., Nussenbaum, B., & Wang, E. W. (2010). A practical guide to understanding Kaplan–Meier curves. Otolaryngology-Head and Neck Surgery, 143(3), 331–336. Available from http://www.sciencedirect.com/science/article/pii/S0194599810007102.

  41. Savaya, R., & Spiro, S. E. (2012). Predictors of sustainability of social programs. American Journal of Evaluation, 33, 26–43. doi:10.1177/1098214011408066.

    Article  Google Scholar 

  42. Scheirer, M. A. (2005). Is sustainability possible? A review and commentary on empirical studies of program sustainability. American Journal of Evaluation, 26, 320–347. doi:10.1177/1098214005278752.

    Article  Google Scholar 

  43. Scheirer, M. A., & Dearing, J. W. (2011). An agenda for research on the sustainability of public health programs. American Journal of Public Health, 101(11), 2059.

    Article  PubMed  PubMed Central  Google Scholar 

  44. Swain, K., Whitley, R., McHugo, G. J., & Drake, R. E. (2010). The sustainability of evidence-based practices in routine mental health agencies. Community Mental Health Journal, 46, 119–129.

    Article  PubMed  Google Scholar 

  45. U.S. Department of Health and Human Services, Substance Abuse and Mental Health Services Administration. (2015). ICCD clubhouse model. Retrieved from http://nrepp.samhsa.gov/ViewIntervention.aspx?id=189.

  46. Wang, Q., Macias, C., & Jackson, R. (1999). First step in the development of a clubhouse fidelity instrument: Content analysis of clubhouse certification reports. Psychiatric Rehabilitation Journal, 22, 294–301.

    Article  Google Scholar 

  47. Wholey, J. S., Hatry, H. P., & Newcomer, K. E. (2010). Handbook of practical program evaluation (3rd ed.). San Francisco, CA: Jossey-Bass.

    Google Scholar 

  48. Wright, R. E. (2000). Survival analysis. In L. G. Grimm & P. R. Yarnold (Eds.), Reading and understanding more multivariate statistics (pp. 363–407). Washington, DC: American Psychological Association.

    Google Scholar 

  49. Yin, R. K., & Quick, S. K. (1979). Changing urban bureaucracies: How new practices become routinized. Lexington, MA: Lexington Books.

    Google Scholar 

Download references

Acknowledgments

We thank Kathleen Calcerano for her research assistance in the qualitative study, Clubhouse Faculty for their participation in interviews, and all U.S. clubhouses for their contributions to the CPQ.

Author information

Affiliations

Authors

Corresponding author

Correspondence to Brian T. Yates.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (DOCX 512 KB)

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Gorman, J.A., McKay, C.E., Yates, B.T. et al. Keeping Clubhouses Open: Toward a Roadmap for Sustainability. Adm Policy Ment Health 45, 81–90 (2018). https://doi.org/10.1007/s10488-016-0766-x

Download citation

Keywords

  • Clubhouse
  • Psychiatric rehabilitation
  • Sustainability
  • Survival