Abstract
Little is known about long-term fidelity of evidence-based interventions (EBIs) under changing conditions. This study examines how staff at ‘mature’ (eight or more years in operation) Housing First (HF) programs strategize to sustain EBI fit in different geographic areas in the Mid-Atlantic/Northeastern United States. Six focus groups (FGs) at three purposively selected HF programs were conducted with separate FGs for case managers and supervisors at each site. FG discussions elicited participants’ service approaches and strategies in addressing fidelity amidst ongoing changes affecting each program. Thematic content analysis of FG transcripts was conducted using the five HF fidelity domains (housing choice/structure, separation of housing and services, service philosophy, service array, and program structure) as a priori themes with inductive content analyses conducted on data in each theme. Strategies for rigor were employed. Case managers (N = 17) and supervisors (N = 16) were predominantly white (76%) and female (60%). Across the themes, challenges included lack of affordable housing and choice, funders’ restrictions and practice ‘drift.’ Strategies included community engagement and hiring, strong leadership and ‘bending the rules.’ There were no differences across sites. Later-stage implementation challenges show the need for continued vigilance in fidelity to EBIs. Among the strategies used to address fidelity in this study, the pursuit of pro-active community engagement to attract knowledgeable staff as well as increase local buy-in was considered pivotal at all three sites. These findings underscore the need to attend to the external setting as well as to internal program operations.
Similar content being viewed by others
Notes
P5 = Participant #5; FG3 = Focus Group #3.
References
Andvig, E. S., Sælør, K. T., & Ogundipe, E. (2018). Harm reduction in a Norwegian housing first project: A qualitative study of the treatment providers’ practice. Advanced Dual Diagnosis, 11(1), 4–15.
Baumann, A. A., Cabassa, L. J., & Stirman, S. W. (2018). Adaptation in dissemination and implementation science. In R. C. Brownson, G. A. Colditz, & E. K. Proctor (Eds.), Dissemination and implementation research in health; translating science to practice (pp. 285–300). New York: Oxford University Press.
Birken, S. A., Lee, S. Y., & Weiner, B. J. (2012). Uncovering middle managers' role in healthcare innovation implementation. Implementation Science, 7(1), 28.
Boyatzis, R. E. (1998). Transforming qualitative information: Thematic analysis and code development. Thousand Oaks, CA: Sage.
Buchanan, D., Kee, R., Sadowski, L. S., & Garcia, D. (2009). The health impact of supportive housing for HIV-positive homeless patients: A randomized controlled trial. AJPH, 99(S3), S675–S680.
Chamberlain, P., Brown, C. H., & Saldana, L. (2011). Observational measure of implementation progress in community-based settings: The stages of implementation completion (SIC). Implementation Science, 6(1), 116.
Chambers, D. A., Glasgow, R. E., & Stange, K. C. (2013). The dynamic sustainability framework: Addressing the paradox of sustainment amid ongoing change. Implementation Science, 8(1), 117.
Choy-Brown, M., Stanhope, V., Tiderington, E., & Padgett, D. (2016). Unpacking clinical supervision in transitional and permanent supportive housing: Support or scrutiny? Administration and Policy in Mental Health and Mental Health Services Research, 43(4), 546–554. https://doi.org/10.1007/s10488-015-0665-6.
Ehrhart, M. G., Aarons, G. A., & Farahnak, L. R. (2014). Assessing the organizational context for EBP implementation: The development and validity testing of the Implementation Climate Scale (ICS). Implementation Science, 9(1), 157.
Feldstein, A. C., & Glasgow, R. E. (2008). A practical, robust implementation and sustainability model (PRISM) for integrating research findings into practice. Joint Commission Journal on Quality and Patient Safety, 34(4), 228–243.
Fereday, J., & Muir-Cochrane, E. (2006). Demonstrating rigor using thematic analysis: A hybrid approach of inductive and deductive coding and theme development. International Journal of Qualitative Methods, 5(1), 80–92.
Glasgow, R. E., Vinson, C., Chambers, D., Khoury, M. J., Kaplan, R. M., & Hunter, C. (2012). National Institutes of Health approaches to dissemination and implementation science: Current and future directions. AJPH, 102(7), 1274–1281.
Hamilton, A., Cohen, D., Crabtree, B., Damschroder. L., Leeman, J., Padgett, D.,… Schacht Reisinger, H. (2018). Qualitative Research in Implementation Science (QUALRIS): Strong methods for strong science. Implementation Science, 13, 236.
Kertesz, S. G., & Johnson, G. (2017). Housing first: Lessons from the United States and challenges for Australia. Australian Economic Review, 50(2), 220–228.
Kirst, M., Zerger, S., Misir, V., Hwang, S., & Stergiopoulos, V. (2015). The impact of a Housing First randomized controlled trial on substance use problems among homeless individuals with mental illness. Drug and Alcohol Dependence, 146, 24–29.
Klein, K. J., & Sorra, J. S. (1996). The challenge of innovation implementation. The Academy of Management Review, 21(4), 1055–1080.
Lipsky, M. (2010). Street-level bureaucracy: Dilemmas of the individual in public service. New York, NY: Russell Sage Foundation.
Macnaughton, E., Stefancic, A., Nelson, G., Caplan, R., Townley, G., Aubry, T.,… Goering, P. (2015). Implementing Housing First across sites and over time: Later fidelity and implementation evaluation of a pan-Canadian multi-site Housing First program for homeless people with mental illness. The American Journal of Community Psychology, 55(3–4), 279–291.
May, C.R., Mair, F., Finch, T., MacFarlane, A., Dowrick, C., Treweek, S.,… Montori, V.M. (2009). Development of a theory of implementation and integration: Normalization process theory. Implementation Science, 4(1), 29.
Miles, M. B., Huberman, A. M., & Saldana, J. (2014). Qualitative data analysis: A methods sourcebook (3rd ed.). Thousand Oaks, CA: Sage.
Morgan, P. (1996). Unknown, unexplored, and unseen populations: An introduction into the truly hidden worlds of drug and alcohol research. Journal of Drug Issues, 26(1), 1–4.
Nelson, G., Caplan, R., MacLeod, T., Macnaughton, E., Cherner, R., Aubry, T.,… Goering, P. (2017). What happens after the demonstration phase? The sustainability of Canada's At Home/Chez Soi Housing First programs for homeless persons with mental illness. The American Journal of Community Psychology, 59(1–2), 144–157.
Nelson, G., Stefancic, A., Rae, J., Townley, G., Tsemberis, S., Macnaughton, E.,… Goering, P. (2014). Early implementation evaluation of a multi-site housing first intervention for homeless people with mental illness: A mixed methods approach. Evaluation and Program Planning, 43, 16–26.
O'Brien, B. C., Harris, I. B., Beckman, T. J., Reed, D. A., & Cook, D. A. (2014). Standards for reporting qualitative research: A synthesis of recommendations. Academic Medicine, 89(9), 1245–1251.
O'Campo, P., Stergiopoulos, V., Nir, P., Levy, M., Misir, V., Chum, A.,… Hwang, S.W. (2016). How did a Housing First intervention improve health and social outcomes among homeless adults with mental illness in Toronto? Two-year outcomes from a randomized trial. BMJ Open, 6(9), e010581.
Padgett, D., Henwood, B. F., & Tsemberis, S. J. (2016). Housing First: Ending homelessness, transforming systems, and changing lives. New York, NY: Oxford University Press.
Padgett, D. K. (2017). Qualitative methods in social work research (3rd ed.). Thousand Oaks, CA: Sage.
Padgett, D. K., Stanhope, V., Henwood, B. F., & Stefancic, A. (2011). Substance use outcomes among homeless clients with serious mental illness: Comparing housing first with treatment first programs. Community Mental Health Journal, 47(2), 227–232.
Proctor, E., Luke, D., Calhoun, A., McMillen, C., Brownson, R., McCrary, S., et al. (2015). Sustainability of evidence-based healthcare: Research agenda, methodological advances, and infrastructure support. Implementation Science, 10(1), 88.
RE-AIM. (2018). Retrieved August 27, 2018, from https://www.re-aim.org/.
Scheirer, M. A., & Dearing, J. W. (2011). An agenda for research on the sustainability of public health programs. AJPH, 101(11), 2059–2067.
Spitzmueller, M. C. (2016). Negotiating competing institutional logics at the street level: An ethnography of a community mental health organization. Social Service Review, 90(1), 35–82.
Stefancic, A., Tsemberis, S., Messeri, P., Drake, R., & Goering, P. (2013). The Pathways Housing First fidelity scale for individuals with psychiatric disabilities. American Journal of Psychiatric Rehabilitation, 16(4), 240–261.
Tiderington, E. (2018) “The apartment is for you, it’s not for anyone else”: Managing social recovery and risk on the frontlines of single-adult supportive housing. Administration and Policy in Mental Health and Mental Health Services Research, 45(1), 152–162.
Tiderington, E., Stanhope, V., & Padgett, D. K. (2018). “How do we force six visits on a consumer?”: Street-level dilemmas and strategies for person-centered care under Medicaid fee-for-service. American Journal of Psychiatric Rehabilitation, 21(1–2), 79–101.
Tsemberis, S. (2010). Housing First: Ending homelessness, promoting recovery and reducing costs. In E. I. Gould & B. O’Flaherty (Eds.), How to house the homeless (pp. 37–56). New York, NY: Russell Sage Foundation.
Tsemberis, S., Gulcur, L., & Nakae, M. (2004). Housing first, consumer choice, and harm reduction for homeless individuals with a dual diagnosis. AJPH, 94(4), 651–656.
Worton, S.K., Hasford, J., Macnaughton, E., Nelson, G., MacLeod, T., Tsemberis, S.,… Stergiopoulos, V. (2018). Understanding systems change in early implementation of housing first in Canadian communities: An examination of facilitators/barriers, training/technical assistance, and points of leverage. The American Journal of Community Psychology, 61(1–2), 118–130.
Funding
This study was funded by the National Institute of Mental Health R01MH084903.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Ethical Approval
All study protocols were approved by the authors’ University Committee on Activities Involving Human Subjects (Reference #; 10-0338). This article does not contain any studies with animals performed by any of the authors.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Choy-Brown, M., Tiderington, E., Tran Smith, B. et al. Strategies for Sustaining Fidelity: A Multi-state Qualitative Analysis in Housing First Programs. Adm Policy Ment Health 48, 36–45 (2021). https://doi.org/10.1007/s10488-020-01041-2
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10488-020-01041-2