Abstract
Measuring treatment outcomes can be challenging in patients who experience multiple interlinked problems, as is the case in public mental health care (PMHC). This study describes the development and psychometric properties of a Dutch version of the self-sufficiency matrix (SSM-D), an instrument that measures outcomes and originates from the US. In two different settings, clients were rated using the SSM-D in combination with the Health of the Nation Outcome Scales (HoNOS) and the Camberwell assessment of need short appraisal schedule (CANSAS). The results provided support for adequate psychometric properties of the SSM-D. The SSM-D had a solid single factor structure and internal consistency of the scale was excellent. In addition, convergent validity of the SSM-D was indicated by strong correlations between HoNOS and CANSAS, as well as between several subdomains. Further research is needed to establish whether the results presented here can be obtained in other PMHC settings.
Similar content being viewed by others
References
Audin, K., Margison, F. R., Clark, J. M., & Barkham, M. (2001). Value of HoNOS in assessing patient change in NHS psychotherapy and psychological treatment services. British Journal of Psychiatry, 178, 561–566. doi:10.1192/bjp.178.6.561.
Bartley, M. (1994). Unemployment and ill health: Understanding the relationship. Journal of Epidemiology and Community Health, 48, 333–337. doi:10.1136/jech.48.4.333.
Boot, B., Hall, W., & Andrews, G. (1997). Disability, outcome and case-mix in acute psychiatric in-patient units. British Journal of Psychiatry, 171, 242–246. doi:10.1192/bjp.171.3.242.
Brooks, R. (2000). The reliability and validity of the Health of the Nation Outcome Scales: Validation in relation to patient derived measures. The Australian and New Zealand Journal of Psychiatry, 34, 504–511. doi:10.1046/j.1440-1614.2000.00755.x.
Brunette, M. F., Mueser, K. T., & Drake, R. E. (2004). A review of research on residential programs for people with severe mental illness and co-occurring substance use disorders. Drug and Alcohol Review, 23, 471–481. doi:10.1080/09595230412331324590.
Campbell, J. C. (2002). Health consequences of intimate partner violence. Lancet, 359, 1331–1336. doi:10.1016/S0140-6736(02)08336-8.
Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). New Jersey: Lawrence Erlbaum Associates.
Culhane, D., Gross, K., Parker, W., Poppe, B., & Sykes, E. (2008). Accountability, cost-effectiveness, and program performance: Progress since 1998 Philadelphia: National Symposium on Homelessness Research.
Dekker, J. J., Theunissen, J., Van, R., Peen, J., Duurkoop, P., & Kikkert, M. (2010). Victimization of patients with severe psychiatric disorders: Prevalence, risk factors, protective factors and consequences for mental health. A longitudinal study. BMC Public Health, 10, 687. doi:10.1186/1471-2458-10-687.
Fischer, P. J., Shapiro, S., Breakey, W. R., Anthony, J. C., & Kramer, M. (1986). Mental health and social characteristics of the homeless: A survey of mission users. American Journal of Public Health, 76, 519–524. doi:10.2105/AJPH.76.5.519.
Gallagher, J., & Teesson, M. (2000). Measuring disability, need and outcome in Australian community mental health services. The Australian and New Zealand Journal of Psychiatry, 34, 850–855. doi:10.1046/j.1440-1614.2000.00815.x.
Gelberg, L., Andersen, R. M., & Leake, B. D. (2000). The behavioral model for vulnerable populations: Application to medical care use and outcomes for homeless people. Health Services Research, 34, 1273–1302.
Gowers, S., Levine, W., Bailey-Rogers, S., Shore, A., & Burhouse, E. (2002). Use of a routine, self-report outcome measure (HoNOSCA–SR) in two adolescent mental health services. Health of the nation outcome scale for children and adolescents. British Journal of Psychiatry, 180, 266–269. doi:10.1192/bjp.180.3.266.
Jacobs, R., & Moran, V. (2010). Uptake of mandatory outcome measures in mental health services. The Psychiatrist, 34, 338–343. doi:10.1192/pb.bp.109.026526.
Lawrinson, P., Copeland, J., & Indig, D. (2005). Development and validation of a brief instrument for routine outcome monitoring in opioid maintenance pharmacotherapy services: The brief treatment outcome measure (BTOM). Drug and Alcohol Dependence, 80, 125–133. doi:10.1016/j.drugalcdep.2005.04.001.
Machin, D., Campbell, M., Fayers, P., & Pinol, A. (1997). Sample size tables for clinical studies (2nd ed.). London, Edinburgh: Blackwell Science.
McCrone, P., Leese, M., Thornicroft, G., Schene, A. H., Knudsen, H. C., Vazquez-Barquero, J. L., et al. (2000). Reliability of the Camberwell assessment of need—European version. EPSILON study 6. European psychiatric services: Inputs linked to outcome domains and needs. British Journal of Psychiatry, 177(Suppl), s34–s40. doi:10.1192/bjp.177.39.s34.
Mulder, C., Staring, A., Loos, J., Buwalda, V., Kuijpers, D., Sytema, S., et al. (2004). De Health of the Nation Outcome Scales (HoNOS) als instrument voor ‘routine outcome assessment’. Tijdschrift voor Psychiatrie, 46(5), 273–284.
Mulder, C. L., van der Gaag, M., Bruggeman, R., Cahn, W., Delespaul, P. A., Dries, P., et al. (2010). Routine outcome monitoring for patients with severe mental illness: A consensus document. Tijdschrift voor Psychiatrie, 52, 169–179.
Phelan, M., Slade, M., Thornicroft, G., Dunn, G., Holloway, F., Wykes, T., et al. (1995). The Camberwell assessment of need: The validity and reliability of an instrument to assess the needs of people with severe mental illness. British Journal of Psychiatry, 167, 589–595. doi:10.1192/bjp.167.5.589.
Phelan, M., Stradins, L., & Morrison, S. (2001). Physical health of people with severe mental illness. British Medical Journal, 322, 443–444. doi:10.1136/bmj.322.7284.443.
Repetti, R. L., Taylor, S. E., & Seeman, T. E. (2002). Risky families: Family social environments and the mental and physical health of offspring. Psychological Bulletin, 128, 330–366. doi:10.1037/0033-2909.128.
Rock, D., & Preston, N. (2001). HoNOS: Is there any point in training clinicians? Journal of Psychiatric and Mental Health Nursing, 8, 405–409. doi:10.1046/j.1365-2850.2001.00410.x.
Roy, A., Matthews, H., Clifford, P., Fowler, V., & Martin, D. M. (2002). Health of the Nation Outcome Scales for People with Learning Disabilities (HoNOS-LD). British Journal of Psychiatry, 180, 61–66. doi:10.1192/bjp.180.1.61.
Slade, M. (2002). Routine outcome assessment in mental health services. Psychological Medicine, 32, 1339–1343. doi:10.1017/S0033291701004974.
Slade, M., Beck, A., Bindman, J., Thornicroft, G., & Wright, S. (1999). Routine clinical outcome measures for patients with severe mental illness: CANSAS and HoNOS. British Journal of Psychiatry, 174, 404–408. doi:10.1192/bjp.174.5.404.
Slade, M., Phelan, M., Thornicroft, G., & Parkman, S. (1996). The Camberwell assessment of need (CAN): Comparison of assessments by staff and patients of the needs of the severely mentally ill. Social Psychiatry and Psychiatric Epidemiology, 31, 109–113. doi:10.1192/pb.29.1.13.
Smith, G. R., Jr., Fischer, E. P., Nordquist, C. R., Mosley, C. L., & Ledbetter, N. S. (1997). Implementing outcomes management systems in mental health settings. Psychiatric Services, 48, 364–368.
The Self-sufficiency Standard website. http://www.selfsufficiencystandard.org/standard.html. 1 Dec 2011.
The Results Oriented Management and Accountability (ROMA) website. http://www.roma1.org/. 1 Dec 2011.
Theunissen, J. R., & Raven, E. M. I. E. (1997). Patiënten met langdurige psychiatrische stoornissen bij een RIAGG. Patiënten, patiëntkenmerken, de ontvangen zorg en het gewenste aanbod. Tijdschrift voor Psychiatrie, 39, 400–408.
van de Ven, W., & Schut, F. (2008). Universal mandatory health insurance in the Netherlands: A model for the United States? Health Affairs (Millwood.), 27, 771–781. doi:10.1377/hlthaff.27.3.771.
van der Meer, C., & Hendriks, V. (2003). Dubbele Diagnose, Dubbele hulp. Richtlijnen voor diagnostiek en behandeling. Den Haag: Parnassia Addiction Research Center.
Van Laere, I., de Wit, M., & Klazinga, N. (2009). Preventing evictions as a potential public health intervention: characteristics and social medical risk factors of households at risk in Amsterdam. Scandavian Journal of Public Health, 37, 697–705. doi:10.1177/1403494809343479.
Wennstrom, E., Sorbom, D., & Wiesel, F. A. (2004). Factor structure in the Camberwell assessment of need. British Journal of Psychiatry, 185, 505–510. doi:10.1192/bjp.185.6.505.
Wing, J. K., Beevor, A. S., Curtis, R. H., Park, S. B., Hadden, S., & Burns, A. (1998). Health of the Nation Outcome Scales (HoNOS). Research and development. British Journal of Psychiatry, 172, 11–18. doi:10.1192/bjp.172.1.11.
Zlotnick, C., Tam, T., & Zerger, S. (2012). Common needs but divergent interventions for U.S. homeless and foster care children: Results from a systematic review. Health and Social Care Community, 20, 449–476. doi:10.1111/j.1365-2524.2011.01053.x.
Acknowledgments
The authors would like to thank all employees at the mental health care institutions (Lucertis, Arkin and GGZ inGeest) who participated in the data collection. In addition, the authors thank the reviewers, whose comments significantly improved the original manuscript. This study was financially supported by a grant from the Public Health Services of Amsterdam and Rotterdam. The Dutch version of the Self-Sufficiency Matrix is freely available upon request, or via www.selfsufficiencymatrix.org.
Conflict of interests
The authors have no conflict of interests.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Fassaert, T., Lauriks, S., van de Weerd, S. et al. Psychometric Properties of the Dutch Version of the Self-Sufficiency Matrix (SSM-D). Community Ment Health J 50, 583–590 (2014). https://doi.org/10.1007/s10597-013-9683-6
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10597-013-9683-6