Development of a mental health recovery module for the WHOQOL
The WHOQOL tools are widely used, multi-faceted, patient-rated, quality of life (QoL) measures, developed by the World Health Organization. The WHOQOL questionnaires are used to assess generic quality of life issues affected by all health problems. This study developed a module to use with the WHOQOL tools to improve their sensitivity to Health Related QoL issues relevant to mental health recovery.
Using a sequential mixed-methods approach, two research stages occurred. A qualitative stage invited 88 participants with experience of mental health recovery, into focus groups and importance rating activities, to identify candidate items for the new module. Following this, a quantitative stage involved 667 participants with, and without, mental health/addiction issues completing online or paper-based questionnaires to analyze which candidate items differentiated between those with and without mental health/addiction issues. Classical test theory and iterative Partial Credit Rasch Analysis were used to identify the most suitable candidate items for a reliable and valid mental health recovery module to be used with the WHOQOL tools.
Seventeen candidate items captured important HRQoL facets relevant to mental health recovery. Rasch analysis removed 10 misfitting items. The final 7-item module, which demonstrated the best Rasch model fit, enquires about recovery beliefs, identifying strengths, self-awareness, acceptance, capacity to relate, feeling understood, and recovery progress. Ordinal-to-interval conversion tables have been developed to optimize measurement precision when using the module.
Important HRQoL issues central to mental health recovery can be reliably evaluated by using the recovery module with the WHOQOL tools.
KeywordsQuality of life Patient-reported outcome Measurement Rasch model WHOQOL Mental health recovery
Appreciation and acknowledgement goes to the individual participants who contributed the information that has led to the outcomes of this research and to the individuals and organisations that have supported this research: Connect Supporting Recovery, Pathways & Ross Phillips, Emerge Aotearoa & Sarah Andrews, Walsh Trust, EQUIP, Comcare, Changing Minds, Sarah Gordon, DRIVE network, Northland DHB, Paul Clements and Granville Hendricks, Midland DHB, Southland DHB & Patricia Hsu, Sandra Finlay, Oliver Rowthorn, Jason Verburg, Supporting Families, Mike King & the Nutters Club, as well as Platform Trust, Phillipa Gaines & the members of the WHOQOL outcome Forum, Te Pou, and Wild Bamboo, all whom gave time or assisted in various promotional and practical ways with this study. Much appreciation for the support, guidance, and experience of the team of researchers and co-authors involved with this study, and to AUT university for making this study possible.
No Grants or external funding were involved in this research.
Compliance with ethical standards
Conflict of interest
All authors declare that they have no conflicts of interest.
This article does not contain any studies with animals performed by any of the authors. All procedures performed in studies involving human participants were reviewed and approved by the Auckland University of Technology Ethics Committee (AUTEC Approval Reference 14/227) which is aligned with New Zealand National Ethics Committee guidelines and the 1964 ethical standards within the Helsinki declaration and its later amendments. Agencies were approached and gave consent to invite the people receiving and working in their services into the study. Participants with lived experience of mental illness were in stable states of mental health, identifying themselves as being in mid-later stages of recovery. All participants were provided with information sheets detailing the purposes of the study, activities involved, their rights to withdraw, contact details to request further information about the study, consent forms, and opportunities to ask questions with staff and of the researcher. Support was available to participants during and following research activities. Participants had a choice of participating in group or individual interviews in Stage 1, or of completing online or paper versions of the survey in Stage 2, as well as choices to enter a grocery voucher draw or to receive information about the study at its conclusion, if desired. All participants self-identified themselves as capable of participating in the study by signing paper-based consent forms in both studies or by clicking on a progress to the survey link, after reading the online information sheet, if they consented to participate in the online version of the questionnaire in Stage 2. Participants knew they could withdraw at any time with no consequences to them in both studies.
- 1.World Health Organisation. (2018). Retrieved from https://www.who.int/mental_health/world-mental-health-day/2018/en/.
- 2.World Health Organisation (WHO). Global status report mental health action plan 2013-2020, NLM classification: WM 101 ISBN: 978-92-4-150602-1. http://apps.who.int/iris/bitstream/handle/10665/89966/9789241506021_eng.pdf?sequence=1.
- 3.World Health Organisation. (2012). Agenda item 13.2 WHA65.4: The global burden of mental disorders and the need for a comprehensive, coordinated response from health and social sectors at country level. The 65th World Health Assembly, 9th Plenary Meeting, 25th May, A65/VR/9. Retrieved from https://www.who.int/mental_health/WHA65.4_resolution.pdf.
- 4.Akvardar, Y., Akdede, B. B., Ozerdem, A., Eser, E., Topyaka, S., & Alptekin, K. (2006). Assessment of quality of life with the WHOQOL-BREF in a group of Turkish psychiatric patients compared with diabetic and healthy subjects. Psychiatry Clinical Neuroscience, 60(6), 693–699. https://doi.org/10.1111/j.1440-1819.2006.01584.x.Google Scholar
- 6.Revicki, D. A., Kleinman, L., & Cella, D. (2014). A history of health-related quality of life outcomes in psychiatry. Dialogues in Clinical Neuroscience, 16(2), 127–135. (PMID: 25152652).Google Scholar
- 12.Masthoff, E. D., Trompenaars, F. J., Van Heck, G. L., Hodiamont, P. P., & De Vries, J. (2006). Quality of life and psychopathology: Investigations into their relationship. Australian and New Zealand Journal of Psychiatry, 40(4), 333–340. https://doi.org/10.1080/j.1440-1614.2006.01799.x.Google Scholar
- 14.Bayliss, M., Rendas-Baum, R., White, M. K., Maruish, M., Bjorner, J., & Tunis, S. L. (2012). Health-related quality of life (HRQL) for individuals with self-reported chronic physical and/or mental health conditions: Panel survey of an adult sample in the United States. Health and Quality of Life Outcomes, 10, 154–164. https://doi.org/10.1186/1477-7525-10-154.Google Scholar
- 17.Medici, C. R., Vestergaard, C. H., Hjorth, P., Hansen, M. V., Shanmuganathan, J. W., Viuff, A. G., et al. (2016). Quality of life and clinical characteristics in a non-selected sample of patients with schizophrenia. International Journal of Social Psychiatry, 62(1), 12–20. https://doi.org/10.1177/0020764015585330.Google Scholar
- 19.De Abreu, L. N., Nery, F. G., Harkavy-Friedman, J. M., de Almeida, K. M., Gomes, B. C., Oquendo, M. A., et al. (2012). Suicide attempts are associated with worse quality of life in patients with bipolar disorder type I. Comprehensive Psychiatry, 53(2), 125–129. https://doi.org/10.1016/j.comppsych.2011.03.003.Google Scholar
- 21.Katschnig, H. (2006). Quality of life in mental disorders: Challenges for research and clinical practice. World Psychiatry, 5(3), 139–145. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC1636133/.Google Scholar
- 23.Bakas, T., McLennon, S. M., Carpenter, J. S. Buelow, J. M., Otte, J. L., Hanna, K. M., Ellett, M. L., Hadler, K. A., Welch, J. L. (2012). Systematic review of health-related quality of life models. Health and Quality of Life Outcomes, 10, 134–146. https://doi.org/10.1186/1477-7525-10-134.
- 24.Keetharuth, A. D., Brazier, J., Connell, J., Bjorner, J. B., Carlton, J., Taylor-Buck, E., et al. (2018). Recovering Quality of Life (ReQoL): a new generic self-reported outcome measure for use with people experiencing mental health difficulties. The British Journal of Psychiatry, 212(1), 42–49. https://doi.org/10.1192/bjp.2017.10.Google Scholar
- 27.Slade, M. (2013). 100 ways to support recovery: A guide for mental health professionals (2nd ed.). London: Rethink. Retrieved from URL: https://www.rethink.org/advice-information/living-with-mental-illness/treatment-and-support/100-ways-to-support-recovery/.Google Scholar
- 28.Masthoff, E. D., Trompenaars, F. J., Van Heck, G. L., Hodiamont, P. P., & De Vries, J. (2005). Validation of the WHO quality of life assessment instrument (WHOQOL-100) in a population of Dutch adult psychiatric outpatients. European Psychiatry, 20(7), 465–473. https://doi.org/10.1016/j.eurpsy.2004.09.012.Google Scholar
- 29.Trompenaars, F. J., Masthoff, E. D., Van Heck, G. L., Hodiamont, P. P., & De Vries, J. (2006). The WHO Quality of Life Assessment Instrument (WHOQOL-100)—Investigating its discriminant ability for psychiatric outpatients. European Journal of Psychological Assessment, 22(3), 207–215. https://doi.org/10.1027/1015-57220.127.116.11.Google Scholar
- 30.Trompenaars, F. J., Masthoff, E. D., Van Heck, G. L., Hodiamont, P. P., & De Vries, J. (2006). Relationship between mood-related disorders and quality of life in a population of Dutch adult psychiatric outpatients. Depression and Anxiety, 23(6), 353–363. https://doi.org/10.1002/da.20180.Google Scholar
- 31.Mas-Exposito, L., Amador-Campos, J. A., Gomez-Benito, J., & Lalucat-Jo, L. (2011). The World Health Organization Quality of Life Scale Brief Version: A validation study in patients with schizophrenia. Quality of Life Research, 20(7), 1079–1089. https://doi.org/10.1007/s11136-011-9847-1.Google Scholar
- 33.Garcia-Rea, E. A., & LePage, J. P. (2010). Reliability and validity of the World Health Organization quality of life: brief version (WHOQOL-BREF) in a homeless substance dependent veteran population. Social Indicators Research, 99(2), 333–340. https://doi.org/10.1007/s11205-010-9583-x.Google Scholar
- 36.Priebe, S., Reininghaus, U., McCabe, R., Burns, T., Eklund, M., Hansson, L., et al. (2010). Factors influencing subjective quality of life in patients with schizophrenia and other mental disorders: a pooled analysis. Schizophrenia Research, 121(1–3), 251–258. https://doi.org/10.1016/j.schres.2009.12.020.Google Scholar
- 39.WHOQOL (World Health Organization’s Quality of Life Instrument) HIV Group. (2003). Initial steps to developing the World Health Organization’s Quality of Life Instrument (WHOQOL) module for international assessment in HIV/AIDS. AIDS Care, 15(3), 347–357. https://doi.org/10.1080/0954012031000105405.Google Scholar
- 40.Mason, V. L., Skevington, S. M., & Osborn, M. (2004). Development of a pain and discomfort module for use with the WHOQOL 100. Quality of Life Research, 13(6), 1139–1152. https://doi.org/10.1023/B:QURE.0000031344.53009.eb.Google Scholar
- 42.Caballero, F. F., Miret, M., Power, M., Chatterji, S., Tobiasz-Adamczyk, B., Koskinen, S., et al. (2013). Validation of an instrument to evaluate quality of life in the aging population: WHOQOL-AGE. Health and Quality of Life Outcomes, 11, 177. https://doi.org/10.1186/1477-7525-11-177.Google Scholar
- 45.Lin, C. Y., Lee, T. Y., Sun, Z. J., Yang, Y. C., Wu, J. S., & Ou, H. T. (2017). Development of diabetes-specific quality of life module to be in conjunction with the World Health Organization quality of life scale brief version (WHOQOL-BREF). Health and Quality of Life Outcomes, 15, 167. https://doi.org/10.1186/s12955-017-0744-3.Google Scholar
- 46.Skevington, S. M., Gunson, K. S., & O’Connell, K. A. (2013). Introducing the WHOQOL-SRPB BREF: Developing a short-form instrument for assessing spiritual, religious and personal beliefs within quality of life. Quality of Life Research, 22(5), 1073–1083. https://doi.org/10.1007/s11136-012-0237-0.Google Scholar
- 48.Siggins Miller Consultants. (2003). Consumer self-rated outcome measures in mental health: A report to the Mental Health Branch, Department of Human Services. Retrieved from http://www.health.vic.gov.au/mentalhealth/outcomes/csrfinal.pdf.
- 50.Reeve, B. B., Wyrwich, K. W., Wu, A. W., Velikova, G., Terwee, C. B., Snyder, …, Butt, Z. (2012). ISOQOL recommends minimum standards for patient-reported outcome measures used in patient-centered outcomes and comparative effectiveness research. Quality of Life Research, 22(8), 1889–1905. https://doi.org/10.1007/s11136-012-0344-y.
- 52.Krägeloh, C. U., Billington, D. R., Hsu P. H.-C., Feng, X. J., Medvedev, O. N., Kersten, P., Landon, J., & Siegert, R. J. (2016). Ordinal-to-interval scale conversion tables and national items for the New Zealand Version of the WHOQOL-BREF. PLoS ONE, 11(11): e0166065. https://doi.org/10.1371/journal.pone.0166065.
- 53.Krägeloh, C. U., Kersten, P., Billington, D. R., Hsu, P. H.-C., Shepherd, D., Landon, J., & Feng, X. J. (2013). Validation of the WHOQOL-BREF quality of life questionnaire for general use in New Zealand: Confirmatory factor analysis and Rasch analysis. Quality of Life Research, 22(6), 1451–1457. https://doi.org/10.1007/s11136-012-0265-9.Google Scholar
- 54.Rethfeldt, S. (2007). Comparison of paper-and-pencil with online survey methodology using the quality of life instrument (WHOQOL-BREF) developed by the World Health Organisation (Unpublished BHSc(Hons) thesis), Auckland University of Technology, Auckland, New Zealand.Google Scholar
- 58.Ellison, M. L., Belanger, L. K., Niles, B. L., Evans, L. C., & Bauer, M. S. (2018). Explication and definition of Mental Health Recovery: A systematic review. Administration and Policy in Mental Health and Mental Health Services Research, 45(1), 91–102. https://doi.org/10.1007/s10488-016-0767-9.Google Scholar
- 59.Williams, K., Sansoni, J., Morris, D., Grootemaat, P., & Thompson, C. (2016). Patient-reported outcome measures: Literature Review. Australian Commission on Safety and Quality in Health Care. IBSN: 978-1-925224-74-0. Retrieved from: https://www.safetyandquality.gov.au/publications-and-resources/resource-library/patient-reported-outcome-measures-literature-review.