Abstract
Low mental health literacy is a public health concern in China and contributes to the low underutilization of mental health resources. We extended the current conceptualization of mental health literacy and developed a comprehensive self-report measure of mental health literacy in the Chinese context, the Mental Health Literacy Questionnaire (MHLQ). We generated items based on existing literature, extensive qualitative interviews with mental health professionals and community members. We revised these items based on expert review to examine content validity, after which we conducted a pilot test with a representative sample of 734 urban and rural community members to illicit feedback on wording clarity and select items within appropriate difficulty levels (i.e., correct rate). We then examined dimensionality and item performance using multidimensional item response theory analyses in a combined sample of mental health professionals (n = 122), community members (n = 121), and college students (n = 144). We concluded a six-factor structure for the MHLQ encompassing mental health knowledge, mental illness knowledge, attitudes towards mental health, attitudes towards mental illness, behaviors regarding mental health promotion, and behaviors regarding mental illness coping. The scale yielded adequate internal reliability estimates and test-retest agreement, and convergent evidence and known-group comparisons results in support of construct validity. The six-factor MHLQ largely supported our extended theoretical conceptualization of the mental health literacy in the Chinese context. Future studies are needed to further validate the factor structure and examine measurement invariance.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Angermeyer, M. C., & Matschinger, H. (2003). The stigma of mental illness: Effects of labelling on public attitudes towards people with mental disorder. Acta Psychiatrica Scandinavica, 108, 304–309. https://doi.org/10.1034/j.1600-0447.2003.00150.x
Baker, F. (2001). The basic of item response theory. ERIC.
Brown, T. (2006). Confirmatory factor analysis for applied research. Guildford.
Chen, F. (2016). "Seven Myths" of drug therapy for mental Illness. Medicine and Health, 5, 93.
Cheng, H. L., Wang, C., McDermott, R. C., Kridel, M., & Rislin, J. L. (2018). Self-stigma, mental health literacy, and attitudes toward seeking psychological help. Journal of Counseling & Development, 96, 64–74. https://doi.org/10.1002/jcad.12178
Chen, J. (2018). Some people may need it, but not me, not now: Seeking professional help for mental health problems in urban China. Transcultural Psychiatry, 55(6), 754–774. https://doi.org/10.1177/1363461518792741
Cicchetti, D. V. (1994). Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychological assessment, 6(4), 284. https://doi.org/10.1037/1040-3590.6.4.284
Corrigan, P. W., & Watson, A. C. (2002). The paradox of self-stigma and mental illness. Clinical Psychology: Science and Practice, 9, 35–53. https://doi.org/10.1093/clipsy.9.1.35
Davis, L. (1992). Instrument review: Getting the most from your panel of experts. Applied Nursing Research, 5, 194–197. https://doi.org/10.1016/s0897-1897(05)80008-4
DeVellis, R. F. (2016). Scale development: Theory and applications. Sage.
Gabriel, A., & Violato, C. (2010). The development and psychometric assessment of an instrument to measure attitudes towards depression and its treatments in patients suffering from non-psychotic depression. Journal of Affective Disorders, 124, 241–249. https://doi.org/10.1016/j.jad.2009.11.009
Hasmy, A. (2014). Compare unidimensional & multidimensional Rasch model for test with multidimensional construct and items local dependence. Journal of Education and Learning, 8, 187–194. https://doi.org/10.11591/edulearn.v8i3.261
Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1–55. https://doi.org/10.11591/edulearn.v8i3.261
Huang, Y., Wang, Y., Wang, H., Liu, Z., Yu, X., Yan, J., et al. (2019). Prevalence of mental disorders in China: A cross-sectional epidemiological study. The Lancet Psychiatry, 6, 211–224. https://doi.org/10.1016/S2215-0366(18)30511-X
Jiang, G. R., Zhao, C. X., Yu, L. X., Li, D. Y., Lin, X. B., & Ren, Z. H. (2020). Mental health literacy: Connotation, measurement and new framework. Psychological Science., 43(1), 232–238.
Johanson, G. A., & Brooks, G. P. (2010). Initial scale development: Sample size for pilot studies. Educational and Psychological Measurement, 70(3), 394–400. https://doi.org/10.1177/0013164409355692
Jorm, A. F., Korten, A. E., Jacomb, P. A., Christensen, H., Rodgers, B., & Pollitt, P. (1997). Mental health literacy: A survey of the public's ability to recognise mental disorders and their beliefs about the effectiveness of treatment. The Medical Journal of Australia, 166, 182-186. doi: j.1326-5377.1997.tb140071.x.
Jorm, A. F. (2012). Mental health literacy: Empowering the community to take action for better mental health. American Psychologist, 67, 231–243. https://doi.org/10.1037/a0025957
Jung, H., von Sternberg, K., & Davis, K. (2016). Expanding a measure of mental health literacy: Development and validation of a multicomponent mental health literacy measure. Psychiatry Research, 243, 278–286. https://doi.org/10.1016/j.psychres.2016.06.034
Kutcher, S., Wei, Y., & Coniglio, C. (2016). Mental health literacy: Past, present, and future. The Canadian Journal of Psychiatry, 61, 154–158. https://doi.org/10.1177/0706743715616609
Li, Y., Zhang, Y., Zhu, X., Wu, J., Liu, G., Zhang, L., & Jiang, G. (2018). The Content of Chinese public mental disorder coping literacy: A qualitative study. [Paper presentation]. 21st National Academic Congress of Psychology.
Liu, G., Xu, Z., Jue, W., Li, Y., Zhang, L., & Jiang, G. (2018, November 2-4). The Content of Chinese public mental health literacy: a qualitative study. [Paper presentation]. 21st National Academic Congress of Psychology, Beijing, China.
Liu, J., Zhang, Y., & Yang, C. (2017). The urban mental hygiene work and its suggestions: Base on the meta-analysis of urban citizen's awareness of knowledge about mental health rates from 2005 to 2015. China Journal of Health Psychology, 5, 8.
Lu, A., Bond, M. H., Friedman, M., & Chan, C. (2010). Understanding cultural influences on depression by analyzing a measure of its constituent symptoms. International Journal of Psychological Studies, 2(1), 55. https://doi.org/10.5539/ijps.v2n1p55
Muenks, K., Wigfield, A., Yang, J. S., & O'Neal, C. R. (2017). How true is grit? Assessing its relations to high school and college students’ personality characteristics, self-regulation, engagement, and achievement. Journal of Educational Psychology, 109(5), 599.
Mundfrom, D. J., Shaw, D. G., & Ke, T. L. (2005). Minimum sample size recommendations for conducting factor analyses. International Journal of Testing, 5(2), 159–168. https://doi.org/10.1207/s15327574ijt0502_4
National Health Commissions of the People’s Republic of China. (2020). Tan suo yi yu zheng fang zhi te se fu wu gong zuo fang an. [Special plans to explore ways to prevent depression]. Retrieved from http://www.nhc.gov.cn/
O’Connor, M., & Casey, L. (2015). The Mental Health Literacy Scale (MHLS): A new scale-based measure of mental health literacy. Psychiatry Research, 229, 511–516. https://doi.org/10.1016/j.psychres.2015.05.064
Phillips, M. R., Zhang, J., Shi, Q., Song, Z., Ding, Z., Pang, S., et al. (2009). Prevalence, treatment, and associated disability of mental disorders in four provinces in China during 2001–05: An epidemiological survey. Lancet, 373(9680), 2041–2053. https://doi.org/10.1016/s0140-6736(09)60660-7
Rummel, R. J. (1988). Applied factor analysis. Northwestern University Press.
Rust, J., & Golombok, S. (2014). Modern psychometrics: The science of psychological assessment. Routledge.
Sass, D. A., Schmitt, T. A., & Marsh, H. (2014). Evaluating model fit with ordered categorical data within a measurement invariance framework: A comparison of estimators. Structural Equation Modeling, 21, 167–180. https://doi.org/10.1080/10705511.2014.882658
Shen, Y., Zhang, M., Huang, Y., He, Y., Liu, Z., Cheng, H., . . . Kessler, R. C. (2006). Twelve-month prevalence, severity, and unmet need for treatment of mental disorders in metropolitan China. Psychological Medicine, 36(2), 257–267. doi: https://doi.org/10.1017/S0033291705006367.
Spiker, D. A., & Hammer, J. H. (2019). Mental health literacy as theory: current challenges and future directions. Journal of Mental Health, 28, 238–242. https://doi.org/10.1080/09638237.2018.1437613
Vaske, J. J., Beaman, J., & Sponarski, C. C. (2017). Rethinking internal consistency in Cronbach's alpha. Leisure Sciences, 39(2), 163–173. https://doi.org/10.1080/01490400.2015.1127189
Wang, J., He, Y., Jiang, Q., Cai, J., Wang, W., Zeng, Q., et al. (2013). Mental health literacy among residents in Shanghai. Shanghai Archives of Psychiatry, 25, 224. https://doi.org/10.3969/j.issn.1002-0829.2013.04.004
Wirth, R. J., & Edwards, M. C. (2007). Item factor analysis: Current approaches and future directions. Psychological Methods, 12, 58–79. https://doi.org/10.1037/1082-989X.12.1.58
Wu, J., Zhang, L., Zhu, X., & Jiang, G. (2021). Mental Health Literacy from the Perspective of Multi-Field Experts in the Context of Chinese Culture. International journal of environmental research and public health, 18(4), 1387. https://doi.org/10.3390/ijerph18041387
Xia, Y., & Yang, Y. (2019). RMSEA, CFI, and TLI in structural equation modeling with ordered categorical data: The story they tell depends on the estimation methods. Behavior Research Methods, 51, 409–428. https://doi.org/10.3758/s13428-018-1055-2
Xu, H., Ma, Z. Y., Xiao, S. Y., & Li, Y. (2007). Suicide prevention, suicide attitude and related factors among undergraduates in Changsha. Chinese Mental Health Journal, 21, 654. https://doi.org/10.1016/j.conbuildmat.2005.08.001
Yu, S., Kowitt, S. D., Fisher, E. B., & Li, G. (2018). Mental health in China: Stigma, family obligations, and the potential of peer support. Community mental health journal, 54(6), 757–764. https://doi.org/10.1007/s10597-017-0182-z
Zhang, L., Zhang, Y., Li, Y., Wu, J., Zhu, X., Liu, G., & Jiang, G. (2018, November 2-4). The mental health literacy that public should have in the maintenance of mental health. [Paper presentation]. 21st National Academic Congress of Psychology, Beijing, China.
Zhou, Y., Pan, S., & Zhao, C. (2015). Large sample investigation on discrimination against the patients with mental disorders. China Journal of Health Psychology, 11, 10.
Zhang, M. (2021). Application of mental health literacy scale in patients with mood disorders and related research. (Unpublished thesis. Shanghai Jiao Tong University).
Acknowledgements
We would like to thank our experts and participants for their great support, thoughts and practical help.
Credit author statement
Conceptualization: [Xu Zhu, Guangrong Jiang]
Methodology: [Cixin Wang, Yun Lu, Xu Zhu, Guangrong Jiang]
Formal analysis and investigation: [Jue Wu, Yanqing Li, Guangda Liu]
Writing - original draft preparation: [Jue Wu]
Writing - review and editing: [Cixin Wang, Yun Lu]
Funding acquisition: [Guangrong Jiang]
Supervision: [Xu Zhu]
Data Policy
The datasets generated during and analyzed during the current study are available from the corresponding author on reasonable request.
Funding
This work was supported by the Chinese Major projects of the national social science fund "national mental health literacy and its improvement mechanism and strategies" [grant numbers 16ZDA232].
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Compliance with ethical standards
This manuscript has not been submitted to more than one journal for simultaneous consideration. The work submitted is original and has not been published elsewhere in any form or language (partially or in full).
Ethical approval
Ethical approval was obtained from the Ethics Committee at the researchers’ institution to collect data from adults and minors with parental consent (Ethical Approval Reference Number: ccnu-irb-202005-001). No monetary incentives were provided.
Informed consent
Informed consent was obtained from all individual participants included in the study.
Conflict of interest
No potential conflict of interest was reported by the authors.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Wu, J., Wang, C., Lu, Y. et al. Development and initial validation of the mental health literacy questionnaire for chinese adults. Curr Psychol 42, 8425–8440 (2023). https://doi.org/10.1007/s12144-021-02603-9
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12144-021-02603-9