Abstract
The 12-item General Health Questionnaire (GHQ-12) is a self-reporting instrument to assess mental health. The present study was aimed to explore the optimal factor model of the Chinese version of the GHQ-12 in patients with psychological disorders, and examine its measurement invariance across gender. A total of 870 outpatients completed the GHQ-12. Among them, 361 patients also completed the Center for Epidemiologic Studies Depression Scale (CES-D) and the Self-Rating Anxiety Scale (SAS). Confirmatory factor analysis (CFA) was adopted to assess the fit of two models of the GHQ-12. Multi-group confirmatory factor analysis (MGCFA) was performed to verify the measurement invariance of the GHQ-12 across gender. The Cronbach’s α coefficients, McDonald’s omega coefficients (ω), and mean inter-item correlations (MIC) were calculated to investigate the internal reliability of the GHQ-12. Pearson correlations between GHQ-12 and CES-D/SAS were performed to examine the convergent construct validity. The results showed that the 3-factor model of the GHQ-12 fitted the data better than the 2-factor model, and the 3-factor model of the GHQ-12 was measurement invariant across gender. The Cronbach’s α coefficients of the GHQ-12 and its factors ranged from 0.63 to 0.83, ω ranged from 0.80 to 0.90, and MIC ranged from 0.28 to 0.46. The scores of the GHQ-12 and its factors had significantly positive correlations with scores of CES-D and SAS. In conclusion, the good factorial validity and reliability of the Chinese version of the GHQ-12 supported its application in evaluating the general mental health of patients in clinical context.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Data availability
Data and material that support the findings of this study are available from the corresponding author upon reasonable request.
References
Banks, M. H., Clegg, C. W., Jackson, P. R., Kemp, N. J., Stafford, E. M., & Wall, T. D. (1980). The use of the General Health Questionnaire as an indicator of mental health in occupational studies. Journal of Occupational Psychology, 53(3), 187–194. https://doi.org/10.1111/j.2044-8325.1980.tb00024.x
Barrigón, M. L., Rico-Romano, A. M., Ruiz-Gomez, M., Delgado-Gomez, D., Barahona, I., Aroca, F., & Baca-García, E. (2017). Estudio comparativo de los formatos en lápiz y papel y electrónicos de los cuestionarios GHQ-12, WHO-5 y PHQ-9. Revista de Psiquiatria y Salud Mental, 10(3), 160–167. https://doi.org/10.1016/j.rpsm.2016.12.002
Bentley, N., Hartley, S., & Bucci, S. (2019). Systematic Review of Self-Report Measures of General Mental Health and Wellbeing in Adolescent Mental Health. Clinical Child and Family Psychology Review, 22(2), 225–252. https://doi.org/10.1007/s10567-018-00273-x
Bhui, K., Bhugra, D., & Goldberg, D. (2000). Cross-cultural validity of the Amritsar Depression Inventory and the General Health Questionnaire amongst English and Punjabi primary care attenders. Social Psychiatry and Psychiatric Epidemiology, 35(6), 248–254. https://doi.org/10.1007/s001270050235
Briggs, S. R., & Cheek, J. M. (1986). The role of factor analysis in the development and evaluation of personality scales. Journal of Personality, 54(1), 106–148. https://doi.org/10.1111/j.1467-6494.1986.tb00391.x
Brown, T. A. (2015). Confirmatory factor analysis for applied research. Guilford publications
Castaldelli-Maia, J. M., Lewis, T., Marques dos Santos, N., Picon, F., Kadhum, M., Farrell, S. M. … Ventriglio, A. (2019). Stressors, psychological distress, and mental health problems amongst Brazilian medical students. International Review of Psychiatry, 31(7–8), 603–607. https://doi.org/10.1080/09540261.2019.1669335
Centofanti, S., Lushington, K., Wicking, A., Wicking, P., Fuller, A., Janz, P., & Dorrian, J. (2019). Establishing norms for mental well-being in young people (7–19 years) using the General Health Questionnaire-12. Australian Journal of Psychology, 71(2), 117–126. https://doi.org/10.1111/ajpy.12227
Cheung, G. W., & Rensvold, R. B. (2002). Evaluating Goodness-of-Fit Indexes for Testing Measurement Invariance. Structural Equation Modeling, 9(2), 233–255. https://doi.org/10.1080/10705519909540118
Cohen, J. (2013). Statistical power analysis for the behavioral sciences. Academic press
Cole, D. A., Maxwell, S. E., Arvey, R., & Salas, E. (1993). Multivariate group comparisons of variable systems: MANOVA and structural equation modeling. Psychological Bulletin, 114(1), 174–184. https://doi.org/10.1037/0033-2909.114.1.174
Davidov, E., Meuleman, B., Cieciuch, J., Schmidt, P., & Billiet, J. (2014). Measurement equivalence in cross-national research. Annual Review of Sociology, 40, 55–75. https://doi.org/10.1146/annurev-soc-071913-043137
DeVellis, R. F. (2016). Scale development: Theory and applications. Sage Publications
El-Metwally, A., Javed, S., Razzak, H. A., Aldossari, K. K., Aldiab, A., Al-Ghamdi, S. H. … Al-Zahrani, J. M. (2018). The factor structure of the general health questionnaire (GHQ12) in Saudi Arabia. BMC Health Services Research, 18(1), 1–11. https://doi.org/10.1186/s12913-018-3381-6
Elovanio, M., Hakulinen, C., Pulkki-Råback, L., Aalto, A. M., Virtanen, M., Partonen, T., & Suvisaari, J. (2020). General Health Questionnaire (GHQ-12), Beck Depression Inventory (BDI-6), and Mental Health Index (MHI-5): psychometric and predictive properties in a Finnish population-based sample. Psychiatry Research, 289(August 2019), 112973. https://doi.org/10.1016/j.psychres.2020.112973
Fernandes, H. M., & Vasconcelos-Raposo, J. (2013). Factorial Validity and Invariance of the GHQ-12 Among Clinical and Nonclinical Samples. Assessment, 20(2), 219–229. https://doi.org/10.1177/1073191112465768
Furnham, A., & Cheng, H. (2019). GHQ score changes from teenage to young adulthood. Journal of Psychiatric Research, 113(October 2018), 46–50. https://doi.org/10.1016/j.jpsychires.2019.03.006
García-Esquinas, E., Rodríguez-Sánchez, I., Ortolá, R., Lopez-Garcia, E., Caballero, F. F., Rodríguez-Mañas, L. … Rodríguez-Artalejo, F. (2019). Gender Differences in Pain Risk in Old Age: Magnitude and Contributors. Mayo Clinic Proceedings, 94(9), 1707–1717. https://doi.org/10.1016/j.mayocp.2019.03.034
Gelaye, B., Tadesse, M. G., Lohsoonthorn, V., Lertmeharit, S., Pensuksan, W. C., Sanchez, S. E. … Williams, M. A. (2015). Psychometric properties and factor structure of the General Health Questionnaire as a screening tool for anxiety and depressive symptoms in a multi-national study of young adults. Journal of Affective Disorders, 187, 197–202. https://doi.org/10.1016/j.jad.2015.08.045
Goldberg, D. P. (1972). The detection of psychiatric illness by questionnaire. Maudsley Monograph, 21
Goldberg, D. P., & Williams, P. (1988). A User’s Guide to the General Health Questionnaire. Nfer-Nelson
Gouveia, V. V., Barbosa, G. A., de Oliveira Andrade, E., & Carneiro, M. B. (2010). Factorial validity and reliability of the General Health Questionnaire (GHQ-12) in the Brazilian physician population. Cadernos de Saude Publica, 26(7), 1439–1445. https://doi.org/10.1590/S0102-311X2010000700023
Graetz, B. (1991). Multidimensional properties of the general health questionnaire. Social Psychiatry and Psychiatric Epidemiology, 26, 132–138. https://doi.org/10.1007/BF00782952
Guan, M., & Han, B. (2019). Factor structures of general health questionnaire-12 within the number of kins among the rural residents in China. Frontiers in Psychology, 10(JULY). https://doi.org/10.3389/fpsyg.2019.01774
Hancock, G. R. (1997). Structural equation modeling methods of hypothesis testing of latent variable means. Measurement and Evaluation in Counseling and Development, 30(2), 91–105. https://doi.org/10.1080/07481756.1997.12068926
Hong, S., Malik, M. L., & Lee, M. K. (2003). Testing configural, metric, scalar, and latent mean invariance across genders in sociotropy and autonomy using a non-western sample. Educational and Psychological Measurement, 63(4), 636–654. https://doi.org/10.1177/0013164403251332
Huang, Y., Wang, Y., Wang, H., Liu, Z., Yu, X., Yan, J. … Wu, Y. (2019). Prevalence of mental disorders in China: a cross-sectional epidemiological study. The Lancet Psychiatry, 6(3), 211–224. https://doi.org/10.1016/S2215-0366(18)30511-X
Kashyap, G. C., & Singh, S. K. (2017). Reliability and validity of general health questionnaire (GHQ-12) for male tannery workers: A study carried out in Kanpur, India. BMC Psychiatry, 17(1), 1–7. https://doi.org/10.1186/s12888-017-1253-y
Liang, Y., Wang, L., & Yin, X. (2016). The factor structure of the 12-item general health questionnaire (GHQ-12) in young Chinese civil servants. Health and Quality of Life Outcomes, 14(1), 1–9. https://doi.org/10.1186/s12955-016-0539-y
Madden, D. (2010). Gender Differences in Mental Well-Being: A Decomposition Analysis. Social Indicators Research, 99(1), 101–114. https://doi.org/10.1007/s11205-009-9569-8
Mayhew, E., Stuttard, L., & Beresford, B. (2021). An Assessment of the Psychometric Properties of the GHQ-12 in an English Population of Autistic Adults Without Learning Difficulties. Journal of Autism and Developmental Disorders, 51(4), 1093–1106. https://doi.org/10.1007/s10803-020-04604-2
Motamed, N., Zakeri, E., Rabiee, S., Maadi, B., Khonsari, M., Keyvani, M. R. … Zamani, F. (2018). The Factor Structure of the Twelve Items General Health Questionnaire (GHQ-12): a Population Based Study. Applied Research in Quality of Life, 13(2), 303–316. https://doi.org/10.1007/s11482-017-9522-y
Najarkolaei, F. R., Raiisi, F., Rahnama, P., Fesharaki, M. G., Zamani, O., Jafari, M. R., & Montazeri, A. (2014). Factor structure of the Iranian version of 12-item general health questionnaire. Iranian Red Crescent Medical Journal, 16(9), https://doi.org/10.5812/ircmj.11794
Namjoo, S., Shaghaghi, A., Sarbaksh, P., Allahverdipour, H., & Pakpour, A. H. (2017). Psychometric properties of the General Health Questionnaire (GHQ-12) to be applied for the Iranian elder population. Aging and Mental Health, 21(10), 1047–1051. https://doi.org/10.1080/13607863.2016.1196337
Neupane, S., Lallukka, T., Pietiläinen, O., Rahkonen, O., & Leino-Arjas, P. (2020). Trajectories of multisite musculoskeletal pain in midlife: Associations with common mental disorders. European Journal of Pain (United Kingdom), 24(2), 364–373. https://doi.org/10.1002/ejp.1492
Nye, C. D., Bradburn, J., Olenick, J., Bialko, C., & Drasgow, F. (2019). How Big Are My Effects? Examining the Magnitude of Effect Sizes in Studies of Measurement Equivalence. Organizational Research Methods, 22(3), 678–709. https://doi.org/10.1177/1094428118761122
Radloff, L. S. (1977). The CES-D Scale: A Self-Report Depression Scale for Research in the General Population. Applied Psychological Measurement, 1(3), 385–401. https://doi.org/10.1177/014662167700100306
Romppel, M., Hinz, A., Finck, C., Young, J., Brähler, E., & Glaesmer, H. (2017). Cross-cultural measurement invariance of the General Health Questionnaire-12 in a German and a Colombian population sample. International Journal of Methods in Psychiatric Research, 26(4), 1–9. https://doi.org/10.1002/mpr.1532
Rusconi, F., Gagliardi, L., Gori, E., Porta, D., Popovic, M., Asta, F. … Stazi, M. A. (2019). Perinatal maternal mental health is associated with both infections and wheezing in early childhood. Pediatric Allergy and Immunology, 30(7), 732–738. https://doi.org/10.1111/pai.13103
Saito, Y., Shoji, T., Tateishi, K., Kitahara, H., Fujimoto, Y., & Kobayashi, Y. (2020). Mental Health Status in Patients Undergoing Intracoronary Acetylcholine Provocation Test. Advances in Therapy, 37(9), 3807–3815. https://doi.org/10.1007/s12325-020-01424-9
Sampogna, F., Mastroeni, S., Pallotta, S., Fusari, R., Uras, C., Napolitano, M., & Abeni, D. (2019). Use of the SF-12 questionnaire to assess physical and mental health status in patients with psoriasis. Journal of Dermatology, 46(12), 1153–1159. https://doi.org/10.1111/1346-8138.15074
Sanchez-Lopez, P., Saavedra-San Roman, A. I., Dresch, V., Garcia-Quintans, L., & Rodrigo-Holgado, I. (2016). Women Are More at Risk of Poor Mental Health: Mental Health of Spanish Nurses Measured by the GHQ-12. Women’s Health Bulletin, 3(2), 1–5. https://doi.org/10.17795/whb-29603
Schmitt, N., & Kuljanin, G. (2008). Measurement invariance: Review of practice and implications. Human Resource Management Review, 18(4), 210–222. https://doi.org/10.1016/j.hrmr.2008.03.003
Schmitz, N., Kruse, J., & Tress, W. (1999). Psychometric properties of the General Health Questionnaire (GHQ-12) in a German primary care sample. Acta Psychiatrica Scandinavica, 100(6), 462–468. https://doi.org/10.1111/j.1600-0447.1999.tb10898.x
Setyowati, A., Chung, M. H., & Yusuf, A. (2019). Development of self-report assessment tool for anxiety among adolescents: Indonesian version of the Zung self-rating anxiety scale. Journal of Public Health in Africa, 10, 15–18. https://doi.org/10.4081/jphia.2019.1172
Tomás, J. M., Hontangas, P., Oliver, A., Galiana, L., & Sancho, P. (2019). More on the dimensionality of the GHQ-12: Competitive confirmatory models. Universitas Psychologica, 18(1), https://doi.org/10.11144/Javeriana.upsy18-1.mdgc
Tsaousis, I., & Kazi, S. (2013). Factorial invariance and latent mean differences of scores on trait emotional intelligence across gender and age. Personality and Individual Differences, 54(2), 169–173. https://doi.org/10.1016/j.paid.2012.08.016
Vandenberg, R. J., & Lance, C. E. (2000). A Review and Synthesis of the Measurement Invariance Literature: Suggestions, Practices, and Recommendations for Organizational Research. Organizational Research Methods, 3(1), 3–70. https://doi.org/10.1177/109442810031002
Wang, M., Elhai, J. D., Dai, X., & Yao, S. (2012). Longitudinal invariance of posttraumatic stress disorder symptoms in adolescent earthquake survivors. Journal of Anxiety Disorders, 26(2), 263–270. https://doi.org/10.1016/j.janxdis.2011.12.009
Xiao, J., Qiu, Y., He, Y., Cui, L., Auerbach, R. P., McWhinnie, C. M., & Yao, S. (2016). “Weakest Link” as a Cognitive Vulnerability Within the Hopelessness Theory of Depression in Chinese University Students. Stress and Health, 32(1), 20–27. https://doi.org/10.1002/smi.2571
Ye, S. (2009). Factor structure of the General Health Questionnaire (GHQ-12): The role of wording effects. Personality and Individual Differences, 46(2), 197–201. https://doi.org/10.1016/j.paid.2008.09.027
Zung, W. W. K. (1971). A Rating Instrument For Anxiety Disorders. Psychosomatics, 12(6), 371–379. https://doi.org/10.1016/S0033-3182(71)71479-0
Acknowledgements
We are grateful to all subjects for their participation.
Conflict of interest
The authors have no conflicts of interest to declare that are relevant to the content of this article.
Funding
This work was supported by the National Natural Science Foundation of China [grant number 81871074].
Author information
Authors and Affiliations
Contributions
Jinyao Yi and Mingtian Zhong were involved in the design of the study and revised new drafts from co-authors. Zhaoxia Liu and Chang Xi participated in the design, performed the analysis and wrote the first manuscript drafting. Wanrong Peng, Qian Liu, Jun Chu and Kaili Zheng were responsible for data collection and analyses. All authors have read and approved the manuscript.
Corresponding author
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Zhaoxia Liu and Chang Xi are co-first authors.
Rights and permissions
About this article
Cite this article
Liu, Z., Xi, C., Zhong, M. et al. Factorial validity of the 12-item general health questionnaire in patients with psychological disorders. Curr Psychol 42, 18133–18141 (2023). https://doi.org/10.1007/s12144-022-02845-1
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12144-022-02845-1