Abstract
Study objectives
Sleep quality is essential to health. The current study aimed to adapt and validate the Sleep Quality Questionnaire (SQQ) into Chinese language.
Methods
The Chinese version of the SQQ (SQQ-C) was created following the guidelines for cross-cultural adaptation. Compliant with the COSMIN methodology, baseline data (N = 13,325) examined three validity domains and internal consistency, including content validity using the content validity index (CVI) and the cognitive debriefing and focus group (relevance, comprehensiveness and comprehensibility), construct validity using structural validity and cross‑sectional measurement invariance, and criterion validity using concurrent/convergent validity. Follow-up data (N = 3410) gathered within a mean of 168 (167–207) h interval were used to additionally assess longitudinal measurement invariance and test–retest reliability using intraclass correlation coefficient (ICC).
Results
Scale-level CVI/Average was equal to 0.922; Item-level CVIs ranged from 0.889 to 1.000 (excellent), except for item 2 (0.556-fair). A panel of local experts and local participants during cognitive debriefing and focus group stated that it had sufficient relevance and comprehensibility but a slight deficiency in comprehensiveness. Confirmatory factor analysis indicated a stable two-factor structure encompassing Daytime Sleepiness Subscale and Sleep Difficulty Subscale from baseline to follow-up data. The SQQ-C-9 (without item 2) outperformed the SQQ-C-10 (full form). The SQQ-C-9 provided evidence of measurement invariance (strict) across subgroups (cohorts, gender, and age) and across time. The SQQ-C was negatively correlated with the Chinese Nonrestorative Sleep Scale and the Chinese Sleep Condition Indicator. Cronbach's alpha (α), McDonald's Omega (ω), and ICC, respectively, ranged from 0.712 to 0.838, 0.723 to 0.840, and 0.738 to 0.764 for total scale and each subscale.
Conclusion
The SQQ-C exhibits adequate psychometric properties and a stable two-factor structure, and should enable valuable assessments of sleep quality in clinical and research settings.
Similar content being viewed by others
Data availability
Not available.
Code availability
Not available.
Material availability
Anyone interested in using the formatted SQQ-C and its scoring rubric should contact the corresponding author when ready to initiate research collaboration.
References
Ramar, K., Malhotra, R. K., Carden, K. A., Martin, J. L., Abbasi-Feinberg, F., Aurora, R. N., Kapur, V. K., Olson, E. J., Rosen, C. L., Rowley, J. A., Shelgikar, A. V., & Trotti, L. M. (2021). Sleep is essential to health: An American Academy of sleep medicine position statement. Journal of Clinical Sleep Medicine, 17(10), 2115–2119.
Hall, M. H. (2013). Sleep. In M. D. Gellman & J. R. Turner (Eds.), Encyclopedia of behavioral medicine (pp. 1795–1799). Springer.
Kushida, C. A. (2013). Encyclopedia of sleep. Academic Press.
Kryger, M. H., Roth, T., & Dement, W. C. (2017). Principles and practice of sleep medicine (6th ed.). Elsevier.
Harvey, A. G., Stinson, K., Whitaker, K. L., Moskovitz, D., & Virk, H. (2008). The subjective meaning of sleep quality: A comparison of individuals with and without insomnia. Sleep, 31(3), 383–393.
Mendonça, F., Mostafa, S. S., Morgado-Dias, F., Ravelo-García, A. G., & Penzel, T. (2019). A review of approaches for sleep quality analysis. IEEE Access, 7, 24527–24546.
Kline, C. (2013). Sleep quality. In M. D. Gellman & J. R. Turner (Eds.), Encyclopedia of behavioral medicine (pp. 1811–1813). Springer.
Hale, L., Troxel, W., & Buysse, D. J. (2020). Sleep health: An opportunity for public health to address health equity. Annual Review of Public Health, 41(1), 81–99.
Kato, T. (2014). Development of the Sleep Quality Questionnaire in healthy adults. Journal of Health Psychology, 19(8), 977–986.
Morin, C. M., Belleville, G., Bélanger, L., & Ivers, H. (2011). The Insomnia Severity Index: psychometric indicators to detect insomnia cases and evaluate treatment response. Sleep, 34(5), 601–608.
Yi, H., Shin, K., & Shin, C. (2006). Development of the Sleep Quality Scale. Journal of Sleep Research, 15(3), 309–316.
Quan, S. F., Lockyer, B. J., Batool-Anwar, S., & Aeschbach, D. (2019). Out of center sleep testing in ostensibly healthy middle aged to older adults. Southwest Journal of Pulmonary and Critical Care, 18, 87–93.
Jahedi, S., & Méndez, F. (2014). On the advantages and disadvantages of subjective measures. Journal of Economic Behavior & Organization, 98, 97–114.
Shahid, A., Wilkinson, K., Marcu, S., & Shapiro, C. M. (2012). STOP, THAT and one hundred other sleep scales. Springer.
APA. (2013). Diagnostic and statistical manual of mental disorders (DSM-5®). American Psychiatric Pub.
Black, D. W., & Grant, J. E. (2014). DSM-5® guidebook: The essential companion to the diagnostic and statistical manual of mental disorders. American Psychiatric Pub.
NIH. (2005). National institutes of health state of the science conference statement: Manifestations and management of chronic insomnia in adults june 13–15, 2005. Sleep, 28(9), 1049–1057.
Buysse, D. J., Reynolds, C. F., Monk, T. H., Berman, S. R., & Kupfer, D. J. (1989). The Pittsburgh sleep quality index: A new instrument for psychiatric practice and research. Psychiatry Research, 28(2), 193–213.
Bastien, C. H., Vallières, A., & Morin, C. M. (2001). Validation of the Insomnia Severity Index as an outcome measure for insomnia research. Sleep Medicine, 2(4), 297–307.
NIH. (1999). Insomnia: Assessment and management in primary care. National Heart, Lung, and Blood Institute Working Group on insomnia. American family Physician, 59(11), 3029–3038.
Johns, M. W. (1991). A new method for measuring daytime sleepiness: The Epworth Sleepiness Scale. Sleep, 14(6), 540–545.
Hoddes, E., Zarcone, V., Smythe, H., Phillips, R., & Dement, W. C. (1973). Quantification of sleepiness: A new approach. Psychophysiology, 10(4), 431–436.
Epstein, J., Santo, R. M., & Guillemin, F. (2015). A review of guidelines for cross-cultural adaptation of questionnaires could not bring out a consensus. Journal of Clinical Epidemiology, 68(4), 435–441.
Herdman, M., Fox-Rushby, J., & Badia, X. (1998). A model of equivalence in the cultural adaptation of HRQoL instruments: The universalist approach. Quality of Life Research, 7(4), 323–335.
DeVellis, R. F. (2016). Scale development: Theory and applications (4th ed.). Sage Publications.
Spruyt, K., & Gozal, D. (2011). Development of pediatric sleep questionnaires as diagnostic or epidemiological tools: A brief review of dos and don’ts. Sleep Medicine Reviews, 15(1), 7–17.
NSF. (2010). Sleep differences among ethnic groups revealed in new poll. Retrieved October 18, 2020, from www.sciencedaily.com/releases/2010/03/100308081740.htm
CDC. (2017). Short Sleep Duration Among US Adults. Retrieved October 18, 2020, from https://www.cdc.gov/sleep/data_statistics.html
Chen, X., Wang, R., Zee, P., Lutsey, P. L., Javaheri, S., Alcántara, C., Jackson, C. L., Williams, M. A., & Redline, S. (2015). Racial/ethnic differences in sleep disturbances: The Multi-Ethnic Study of Atherosclerosis (MESA). Sleep, 38(6), 877–888.
Wild, D., Grove, A., Martin, M., Eremenco, S., McElroy, S., Verjee-Lorenz, A., & Erikson, P. (2005). Principles of good practice for the translation and cultural adaptation process for Patient-Reported Outcomes (PRO) measures: Report of the ISPOR task force for translation and cultural adaptation. Value in Health, 8(2), 94–104.
Acquadro, C., Conway, K., Giroudet, C., & Mear, I. (2012). Linguistic validation manual for health outcome assessments. MAPI Research Trust.
WHO. Process of translation and adaptation of instruments. Retrieved December 10, 2016, from http://www.who.int/substance_abuse/research_tools/translation/en/
Jiang, X. I., Zheng, X.-y, Yang, J., Ye, C.-p, Chen, Y.-y, Zhang, Z.-g, & Xiao, Z.-j. (2015). A systematic review of studies on the prevalence of Insomnia in university students. Public Health, 129(12), 1579–1584.
Wang, F., & Bíró, É. (2021). Determinants of sleep quality in college students: A literature review. EXPLORE, 17(2), 170–177.
Booker, L. A., Magee, M., Rajaratnam, S. M. W., Sletten, T. L., & Howard, M. E. (2018). Individual vulnerability to insomnia, excessive sleepiness and shift work disorder amongst healthcare shift workers. A systematic review. Sleep Medicine Reviews, 41, 220–233.
Morse, A. M., & Bender, E. (2019). Sleep in hospitalized patients. Clocks & Sleep, 1(1), 151–165.
Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Routledge.
Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric theory (3rd ed.). McGraw-Hill Inc.
Wilkinson, K., & Shapiro, C. (2013). Development and validation of the Nonrestorative Sleep Scale (NRSS). Journal of Clinical Sleep Medicine, 09(09), 929–937.
Li, S., Fong, D. Y. T., Wong, J. Y. H., Wilkinson, K., Shapiro, C., Choi, E. P. H., McPherson, B., Lam, C. L. K., & Ip, M. S. M. (2019). Nonrestorative sleep scale: Reliable and valid for the Chinese population. Quality of Life Research, 28(6), 1685–1692.
Li, S., Fong, D. Y. T., Xu, Y., Wilkinson, K., Shapiro, C., & Wong, J. Y. H. (2021). Measurement properties of the simplified Chinese version of Nonrestorative Sleep Scale in adolescents. Health and Social Care in the Community, 29(6), e299–e307.
Espie, C. A., Kyle, S. D., Hames, P., Gardani, M., Fleming, L., & Cape, J. (2014). The sleep condition indicator: A clinical screening tool to evaluate insomnia disorder. British Medical Journal Open, 4(3), e004183.
Wong, M. L., Lau, K. N. T., Espie, C. A., Luik, A. I., Kyle, S. D., & Lau, E. Y. Y. (2017). Psychometric properties of the sleep condition indicator and Insomnia Severity Index in the evaluation of insomnia disorder. Sleep Medicine, 33, 76–81.
Prinsen, C. A. C., Mokkink, L. B., Bouter, L. M., Alonso, J., Patrick, D. L., de Vet, H. C. W., & Terwee, C. B. (2018). COSMIN guideline for systematic reviews of patient-reported outcome measures. Quality of Life Research, 27(5), 1147–1157.
Polit, D. F., Beck, C. T., & Owen, S. V. (2007). Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Research in Nursing & Health, 30(4), 459–467.
Waltz, C. F., Strickland, O. L., & Lenz, E. R. (2010). Measurement in nursing and health research (4th ed.). Springer.
Davis, L. L. (1992). Instrument review: Getting the most from a panel of experts. Applied Nursing Research, 5(4), 194–197.
Lynn, M. R. (1986). Determination and quantification of content validity. Nursing Research, 35(6), 382–385.
Cicchetti, D. V., & Sparrow, S. A. (1981). Developing criteria for establishing interrater reliability of specific items: Applications to assessment of adaptive behavior. American Journal of Mental Deficiency, 86(2), 127–137.
Fleiss, J. L., Levin, B., & Paik, M. C. (2003). Statistical methods for rates and proportions (3rd ed.). Wiley.
Meng, R. (2020). Development and evaluation of the chinese version of the sleep quality questionnaire (doctoral dissertation in Chinese). Wuhan University.
Terwee, C. B., Prinsen, C. A. C., Chiarotto, A., Westerman, M. J., Patrick, D. L., Alonso, J., Bouter, L. M., de Vet, H. C. W., & Mokkink, L. B. (2018). COSMIN methodology for evaluating the content validity of patient-reported outcome measures: A Delphi study. Quality of Life Research, 27(5), 1159–1170.
Jackson, D. L., Gillaspy, J. A., Jr., & Purc-Stephenson, R. (2009). Reporting practices in confirmatory factor analysis: An overview and some recommendations. Psychological Methods, 14(1), 6–23.
Prinsen, C. A. C., Vohra, S., Rose, M. R., Boers, M., Tugwell, P., Clarke, M., Williamson, P. R., & Terwee, C. B. (2016). How to select outcome measurement instruments for outcomes included in a “Core Outcome Set”—A practical guideline. Trials, 17(1), 449–458.
Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2014). Multivariate data analysis: Pearson new international edition (7th ed.). Pearson Higher Education.
Kline, R. B. (2016). Principles and practice of structural equation modeling. Guilford Publications.
Van De Schoot, R., Schmidt, P., De Beuckelaer, A., Lek, K., & Zondervan-Zwijnenburg, M. (2015). Editorial: Measurement invariance. Frontiers in Psychology, 6(1064), 1–4.
Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal, 9(2), 233–255.
Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal, 14(3), 464–504.
Meade, A. W., Johnson, E. C., & Braddy, P. W. (2008). Power and sensitivity of alternative fit indices in tests of measurement invariance. Journal of Applied Psychology, 93(3), 568–592.
Nelemans, S. A., Meeus, W. H. J., Branje, S. J. T., Van Leeuwen, K., Colpin, H., Verschueren, K., & Goossens, L. (2019). Social Anxiety Scale for Adolescents (SAS-A) short form: Longitudinal measurement invariance in two community samples of youth. Assessment, 26(2), 235–248.
DiStefano, C., & Morgan, G. B. (2014). A comparison of diagonal weighted least squares robust estimation techniques for ordinal data. Structural Equation Modeling: A Multidisciplinary Journal, 21(3), 425–438.
Flora, D. B., & Curran, P. J. (2004). An empirical evaluation of alternative methods of estimation for confirmatory factor analysis with ordinal data. Psychological Methods, 9(4), 466.
Floyd, F. J., & Widaman, K. F. (1995). Factor analysis in the development and refinement of clinical assessment instruments. Psychological Assessment, 7(3), 286–299.
Brannick, M. T. (1995). Critical comments on applying covariance structure modeling. Journal of Organizational Behavior, 16(3), 201–213.
Kelloway, E. K. (1995). Structural equation modelling in perspective. Journal of Organizational Behavior, 16(3), 215–224.
Terwee, C. B., Bot, S. D., de Boer, M. R., van der Windt, D. A., Knol, D. L., Dekker, J., Bouter, L. M., & de Vet, H. C. (2007). Quality criteria were proposed for measurement properties of health status questionnaires. Journal of clinical epidemiology, 60(1), 34–42.
Cho, E., & Kim, S. (2015). Cronbach’s coefficient alpha: Well known but poorly understood. Organizational Research Methods, 18(2), 207–230.
DeVon, H. A., Block, M. E., Moyle-Wright, P., Ernst, D. M., Hayden, S. J., Lazzara, D. J., Savoy, S. M., & Kostas-Polston, E. (2007). A psychometric toolbox for testing validity and reliability. Journal of Nursing Scholarship, 39(2), 155–164.
Revelle, W., & Condon, D. M. (2019). Reliability from α to ω: A tutorial. Psychological Assessment, 31(12), 1395–1411.
Bennett, D. A. (2001). How can I deal with missing data in my study? Australian and New Zealand Journal of Public Health, 25(5), 464–469.
Lynch, S. M. (2007). Introduction to applied Bayesian statistics and estimation for social scientists. Springer.
Korkmaz, S., Goksuluk, D., & Zararsiz, G. (2014). MVN: An R package for assessing multivariate normality. The R Journal, 6(2), 151–162.
Rosseel, Y. (2012). lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48(2), 1–36.
Jorgensen, T. D., Pornprasertmanit, S., Schoemann, A. M., & Rosseel, Y. (2021). semTools: Useful tools for structural equation modeling. R package version 0.5–5., Retrieved from https://CRAN.R-project.org/package=semTools
Wickham, H. (2016). ggplot2: Elegant graphics for data analysis. Springer.
Özdilekcan, Ç., Özdemir, T., Türkkanı, M. H., Sur, H. Y., & Katoue, M. G. (2019). The association of body mass index values with severity and phenotype of sleep-disordered breathing. Tuberkuloz ve Toraks, 67(4), 265–271.
Suhonen, L.-V. (2020). Snakes and ladders: Developmental aspects of lexical-conceptual relationships in the multilingual mental lexicon. Lund University.
Luo, Y., Fei, S., Gong, B., Sun, T., & Meng, R. (2021). Understanding the mediating role of anxiety and depression on the relationship between perceived stress and sleep quality among health care workers in the COVID-19 response. Nature and Science of Sleep, 13, 1747–1758.
Polit, D. F., & Beck, C. T. (2006). The content validity index: Are you sure you know what’s being reported? Critique and recommendations. Research in Nursing & Health, 29(5), 489–497.
Schlarb, A. A., Friedrich, A., & Claßen, M. (2017). Sleep problems in university students—An intervention. Neuropsychiatric Disease and Treatment, 13, 1989–2001.
Burch, J. B., Tom, J., Zhai, Y., Criswell, L., Leo, E., & Ogoussan, K. (2009). Shiftwork impacts and adaptation among health care workers. Occupational Medicine, 59(3), 159–166.
Kubota, K., Shimazu, A., Kawakami, N., Takahashi, M., Nakata, A., & Schaufeli, W. B. (2010). Association between workaholism and sleep problems among hospital nurses. Industrial Health, 48(6), 864–871.
Kato, T. (2014). Insomnia symptoms, depressive symptoms, and suicide ideation in Japanese white-collar employees. International Journal of Behavioral Medicine, 21(3), 506–510.
Kato, T. (2016). Impact of psychological inflexibility on depressive symptoms and sleep difficulty in a Japanese sample. Springerplus, 5(1), 712.
Kato, T. (2021). Effects of waiting patiently as coping strategy for an interpersonal stressor on depressive symptoms. Anxiety, Stress, & Coping, 34(1), 51–65.
Specht, J. (2017). Personality development across the lifespan. Academic Press.
Sousa, V. D., & Rojjanasrirat, W. (2011). Translation, adaptation and validation of instruments or scales for use in cross-cultural health care research: A clear and user-friendly guideline. Journal of Evaluation in Clinical Practice, 17(2), 268–274.
Geiser, C., Keller, B. T., Lockhart, G., Eid, M., Cole, D. A., & Koch, T. (2015). Distinguishing state variability from trait change in longitudinal data: The role of measurement (non)invariance in latent state-trait analyses. Behavior Research Methods, 47(1), 172–203.
Putnick, D. L., & Bornstein, M. H. (2016). Measurement invariance conventions and reporting: The state of the art and future directions for psychological research. Developmental Review, 41, 71–90.
Acknowledgements
The authors wish to thank group of consultant experts on the CVI, including Lu Dong (Ph.D., Behavioral Scientist, RAND Corporation, USA), Daniel Yee Tak Fong (Ph.D., Associate Professor, Li Ka Shing Faculty of Medicine, The University of Hong Kong, China), Yuantao Hao (Ph.D., Professor, School of Public Health, Sun Yat-Sen University, China), Esther Yuet Ying Lau (Ph.D., Associate Professor, Department of Psychology, The Education University of Hong Kong, China), Jian Li (M.D., Ph.D., Senior Researcher, Faculty of Medicine, University of Düsseldorf, Germany), Jingjing Li (M.D., Ph.D., PostDoc, Rollins School of Public Health, Emory University, USA), Zhen Wang (M.D., Ph.D., Chief Psychiatrist, Shanghai Mental Health Center, Shanghai Jiao Tong University School of Medicine, China), Qiong Wu (Ph.D., Associate Research Fellow, Institute of Social Science Survey, Peking University, China) and Yu-Tao Xiang (M.D., Ph.D., Professor, Faculty of Health Sciences, University of Macau, China). The authors appreciate comments and edits on earlier drafts from Assoc. Prof. Dr. Esther Yuet Ying Lau. The authors are grateful to Lidwine B. Mokkink (Ph.D., Senior Researcher, Department of Epidemiology and Data Science, Amsterdam Public Health Research Institute, Amsterdam UMC, Vrije Universiteit Amsterdam, the Netherlands) for discussion on content validity and Chen Jiang (M.B.B.S., Master Candidate, School of Public Health, Hangzhou Normal University, China) for assistance in data visualization during the revision process. The authors are indebted to four anonymous reviewers and two editors who provided insightful comments and constructive suggestions to facilitate this manuscript. Lastly, Dr. Runtang Meng thanks a panel of independent experts, the partners, the participants and the research assistants who made this study possible.
Funding
This study was supported by the Research Initiation Fund of Hangzhou Normal University (Grant No. RWSK20201003). This study was supported by a grant from an independent self-funded project to Runtang Meng during the doctorate at Wuhan University.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
All authors declare that they have no conflict of interest to disclose.
Ethical approval
The study protocol was approved by the Ethics Committee of Wuhan University School of Medicine (WUSM) (Reference No. 2019YF2034) and the Ethics Committee of Shiyan Taihe Hospital (Reference No. 201917). This study followed the ethical standards of the institutional and/or national research committee and the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Consent to participate
Routinely collected data were anonymized and informed consent was obtained from all participants enrolled in the study.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Meng, R., Kato, T., Mastrotheodoros, S. et al. Adaptation and validation of the Chinese version of the Sleep Quality Questionnaire. Qual Life Res 32, 569–582 (2023). https://doi.org/10.1007/s11136-022-03241-9
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11136-022-03241-9