Abstract
Digital stress describes the stress and anxiety that accompanies notifications and alerts from and the usage of mobile and social media. According to recent studies, digital stress may help to explain the various effects of social media usage on psychological and behavioral outcomes. The Digital Stress Scale (DSS) is a psychometrically reliable measure of digital stress. The present study translated the DSS into Chinese and examined its psychometric properties among Chinese young adults. The results exhibited that the DSS was best characterized by a bifactor Exploratory Structural Equation Modeling (bifactor-ESEM) representation, which includes one general factor of digital stress and the combination of five specific factors which are Availability Stress, Approval Anxiety, Fear of Missing Out, Connection Overload, and Online Vigilance. The measurement and structural invariance of the bifactor-ESEM solution were demonstrated across male and female groups. Reliabilities of the general factor and specific factors of the DSS were sound with high Cronbach’s alpha and MacDonald’s coefficient omega. Convergent validity was supported by the associations between DSS and measures of psychological stress, depression, and mindfulness.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Data Availability
The data that support the findings of this study are available from the corresponding author on reasonable request.
Notes
The counselors are administrative staff responsible for the management of non-teaching affairs. Theirs usual work focuses on students’ life and involves various daily class affairs such as students’ mental health supervision and education.
References
Amirkhan, J. H. (2018). A brief stress diagnostic tool: The short stress overload scale. Assessment, 25(8), 1001–1013. https://doi.org/10.1177/1073191116673173
Anderson, M., & Jiang, J. (2018). Teens, social media & technology 2018. 10.
Asparouhov, T., & Muthén, B. (2009). Exploratory structural equation modeling. Structural Equation Modeling: A Multidisciplinary Journal, 16(3), 397–438. https://doi.org/10.1080/10705510903008204
Beaton, D. E., Bombardier, C., Guillemin, F., & Ferraz, M. B. (2000). Guidelines for the process of cross-cultural adaptation of self-report measures. Spine, 25(24), 3186–3191. https://doi.org/10.1097/00007632-200012150-00014
Beyens, I., Frison, E., & Eggermont, S. (2016). “I don’t want to miss a thing”: Adolescents’ fear of missing out and its relationship to adolescents’ social needs, Facebook use, and Facebook related stress. Computers in Human Behavior, 64, 1–8. https://doi.org/10.1016/j.chb.2016.05.083
Bharati, P., Zhang, W., & Chaudhury, A. (2015). Better knowledge with social media? Exploring the roles of social capital and organizational knowledge management. Journal of Knowledge Management, 19(3), 456–475. https://doi.org/10.1108/JKM-11-2014-0467
Black, D. S., Sussman, S., Johnson, C. A., & Milam, J. (2012). Psychometric assessment of the mindful attention awareness scale (MAAS) among Chinese adolescents. Assessment, 19(1), 42–52. https://doi.org/10.1177/1073191111415365
Brown, K. W., & Ryan, R. M. (2003). The benefits of being present: Mindfulness and its role in psychological well-being. Journal of Personality and Social Psychology, 84(4), 822–848. https://doi.org/10.1037/0022-3514.84.4.822
Campisi, J., Bynog, P., McGehee, H., Oakland, J. C., Quirk, S., Taga, C., & Taylor, M. (2012). Facebook, stress, and incidence of upper respiratory infection in undergraduate college students. Cyberpsychology, Behavior, and Social Networking, 15(12), 675–681. https://doi.org/10.1089/cyber.2012.0156
Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal, 14(3), 464–504. https://doi.org/10.1080/10705510701301834
Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal, 9(2), 233–255. https://doi.org/10.1207/S15328007SEM0902_5
De Choudhury, M., Counts, S., & Horvitz, E. (2013). Predicting postpartum changes in emotion and behavior via social media. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 3267–3276. https://doi.org/10.1145/2470654.2466447
DeVito, M. A., Birnholtz, J., Hancock, J. T., French, M., & Liu, S. (2018). How people form folk theories of social media feeds and what it means for how we study self-presentation. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, 1–12. https://doi.org/10.1145/3173574.3173694
Di, M., Jia, N., Wang, Q., Yan, W., Yang, K., & Kong, F. (2021). A bifactor model of the Wong and Law Emotional Intelligence Scale and its association with subjective well-being. The Journal of Positive Psychology, 16(4), 561–572. https://doi.org/10.1080/17439760.2020.1791947
Ding, Q., Zhang, Y.-X., Wei, H., Huang, F., & Zhou, Z.-K. (2017). Passive social network site use and subjective well-being among Chinese university students: A moderated mediation model of envy and gender. Personality and Individual Differences, 113, 142–146. https://doi.org/10.1016/j.paid.2017.03.027
Duan, W., & Mu, W. (2018). Validation of a Chinese version of the stress overload scale-short and its use as a screening tool for mental health status. Quality of Life Research, 27(2), 411–421. https://doi.org/10.1007/s11136-017-1721-3
Duan, W., Mu, W., & Xiong, H. (2020). Cross-cultural adaptation and validation of the physical disability resiliency scale in a sample of Chinese with physical disability. Frontiers in Psychology, 11, 3544. https://doi.org/10.3389/fpsyg.2020.602736
Dunn, T. J., Baguley, T., & Brunsden, V. (2014). From alpha to omega: A practical solution to the pervasive problem of internal consistency estimation. British Journal of Psychology, 105(3), 399–412. https://doi.org/10.1111/bjop.12046
Fadda, D., Quevedo-Aguado, M. P., Benavente Cuesta, M. H., & Scalas, L. F. (2020). The Multidimensional and Hierarchical Nature of the Questionnaire for Eudaimonic Wellbeing: A Bifactor-ESEM Representation in a Spanish Sample. Frontiers in Psychology, 11. https://www.frontiersin.org/article/10.3389/fpsyg.2020.00422
Gignac, G. E. (2016). The higher-order model imposes a proportionality constraint: That is why the bifactor model tends to fit better. Intelligence, 55, 57–68. https://doi.org/10.1016/j.intell.2016.01.006
Hall, J. A., Pennington, N., & Lueders, A. (2014). Impression management and formation on Facebook: A lens model approach. New Media & Society, 16(6), 958–982. https://doi.org/10.1177/1461444813495166
Hall, J. A., Steele, R. G., Christofferson, J. L., & Mihailova, T. (2021). Development and initial evaluation of a multidimensional digital stress scale. Psychological Assessment. https://doi.org/10.1037/pas0000979
Heffer, T., Good, M., Daly, O., MacDonell, E., & Willoughby, T. (2019). The longitudinal association between social-media use and depressive symptoms among adolescents and young adults: An empirical reply to Twenge et al. (2018). Clinical Psychological Science, 7(3), 462–470. https://doi.org/10.1177/2167702618812727
Herring, S. C., & Kapidzic, S. (2015). Teens, gender, and self-presentation in social media. In International Encyclopedia of the Social & Behavioral Sciences (pp. 146–152). Elsevier. https://doi.org/10.1016/B978-0-08-097086-8.64108-9
Hwang, A., Francesco, A. M., & Kessler, E. (2003). The relationship between individualism-collectivism, face, and feedback and learning processes in Hong Kong, Singapore, and the United States. Journal of Cross-Cultural Psychology, 34(1), 72–91. https://doi.org/10.1177/0022022102239156
Ivie, E. J., Pettitt, A., Moses, L. J., & Allen, N. B. (2020). A meta-analysis of the association between adolescent social media use and depressive symptoms. Journal of Affective Disorders, 275, 165–174. https://doi.org/10.1016/j.jad.2020.06.014
Jetten, J., Postmes, T., & McAuliffe, B. J. (2002). “We’re all individuals”: Group norms of individualism and collectivism, levels of identification and identity threat. European Journal of Social Psychology, 32(2), 189–207. https://doi.org/10.1002/ejsp.65
Kim, J. Y. (2018). A study of social media users’ perceptional typologies and relationships to self-identity and personality. Internet Research, 28(3), 767–784. https://doi.org/10.1108/IntR-05-2017-0194
Kim, K. H., & Yun, H. (2007). Cying for me, cying for us: Relational dialectics in a Korean social network site. Journal of Computer-Mediated Communication, 13(1), 298–318. https://doi.org/10.1111/j.1083-6101.2007.00397.x
Kim, Y., Wang, Y., & Oh, J. (2016). Digital media use and social engagement: How social media and smartphone use influence social activities of college students. Cyberpsychology, Behavior, and Social Networking, 19(4), 264–269. https://doi.org/10.1089/cyber.2015.0408
Kuha, J. (2004). AIC and BIC: Comparisons of assumptions and performance. Sociological Methods & Research, 33(2), 188–229. https://doi.org/10.1177/0049124103262065
LaRose, R., Connolly, R., Lee, H., Li, K., & Hales, K. D. (2014). Connection overload? A cross cultural study of the consequences of social media connection. Information Systems Management, 31(1), 59–73. https://doi.org/10.1080/10580530.2014.854097
Liu, D., Baumeister, R. F., Yang, C., & Hu, B. (2019). Digital communication media use and psychological well-being: A meta-analysis. Journal of Computer-Mediated Communication, 24(5), 259–273. https://doi.org/10.1093/jcmc/zmz013
Lo, J. (2019). Exploring the buffer effect of receiving social support on lonely and emotionally unstable social networking users. Computers in Human Behavior, 90, 103–116. https://doi.org/10.1016/j.chb.2018.08.052
Lovibond, S. H., & Lovibond, P. F. (1996). Manual for the depression anxiety stress scales. Psychology Foundation of Australia.
Maïano, C., Morin, A. J. S., Aimé, A., Lepage, G., & Bouchard, S. (2021). Psychometric properties of the Body Checking Questionnaire (BCQ) and of the Body Checking Cognitions Scale (BCCS): A bifactor-exploratory structural equation modeling approach. Assessment, 28(2), 632–646. https://doi.org/10.1177/1073191119858411
Marsh, H. W., Morin, A. J. S., Parker, P. D., & Kaur, G. (2014). Exploratory Structural Equation Modeling: An integration of the best features of exploratory and confirmatory factor analysis. Annual Review of Clinical Psychology, 10(1), 85–110. https://doi.org/10.1146/annurev-clinpsy-032813-153700
Millsap, R. E. (2012). Statistical approaches to measurement invariance. Routledge.
Morin, A. J. S., Arens, A. K., & Marsh, H. W. (2016). A bifactor exploratory structural equation modeling framework for the identification of distinct sources of construct-relevant psychometric multidimensionality. Structural Equation Modeling: A Multidisciplinary Journal, 23(1), 116–139. https://doi.org/10.1080/10705511.2014.961800
Muthén, B., & Muthén, L. (2017). Mplus. Chapman and Hall/CRC.
Neff, K. D., Tóth-Király, I., Yarnell, L. M., Arimitsu, K., Castilho, P., Ghorbani, N., Guo, H. X., Hirsch, J. K., Hupfeld, J., Hutz, C. S., Kotsou, I., Lee, W. K., Montero-Marin, J., Sirois, F. M., de Souza, L. K., Svendsen, J. L., Wilkinson, R. B., & Mantzios, M. (2019). Examining the factor structure of the self-compassion scale in 20 diverse samples: Support for use of a total score and six subscale scores. Psychological Assessment, 31(1), 27–45. https://doi.org/10.1037/pas0000629
Nunnally, J. C. (1978). Psychometric Theory 2nd ed. Mcgraw hill book company. http://125.18.99.74:8080/jspui/handle/123456789/11061
Oberst, U., Wegmann, E., Stodt, B., Brand, M., & Chamarro, A. (2017). Negative consequences from heavy social networking in adolescents: The mediating role of fear of missing out. Journal of Adolescence, 55, 51–60. https://doi.org/10.1016/j.adolescence.2016.12.008
Rae, J. R., & Lonborg, S. D. (2015). Do motivations for using Facebook moderate the association between Facebook use and psychological well-being? Frontiers in Psychology, 6, 771. https://doi.org/10.3389/fpsyg.2015.00771
Reinecke, L., Aufenanger, S., Beutel, M. E., Dreier, M., Quiring, O., Stark, B., Wölfling, K., & Müller, K. W. (2017). Digital stress over the life span: The effects of communication load and internet multitasking on perceived stress and psychological health impairments in a German probability sample. Media Psychology, 20(1), 90–115. https://doi.org/10.1080/15213269.2015.1121832
Reinecke, L., Klimmt, C., Meier, A., Reich, S., Hefner, D., Knop-Huelss, K., Rieger, D., & Vorderer, P. (2018). Permanently online and permanently connected: Development and validation of the Online Vigilance Scale. PLoS ONE, 13(10), e0205384. https://doi.org/10.1371/journal.pone.0205384
Reise, S. P. (2012). The rediscovery of bifactor measurement models. Multivariate Behavioral Research, 47(5), 667–696. https://doi.org/10.1080/00273171.2012.715555
Reise, S. P., Moore, T. M., & Haviland, M. G. (2010). Bifactor models and rotations: Exploring the extent to which multidimensional data yield univocal scale scores. Journal of Personality Assessment, 92(6), 544–559. https://doi.org/10.1080/00223891.2010.496477
Reise, S. P., Bonifay, W. E., & Haviland, M. G. (2013). Scoring and modeling psychological measures in the presence of multidimensionality. Journal of Personality Assessment, 95(2), 129–140. https://doi.org/10.1080/00223891.2012.725437
Steele, R. G., Hall, J. A., & Christofferson, J. L. (2020). Conceptualizing digital stress in adolescents and young adults: Toward the development of an empirically based model. Clinical Child and Family Psychology Review, 23(1), 15–26. https://doi.org/10.1007/s10567-019-00300-5
Thomée, S., Dellve, L., Härenstam, A., & Hagberg, M. (2010). Perceived connections between information and communication technology use and mental symptoms among young adults—A qualitative study. BMC Public Health, 10(1), 66. https://doi.org/10.1186/1471-2458-10-66
Thorisdottir, I. E., Sigurvinsdottir, R., Asgeirsdottir, B. B., Allegrante, J. P., & Sigfusdottir, I. D. (2019). Active and passive social media use and symptoms of anxiety and depressed mood among icelandic adolescents. Cyberpsychology, Behavior, and Social Networking, 22(8), 535–542. https://doi.org/10.1089/cyber.2019.0079
Tóth-Király, I., & Neff, K. D. (2021). Is self-compassion universal? Support for the measurement invariance of the self-compassion scale across populations. Assessment, 28(1), 169–185. https://doi.org/10.1177/1073191120926232
Turcotte, J., York, C., Irving, J., Scholl, R. M., & Pingree, R. J. (2015). News recommendations from social media opinion leaders: Effects on media trust and information seeking. Journal of Computer-Mediated Communication, 20(5), 520–535. https://doi.org/10.1111/jcc4.12127
Vandenberg, R. J., & Lance, C. E. (2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3(1), 4–70. https://doi.org/10.1177/109442810031002
Vannucci, A., Simpson, E. G., Gagnon, S., & Ohannessian, C. M. (2020). Social media use and risky behaviors in adolescents: A meta-analysis. Journal of Adolescence, 79, 258–274. https://doi.org/10.1016/j.adolescence.2020.01.014
Verduyn, P., Lee, D. S., Park, J., Shablack, H., Orvell, A., Bayer, J., Ybarra, O., Jonides, J., & Kross, E. (2015). Passive Facebook usage undermines affective well-being: Experimental and longitudinal evidence. Journal of Experimental Psychology: General, 144(2), 480.
Wang, K., Shi, H.-S., Geng, F.-L., Zou, L.-Q., Tan, S.-P., Wang, Y., Neumann, D. L., Shum, D. H. K., & Chan, R. C. K. (2016). Cross-cultural validation of the Depression Anxiety Stress Scale–21 in China. Psychological Assessment, 28(5), e88–e100. https://doi.org/10.1037/pas0000207
Wang, Z., Guo, M., & Ming, J. (2020). Effect of hometown housing investment on the homeownership of rural migrants in urban destinations: Evidence from China. Cities, 102619. https://doi.org/10.1016/j.cities.2020.102619
Wang, T., Zhang, T., Mu, W., & Li, X. (2021). Psychometric evaluation of the encouragement character strength scale in a Chinese sample. Current Psychology, 40(10), 4741–4749. https://doi.org/10.1007/s12144-020-01161-w
Whittaker, T. A. (2012). Using the modification index and standardized expected parameter change for model modification. The Journal of Experimental Education, 80(1), 26–44. https://doi.org/10.1080/00220973.2010.531299
Funding
This research was funded by the Educational Science Planning Project of Hubei Province (Project Number: 2020GB008).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Ethical Approval
All of the procedures performed in the studies which involved human participation were in accordance with the ethical standards of the institutional and/or national research committee and the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Informed Consent
The written informed consent was obtained from all of the participants.
Conflicts of Interest
The authors declare that they have no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
About this article
Cite this article
Xie, P., Mu, W., Li, Y. et al. The Chinese version of the Digital Stress Scale: Evaluation of psychometric properties. Curr Psychol 42, 20532–20542 (2023). https://doi.org/10.1007/s12144-022-03156-1
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12144-022-03156-1