Skip to main content
Log in

Construct validity of brief difficulties in emotion regulation scale and its revised version: evidence for a general factor

  • Published:
Current Psychology Aims and scope Submit manuscript

Abstract

The Difficulties in Emotion Regulation Scale (DERS) was developed to assess the multidimensional structure of emotion dysregulation. This study investigated the validity of a brief version for the DERS (DERS-18) and its revised version (DERS-15). We proposed a bifactor model for representing the unidimensional construct underlying the multi-facets of emotion dysregulation and examined the fit of the bifactor structure for DERS-18 and DERS-15 by estimating and comparing a series of measurement models suggested by previous studies, using a non-clinical sample of 907 Chinese college students. The bifactor model fits the data best compared to other competing models for DERS-18. Findings indicated that the majority variance of the clustered manifestations of emotion regulation deficits could be explained by one general emotion dysregulation factor, supporting the use of the total score of the DERS-18. The specific factors Awareness, Clarity, Goals, and Non-acceptance in DERS-18 demonstrated their specificity after controlling the effect of the general factor. The DERS-18 demonstrated good composite reliability, test-retest reliability, discriminant validity, and good criterion validity when connected with regulatory emotional self-efficacy and wellbeing indicators. The DERS-15 showed equally good model fit and reliability, and a small diminution in discriminant and criterion validity. Implications of the findings are discussed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Bardeen, J. R., & Fergus, T. A. (2014). An examination of the incremental contribution of emotion regulation difficulties to health anxiety beyond specific emotion regulation strategies. Journal of Anxiety Disorders, 28(4), 394–401. https://doi.org/10.1016/J.JANXDIS.2014.03.002.

    Article  PubMed  Google Scholar 

  • Bardeen, J. R., Fergus, T. A., Hannan, S. M., & Orcutt, H. K. (2016). Addressing psychometric limitations of the difficulties in emotion regulation scale through item modification. Journal of Personality Assessment, 98(3), 298–309. https://doi.org/10.1080/00223891.2015.1091774.

    Article  PubMed  Google Scholar 

  • Bardeen, J. R., Fergus, T. A., & Orcutt, H. K. (2012). An examination of the latent structure of the difficulties in emotion regulation scale. Journal of Psychopathology and Behavioral Assessment, 34(3), 382–392. https://doi.org/10.1007/S10862-012-9280-Y.

    Article  Google Scholar 

  • Beauchaine, T. P. (2015). Future directions in emotion dysregulation and youth psychopathology. Journal of Clinical Child and Adolescent Psychology, 44(5), 875–896. https://doi.org/10.1080/15374416.2015.1038827.

    Article  PubMed  Google Scholar 

  • Bjureberg, J., Ljótsson, B., Tull, M. T., Hedman, E., Sahlin, H., Lundh, L. G., Bjärehed, J., DiLillo, D., Messman-Moore, T., Gumpert, C. H., & Gratz, K. L. (2016). Development and validation of a brief version of the difficulties in emotion regulation scale: The DERS-16. Journal of Psychopathology and Behavioral Assessment, 38(2), 284–296. https://doi.org/10.1007/S10862-015-9514-X.

    Article  PubMed  Google Scholar 

  • Caprara, G. V., Giunta, L. D., Eisenberg, N., Gerbino, M., Pastorelli, C., & Tramontano, C. (2008). Assessing regulatory emotional self-efficacy in three countries. Psychological Assessment, 20(3), 227–237. https://doi.org/10.1037/1040-3590.20.3.227.

    Article  PubMed  PubMed Central  Google Scholar 

  • Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling, 14(3), 464–504. https://doi.org/10.1080/10705510701301834.

    Article  Google Scholar 

  • Clark, L. A., & Watson, D. (1995). Constructing validity: Basic issues in objective scale development. Psychological Assessment, 7(3), 309–319. https://doi.org/10.1037/1040-3590.7.3.309

  • Cole, P. M., Hall, S. E., & Hajal, N. J. (2013). Emotion dysregulation as a risk factor for psychopathology. In T. P. Beauchaine & S. P. Hinshaw (Eds.), Child and adolescent psychopathology (2nd ed., pp. 341–343). Wiley.

  • Dan-Glauser, E. S., & Scherer, K. R. (2013). The difficulties in emotion regulation scale (DERS) factor structure and consistency of a French translation. Swiss Journal of Psychology, 72(1), 5–11. https://doi.org/10.1024/1421-0185/A000093.

    Article  Google Scholar 

  • DeCarlo, L. T. (1997). On the meaning and use of kurtosis. Psychological Methods, 2(3), 292–307. https://doi.org/10.1037/1082-989X.2.3.292.

    Article  Google Scholar 

  • Fabrigar, L. R., Wegener, D. T., MacCallum, R. C., & Strahan, E. J. (1999). Evaluating the use of exploratory factor analysis in psychological research. Psychological Methods, 4(3), 272–299. https://doi.org/10.1037/1082-989X.4.3.272.

    Article  Google Scholar 

  • Fowler, J. C., Charak, R., Elhai, J. D., Allen, J. G., Frueh, B. C., & Oldham, J. M. (2014). Construct validity and factor structure of the difficulties in emotion regulation scale among adults with severe mental illness. Journal of Psychiatric Research, 58, 175–180. https://doi.org/10.1016/J.JPSYCHIRES.2014.07.029.

    Article  PubMed  Google Scholar 

  • Gómez-Simón, I., Penelo, E., & Osa, N. d. l. (2014). Factor structure and measurement invariance of the difficulties emotion regulation scale (DERS) in Spanish adolescents. Psicothema, 26(3), 401–408. https://doi.org/10.7334/PSICOTHEMA2013.324.

    Article  PubMed  Google Scholar 

  • Gong, X., Xie, X., Xu, R., & Luo, Y. (2010). 抑郁-焦虑-压力量表简体中文版(DASS-21)在中国大学生中的测试报告 (psychometric properties of the Chinese versions of DASS-21 in Chinese college students). Chinese Journal of Clinical Psychology, 18(4), 443–446.

    Google Scholar 

  • Gratz, K. L., & Roemer, L. (2004). Multidimensional assessment of emotion regulation and dysregulation: Development, factor structure, and initial validation of the difficulties in emotion regulation scale. Journal of Psychopathology and Behavioral Assessment, 30(4), 315–354. https://doi.org/10.1023/B:JOBA.0000007455.08539.94.

    Article  Google Scholar 

  • Gustafsson, J.-E., & Åberg-Bengtsson, L. (2009). Unidimensionality and interpretability of psychological instruments. In S. E. Embretson (Ed.), Measuring psychological constructs (pp. 97–121). American Psychological Association. https://doi.org/10.1037/12074-005.

  • Hallion, L. S., Steinman, S. A., Tolin, D. F., & Diefenbach, G. J. (2018). Psychometric properties of the difficulties in emotion regulation scale (DERS) and its short forms in adults with emotional disorders. Frontiers in Psychology, 9, 539–539. https://doi.org/10.3389/FPSYG.2018.00539.

    Article  PubMed  PubMed Central  Google Scholar 

  • Hu, L.-t., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1–55. https://doi.org/10.1080/10705519909540118.

    Article  Google Scholar 

  • Innamorati, M., Quinto, R. M., Imperatori, C., Lora, V., Graceffa, D., Fabbricatore, M., Lester, D., Contardi, A., & Bonifati, C. (2016). Health-related quality of life and its association with alexithymia and difficulties in emotion regulation in patients with psoriasis. Comprehensive Psychiatry, 70, 200–208. https://doi.org/10.1016/J.COMPPSYCH.2016.08.001.

    Article  PubMed  Google Scholar 

  • Lee, D. J., Witte, T. K., Bardeen, J. R., Davis, M. T., & Weathers, F. W. (2016). A factor analytic evaluation of the difficulties in emotion regulation scale. Journal of Clinical Psychology, 72(9), 933–946. https://doi.org/10.1002/JCLP.22297.

    Article  PubMed  Google Scholar 

  • Lovibond, S. H., & Lovibond, P. F. (1995). Manual for the depression anxiety stress scales (2nd. ed.) Psychology Foundation.

  • McLaughlin, L. E., Luberto, C. M., O ' Bryan, E. M., Kraemer, K. M., & McLeish, A. C. (2019). The indirect effect of positive affect in the relationship between trait mindfulness and emotion dysregulation. Personality and Individual Differences, 145, 70–74. https://doi.org/10.1016/J.PAID.2019.03.020.

    Article  PubMed  PubMed Central  Google Scholar 

  • Mekawi, Y., Watson-Singleton, N. N., Dixon, H. D., Fani, N., Michopoulos, V., & Powers, A. (2021). Validation of the difficulties with emotion regulation scale in a sample of trauma-exposed black women. Journal of Clinical Psychology, 77(3), 587–606. https://doi.org/10.1002/JCLP.23036.

    Article  PubMed  Google Scholar 

  • Miao, Y. (2003). 心理学视野中的幸福 (Happiness in Psychology Field ) [doctoral dissertation, Tianjin People ' s publishing house.

  • Moreira, H., Gouveia, M. J., & Canavarro, M. C. (2020). A bifactor analysis of the difficulties in emotion regulation scale - short form (DERS-SF) in a sample of adolescents and adults. Current Psychology, 1–26. https://doi.org/10.1007/S12144-019-00602-5.

  • Muthén, L. K., & Muthén, B. O. (1998-2007). Mplus User’s Guide. Eighth Edition.

  • Neumann, A., van Lier, P. A. C., Gratz, K. L., & Koot, H. M. (2010). Multidimensional assessment of emotion regulation difficulties in adolescents using the difficulties in emotion regulation scale. Assessment, 17(1), 138–149. https://doi.org/10.1177/1073191109349579.

    Article  PubMed  Google Scholar 

  • Nordgren, L., Monell, E., Birgegård, A., Bjureberg, J., & Hesser, H. (2020). Factor structure of the difficulties in emotion regulation scale in treatment seeking adults with eating disorders. Journal of Psychopathology and Behavioral Assessment, 42(1), 111–126. https://doi.org/10.1007/S10862-019-09765-8.

    Article  Google Scholar 

  • Osborne, T. L., Michonski, J., Sayrs, J., Welch, S. S., & Anderson, L. K. (2017). Factor structure of the difficulties in emotion regulation scale (DERS) in adult outpatients receiving dialectical behavior therapy (DBT). Journal of Psychopathology and Behavioral Assessment, 39(2), 355–371. https://doi.org/10.1007/S10862-017-9586-X.

    Article  Google Scholar 

  • Reise, S. P., Bonifay, W. E., & Haviland, M. G. (2013a). Scoring and modeling psychological measures in the presence of multidimensionality. Journal of Personality Assessment, 95(2), 129–140. https://doi.org/10.1080/00223891.2012.725437.

    Article  PubMed  Google Scholar 

  • Reise, S. P., Scheines, R., Widaman, K. F., & Haviland, M. G. (2013b). Multidimensionality and structural coefficient Bias in structural equation modeling: A Bifactor perspective. Educational and Psychological Measurement, 73(1), 5–26. https://doi.org/10.1177/0013164412449831.

    Article  Google Scholar 

  • Rodriguez, A., Reise, S. P., & Haviland, M. G. (2016). Applying Bifactor statistical indices in the evaluation of psychological measures. Journal of Personality Assessment, 98(3), 223–237. https://doi.org/10.1080/00223891.2015.1089249.

    Article  PubMed  Google Scholar 

  • Rosellini, A. J., Fairholme, C. P., & Brown, T. A. (2011). The temporal course of anxiety sensitivity in outpatients with anxiety and mood disorders: Relationships with behavioral inhibition and depression. Journal of Anxiety Disorders, 25(4), 615–621. https://doi.org/10.1016/J.JANXDIS.2011.02.001.

    Article  PubMed  PubMed Central  Google Scholar 

  • Sarıtaş-Atalar, D., Gençöz, T., & Özen, A. (2015). Confirmatory factor analyses of the difficulties in emotion regulation scale (DERS) in a Turkish adolescent sample. European Journal of Psychological Assessment, 31(1), 12–19. https://doi.org/10.1027/1015-5759/A000199.

    Article  Google Scholar 

  • Skutch, J. M., Wang, S. B., Buqo, T., Haynos, A. F., & Papa, A. (2019). Which brief is best? Clarifying the use of three brief versions of the difficulties in emotion regulation scale. Journal of Psychopathology and Behavioral Assessment, 41(3), 485–494. https://doi.org/10.1007/S10862-019-09736-Z.

    Article  PubMed  PubMed Central  Google Scholar 

  • Victor, S. E., & Klonsky, E. D. (2016). Validation of a brief version of the difficulties in emotion regulation scale (DERS-18) in five samples. Journal of Psychopathology and Behavioral Assessment, 38(4), 582–589. https://doi.org/10.1007/S10862-016-9547-9.

    Article  Google Scholar 

  • Wang, L., Liu, H., Du, W., & Li, Z. (2007). 情绪调节困难量表在中国人群中的初步测试 (test of difficulties in emotion regulation in Chinese people). China Journal of Health Psychology, 15(4), 336–340.

    Google Scholar 

  • Wang, Y., Dou, K., & Liu, Y. (2013). 情绪调节自我效能感量表的修订 (revision of the scale of regulatory emotional self-efficacy). Journal of Guangzhou University (Social Science Edition), 12(01), 45–50.

    Google Scholar 

  • Ware, J. E. (1993). SF-36 health survey: Manual and interpretation guide. The Health Institute, .

  • Weinberg, A., & Klonsky, E. D. (2009). Measurement of emotion dysregulation in adolescents. Psychological Assessment, 21(4), 616–621. https://doi.org/10.1037/A0016669.

    Article  PubMed  Google Scholar 

  • Zhao, L., Yang, Z., Hu, X., He, Y., Liu, D., & Li, N. (2018). SF-12v2与SF-36v2在成都市居民人群中的等效性评价(equivalence of SF-12v2 and SF-36v2 in assessing health related quality of life in a general population in Chengdu). Journal of Sichuan University, Medical Edition, (1), 87–92.

  • Zinbarg, R. E., Revelle, W., Yovel, I., & Li, W. (2005). Cronbach’s Alpha, Revelle’s Beta, McDonald ' s Omega: Their relations with each other and two alternative conceptualizations of reliability. Psychometrika, 70, 123–133. https://doi.org/10.1007/s12144-019-00602-5

Download references

Funding

This study was funded by the Ministry of Education of the People’s Republic of China (grant number 18YJC190034) and the Education Department of Henan Province (the 13th Five-year Plan of Educational Science, project number 2018-JKGHYB-0022).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Entao Zhang.

Ethics declarations

Conflict of Interest

Yanhua Zhao, Kai Wu, Yuanyuan Wang, Guoxiang Zhao, and Entao Zhang declare that they have no conflict of interest.

Availability of Data and Material

All data were available based on reasonable request.

Code Availability

All Mplus codes were available based on reasonable request.

Human Participants

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.

Informed Consent

Informed consent was obtained from all individual participants included in the study.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

ESM 1

(DOCX 16   kb)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhao, Y., Wu, K., Wang, Y. et al. Construct validity of brief difficulties in emotion regulation scale and its revised version: evidence for a general factor. Curr Psychol 41, 1085–1096 (2022). https://doi.org/10.1007/s12144-021-02056-0

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12144-021-02056-0

Keywords

Navigation