Advertisement

Development and Validation of a Brief Version of the Difficulties in Emotion Regulation Scale: The DERS-16

  • Johan BjurebergEmail author
  • Brjánn Ljótsson
  • Matthew T. Tull
  • Erik Hedman
  • Hanna Sahlin
  • Lars-Gunnar Lundh
  • Jonas Bjärehed
  • David DiLillo
  • Terri Messman-Moore
  • Clara Hellner Gumpert
  • Kim L. Gratz
Article

Abstract

The Difficulties in Emotion Regulation Scale (DERS) is a widely-used, theoretically-driven, and psychometrically-sound self-report measure of emotion regulation difficulties. However, at 36-items, the DERS may be challenging to administer in some situations or settings (e.g., in the course of patient care or large-scale epidemiological studies). Consequently, there is a need for a briefer version of the DERS. The goal of the present studies was to develop and evaluate a 16-item version of the DERS – the DERS-16. The reliability and validity of the DERS-16 were examined in a clinical sample (N = 96) and two large community samples (Ns = 102 and 482). The validity of the DERS-16 was evaluated comparing the relative strength of the association of the two versions of the DERS with measures of emotion regulation and related constructs, psychopathology, and clinically-relevant behaviors theorized to stem from emotion regulation deficits. Results demonstrate that the DERS-16 has retained excellent internal consistency, good test-retest reliability, and good convergent and discriminant validity. Further, the DERS-16 showed minimal differences in its convergent and discriminant validity with relevant measures when compared to the original DERS. In conclusion, the DERS-16 offers a valid and brief method for the assessment of overall emotion regulation difficulties.

Keywords

Emotion regulation Short version Self-report measure Assessment Experiential avoidance 

Notes

Acknowledgments

This research was supported by National Institute of Child Health and Human Development Grant R01 HD062226, awarded to the eighth author (DD). Additional funding was provided by the Stockholm County Council (ALF project; grant number: 20140428) and the Fredrik och Ingrid Thurings stiftelse.

Conflict of Interest

All authors declare that they have no conflicts of interest.

Experiment Participants

All study procedures were approved by the appropriate institutional review committee and meet the guidelines of the responsible government agency. Written informed consent was obtained for all participants prior to participation.

References

  1. Baer, R. A., Smith, G. T., Hopkins, J., Krietemeyer, J., & Toney, L. (2006). Using self-report assessment methods to explore facets of mindfulness. Assessment, 13, 27–45.PubMedCrossRefGoogle Scholar
  2. Baer, R. A., Smith, G. T., Lykins, E., Button, D., Krietemeyer, J., Sauer, S., Walsh, E., Duggan, D., & Williams, J. M. G. (2008). Construct validity of the five facet mindfulness questionnaire in meditating and nonmeditating samples. Assessment, 15, 329–342.PubMedCrossRefGoogle Scholar
  3. Bagby, R. M., Taylor, G. J., & Parker, J. A. (1994). The twenty-item Toronto alexithymia scale: II. Convergent, discriminant, and concurrent validity. Journal of Psychosomatic Research, 38, 33–40.PubMedCrossRefGoogle Scholar
  4. Bardeen, J. R., Fergus, T. A., & Orcutt, H. K. (2012). An examination of the latent structure of the difficulties in emotion regulation scale. Journal of Psychopathology and Behavioral Assessment, 34, 382–392.CrossRefGoogle Scholar
  5. Ben-Porath, D. D., Federici, A., Wisniewski, L., & Warren, M. (2014). Dialectical behavior therapy: does it bring about improvements in affect regulation in individuals with eating disorders? Journal of Contemporary Psychotherapy, 44, 245–251.CrossRefGoogle Scholar
  6. Berna, G., Ott, L., & Nandrino, J. L. (2014). Effects of emotion regulation difficulties on the tonic and phasic cardiac autonomic response. PloS One, 9, e102971.PubMedPubMedCentralCrossRefGoogle Scholar
  7. Bohus, M., Limberger, M. F., Frank, U., Sender, I., Gratwohl, T., & Stieglitz, R. (2001). Development of the borderline symptom list (BSL). Psychotherapie Psychosomatik Medizinische Psychologie, 51, 201–221.CrossRefGoogle Scholar
  8. Cicchetti, D., Ackerman, B. P., & Izard, C. E. (1995). Emotions and emotion regulation in developmental psychopathology. Development and Psychopathology, 7, 1–10.CrossRefGoogle Scholar
  9. Dixon-Gordon, K. L., Tull, M. T., & Gratz, K. L. (2014). Self-injurious behaviors in posttraumatic stress disorder: an examination of potential moderators. Journal of Affective Disorders, 166, 359–367.PubMedPubMedCentralCrossRefGoogle Scholar
  10. Ehring, T., Fischer, S., Schnülle, J., Bösterling, A., & Tuschen-Caffier, B. (2008). Characteristics of emotion regulation in recovered depressed versus never depressed individuals. Personality and Individual Differences, 44, 1574–1584.CrossRefGoogle Scholar
  11. Ehring, T., Tuschen-Caffier, B., Schnülle, J., Fischer, S., & Gross, J. J. (2010). Emotion regulation and vulnerability to depression: spontaneous versus instructed use of emotion suppression and reappraisal. Emotion, 10, 563–572.PubMedCrossRefGoogle Scholar
  12. First, M. B., Gibbon, M., Spitzer, R. L., Williams, J. B. W, & Benjamin, L. S. (1997). Structured clinical interview for DSM-IV. Washington: American Psychiatric Press.Google Scholar
  13. Fliege, H., Kocalevent, R. D., Walter, O. B., Beck, S., Gratz, K. L., Gutierrez, P. M., & Klapp, B. F. (2006). Three assessment tools for deliberate self-harm and suicide behavior: evaluation and psychopathological correlates. Journal of Psychosomatic Research, 61, 113–121.PubMedCrossRefGoogle Scholar
  14. Fowler, J. C., Charak, R., Elhai, J. D., Allen, J. G., Frueh, B. C., & Oldham, J. M. (2014). Construct validity and factor structure of the difficulties in emotion regulation scale among adults with severe mental illness. Journal of Psychiatric Research, 58, 175–180.PubMedCrossRefGoogle Scholar
  15. Fox, H. C., Axelrod, S. R., Paliwal, P., Sleeper, J., & Sinha, R. (2007). Difficulties in emotion regulation and impulse control during cocaine abstinence. Drug and Alcohol Dependence, 89, 298–301.PubMedCrossRefGoogle Scholar
  16. Goodman, M., Carpenter, D., Tang, C. Y., Goldstein, K. E., Avedon, J., Fernandez, N.,... & Hazlett, E. A. (2014). Dialectical behavior therapy alters emotion regulation and amygdala activity in patients with borderline personality disorder. Journal of Psychiatric Research, 57, 108–116.Google Scholar
  17. Gratz, K. L. (2001). Measurement of deliberate self-harm: preliminary data on the deliberate self-harm inventory. Journal of Psychopathology and Behavioral Assessment, 23, 253–263.CrossRefGoogle Scholar
  18. Gratz, K. L. (2007). Targeting emotion dysregulation in the treatment of self-injury. Journal of Clinical Psychology, 63, 1091–1103.PubMedCrossRefGoogle Scholar
  19. Gratz, K. L., & Roemer, L. (2004). Multidimensional assessment of emotion regulation and dysregulation: development, factor structure, and initial validation of the difficulties in emotion regulation scale. Journal of Psychopathology and Behavioral Assessment, 26, 41–54.CrossRefGoogle Scholar
  20. Gratz, K. L., & Roemer, L. (2008). The relationship between emotion dysregulation and deliberate self-harm among female undergraduate students at an urban commuter university. Cognitive Behaviour Therapy, 37, 14–25.PubMedCrossRefGoogle Scholar
  21. Gratz, K. L., & Tull, M. T. (2010). Emotion regulation as a mechanism of change in acceptance- and mindfulness-based treatments. In R. A. Baer (Ed.), Assessing mindfulness and acceptance: Illuminating the processes of change (pp. 107–134). Oakland, CA: New Harbinger Publications.Google Scholar
  22. Gratz, K. L., & Tull, M. T. (2011). Extending research on the utility of an adjunctive emotion regulation group therapy for deliberate self-harm among women with borderline personality pathology. Personality Disorders: Theory, Research, and Treatment, 2, 316–326.CrossRefGoogle Scholar
  23. Gratz, K. L., & Tull, M. T. (2012). Exploring the relationship between posttraumatic stress disorder and deliberate self-harm: The moderating roles of borderline and avoidant personality disorders. Psychiatry Research, 199, 19–23.PubMedPubMedCentralCrossRefGoogle Scholar
  24. Gratz, K. L., Rosenthal, M. Z., Tull, M. T., Lejuez, C. W., & Gunderson, J. G. (2006). An experimental investigation of emotion dysregulation in borderline personality disorder. Journal of Abnormal Psychology, 115, 850–855.PubMedCrossRefGoogle Scholar
  25. Gratz, K. L., Hepworth, C., Tull, M. T., Paulson, A., Clarke, S., Remington, B., & Lejuez, C. W. (2011). An experimental investigation of emotional willingness and physical pain tolerance in deliberate self-harm: the moderating role of interpersonal distress. Comprehensive Psychiatry, 52, 63–74.PubMedCrossRefGoogle Scholar
  26. Gratz, K. L., Tull, M. T., & Levy, R. (2014). Randomized controlled trial and uncontrolled 9-month follow-up of an adjunctive emotion regulation group therapy for deliberate self-harm among women with borderline personality disorder. Psychological Medicine, 44, 2099–2112.PubMedCrossRefGoogle Scholar
  27. Gratz, K. L., Bardeen, J. R., Levy, R., Dixon-Gordon, K. L., & Tull, M. T. (2015). Mechanisms of change in an emotion regulation group therapy for deliberate self-harm among women with borderline personality disorder. Behaviour Research and Therapy, 65, 29–35.PubMedPubMedCentralCrossRefGoogle Scholar
  28. Gross, J. J., & Jazaieri, H. (2014). Emotion, emotion regulation, and psychopathology: an affective science perspective. Clinical Psychological Science, 2, 387–401.CrossRefGoogle Scholar
  29. Gross, J. J., & John, O. P. (1995). Facets of emotional expressivity: three self-report factors and their correlates. Personality and Individual Differences, 19, 555–568.CrossRefGoogle Scholar
  30. Gross, J. J., & John, O. P. (1997). Revealing feelings: facets of emotional expressivity in self-reports, peer ratings, and behavior. Journal of Personality and Social Psychology, 72, 435–448.PubMedCrossRefGoogle Scholar
  31. Gross, J. J., & John, O. P. (2003). Individual differences in two emotion regulation processes: implications for affect, relationships, and well-being. Journal of Personality and Social Psychology, 85, 348–362.PubMedCrossRefGoogle Scholar
  32. Hamilton, N. A., Karoly, P., Gallagher, M., Stevens, N., Karlson, C., & McCurdy, D. (2007). The assessment of emotion regulation in cognitive context: the emotion amplification and reduction scales. Cognitive Therapy and Research, 33, 255–263.CrossRefGoogle Scholar
  33. Hayes, S.C., Strosahl, K., Wilson, K.G., Bissett, R.T., Pistorello, J., Toarmino, D.,... McCurry, S.M. (2004). Measuring experiential avoidance: a preliminary test of a working model. The Psychological Record, 54, 553–578.Google Scholar
  34. Henry, J. D., & Crawford, J. R. (2005). The short-form version of the depression anxiety stress scales (DASS-21): construct validity and normative data in a large non-clinical sample. British Journal of Clinical Psychology, 44, 227–239.PubMedCrossRefGoogle Scholar
  35. Hinkin, T. R. (1998). A brief tutorial on the development of measures for use in survey questionnaires. Organizational Research Methods, 1, 104–121.CrossRefGoogle Scholar
  36. Hofmann, S. G., & Kashdan, T. B. (2010). The affective style questionnaire: development and psychometric properties. Journal of Psychopathology and Behavioral Assessment, 32, 255–263.PubMedPubMedCentralCrossRefGoogle Scholar
  37. Izard, C. E., & Ackerman, B. P. (2000). Motivational, organizational, and regulatory functions of discrete emotions. In M. Lewis, & J. M. Haviland-Jones (Eds.), Handbook of emotions (2nd ed., pp. 253–264). New York: Guilford Press.Google Scholar
  38. Kring, A. M., & Werner, K. H. (2004). Emotion regulation in psychopathology. In P. Philippot, & R. S. Feldman (Eds.), The regulation of emotion (pp. 359–385). Mahwah, NJ: Lawrence Erlbaum Associates.Google Scholar
  39. Kuo, J. R., Khoury, J. E., Metcalfe, R., Fitzpatrick, S., & Goodwill, A. (2015). An examination of the relationship between childhood emotional abuse and borderline personality disorder features: the role of difficulties with emotion regulation. Child Abuse and Neglect, 39, 147–155.PubMedCrossRefGoogle Scholar
  40. Larsen, R. J., & Diener, E. (1987). Affect intensity as an individual difference characteristic: a review. Journal of Research in Personality, 21, 1–39.CrossRefGoogle Scholar
  41. Lavender, J. M., Wonderlich, S. A., Peterson, C. B., Crosby, R. D., Engel, S. G., Mitchell, J. E., &... Berg, K. C. (2014). Dimensions of emotion dysregulation in bulimia nervosa. European Eating Disorders Review, 22, 212–216.Google Scholar
  42. Li, C. R., Huang, C., Yan, P., Bhagwagar, Z., Milivojevic, V., & Sinha, R. (2008). Neural correlates of impulse control during stop signal inhibition in cocaine-dependent men. Neuropsychopharmacology, 33, 1798–1806.PubMedPubMedCentralCrossRefGoogle Scholar
  43. Look, A. E., Flory, J. D., Harvey, P. D., & Siever, L. J. (2010). Psychometric properties of a short form of the affective lability scale (ALS-18). Personality and Individual Differences, 49, 187–191.PubMedPubMedCentralCrossRefGoogle Scholar
  44. Messman-Moore, T. L., Walsh, K. L., & DiLillo, D. (2010). Emotion dysregulation and risky sexual behavior in revictimization. Child Abuse and Neglect, 34, 967–976.PubMedCrossRefGoogle Scholar
  45. Muris, P., Merckelbach, H., & Horselenberg, R. (1996). Individual differences in thought suppression. The white bear suppression inventory: factor structure, reliability, validity, and correlates. Behaviour Research and Therapy, 34, 501–513.PubMedCrossRefGoogle Scholar
  46. Neumann, A., van Lier, P. A. C., Gratz, K. L., & Koot, H. M. (2010). Multidimensional assessment of emotion regulation difficulties in adolescents using the difficulties in emotion regulation scale. Assessment, 17, 138–149.PubMedCrossRefGoogle Scholar
  47. Oliver, M. N., & Simmons, J. S. (2004). The affective lability scales: development of a short-form measure. Personality and Individual Differences, 37, 1279–1288.CrossRefGoogle Scholar
  48. Pfohl, B., Blum, N., St. John, D., McCormick, B., Allen, J., & Black, D. W. (2009). Reliability and validity of the borderline evaluation of severity over time (BEST): a self-rated scale to measure severity and change in persons with borderline personality disorder. Journal of Personality Disorders, 23, 281–293.PubMedPubMedCentralCrossRefGoogle Scholar
  49. Reinert, D. F., & Allen, J. P. (2007). The alcohol use disorders identification test: an update of research findings. Alcoholism: Clinical and Experimental Research, 31, 185–199.CrossRefGoogle Scholar
  50. Salters-Pedneault, K., Roemer, L., Tull, M. T., Rucker, L., & Mennin, D. S. (2006). Evidence of broad deficits in emotion regulation associated with chronic worry and generalized anxiety disorder. Cognitive Therapy and Research, 30, 469–480.CrossRefGoogle Scholar
  51. Saunders, J. B., Aasland, O. G., Babor, T. F., De La Fuente, J. R., & Grant, M. (1993). Development of the alcohol use disorders identification test (AUDIT): WHO collaborative project on early detection of persons with harmful alcohol consumption-II. Addiction, 88, 791–804.PubMedCrossRefGoogle Scholar
  52. Schmidt, R. E., Gay, P., Courvoisier, D., Jermann, F., Ceschi, G., David, M., Brinkmann, K., & Van der Linden, M. (2009). Anatomy of the white bear suppression inventory (WBSI): a review of previous findings and a new approach. Journal of Personality Assessment, 91, 323–330.PubMedCrossRefGoogle Scholar
  53. Sheehan, D., Janavs, J., Baker, R., Lecrubier, Y., Hergueta, T., & Weiller, E. (2010). MINI international neuropsychiatric interview, Swedish Version 5.0.Google Scholar
  54. Sheppes, G., Suri, G., & Gross, J. J. (2015). Emotion regulation and psychopathology. Annual Review of Clinical Psychology, 11, 379–405.PubMedCrossRefGoogle Scholar
  55. Simons, J. S., & Gaher, R. M. (2005). The distress tolerance scale: development and validation of a self-report measure. Motivation and Emotion, 29, 83–102.CrossRefGoogle Scholar
  56. Smith, G. T., McCarthy, D. M., & Anderson, K. G. (2000). On the sins of short-form development. Psychological Assessment, 1, 102–111.CrossRefGoogle Scholar
  57. Steiger, J. H. (1980). Tests for comparing elements of a correlation matrix. Psychological Bulletin, 87, 245–251.CrossRefGoogle Scholar
  58. Stevens, N. R., Gerhart, J., Goldsmith, R. E., Heath, N. M., Chesney, S. A., & Hobfoll, S. E. (2013). Emotion regulation difficulties, low social support, and interpersonal violence mediate the link between childhood abuse and posttraumatic stress symptoms. Behavior Therapy, 44, 152–161.PubMedCrossRefGoogle Scholar
  59. Tabachnick, B. G., & Fidell, L. S. (2001). Using multivariate statistics. California State University Northridge: HarperCollins College Publishers.Google Scholar
  60. Taylor, C. T., Laposa, J. M., & Alden, L. E. (2004). Is avoidant personality disorder more than just social avoidance? Journal of Personality Disorders, 18, 571–594.PubMedCrossRefGoogle Scholar
  61. Taylor, S., Zvolensky, M.J., Cox, B.J., Deacon, B., Heimberg, R.G., Ledley, D.R.,... Cardenas, S.J. (2007). Robust dimensions of anxiety sensitivity: development and initial validation of the anxiety sensitivity index-3. Psychological Assessment, 19, 176–188.PubMedCrossRefGoogle Scholar
  62. Thompson, R. A. (1994). Emotion regulation: a theme in search of definition. In N. A. Fox (Ed.), The development of emotion regulation: biological and behavioral considerations (pp. 25–52). Chicago: University of Chicago Press.Google Scholar
  63. Tull, M. T. (2006). Extending an anxiety sensitivity model of uncued panic attack frequency and symptom severity: the role of emotion dysregulation. Cognitive Therapy and Research, 30, 177–184.CrossRefGoogle Scholar
  64. Tull, M. T., & Roemer, L. (2007). Emotion regulation difficulties associated with the experience of uncued panic attacks: evidence of experiential avoidance, emotional nonacceptance, and decreased emotional clarity. Behavior Therapy, 38, 378–391.PubMedCrossRefGoogle Scholar
  65. Tull, M. T., Barrett, H. M., McMillan, E. S., & Roemer, L. (2007). A preliminary investigation of the relationship between emotion regulation difficulties and posttraumatic stress symptoms. Behavior Therapy, 38, 303–313.PubMedCrossRefGoogle Scholar
  66. Tull, M. T., Stipelman, B. A., Salters-Pedneault, K., & Gratz, K. L. (2009). An examination of recent non-clinical panic attacks, panic disorder, anxiety sensitivity, and emotion regulation difficulties in the prediction of generalized anxiety disorder in an analogue sample. Journal of Anxiety Disorders, 23, 275–282.PubMedCrossRefGoogle Scholar
  67. Tull, M. T., Gratz, K. L., Latzman, R. D., Kimbrel, N. A., & Lejuez, C. W. (2010). Reinforcement sensitivity theory and emotion regulation difficulties: a multimodal investigation. Personality and Individual Differences, 49, 989–994.CrossRefGoogle Scholar
  68. Tull, M. T., Weiss, N. H., Adams, C. E., & Gratz, K. L. (2012). The contribution of emotion regulation difficulties to risky sexual behavior within a sample of patients in residential substance abuse treatment. Addictive Behaviors, 37, 1084–1092.PubMedPubMedCentralCrossRefGoogle Scholar
  69. Tull, M. T., Bardeen, J. R., DiLillo, D., Messman-Moore, T., & Gratz, K. L. (2015). A prospective investigation of emotion dysregulation as a moderator of the relation between posttraumatic stress symptoms and substance use severity. Journal of Anxiety Disorders, 29, 52–60.PubMedPubMedCentralCrossRefGoogle Scholar
  70. Turner, B. J., Layden, B. K., Butler, S. M., & Chapman, A. L. (2013). How often, or how many ways: clarifying the relationship between non-suicidal self-injury and suicidality. Archives of Suicide Research, 17, 397–415.PubMedCrossRefGoogle Scholar
  71. Wegner, D. M., & Zanakos, S. (1994). Chronic thought suppression. Journal of Personality, 62, 615–640.CrossRefGoogle Scholar
  72. Weinberg, A., & Klonsky, E. D. (2009). Measurement of emotion dysregulation in adolescents. Psychological Assessment, 21, 616–621.PubMedCrossRefGoogle Scholar
  73. Whiteside, U., Chen, E., Neighbors, C., Hunter, D., Lo, T., & Larimer, M. (2007). Difficulties regulating emotions: do binge eaters have fewer strategies to modulate and tolerate negative affect? Eating Behaviors, 8, 162–169.PubMedCrossRefGoogle Scholar
  74. Zou, G. Y. (2007). Toward using confidence intervals to compare correlations. Psychological Methods, 12, 399–413.PubMedCrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2015

Authors and Affiliations

  • Johan Bjureberg
    • 1
    Email author
  • Brjánn Ljótsson
    • 1
  • Matthew T. Tull
    • 2
  • Erik Hedman
    • 1
  • Hanna Sahlin
    • 1
  • Lars-Gunnar Lundh
    • 3
  • Jonas Bjärehed
    • 3
  • David DiLillo
    • 4
  • Terri Messman-Moore
    • 5
  • Clara Hellner Gumpert
    • 1
  • Kim L. Gratz
    • 2
  1. 1.Department of Clinical NeuroscienceKarolinska InstitutetStockholmSweden
  2. 2.Department of Psychiatry and Human BehaviorUniversity of Mississippi Medical CenterJacksonUSA
  3. 3.Department of PsychologyLund UniversityLundSweden
  4. 4.Department of PsychologyUniversity of Nebraska-LincolnLincolnUSA
  5. 5.Department of PsychologyMiami UniversityOxfordUSA

Personalised recommendations