Abstract
Purpose
Adolescence is a sensitive period for developing mental health problems. Interventions targeting emotion regulation have shown promising transdiagnostic effects for this group, but optimization efforts are called for. In the current study, we used an element-based approach to identify potentially active ingredients in interventions measuring emotion regulation, to guide further optimization.
Methods
We coded practice elements in 30 studies based on a systematic review of mental health interventions measuring emotion regulation in adolescents (N = 2,389 participants, mean age 13–17 years). Using a three-level modeling approach, we then investigated the difference in effect on emotion regulation between studies of interventions with and without these practice elements.
Results
We identified 75 practice elements and 15 element categories used in the included interventions. Results showed significantly stronger effects on emotion regulation when interventions included the practice elements Setting goals for treatment (difference in d = 0.40, 95% CI [0.09, 0.70], p = .012) and Psychoeducation about acceptance (difference in d = 0.58, 95% CI [0.09, 1.07], p = .021). Furthermore, a total of 11 elements and four overall categories were identified as potentially active ingredients, based on an effect size difference of > 0.20 between interventions with and without the elements.
Conclusion
The results can direct experimental research into the selection of practices that are most likely key to mechanisms of change in interventions addressing emotion regulation for adolescents. The challenge of measuring emotion regulation is discussed.
Adolescents’ mental health problems are increasing worldwide, with significant consequences for academic, social, and health development (End the neglect of young people’s mental health, 2021; Patton et al., 2016). To prevent later adverse outcomes, a vast number of evidence-based interventions (EBIs) have emerged (Weisz et al., 2019). However, the population-level impact from such interventions appears to be limited (La Greca et al., 2009), and their overall effect size is moderate and not increasing (Weisz et al., 2017). One reason for the limited effects may be that the EBIs are not accessible to a large part of the population. Meta-analyses show that the effects of adolescent’s mental health interventions often drop when they move from research to practice contexts (Santucci et al., 2015), or that they do not necessarily outperform practice as usual (Kazdin, 2015; Weisz et al., 2013). Also, implementation research across mental health contexts documents significant difficulties with sustainable implementation of EBIs at scale (Shelton et al., 2018). The majority of implementation research thus far has focused on how and where we implement to increase access to EBIs, such as improving implementation strategies (Kirchner et al., 2020) and community readiness for implementation (Chambers et al., 2020). In recent years, what we implement has also gained attention as important implementation determinants (Lewis et al., 2021), including the EBIs design, content, and fit with diverse needs across mental health workforces. Researchers are calling for approaches to improve the implementability of EBIs, to reduce the total implementation demands on practice settings and make EBIs more usable to practitioners (Lyon et al., 2020; Ginsbrug et al., 2020). Thus, increasing the impact of mental health interventions includes optimizing their effectiveness and implementability. Learning more about active ingredients of potentially transdiagnostic interventions can contribute in the following three respects:
Firstly, mental health interventions typically target one type of mental health problem (e.g., conduct problems or anxiety), while comorbidity is the rule rather than the exception (Kessler et al., 2010). The concurrent and shifting lifespan comorbidity indicates a need for interventions targeting transdiagnostic factors or underlying vulnerabilities for developing mental health problems (Caspi et al., 2020). Accumulating evidence suggests emotion regulation processes are salient targets for making transdiagnostic interventions effective. Secondly, having interventions tailored for a specific type of problem requires training and maintenance of skills in many interventions for practitioners, who typically have jobs characterized by high workload and significant time constraints. Effective transdiagnostic interventions reduce the number of interventions needed, thus the total implementation demands. Thirdly, we know little about what drives the effects of EBI’s and which elements (i.e., discrete practices, processes, or principles) contribute most to effective mechanisms. Knowledge about how such elements are associated with effects may help trim EBIs by removing superfluous elements, and/or optimizing effectiveness by replacing content with elements more likely to strengthen effects (Engell et al., 2020). Subsequently, practitioners can learn and retain evidence-informed elements covering a broader range of needs with effective help more implementable.
In the present study, we identified practice elements of interventions targeting mental health problems in adolescents and investigated whether the inclusion of any particular element was associated with positive effects on emotion regulation. These elements are promising candidates as active ingredients in transdiagnostic interventions for adolescent mental health.
Emotion Regulation as a Transdiagnostic Factor
There is accumulating evidence of a common underlying psychopathology factor – also known as the p-factor or p – that explains the comorbidity observed in many people with mental health problems (Caspi & Moffitt, 2018). Developmental theorists have proposed that p may reflect problems with emotion regulation – a key ability associated with most mental health problems – and that biological, temperamental, or environmental factors in turn influence what type of emotion regulation problems develop (Carver & Johnson, 2017). Correspondingly, emotion regulation has received increased attention as a transdiagnostic target in psychological treatment (Sloan et al., 2017; Moltrecht et al., 2020).
Emotion regulation is the process by which people modify the intensity or duration of their emotions (Aldao et al., 2016). The development of emotion regulation strategies during childhood and adolescence is closely related to biological and cognitive maturation. Children initially learn to cope with stressful situations with external strategies, such as parental support, and gradually develop more internal strategies, such as problem-solving or acceptance (Sanchis-Sanchis et al., 2020). These strategies can be both adaptive and maladaptive, and for some, there is an increase in the use of maladaptive strategies during adolescence, for example, rumination (Theurel & Gentaz, 2018). Some studies have indicated a reduction in the use of adaptive strategies between age 13 and 15 (Zimmermann & Iwanski, 2014), suggesting that adolescence is a particularly vulnerable period in the development of emotion regulation. Maladaptive emotion regulation strategies are involved both in internalizing problems (e.g., anxiety and depression; Schäfer et al., 2017) and externalizing problems (e.g., conduct disorder, substance abuse, eating disorders, suicide and risky behaviors; Aldao et al., 2016). For example, anxiety is associated with a lack of understanding of emotions and an increased tendency for maladaptive reactions to emotions, such as withdrawal (Mennin et al., 2005), while eating disorders are associated with low awareness of emotions and lacking problem-solving skills (Van Boven & Espelage, 2006). Thus, emotion regulation is significant for adolescents’ mental health, and the development of interventions aiming at improving emotion regulation may have transdiagnostic and far-reaching effects.
Interventions adopt different approaches to improving emotional regulation. Some focus on reducing maladaptive strategies such as rumination (e.g., Rumination focused CBT; Watkins et al., 2007), while others focus on increasing adaptive strategies such as acceptance (e.g., Acceptance and Commitment Therapy, ACT; Hayes et al., 2009). There has also been a shift from predominantly focusing on controlling emotions to using the information from emotions (Tull & Aldao, 2015) and from mainly downregulating negative emotions to increased attention for upregulation of positive emotions and mindfulness (Roemer et al., 2015). The present study capitalizes on this variation in approaches to identify what strategies (i.e., intervention elements) predict stronger intervention effects. Consequently, we use a multi-faceted understanding of emotion regulation in the current study, including dysregulation (e.g., affect lability) or maladaptive use of strategies (e.g., rumination, worry), emotional awareness (e.g., emotion observation) and use of adaptive strategies, including acceptance or mindfulness concepts (Aldao et al., 2010; Sloan et al., 2017).
Identifying Active Ingredients in Effective Interventions
Concerns with translating EBIs into practice include interventions being excessively complex and resource-intensive for practice contexts (Lyon et al., 2020; Ginsburg et al., 2020). Interventions that are less complex, more implementable, and easier to tailor to individuals may be likely to reach larger portions of the population in need. Currently, however, if program developers, implementers, or practitioners aim to reduce the complexity of an intervention protocol, knowledge is lacking on which elements to keep and which to remove. Similarly, we cannot provide knowledge about which elements, or combinations of elements, to choose when tailoring the intervention to variations in individual needs.
Psychosocial interventions are likely to share core intervention elements (Chorpita et al., 2005). Discrete practice elements, also known as specific factors in the psychotherapy literature (Mulder et al., 2017), are specific activities or actions used to evoke or influence an outcome (e.g., positive reinforcement; Engell et al., 2020). Element-level evidence may facilitate optimization for effectiveness, precision, and implementation of mental health prevention and treatment. For instance, practitioners can be trained in a range of discrete practice elements covering a broad spectrum of domains instead of an ever-increasing number of complex interventions (Okamura et al., 2020). Furthermore, a more complete understanding of how interventions work can help practitioners do more of what is likely effective. Similarly, by removing unnecessary features of complex interventions, we can reduce their implementation demands and thereby increase their implementability.
Common elements methodology is gaining traction as a tool to unpack EBIs and distil the elements that are likely to be ‘active ingredients’ (Okamura et al., 2020). Subsequently, these ingredients can form evidence-informed hypotheses subjected to further experimental testing. Such inquiries can discern the most effective elements and mechanisms across a range of interventions and increase our understanding of how, why, and for whom interventions work. In a scoping review on methods used to identify likely effective intervention elements, Leijten and colleagues (2021) noted expert opinion as the most basic level. On the next level, frequencies of elements are used to determine what elements are commonly used in effective interventions (also known as ‘common elements’) (e.g. Boustani et al., 2020). In the current study, we move beyond the common element strategy by investigating the association between the presence of elements and intervention effects (Leijten et al., 2021). Doing so can provide knowledge of which elements in mental health interventions are associated with the strongest effects on emotion regulation. Such knowledge can be useful for optimizing implementable transdiagnostic interventions, thus improving the opportunity for more adolescents to receive evidence-based help.
Aims
In the present study, the aims were to (1) identify practice elements used in mental health interventions for adolescents measuring emotion regulation, and (2) estimate to what degree the effectiveness of these interventions on emotion regulation is associated with inclusion of the identified practice elements.
Methods
Literature Search and Selection
The literature search was conducted in PsychINFO, Medline, and the Cochrane Library as part of a systematic review of emotion regulation interventions (Espenes et al., 2021) [Manuscript submitted for publication], initially carried out in July 2018 and updated July 2020. Given the central role of emotion regulation both in development of mental health problems (e.g., Claudius et al., 2020) and as an underlying mechanism in change during intervention (e.g., Berking et al., 2019; Helland et al., 2022), we have included both interventions explicitly targeting emotion regulation and interventions targeting mental health, but measuring change in emotion regulation. Keywords included terms related to psychopathology, emotion regulation, and relevant interventions (see Supplementary material S1 for complete search strategy). Identified titles, abstracts, and full texts were reviewed for eligibility by two independent reviewers. Conflicts were resolved by discussion or a third reviewer. Initial search identified 1344 records, and 7 full-text articles were added from review references. After duplicates were removed, 1087 records were excluded based on screening of abstract and 126 excluded based on full-text screening (e.g., lack of emotion regulation outcome measure, review article, wrong population, or wrong design). The original material included 35 articles describing interventions for children and adolescents between 3 and 23 years (M = 15.5 years). From that systematic review, we selected studies of interventions for adolescents with a mean age above 13 years for inclusion in the present study, resulting in 30 articles reporting on the evaluation of 32 interventions.
Eligibility of Studies (PICO)
Eligible populations included children with a mean age of 13 with symptoms of a mental disorder that satisfied DSM-criteria or subclinical levels of symptoms (i.e., identified or indicated mental health problems). Studies of populations with psychosis, intellectual disabilities and autism were excluded. For inclusion, the study needed to have at least one outcome measure of emotion regulation for which the psychometric characteristics of the measure are known. Only studies with a control group (treatment as usual or waitlist control) were included, with both experimental and quasi-experimental designs. Studies investigating the effects of medication treatment only were excluded.
Gathering Study Information
We requested intervention manuals by email from the first authors of the 30 included studies to inform the data extraction, 13 (43%) replied, and six provided a manual that was written in English and could be used. For the remaining interventions, we extracted data from original articles and their supplementary files. In addition, we contacted the first authors to request information about post-intervention measures for studies where data to calculate effect sizes were missing.
Risk of Bias
Using the criteria outlined in the Cochrane Handbook for Systematic Reviews of Interventions (Higgins et al., 2019), three pairs of review authors (BK and JB, AVM and RS, SH and HW) independently assessed the risk of bias in each study meeting the eligibility criteria. Disagreements were resolved by discussion. We rated each study at high, low, or unclear risk of bias across the risk of bias domains. A summary of the overall risk of bias across studies showed that the majority of information came from trials with low or unclear risk of bias (Espenes et al., 2021). An exception was the blinding of participants and personnel where a higher proportion of information (about 20%) was assessed as high risk of bias (Espenes et al., 2021).
Coding Interventions
To distil the discrete practice elements in the included interventions, we developed a coding manual inspired by Engell and colleagues (2020) and Chorpita and Daleiden’s distillation and matching procedure (2009). The manual was developed as a data-driven process until few new elements were discovered. First, all discrete practice elements were listed in SPSS. Second, two clinicians categorized these elements into broader categories (‘element category’) The categorization was done based on the clinicians’ theoretical understanding of the elements. Third, we coded each discrete element and element category in the prepared coding sheet as present or absent, based on information provided in the paper or the intervention manual. Two of the coders had experience from coding elements and effects from similar projects. Coders for this review were trained coding in pair, and coders completed coding of the same sample articles followed by discussions about any discrepancies between their coding.
Although some elements tended to overlap in their content (e.g., Self-exploration of thoughts and feelings and Explore thoughts associated with emotions), we relied on the definitions from our codebook to identify the element that best captured what the treatment delivered. When the information provided about an element was insufficient to specify its content (e.g., the element was named and mentioned as used, but its discrete content or form was not specified in detail), the element was coded as “unspecified.” Each coder (BK and JB, AVM and RS, SH and HW) coded the elements independently before they met up in three pairs to compare. Conflicts were resolved by discussion or a third coder. Coders could add new unanticipated elements that did not fit the prepared coding sheet. The new elements were added if coders agreed they were different from elements in the prepared sheet. Subsequently, one coder (JB) reviewed all studies again to look for the new elements added during the first round of coding. This procedure reduces confirmatory bias and facilitates the discovery of novel elements that may be less popular and less studied, but not necessarily less useful.
Effect Size Calculation
We converted postintervention means and standard deviations into Cohen’s d values. When post means and standard deviations were not reported (11 of the 82 effect sizes), we used available information to calculate the Cohen’s d using an effect size calculator (Wilson, D. A., 2021 May 2) or the authors’ own report of Cohen’s d if available. A variance estimate was calculated based on Cohen’s d and post n in the control and intervention groups. We included multiple effect sizes per trial if trials included multiple measures of our outcomes of interest. In one paper (Shabani et al., 2019), participants were randomized to one of three conditions: two different interventions or to a control group (3-armed Randomized Controlled Trial [RCT]). In this study, effect sizes were estimated for each intervention group compared with the control group. Directions of all outcomes were recoded in the same direction; with a higher score indicating more favorable outcome in the intervention group. We also categorized all outcomes as measuring adaptive or maladaptive emotion regulation strategies. In the main analyses, we used all included measures of emotion regulation.
Analyses
First, we estimated overall intervention effects for all the included studies and investigated the differential effect between studies using adaptive and maladaptive emotion regulation as outcomes. Second, we tested for each element whether inclusion was associated with effects. The meta-regression coefficients of this model include differences in effect size between trials that compare an intervention with the target element against a control, and trials that compare an intervention without the target element against a control. The three-level model described in Assink & Wibbelink (2016) based on the function rma.mv in the R package metafor was used (Viechtbauer, 2010), as implemented in a shiny app (https://github.com/ToreWentzel-Larsen/threelevel). The three-level procedure included analyses between studies, between effects within studies, and between participants for the separate outcome measures.
As the aim of the study was to generate hypotheses of active ingredients in treatment, we identified elements according to at least one of two different levels of criteria (the second criterion is less conservative in order to explore elements with potential for beneficial effects):
-
Significant difference between studies with and without the element on a 0.05 level.
-
Significant effect in studies with the elements and a difference in effect size greater than 0.20 between studies with and without the element.
Results
Descriptive Results
The original literature searches by Espenes et al., (2021) [Manuscript submitted for publication] identified 40 interventions from 35 separate studies that matched the selection criteria. For the current paper, only studies with adolescent samples were included, and studies of children with mean age below 13 were removed (see flow chart in online supplements Fig. 1 S). The included studies (N = 30) used 27 different measures of emotion regulation and provided 82 unique effect sizes as most of the studies used multiple measures (See Supplementary Table 4 for overview of all outcome measures). There was an equal number of measures of general emotion regulation and of specific emotion regulation strategies. The effect sizes included 24 measures of adaptive emotion regulation (e.g., reappraisal, acceptance, and emotional competence) and 58 measures of maladaptive emotion regulation (e.g., rumination, avoidance and suppression). See Table 1 for descriptive information about sample and intervention characteristics.
Table 2 shows all the practice elements that were identified in the included studies. We identified 75 practice elements that were categorized into 15 overall categories. The most frequently included categories of elements were Psychoeducation (found in 24 out of 30 studies [n = 24]), Training in cognitive skills (n = 17), Training in emotional recognition and differentiation (n = 16), Training in preventing maladaptive behavioral response to emotional stress (n = 12), and Mindfulness (n = 12). Caregiver/parenting involvement was not frequent in the included studies. In two of the studies, family members joined the adolescent in skills groups. One study focused on parental support and parenting skills in the intervention.
Meta-analyses
Meta-analyses showed an overall effect for all included studies on emotion regulation of Cohen’s d = 0.29 (95% CI 0.14-0.43, p < .001).
Sample and intervention characteristics
There was no significant difference in effect (differential d = − 0.03, 95% CI [-0.19,0.12], p = .663) between the studies using measures of adaptive emotion regulation (d = 0.26, 95% CI [0.08,0.44], p = .006) and studies using measures of maladaptive emotion regulation as outcomes (d = 0.30, 95% CI [0.14,0.45], p < .001). In our results, there was no significant or meaningful difference in effect size between studies with and without an indicated sample (symptoms without diagnosis) (differential d = − 0.17, 95% CI [0.14, − 0.46], p = .112) or with or without an identified sample (met diagnostic criteria) (differential d = 0.19, 95% CI [0.14, − 0.10], p = .473). There was no significant or meaningful difference in effect size between studies including group interaction and studies not including this element (differential d = 0.07, CI -95% CI [0.14-0.27], p = .520) or between interventions including psychoeducation or not (differential d = 0.10, 95% CI [-0.24, 0.43], p = .566).
Practice elements
Table 2 provides estimates of effect size for each group (i.e., with and without element) and differences in effect sizes between groups. Moderation analyses revealed significant differences between studies with the elements compared to studies without for: Setting goals for treatment (difference in d = 0.40, 95% CI [0.09, 0.70], p = .012) and Psychoeducation about acceptance (difference in d = 0.58, 95% CI [0.09, 1.07], p = .021). Setting goals for treatment involves setting goals for the overall contact with the adolescent, setting goals from session to session and help the youth to state realistic goals. Psychoeducation about accept involves discussion of what it is to accept thoughts and feelings and how accept may be an alternative strategy to control or avoidance. We also found that studies with the element Social skills training, unspecified had significantly lower effect than studies without this element (difference in d = − 0.43, 95% CI [-0.83, − 0.03], p = .034). When using our second criterion for identifying active ingredients, as described in the methods (a differential intervention effect of at least d = 0.20, even if no significant difference), we identified four overall categories of practice elements: Training in preventing maladaptive behavioral response to emotional distress, Mindfulness, Organization skills, and Psychoeducation and 11 discrete practice elements in addition to the elements identified using the significance criteria above: Discussion of challenging emotional situations, Alternative actions to emotional avoidance, Downregulation of negative emotions, Exposure to emotions, Self-exploration/self-monitoring of thoughts and feelings, unspecified, Teach cognitive flexibility reappraisal, Psychoeducation about treatment/treatment element/technique, Psychoeducation about self-esteem and self-worth, Psychoeducation about stress, Evaluating consequence of behaviors, and Lifestyle, unspecified (see Table 2 for effect sizes and supplementary Table S2 for description of the content of the elements).
Discussion
This study aimed to identify elements in mental health interventions for adolescents associated with effects on emotion regulation - a transdiagnostic factor in adolescent mental health problems (Moltrecht et al., 2020). We found that interventions that included elements pertaining to setting goals for treatment and providing psychoeducation about acceptance had significantly higher effects on emotion regulation compared to interventions not including these elements. The effect on emotion regulation was significantly lower for interventions that included unspecified social skills training. In addition, we identified four overall categories of practice elements including 11 discrete practice elements as candidates for further exploration.
In the current study we found that interventions that included setting goals for treatment were significantly more effective than interventions without this element. This element was found in diverse types of interventions such as CBT, ACT, rumination-focused interventions, and mindfulness-focused interventions. Setting goals for treatment could include setting goals for the session as a part of reviewing the previous session and assigning homework between sessions (Shabani et al., 2019). In other interventions the focus was on teaching adolescents to set realistic goals for themselves (Ettelson, 2003) or use goal setting as a motivational exercise to explore expectations and discuss the pros and cons of changing (McIndoo, 2016). By actively involving adolescents in setting goals about their health, the health care professional shows respect for their needs and opinions (Viksveen et al., 2021), which, in turn, can lead to an enhanced sense of control and empower the adolescent. A consequence of this may be better clinical outcomes and higher satisfaction with care (Langer & Jensen-Doss, 2018). In addition, adolescents often want to be involved in decisions affecting their mental healthcare (Dogra, 2005; Gros et al., 2017). However, involvement can take many forms ranging from just being heard about their opinion to being involved in setting goals for treatment and further in the decision-making process about treatment (Viksveen et al., 2021). Although user involvement is generally seen as beneficial, research on outcomes of individual user involvement is scarce (Viksveen et al., 2021).
Our results showed that psychoeducation about acceptance was associated with effects on emotion regulation. Previous research has found unspecified psychoeducation to be effective for mental health literacy and cognitive skills in mental health interventions, but not for emotion regulation (de Pablo et al., 2020). The estimate of effect in our study depended on the type of psychoeducation and outcome measure applied, which may explain why our results differ from those of de Pablo et al., (2020). Our results add to the literature by finding that psychoeducation about acceptance, a specific type of psychoeducation, may be particularly potent for improving emotion regulation. The aim of using acceptance as an emotion regulation strategy is not to change the experienced emotions, but to receive them with openness and without attempting to control them (Hayes, 2004; Kohl et al., 2012). Thus, acceptance is quite distinct from other emotion regulation strategies that most often entail active modification of the emotional states in terms of quality, strength, length, or frequency of emotion (Gross, 2015).
There are several reasons why acceptance may be an adaptive strategy. Experimental studies show that acceptance is not associated with less physiological arousal related to the elicited reaction (Eifert & Heffner, 2003; Feldner et al., 2003; Karekla et al., 2004), but associated with lower levels of subjective distress. This may be because acceptance strategies are associated with higher tolerance of aversive emotional states, and therefore individuals who use acceptance strategies may be less likely to avoid these experiences (Wolgast et al., 2011). Consequently, acceptance may reduce anxiety that is maintained by avoidant behavior.
Our finding is consistent with a meta-analysis showing that strategies using acceptance are on average effective (d = 0.30) on emotional outcomes in an experimental setting (Webb et al., 2012). For individuals presenting with mild emotional symptoms, psychoeducation about the highly acceptance-focused therapy program ACT has been found effective for reducing symptoms (Cartwright & Hooper, 2017) – which corroborates our findings.
Our results also showed that when the element social skills training was included in treatment, there was a negative effect on emotion regulation (locus of control and ruminative thinking) compared to when the element was not included. However, there were only two studies that included this element, and one of them had noteworthy limitations and risks of bias (Schuppert, 2009). This result is, however, in line with other studies failing to find effective reduction of mental health symptoms from interventions focusing on social skills training (Kavale et al., 1997; Kjøbli & Ogden, 2014). Nevertheless, this result should be interpreted with caution.
Strengths and Limitations
To our knowledge, this is the first three-level meta-analysis that identifies practice elements associated with change in emotion regulation in interventions for adolescents. A strength of the current study is the focus on the magnitude of the differential effect size between interventions with (versus without) the target elements, rather than only with significance tests of differential effect sizes, as we want to ensure that any elements identified as potentially active ingredients have value for real-world practice. Furthermore, we included a wide range of therapies, settings, and outcomes, which increases the likelihood of the usability of the elements in diverse settings (Leijten et al., 2021).
A main limitation of the current study is that our results are highly dependent on which intervention elements are common in the literature, which has been coined popularity bias (Engell et al., 2020). Consequently, interventions and their associated elements that have not been frequent subject of controlled studies will not appear in our results. Also, elements that are infrequently used will be largely influenced by the effect in the few studies included. Therefore, there is a higher probability that the effect of an element will be overestimated or underestimated when it is included in few studies. To limit this bias, we excluded effect sizes estimated for elements that only appeared in one study. However, elements included in few studies should be interpreted with caution.
Another limitation is that the identification of an association between the inclusion of elements and study outcomes does not allow for causal inference. We do not know if the elements we identified drive the effects, or if other factors (e.g., treatment fidelity confounding with intervention elements) may explain the increased effect in these studies. A related limitation is that the coding of intervention and sample characteristics was not exhaustive (e.g., treatment versus prevention and ethnic origins of samples were not coded), so we were unable to include these as potential moderators of the effect. Most of the practice elements identified in more effective studies were, however, found across different types of interventions, delivered by diverse professionals, and targeting different groups of youth, reducing the number of potential confounding factors.
Criteria for inclusion in the literature search were studies of interventions that addressed psychological symptoms and included an outcome measure of emotion regulation. Consequently, studies of interventions that aim to improve emotion regulation specifically but only have other outcomes measures than emotion regulation, such as mental health symptoms, are not included in the present study. Related to this, the current study is limited by the large variation in measurement instruments for emotion regulation used in this field, indicating an uncertainty of what construct is being measured. In a recent systematic review, 87 different measures of emotion regulation were identified as being used in the literature (Mazefsky et al., 2021). In our study, there were 27 measures of emotion regulation, reflecting the current lack of unity in the conceptualization of this construct. Future studies of how intervention elements affect change in emotion regulation may in turn advance our scientific understanding of what emotion regulation is. Such inquiries need clear theoretical conceptions of the assumed associations between intervention elements and specific areas of emotion regulation outcomes.
Recommendations for Future Research
A next step for research can be to experimentally test and optimize psychoeducation about acceptance and goal setting in isolation and in conjunction with other prominent discrete practice elements with transdiagnostic potentials (e.g., exposure to emotions and mindfulness). We encourage a mix of population-based methods to learn about population-based effects (e.g., randomized factorial trials), ideographic methods to learn about personalized tailoring (e.g., time-series designs and phenomenological studies), and dynamic systems methods (e.g., realist evaluation) to learn about how different configurations of practice elements, contexts, and mechanisms influence outcomes. We also encourage collecting real-time process data on emotion regulation from adolescents and intervention fidelity from practitioners (e.g., using ecological momentary assessment and feedback from devices and wearables [Bettis et al., 2022]). Such data will help facilitate more precise inferences about elements and mechanisms.
Conclusion
Adolescence is a sensitive period for developing mental health problems and combined with the increase in mental health problems following the covid-19 pandemic, the need for improving interventions for young people is urgent. The results in this review can direct experimental research into the selection of practices that are most likely key to be mechanisms of change in interventions addressing emotion regulation. Subsequently, such inquiries can ultimately provide practitioners with a toolbox of effective, precise, and usable practices for improving mental health in adolescents.
Protocol
This meta-analysis is based on a systematic review by Espenes et al., (2021) [Manuscript submitted for publication]. The review protocol for the original systematic review was prospectively registered in October 2018 with the International Prospective Register of Systematic Reviews (http://www.crd.york.ac.uk/prospero; identifier CRD42018103480).
Data Availability
Data are available at: https://github.com/ToreWentzel-Larsen/threelevel/blob/main/Ung13_emoreg_share.csv.
References
*References are included in the meta-analysis (see Supplementary material for all studies included in the meta-analysis)
Aldao, A., Nolen-Hoeksema, S., & Schweizer, S. (2010). Emotion-regulation strategies across psychopathology: A meta-analytic review. Clinical psychology review, 30(2), 217–237. https://doi.org/10.1016/j.cpr.2009.11.004
Aldao, A., Gee, D. G., De Los Reyes, A., & Seager, I. (2016). Emotion regulation as a transdiagnostic factor in the development of internalizing and externalizing psychopathology: Current and future directions. Development and psychopathology, 28(4pt1), 927–946. https://doi.org/10.1017/S0954579416000638
Assink, M., & Wibbelink, C. J. (2016). Fitting three-level meta-analytic models in R: A step-by-step tutorial. The Quantitative Methods for Psychology, 12(3), 154–174. https://doi.org/10.20982/tqmp.12.3.p154
Berking, M., Eichler, E., Luhmann, M., Diedrich, A., Hiller, W., & Rief, W. (2019). Affect regulation training reduces symptom severity in depression–A randomized controlled trial.PloS one, 14(8), e0220436
Bettis, A. H., Burke, T. A., Nesi, J., & Liu, R. T. (2022). Digital technologies for emotion-regulation assessment and intervention: A conceptual review. Clinical Psychological Science, 10(1), 3–26. https://doi.org/10.1177/21677026211011982
Boustani, M. M., Frazier, S. L., Chu, W., Lesperance, N., Becker, K. D., Helseth, S. A., & Chorpita, B. F. (2020). Common elements of childhood universal mental health programming. Administration and Policy in Mental Health and Mental Health Services Research, 47(3), 475–486. https://doi.org/10.1007/s10488-020-01023-4
Cartwright, J., & Hooper, N. (2017). Evaluating a transdiagnostic acceptance and commitment therapy psychoeducation intervention. The Cognitive Behaviour Therapist, 10(e9), 1–6. https://doi.org/10.1017/S1754470X17000125
Carver, C. S., Johnson, S. L., & Timpano, K. R. (2017). Toward a functional view of the p factor in psychopathology. Clinical Psychological Science, 5(5), 880–888. https://doi.org/10.1177%2F2167702617710037
Caspi, A., & Moffitt, T. E. (2018). All for one and one for all: Mental disorders in one dimension. American Journal of Psychiatry, 175(9), 831–844. https://doi.org/10.1176/appi.ajp.2018.17121383
Chambers, D. A., Pintello, D., & Juliano-Bult, D. (2020). Capacity-building and training opportunities for implementation science in mental health. Psychiatry Research, 283, 112511. https://doi.org/10.1016/j.psychres.2019.112511
Chorpita, B. F., Daleiden, E. L., & Weisz, J. R. (2005). Identifying and selecting the common elements of evidence based interventions: A distillation and matching model. Mental health services research, 7(1), 5–20. https://doi.org/10.1007/s11020-005-1962-6
Chorpita, B. F., & Daleiden, E. L. (2009). Mapping evidence-based treatments for children and adolescents: Application of the distillation and matching model to 615 treatments from 322 randomised trials. Journal of consulting and clinical psychology, 77(3), 566. https://doi.org/10.1037/a0014565
Cludius, B., Mennin, D., & Ehring, T. (2020). Emotion regulation as a transdiagnostic process. Emotion, 20(1), 37. https://doi.org/10.1037/emo0000646
de Pablo, G. S., De Micheli, A., Nieman, D. H., Correll, C. U., Kessing, L. V., Pfennig, A., & Politi, P. (2020). Universal and selective interventions to promote good mental health in young people: systematic review and meta-analysis. European Neuropsychopharmacology, 41, 28–39. https://doi.org/10.1016/j.euroneuro.2020.10.007
Dogra, N. (2005). What do children and young people want from mental health services? Current Opinion in Psychiatry, 18(4), 370–373. https://doi.org/10.1097/01.yco.0000172053.17660.61
Eifert, G. H., & Heffner, M. (2003). The effects of acceptance versus control contexts on avoidance of panic-related symptoms. Journal of Behavior Therapy and Experimental Psychiatry, 34(3–4), 293–312. https://doi.org/10.1016/j.jbtep.2003.11.001
End the neglect of young people’s mental health (2021) [Editorial].Nature, 598,235–236
Engell, T., Kirkøen, B., Hammerstrøm, K. T., Kornør, H., Ludvigsen, K. H., & Hagen, K. A. (2020). Common Elements of Practice, Process and Implementation in Out-of-School-Time Academic Interventions for At-risk Children: a Systematic Review. Prevention Science, 1–12. https://doi.org/10.1007/s11121-020-01091-w
Espenes, K., Tørmoen, A. J., Rognstad, K., Nilsen, K. H., Waaler, P. M., Wentzel-Larsen, T., & Kjøbli, J. (2021). Effect of psychosocial interventions on children and youth emotion regulation: A meta-analysis. [Manuscript submitted for publication].
Feldner, M. T., Zvolensky, M. J., Eifert, G. H., & Spira, A. P. (2003). Emotional avoidance: An experimental test of individual differences and response suppression using biological challenge. Behaviour research and therapy, 41(4), 403–411. https://doi.org/10.1016/S0005-7967(02)00020-7
*Ettelson, R. G. (2003). The treatment of adolescent depression. Dissertation Abstracts International: Section B: The Sciences and Engineering, 64(4-B), 1899
Ginsburg, L. R., Hoben, M., Easterbrook, A., Andersen, E., Anderson, R. A., Cranley, L., & Estabrooks, C. A. (2020). Examining fidelity in the INFORM trial: a complex team-based behavioral intervention. Implementation Science, 15(1), 1–11. https://doi.org/10.1186/s13012-020-01039-2
Gros, C. P., Parr, C., Wright, D. K., Montreuil, M., & Frechette, J. (2017). Hospital rules and regulations: the perspectives of youth receiving psychiatric care. Journal of Child and Adolescent Psychiatric Nursing, 30(1), 18–24. https://doi.org/10.1111/jcap.12166
Gross, J. J. (2015). Emotion regulation: Current status and future prospects. Psychological inquiry, 26(1), 1–26. https://doi.org/10.1080/1047840X.2014.940781
La Greca, A. M., Silverman, W. K., & Lochman, J. E. (2009). Moving beyond efficacy and effectiveness in child and adolescent intervention research. Journal of consulting and clinical psychology, 77(3), 373. https://doi.org/10.1037/a0015954
Hayes, S. C., Strosahl, K. D., & Wilson, K. G. (2009). Acceptance and commitment therapy. Washington, DC: American Psychological Association
Helland, S. S., Baardstu, S., Kjøbli, J., Aalberg, M., & Neumer, S. P. (2022). Exploring the Mechanisms in Cognitive Behavioural Therapy for Anxious Children: Does Change in Emotion Regulation Explain Treatment Effect? Prevention Science, 1–12. https://doi.org/10.1007/s11121-022-01341-z
Higgins, J. P., Thomas, J., Chandler, J., Cumpston, M., Li, T., Page, M. J., & Welch, V. A. (Eds.). (2019). Cochrane handbook for systematic reviews of interventions. John Wiley & Sons
Kavale, K. A., Mathur, S. R., Forness, S. R., Rutherford, R. B., & Quinn, M. M. (1997). Effectiveness of social skills training for students with behavior disorders: A meta-analysis. Advances in learning and behavioral disabilities, 11, 1–26
Karekla, M., Forsyth, J. P., & Kelly, M. M. (2004). Emotional avoidance and panicogenic responding to a biological challenge procedure. Behavior Therapy, 35(4), 725–746. https://doi.org/10.1016/S0005-7894(04)80017-0
Kazdin, A. E. (2015). Treatment as usual and routine care in research and clinical practice. Clinical Psychology Review, 42, 168–178. https://doi.org/10.1016/j.cpr.2015.08.006
Kessler, R. C., McLaughlin, K. A., Green, J. G., Gruber, M. J., Sampson, N. A., Zaslavsky, A. M., & Williams, D. R. (2010). Childhood adversities and adult psychopathology in the WHO World Mental Health Surveys. The British journal of psychiatry, 197(5), 378–385. https://doi.org/10.1192/bjp.bp.110.080499
Kirchner, J. E., Smith, J. L., Powell, B. J., Waltz, T. J., & Proctor, E. K. (2020). Getting a clinical innovation into practice: An introduction to implementation strategies. Psychiatry Research, 283, 112467. https://doi.org/10.1016/j.psychres.2019.06.042
Kjøbli, J., & Ogden, T. (2014). A randomized effectiveness trial of individual child social skills training: Six-month follow-up. Child and adolescent psychiatry and mental health, 8(1), 1–11. https://doi.org/10.1186/s13034-014-0031-6
Kohl, A., Rief, W., & Glombiewski, J. A. (2012). How effective are acceptance strategies? A meta-analytic review of experimental results. Journal of behavior therapy and experimental psychiatry, 43(4), 988–1001. https://doi.org/10.1016/j.jbtep.2012.03.004
Langer, D. A., & Jensen-Doss, A. (2018). Shared decision-making in youth mental health care: using the evidence to plan treatments collaboratively. Journal of Clinical Child & Adolescent Psychology, 47(5), 821–831. https://doi.org/10.1080/15374416.2016.1247358
Leijten, P., Weisz, J. R., & Gardner, F. (2021). Research Strategies to Discern Active Psychological Therapy Components: A Scoping Review. Clinical Psychological Science, 9(3), 307–322. https://orcid.org/0000-0002-8828-4049
Lewis, C. C., Mettert, K., & Lyon, A. R. (2021). Determining the influence of intervention characteristics on implementation success requires reliable and valid measures: Results from a systematic review. Implementation Research and Practice, 2, 263348952199419. https://doi.org/10.1177/2633489521994197
Lyon, A. R., Dopp, A. R., Brewer, S. K., Kientz, J. A., & Munson, S. A. (2020). Designing the future of children’s mental health services. Administration and Policy in Mental Health and Mental Health Services Research, 47(5), 735–751. https://doi.org/10.1007/s10488-020-01038-x
Mazefsky, C. A., Conner, C. M., Breitenfeldt, K., Leezenbaum, N., Chen, Q., Bylsma, L. M., & Pilkonis, P. (2021). Evidence Base Update for Questionnaires of Emotion Regulation and Reactivity for Children and Adolescents. Journal of Clinical Child & Adolescent Psychology, 1–25. https://doi.org/10.1080/15374416.2021.1955372
Mennin, D. S., Heimberg, R. G., Turk, C. L., & Fresco, D. M. (2005). Preliminary evidence for an emotion regulation deficit model of generalised anxiety disorder. Behaviour Research and Therapy, 43, 1281–1310. https://doi.org/10.1016/j.brat.2004.08.008
*McIndoo, C. C., File, A. A., Preddy, T., Clark, C. G., & Hopko, D. R. (2016). Mindfulness-based therapy and behavioral activation: A randomized controlled trial with depressed college students. Behaviour research and therapy, 77, 118–128. https://doi.org/10.1016/j.brat.2015.12.012
Moltrecht, B., Deighton, J., Patalay, P., & Edbrooke-Childs, J. (2020). Effectiveness of current psychological interventions to improve emotion regulation in youth: A meta-analysis. European Child & Adolescent Psychiatry, 1–20. https://doi.org/10.1007/s00787-020-01498-4
Mulder, R., Murray, G., & Rucklidge, J. (2017). Common versus specific factors in psychotherapy: opening the black box. The Lancet Psychiatry, 4(12), 953–962. https://doi.org/10.1016/S2215-0366(17)30100-1
Okamura, K. H., Orimoto, T. E., Nakamura, B. J., Chang, B., Chorpita, B. F., & Beidas, R. S. (2020). A history of child and adolescent treatment through a distillation lens: Looking back to move forward. The journal of behavioral health services & research, 47(1), 70–85. https://doi.org/10.1007/s11414-019-09659-3
Patton, G. C., Sawyer, S. M., Santelli, J. S., Ross, D. A., Afifi, R., Allen, N. B., & Viner, R. M. (2016). Our future: a Lancet commission on adolescent health and wellbeing. The Lancet, 387(10036), 2423–2478
Roemer, L., Williston, S. K., & Rollins, L. G. (2015). Mindfulness and emotion regulation. Current Opinion in Psychology, 3, 52–57. https://doi.org/10.1016/j.copsyc.2015.02.006
Sanchis-Sanchis, A., Grau, M. D., Moliner, A. R., & Morales-Murillo, C. P. (2020). Effects of age and gender in emotion regulation of children and adolescents. Frontiers in Psychology, 11, 946. https://doi.org/10.3389/fpsyg.2020.00946
Santucci, L. C., Thomassin, K., Petrovic, L., & Weisz, J. R. (2015). Building evidence-based
interventions for the youth, providers, and contexts of real-world mental‐health care.Child Development Perspectives, 9(2),67–73. https://doi.org/10.1111/cdep.12118
Schäfer, J., Naumann, E., Holmes, E. A., Tuschen-Caffier, B., & Samson, A. C. (2017). Emotion regulation strategies in depressive and anxiety symptoms in youth: A meta-analytic review. Journal of youth and adolescence, 46(2), 261–276. https://doi.org/10.1007/s10964-016-0585-0
*Shabani, M. J., Mohsenabadi, H., Omidi, A., Lee, E. B., Twohig, M. P., Ahmadvand, A., & Zanjani, Z. (2019). An Iranian study of group acceptance and commitment therapy versus group cognitive behavioral therapy for adolescents with obsessive-compulsive disorder on an optimal dose of selective serotonin reuptake inhibitors. Journal of Obsessive-Compulsive and Related Disorders, 22, 100440. https://doi.org/10.1016/j.jocrd.2019.04.003
Shelton, R. C., Cooper, B. R., & Stirman, S. W. (2018). The sustainability of evidence-based interventions and practices in public health and health care. Annual review of public health, 39, 55–76. https://doi.org/10.1146/annurev-publhealth-040617-014731
Sloan, E., Hall, K., Moulding, R., Bryce, S., Mildred, H., & Staiger, P. K. (2017). Emotion regulation as a transdiagnostic treatment construct across anxiety, depression, substance, eating and borderline personality disorders: A systematic review. Clinical psychology review, 57, 141–163. https://doi.org/10.1016/j.cpr.2017.09.002
Theurel, A., & Gentaz, E. (2018). The regulation of emotions in adolescents: Age differences and emotion-specific patterns. PloS one, 13(6), e0195501. https://doi.org/10.1371/journal.pone.0195501
Tull, M. T., & Aldao, A. (2015). Editorial overview: New directions in the science of emotion regulation. Current opinion in psychology, 3, iv-x. https://doi.org/10.1016/j.copsyc.2015.03.009
Van Boven, A. M., & Espelage, D. L. (2006). Depressive symptoms, coping strategies, and disordered eating among college women. Journal of Counseling & Development, 84(3), 341–348. https://doi.org/10.1002/j.1556-6678.2006.tb00413.x
Viechtbauer, W. (2010). Conducting meta-analyses in R with the metafor package. Journal of Statistical Software, 36(3), 1–48. https://doi.org/10.18637/jss.v036.i03
Viksveen, P., Bjønness, S. E., Cardenas, N. E., Game, J. R., Berg, S. H., Salamonsen, A., & Aase, K. (2021). User involvement in adolescents’ mental healthcare: a systematic review. European Child & Adolescent Psychiatry, 1–24. https://doi.org/10.1007/s00787-021-01818-2
Watkins, E., Scott, J., Wingrove, J., Rimes, K., Bathurst, N., Steiner, H., & Malliaris, Y. (2007). Rumination-focused cognitive behaviour therapy for residual depression: A case series. Behaviour research and therapy, 45(9), 2144–2154. https://doi.org/10.1016/j.brat.2006.09.018
Webb, T. L., Miles, E., & Sheeran, P. (2012). Dealing with feeling: a meta-analysis of the effectiveness of strategies derived from the process model of emotion regulation. Psychological Bulletin, 138(4), 775. https://doi.org/10.1037/a0027600
Weisz, J. R., Kuppens, S., Eckshtain, D., Ugueto, A. M., Hawley, K. M., & Jensen-Doss, A. (2013). Performance of evidence-based youth psychotherapies compared with usual clinical care: a multilevel meta-analysis. JAMA psychiatry, 70(7), 750–761. https://doi.org/10.1001/jamapsychiatry.2013.1176
Weisz, J. R., Kuppens, S., Ng, M. Y., Eckshtain, D., Ugueto, A. M., Vaughn-Coaxum, R., & Chu, B. C. (2017). What five decades of research tells us about the effects of youth psychological therapy: a multilevel meta-analysis and implications for science and practice. American Psychologist, 72(2), 79. https://doi.org/10.1037/a0040360
Weisz, J. R., Kuppens, S., Ng, M. Y., Vaughn-Coaxum, R. A., Ugueto, A. M., Eckshtain, D., & Corteselli, K. A. (2019). Are psychotherapies for young people growing stronger? Tracking trends over time for youth anxiety, depression, attention-deficit/hyperactivity disorder, and conduct problems. Perspectives on Psychological Science, 14(2), 216–237. https://doi.org/10.1177%2F1745691618805436
Wilson, D. A. (2021, May 2). “Practical Meta-Analysis Effect Size Calculator». https://www.campbellcollaboration.org/escalc/html/EffectSizeCalculator-Home.php
Wolgast, M., Lundh, L. G., & Viborg, G. (2011). Cognitive reappraisal and acceptance: An experimental comparison of two emotion regulation strategies. Behaviour research and therapy, 49(12), 858–866. https://doi.org/10.1016/j.brat.2011.09.011
Zimmermann, P., & Iwanski, A. (2014). Emotion regulation from early adolescence to emerging adulthood and middle adulthood: Age differences, gender differences, and emotion-specific developmental variations. International journal of behavioral development, 38(2), 182–194. https://doi.org/10.1177%2F0165025413515405
Acknowledgements
We would like to thank Kristin Frisch Moe and Heidi Brautaset for valuable feedback on the coding manual and Josefine Bergseth, Siv Linnerud, Håkon Winje, Thale Kristin Holtan, and Runa Saltnes for their contributions in coding practice elements.
Author information
Authors and Affiliations
Contributions
All authors contributed to the study design. Coding and data collection were performed by SSH, BK and AVM. SSH performed the data analysis and interpretation under the supervision of TWL. SSH, BK, AVM, JK, and TE drafted the paper, and all authors provided critical revisions. All authors approved the final version of the paper for submission.
Corresponding author
Ethics declarations
Conflict of Interest
The authors report there are no competing interests to declare.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Electronic Supplementary Material
Below is the link to the electronic supplementary material.
Rights and permissions
Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Helland, S.S., Mellblom, A.V., Kjøbli, J. et al. Elements in Mental Health Interventions Associated with Effects on Emotion Regulation in Adolescents: A Meta-Analysis. Adm Policy Ment Health 49, 1004–1018 (2022). https://doi.org/10.1007/s10488-022-01213-2
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10488-022-01213-2
Keywords
- Intervention elements
- Emotion regulation
- Adolescents
- Mental health