Promoting Gratitude as a Resource for Sustainable Mental Health: Results of a 3-Armed Randomized Controlled Trial up to 6 Months Follow-up

The aim of the current study was to evaluate the impact of a 6-week gratitude intervention for people with low to moderate well-being and moderate symptomatology of depression and anxiety up to 6 months follow-up. 217 Dutch adults were randomly assigned to one of three conditions: a 6-week gratitude intervention, a 6-week self-kindness intervention as an active control condition and a waitlist control condition. Participants completed online assessments on well-being, depression, anxiety and gratitude at baseline, post-test, 6 weeks and 6 months follow-up. Changes in outcome measures over time were examined using multilevel growth curve modeling in R to account for repeated measures nested within individuals. The gratitude intervention was more effective in improving mental well-being in comparison to the self-kindness intervention (d = .63 at post-intervention and d = .40 at 6 weeks follow-up) and waitlist control (d = .93 at post-intervention and d = .66 at 6 weeks follow-up). The data also demonstrated that the gratitude intervention was superior to waitlist control and practicing self-kindness on various measures of gratitude but not on distress. The results of this study suggest that a 6-week gratitude intervention is an effective, low-intensity intervention for enhancing mental well-being but not distress among people with low to moderate levels of well-being and moderate distress, at least in higher-educated women. The sustained effects on various measures of gratitude up to 6 months follow-up suggest that it is possible to promote a lasting appreciative perspective on life.


3 Introduction
Traditionally, mental health care is primarily associated with reducing distress and psychopathology. However mental health is more than the absence of mental illness and comprises emotional, social and psychological well-being as well (e.g. Keyes 2005;Lamers et al. 2011;Westerhof and Keyes 2010). There is growing evidence that the absence of mental illness does not necessarily imply the presence of mental well-being and that the presence of mental illness does not necessarily exclude mental well-being or flourishing (Keyes 2005;Lamers et al. 2011;Westerhof and Keyes 2010;de Vos et al. 2018;Franken et al. 2018;Schotanus-Dijkstra et al. 2019b). Mental well-being is a relevant outcome in public health as it reduces the risk of the incidence of mental illnesses (Schotanus-Dijkstra et al. 2017;Lamers et al. 2015;Keyes et al. 2010;Grant et al. 2013;Wood and Joseph 2010).
The high prevalence of common mental disorders in the general population (e.g. Whiteford et al. 2013) and the fact that most people experience impaired levels of well-being (Schotanus-Dijkstra et al. 2016) underscore the need for large-scale, low-intensity interventions that promote and sustain mental health (e.g. Isaacowitz et al. 2003;Cloninger 2006;Huppert 2004;Schotanus-Dijkstra et al. 2019a;Fledderus et al. 2012). Gratitude may be one such intervention. Gratitude has been defined as both a positive affect resulting from the perception of receiving a benefit from another person (McCullough et al. 2002) and a trait, which includes the ability to appreciate simple things in life, sense of abundance and experience and express gratitude towards others (Watkins et al. 2003;Wood et al. 2009). A growing number of longitudinal studies have demonstrated the positive relation between gratitude and mental health . For example, it has been found that higher levels of gratitude predicts improvements in well-being and distress over time for various populations such as healthy adults (Disabato et al. 2016), heart patients (Millstein et al. 2016), people with rheumatic disorders (Sirois and Wood 2017) and war veterans (Kashdan et al. 2006).
In a recent meta-analysis of gratitude interventions such as the gratitude letter and gratitude list, Davis et al. (2016) found limited and inconclusive evidence for their efficacy. Reviews and meta-analyses (Davis et al. 2016;Dickens 2017; identified some factors that may explain the so-far limited impact of gratitude interventions and recommended to address these limitations in future trials. First, the majority of studies included predominantly healthy populations with higher levels of well-being and gratitude, limiting the potential for change. Secondly, most studies evaluated single interventions of short duration (one or two weeks). Increasing the dosage and variation of gratitude interventions may contribute to larger effects on mental health (Lyubomirsky and Layous 2013). Thirdly, there is a scarcity of longer follow-up measurements, and thereby a lack of knowledge about the maintenance of effects of gratitude interventions on mental health. And fourth, there is a need for outcome instruments measuring more proximal effects of gratitude interventions such as gratitude as a mood.
In order to address these gaps in gratitude intervention research, a 3-armed trial was conducted. The aim of the present study was to assess the effects of a 6-week gratitude intervention on mental health and on various measures of gratitude up to 6 months followup in an adult sample with low to moderate levels of well-being and moderate levels of distress. We hypothesized that the gratitude intervention would be superior in comparison to active and waitlist control in improving well-being, decreasing depression and anxiety and promoting gratitude.

Design
The current paper describes results from three of the four conditions of a large parallel, randomized controlled trial in the Netherlands about the efficacy of different happiness exercises. 1 Practicing various gratitude exercises during 6 weeks was compared with performing self-kindness acts during 6 weeks (active control group) and waiting for performing a well-being intervention-exercise (waitlist control group). Participants completed online assessments at baseline (T0), post-test (T1), 6 weeks follow-up (T2) and 6 months followup (T3). A power analysis showed that 78 participants per condition were needed to obtain an effect size of at least d = .45 on well-being (Davis et al. 2016;Kerr et al. 2015) assuming a two-tailed test with alpha of .05 and a power of .80 (1β). This study was approved by the Ethics Committee of the University of Twente (BCE17240) and registered in the Dutch Trial Register (NTR6786).

Participants and Procedure
In September 2017, advertisements were placed via different media, recruiting participants via Facebook/LinkedIn (n = 425), a popular psychology magazine (n = 156) and national and regional newspapers (n = 72). The recruitment message was: 'Can your well-being use a boost? Join this study on the effects of happiness exercises from the University of Twente for free'. Participants needed to be at least 18 years old, have a sufficient Internet connection and a valid email address, and they had to master the Dutch language to complete questionnaires and follow the intervention instructions. Interested participants applied online for the study. Participants who completed the online informed consent procedure were automatically redirected to an online screening questionnaire. Eligible participants had no severe depressive or anxiety symptoms, indicated by a score < 34 on the Center for Epidemiological Studies Depression (CES-D) questionnaire (Bouma et al. 1995;Santor et al. 1995;Radloff 1977) and a score < 15 on the Generalized Anxiety Disorder-7 (GAD-7) questionnaire (Donker et al. 2009;Spitzer et al. 2006). For the current study, people who were already flourishing (n = 37), as measured with the Mental Health Continuum-Short Form (Keyes et al. 2008;Lamers et al. 2011), were excluded to create a more homogeneous group. Analyses including the people who were flourishing at baseline showed similar results as presented here. After completing the baseline survey, participants were randomly assigned to each condition using random numbers from randomizer.org. Randomization was stratified by gender, education level (low, intermediate, high) and flourishing (possess at least one of the three aspects of emotional well-being and at least six of the eleven aspects of social and psychological well-being) to ensure equal distribution of these characteristics among the conditions.
The final sample consisted of 217 participants with an allocation ratio of 1:1:1. The mean age of the participants was 48.6 years (SD = 9.6), with a range between 18 and 1 3 67 years. Participants were mainly female (89.9%), higher educated (78.3%), of Dutch nationality (88.5%), married (48.8%), living with others (74.2%) and in paid employment (73.7%). Socio-demographic characteristics did not significantly differ between groups, except for Dutch nationality which was more pronounced in the waitlist condition compared to the other conditions, χ 2 (2) = 6.59, p = .037. Also, a marginal difference was found for living with children showing that fewer participants in the waitlist condition were living with children compared to the other conditions, χ 2 (2) = 5.19, p = .075 (Table 1). Intervention instructions were sent to the participants on each Sunday, during 6 weeks. If necessary, reminders were sent to increase adherence. At the T3 assessment, participants were informed that they could win one of 20 books about gratitude if they completed that last survey.

Conditions
The 6 weeks gratitude intervention consisted of evidence-based gratitude exercises which were mainly writing exercises Emmons and Stern 2013), psycho-education (e.g. There are two types of gratitude; (1) more general appreciation such as for your living standards, talents or possessions, and (2) appreciation for others, such as about how friendly or supporting others have been for you.) and questions that trigger reflection about cultivating gratitude (e.g. What did you feel when practicing the gratitude exercise of this week? What did it mean for your daily activities?). The weekly gratitude exercises and general instructions are displayed in Table 2. On average, we expected that participants would invest around 15 min a day on 5 days per week (75 min per week).
Participants in the active control condition received the same instructions each week for 6 weeks in total. They were instructed to perform five self-kindness activities on one day per week: 'In our daily lives, we all perform acts of kindness for others, but we often 6 Gratitude attitude in life First, try to remember yourself every morning during 5 min about your intention to have a grateful attitude in life. Can you feel grateful for being awake? What will your day look like? How will you remember yourself on your intention today? Second, try to notice and appreciate the normal things in life as much as possible during the day neglect to do nice things for ourselves-small and simple things that require relatively little extra money or effort. Examples include treating yourself on a special coffee or on your favorite pastry, magazine or meal, taking a 5-min break from work or study, give yourself a compliment or go for a walk. Now and then, you can treat yourself on something bigger, such as a massage or spending time on your favorite hobby. Within the next five days, you pick one day as your kindness day. On this day, you are to perform five nice things for yourself, all five in one day. These acts of kindness should be something out of the ordinary that you do for yourself with a little extra effort and may or may not be similar to the acts listed above.' On average, we expected that participants would invest around 10 min per behavioral activity and sometimes one activity of 1 h, all on one day per week (75 min per week on average). Participants in the waitlist control condition were told that they were allocated to the flexible group: 'You can choose the activity that fits best to your needs to improve your happiness and well-being. However, before you can choose this activity, we would like to monitor your normal fluctuations in your level of well-being.' At 6 weeks follow-up, the participants in this group chose their activity for which they received the instructions during the following 6 weeks.

Well-being
The 14-item MHC-SF was used to obtain overall mental well-being which comprises emotional, social and psychological well-being (Keyes et al. 2008;Lamers et al. 2011). Each item was rated on a scale from 0 (never) to 5 (every day). Higher average scores indicate higher levels of mental well-being over the past 4 weeks. In addition, the MHC-SF was used to calculate the number of flourishers. Following Keyes' classification guidelines, participants were considered flourishing when they scored a 4 or 5 on at least one emotional well-being item together with a score of 4 or 5 on at least 6 of the 11 social and psychological well-being items. The reliability of the continuous scale was good in the present study (α = .87).

Depression
Participants completed the 20-item CES-D to assess depressive symptoms during the last week (Bouma et al. 1995;Radloff 1977). Scores ranged from 0 (rarely or none of the time (less than 1 day) to 3 (most or all of the time (5-7 days). Four items were recoded before sum scores were calculated (0-60). Higher scores indicate higher levels of depression. The reliability at screening was good (α = .84).

Anxiety
The GAD-7 consists of 7 items that measure anxiety symptoms during the past 2 weeks (Donker et al. 2009;Spitzer et al. 2006). The scores ranged from 0 (not at all) to 3 (nearly every day), with higher total scores (0-21) indicating more symptoms of generalized anxiety. A Cronbach's α of .66 at screening showed questionable reliability in the present study. However, the reliability was good at post-test (α = .88), 6 weeks follow-up (α = .87) and 6 months follow-up (α = .88).

Generic Dispositional Gratitude
The 6-item Gratitude Questionnaire (GQ-6) was used to assess grateful disposition (Jans-Beken et al. 2015;). The answer scale ranged from strongly disagree (1) to strongly agree (7). After recoding two negatively formulated items, higher total summed scores ranging from 6 to 42 indicate a higher level of dispositional gratitude. In the present study, the reliability of the scale was questionable (α = .66), but adequate to good at post-test (α = .78), 6 weeks follow-up (α = .75) and 6 months follow-up (α = .81).

Dispositional Characteristics of Gratitude
The 16-item Short Gratitude Resentment and Appreciation Test (SGRAT) has been developed to assess three specific, trait-like characteristics of gratitude: sense of abundance, appreciation of simple pleasures and appreciation of the contribution of others to one's own well-being (Watkins et al. 2003;Jans-Beken et al. 2015). Each item was scored on an 7-point scale ranging from 1 (strongly disagree) to 7 (strongly agree).
Mean scores were calculated of which a higher score indicates higher levels of characteristics of gratitude. The Cronbach's alphas were .76 for sense of abundance, .84 for appreciation of simple pleasures and .85 for appreciation of others.

Grateful Mood
Four questions were used to assess grateful mood (McCullough et al. 2004

Manipulation Check
Potential differences between expectations and motivation between the gratitude and active control condition were checked using self-developed items at baseline and after the first week in an online happiness-diary. The items about expectations differed slightly between assessments: (1) How convinced are you about the utility of performing well-being exercises for your sustainable happiness and well-being? (2) You now know which well-being exercise you are going to perform. How convinced are you about the utility of performing this exercise for your sustainable happiness and well-being? Furthermore, motivation was measured with the item: How motivated are you for doing this weekly exercise during 6 weeks? All these items were scored on a continuous scale from 1 to 10, of which 10 is indicating the highest level of expectations or motivation respectively.

Adherence
The online happiness-diary was also used to measure weekly adherence. To keep time investment for completing the online diary brief and equal among conditions, participants who received the gratitude intervention were asked at the end of each week to write down five experiences or aspects of their lives for which they felt grateful in the past week. Participants in the active control condition were asked the day after they performed the kind acts, to select how many times they had treated themselves yesterday (5 times to 0 times) and what they had done for themselves.

Client Satisfaction
At post-test (T1), the participants in the gratitude and active control condition completed the 8-item Client Satisfaction Questionnaire-short form (CSQ-8) to assess the level of client satisfaction (Attkisson and Zwick 1982). Each item has an answer scale from 1 to 4, but the labels differ per item. Five items were recoded as such that a higher sum score (8-32) indicated higher satisfaction with the exercise. The Cronbach's alpha showed excellent reliability in the current study (.93). In addition, participants were asked about how much time they had spent on doing the exercise each week, on average (1 = less than 15 min per week, 5 = more than 2 h per week) and how they evaluated the exercise in general on a continuous scale from 1 to 10, of which 10 is indicating the highest level of satisfaction.

Statistical Analysis
Descriptive statistics of demographic variables and outcome measures at baseline were calculated and compared between conditions using χ 2 -tests and univariate analysis of variance (ANOVA) in SPSS version 25.0, using two-tailed tests and p < .05. Χ 2 -tests and ANOVAs were also used to determine whether the number of drop-outs differed per condition and whether drop-outs (i.e. participants who completed only the baseline assessment) differed from participants who completed at least two assessments. Adherence was defined as reporting at least four grateful things or activities for themselves during at least 4 of the 6 weeks. The difference in adherence between the gratitude and active control condition was examined using χ 2 -tests. Changes in outcome measures over time were examined using multilevel growth curve modeling in R (version 0.99.902, NLME package) to account for repeated measures nested within individuals (Singer and Willett 2003). This method also complies with the intention-to-treat principal because all randomized individuals are included in the analyses. First, we tested the efficacy of the 6-week gratitude intervention compared to active control and waitlist control up to 6 weeks follow-up using an unconditional growth curve model, specifying linear and quadratic changes over time. The unconditional quadratic growth model best fitted the data on all outcomes (> Δχ 2 (10) = 18.19, p = .001). Therefore, the baseline unconditional quadratic growth model was compared with the hypothesis-testing models. Time was centered on the second time point (post-test) and each condition was dummy-coded.
Secondly, we tested the efficacy of the 6-week gratitude intervention up to 6 months follow-up only with the active control condition because the waitlist control had started with their self-chosen well-being activity after 6 weeks follow-up. Again, the unconditional quadratic growth model was compared with the hypothesis-testing models.
Finally, post-hoc Cohen's d effect sizes were calculated for significant and marginally significant findings from multilevel growth curve analyses and based on completers only data. For this, means at post-test and follow-up assessments were adjusted for baseline differences using analysis of covariance, in which the post-test or follow-up mean scores were entered as dependent variable and the corresponding baseline mean score as covariates. Between-group effect sizes were then calculated by subtracting the adjusted mean scores of the gratitude condition from the adjusted mean score of one of the control conditions at each time point, and dividing the mean difference by the pooled standard deviation. The 95% confidence intervals (CI's) of Cohen's d were computed in R.

Manipulation Check
At baseline, participants in the gratitude and active control condition were strongly convinced about the utility of doing a well-being exercise (M = 7.0, SD = 1.52), which decreased somewhat after the first week of practicing their exercise (M = 6.7, SD = 1.65). Participants were also highly motivated to practice in the upcoming weeks (M = 8.0, SD = 1.10), which was still satisfactorily after the first week intervention (M = 7.6, SD = 1.78). More importantly, expectations and motivation did not significantly differ between both conditions at any assessment (p > .652), except for the expectations after one week practice. The participants in the gratitude intervention were significantly more convinced about the utility of this exercise for their well-being compared to active control (M gratitude = 7.16, SD = 1.33; M activecontrol = 6.31, SD = 1.81, F(130) = 9.26, p = .003).

Drop-out and Adherence
A total of 176 participants (81.1%) completed at least two of the four questionnaires. Drop-out was highest at 6 months follow-up (36.9%). The total number of drop-outs, as well as the number of drop-outs at post-test and at 6 weeks follow-up, were significantly lower in the waitlist condition compared to the other two conditions, χ 2 (2) = 12.51, p = .002; χ 2 (2) = 13.97, p = .001; χ 2 (2) = 11.69, p = .003 respectively. Drop-outs were significantly younger, F(215) = 10.44, p = .001 and they scored significantly lower on generic dispositional gratitude, F(215) = 6.31, p = .013 and marginally lower on appreciation of others F(215) = 3.70, p = .056. No other differences on socio-demographics or baseline measures were found between drop-outs and completers.
Almost half of the participants of the intervention and active control condition adhered to the program (47.9%). However, adherence was significantly greater for the 6-week gratitude intervention compared to performing self-kindness, 57.5% vs. 38.4%; χ 2 (1) = 5.38, p = .020. This difference in favor of the gratitude intervention was also visible during most weeks (ps < .007), except for week 3 and 4 where adherence did not significantly differ between groups (ps > .185). Overall adherence was highest in week 1 (78.1%) and week 2 (63%), and lowest in week 4 (41.8%) and week 5 (42.5%).

Changes up to 6-Months Follow-up
To test the overall efficacy of practicing gratitude up to 6-months, we repeated the analyses using a quadratic growth model wherein we compared the gratitude condition solely with the active control condition as the waitlist had started their intervention after 6-weeks follow-up. Practicing gratitude led to significantly greater linear and quadratic changes over time in mental well-being, γ 11 = .13, S.E. = .05, t(278) = 2.34, p = .020; γ 21 = − .08, S.E. = .04, t(278) = − 1.98, p = .048, and to greater quadratic changes and marginal linear changes over time in simple pleasure appreciation, γ 21 = − .12, S.E. = .06, t(275) = − 2.15, p = .033; γ 11 = .14, S.E. = .08, t(275) = 1.75, p = .081. No other significant changes were found, suggesting that practicing gratitude was not more successful than practicing self-kindness in improving generic dispositional gratitude, sense of abundance, appreciation of the contribution of others and grateful mood, and in reducing depressive symptoms and anxiety symptoms over the long-run. Effect sizes at 6-months follow-up were d = .31 for mental well-being (95% CI = − .12-.73) and d = .17 for appreciation of simple pleasure (95% CI = − .26-.60).

Discussion
The aim of the current study was to assess the impact of a 6-weeks gratitude intervention on mental well-being, depression, anxiety and gratitude and to address some important gaps in the current knowledge about the efficacy of gratitude interventions (Davis et al. 2016). Therefore, our objectives were to evaluate the impact of practicing gratitude on mental health for people with low to moderate well-being and moderate distress, to assess the effects of gratitude up to 6 months follow-up and to assess the effects on gratitude as a mood in addition to generic dispositional gratitude and specific dispositional gratitude characteristics.

Effects on Mental Well-Being
The findings demonstrated that practicing gratitude was more effective in improving mental well-being in comparison to both active and waitlist control. The moderate to large effects on mental well-being relative to active and waitlist control at post-intervention were larger than has generally been found in studies on the efficacy of gratitude interventions (Davis et al. 2016). One explanation may be that the participants experienced suboptimal levels of well-being, allowing more room for improvement. Many studies have been evaluating the impact of gratitude interventions in healthy populations, thereby minimalizing the potential benefits due to a ceiling effect (Davis et al. 2016). A second explanation for the stronger effects found in the current study in comparison to earlier studies may be that, to date, most gratitude interventions were of short duration, i.e. one or two weeks focusing on a single activity such as writing a gratitude letter or making a gratitude list. Finding the optimal dosage of interventions is an important challenge in the field of positive psychology (Lyubomirsky and Layous 2013) and the current study indicates that extending gratitude interventions to 6 weeks, including various gratitude activities may enhance their impact. Directly comparing gratitude interventions of 2, 4 and 6 weeks would give more direct evidence of their optimal duration. A third explanation for the larger effects is that the exercises in the gratitude intervention were much more varied than in other studies, making the intervention less vulnerable to hedonic adaption (Sheldon and Lyubomirsky 2012;Lyubomirsky et al. 2005). Participants in the gratitude condition were instructed to practice different exercises at a daily basis, which might have kept the participants more motivated. In fact, adherence was greater in the gratitude intervention compared to active control and the participants who received the gratitude intervention were significantly more satisfied with this intervention compared to those who were instructed to perform five nice things for themselves on one day each week during 6 weeks. However, these findings also indicate that the found effects in comparison to active control might have been due to the frequency of practice and not to the type of intervention. Although the needed time to perform weekly gratitude or self-kindness activities did not differ in the current study, future research should use an active control activity that also controls for the variability of the gratitude intervention to ensure its efficacy also in comparison to another active intervention.
Interestingly, the findings of this study showed that the effects of practicing gratitude on mental well-being were maintained up to 6 months follow-up. This is one of the first studies to assess the longer term impact of gratitude interventions (Davis et al. 2016). This sustainable impact on mental well-being is relevant as lower levels of mental well-being have been found to increase the risk for first and recurrent incidence of psychopathology and diagnosed mental disorders (e.g. Schotanus-Dijkstra et al. 2017;Lamers et al. 2015;Keyes et al. 2010;Wood and Joseph 2010). Given the large numbers of people with suboptimal well-being (Schotanus-Dijkstra et al. 2016) and with distress and common mental disorders in the general population (de Graaf et al. 2012;Whiteford et al. 2013), there is a need for easy-to-administer and low-intensity interventions in the context of public mental health (e.g. Huppert 2004;Schotanus-Dijkstra et al. 2019a;Fledderus et al. 2012;Kobau et al. 2011). The participants in the present study practiced gratitude without any guidance, suggesting the intervention can be administered at low costs.

Effects on Distress
The results also showed that levels of symptomatology of depression and anxiety diminished in the gratitude intervention group, but that these changes were not significantly different in comparison with active or waitlist control. The non-significant findings of gratitude versus waitlist control were unexpected as earlier studies have found that gratitude promotes positive emotions and coping-styles such positive reframing and acceptance which are associated with reduced distress (e.g. Wood et al. 2007;Lambert et al. 2012). One explanation is that the participant in the waitlist condition also improved, resulting in comparable levels of distress in both groups.
Also, reductions in distress were found to be marginally larger for the participants practicing self-kindness in comparison to waitlist on the short-term. This finding may be explained by the fact that the participants in the active control condition were invited to do five nice things for themselves on one day a week for six weeks. These activities may have supported participants in developing a more compassionate stance towards themselves (Nelson et al. 2016), which has been shown to be positively associated with reduced distress in earlier studies (Kirby et al. 2017;MacBeth and Gumley 2012). Another explanation is that performing acts of kindness for oneself will enhance the experience of positive emotions. Amplifying positive emotions has been shown to be an effective pathway in promoting well-being, increasing resilience and diminishing distress (Fredrickson 2001(Fredrickson , 1998Fredrickson et al. 2003). In sum, these findings indicate that practicing self-kindness might also be a low-benefit intervention, but then on targeting depressive and anxiety symptoms in people with reduced levels of well-being and low to moderate levels of distress (Kirby et al. 2017;Shin and Lyubomirsky 2017). However, more research is needed as the effects of self-kindness might differ from self-indulgence of which the latter was intended in the current study.

Effects on Gratitude
To our knowledge this is one of the first studies to directly compare the impact of a gratitude intervention on various measures of gratitude. The outcome instruments included generic dispositional gratitude (GQ, McCullough et al. 2002), three specific dispositional characteristics of grateful persons: sense of abundance, appreciating simple pleasures and relational gratitude (GRAT, Watkins et al. 2003) and gratitude as a mood (McCullough et al. 2004). The findings demonstrated that the gratitude intervention led to greater increases in all of these outcomes compared to waitlist control, of which the effects at posttest and at 6-weeks follow-up were mainly of moderate to large magnitude. The gratitude intervention was also more effective compared to active control on appreciating simple pleasures, relational gratitude and grateful mood. However, only the overall efficacy of appreciating simple pleasures maintained up to 6-months follow-up, although the difference at this latter time-point was also (marginally) in favor of practicing gratitude compared to active control for relational gratitude and grateful mood.
The current findings are in contrast with a recent meta-analysis which demonstrated the absence of effects on gratitude in comparison with measurement-only control (Davis et al. 2016). A possible explanation for this discrepancy is the longer duration of the intervention in the current study in comparison to most interventions included in the meta-analysis. In addition, most studies evaluated the impact of gratitude interventions on (generic) dispositional gratitude (Davis et al. 2016), while the current study is one of the first to also report the effects of gratitude interventions on gratitude as mood. Dispositional gratitude represents a more stable trait that may be harder to change over time. This may explain the limited impact of gratitude interventions on dispositional gratitude (Davis et al. 2016), although the findings of the current study suggest that a variable 6-week gratitude intervention can effectively improve dispositional gratitude as well. In contrast to dispositional gratitude, moods could be more easily influenced by intentions to be grateful (McCullough et al. 2004). For example, in the current gratitude intervention, the participants were invited to start each day, after waking-up, with focusing on their intention to be appreciative of small good things in life and of positive contributions of others. This may have contributed to a lasting appreciative perspective on one's life and a resulting grateful mood. Also, though of shorter duration and less stable than traits, moods certainly last longer than emotional states and thus represent an intermediate level between gratitude as an affective trait and gratitude as an emotion (Rosenberg 1998). The presence of a grateful mood will promote the occurrence of positive emotions and contribute to upward spirals in daily life (McCullough et al. 2004;Catalino and Fredrickson 2011;Watkins et al. 2015). Our findings suggest that grateful mood is a good proximal outcome of gratitude interventions in addition to dispositional gratitude (Davis et al. 2016;).
Next to grateful mood, strongest effects were found for the appreciation of the contribution of others. This finding suggests that the effects on relational gratitude is a core aspect of gratitude, for example through the recognition and appreciation of receiving specific benefits from other persons (e.g. McCullough et al. 2002;Wood et al. 2009;Watkins et al. 2003). Participants practicing gratitude have become more appreciative of the contribution of others to their well-being in comparison to the participants practicing self-kindness. This is relevant because many recent studies have demonstrated the positive impact of experiencing and expressing gratitude on maintaining relationships (e.g. Grant and Gino 2010;Algoe and Zhaoyang 2016;Lambert and Fincham 2011) and improving relationships (e.g. Algoe 2012; Algoe et al. 2010;Bartlett et al. 2012).
Lastly, the effects on appreciation of simple pleasures were sustained up to 6 months follow-up in comparison with active control. A longer term comparison with waitlist control was not possible but might have yielded even more and stronger results as was also found up to 6-week follow-up. These findings are relevant because recent research suggests that gratitude is an adaptive resource promoting and maintaining mental health, also in the presence of negative life-events (e.g. Disabato et al. 2016;Millstein et al. 2016;Sirois and Wood 2017;Kashdan et al. 2006). However, longer term comparison to a more equal active control group and to waitlist control is needed to draw firm conclusion on the sustainability of the gratitude effects of practicing gratitude.

Limitations
Some important limitations apply to the current study. First, the findings in comparison with the active control condition should be interpreted with caution. The instructions for the active control condition were more static and repetitive while the gratitude intervention was more variable. This might have led to a more motivated group of participants and exemplify the frequency of practice rather than the efficacy of the content of the intervention as was also visible in a higher level of expectation, satisfaction and adherence in the gratitude intervention compared to active control, despite a similar amount of time spent per week on each intervention. Future research might want to compare the 6-week gratitude intervention with a variable 6-week intervention with a focus on self-kindness. Adherence-as measured in an online diary-could then also be more content related (e.g. Did you perform the exercise as instructed this week? On how many days did you perform the exercise?). Also, it is important to note that gratitude is other-oriented while self-kindness is self-oriented. A more conceptually equivalent condition to gratitude would be performing kind acts for others as in both these interventions reduction of self-preoccupation could be an important process. For future research performing acts of kindness for others is recommend as active control condition.
Secondly, higher educated women were over-represented in the current study and the findings cannot be generalized to the general population. Thirdly, Cronbach's alpha of anxiety and dispositional gratitude in the current sample were questionable which might have influenced outcomes. However the Cronbach's alphas were more satisfactorily at later time-points. Fourthly, no diagnostic interviews were conducted so it is unknown how many participant met the criteria for a mood or anxiety disorder at baseline.

Conclusion
Despite the limitations, the results of this study suggest that a 6-week gratitude intervention is an effective, low-intensity intervention for enhancing mental well-being and various gratitude measures but not distress among people with low to moderate levels of well-being and low or moderate distress, at least in higher-educated women. The sustained effects on mental well-being appreciation of simple pleasure up to 6-months follow-up, suggest that it is possible to promote an appreciative and grateful perspective on life that becomes a lasting resource for living a resilient, joyful and meaningful life.