Introduction

Due to digitalization and a more frequent use of the internet, studies on internet-based interventions for the treatment of mental illnesses have been increasing over the past years (Zuelke et al., 2021). Internet-based interventions have proven to be effective in treating various mental disorders, such as depression or panic disorder, and effects are comparable to face-to-face interventions (Carlbring et al., 2018; Richards et al., 2018; Stech et al., 2020). They also have been shown to effectively treat prolonged grief disorder (PGD), which has been recently added as a new diagnosis in the ICD-11 and DSM-5-TR (American Psychiatric Association, 2021; Kaiser et al., 2022; Treml et al., 2021; WHO, 2018). Core diagnostic criteria according to the ICD-11 include persistent or pervasive yearning or longing for the deceased, functional impairment and symptoms of emotional pain lasting for at least six months, or in the case of the DSM-5-TR, 12 months.

Internet-based interventions for prolonged grief symptoms are often based on Boelen’s et al. (2006) cognitive-behavioural model and therefore employ three processes during treatment. Treatment includes exposure, in which patients have to face previously avoided aspects of the loss experience to process and integrate the loss into the autobiographical memory (Boelen et al., 2006; Eisma et al., 2015). This is followed by cognitive restructuring, with patients addressing own misinterpretations and dysfunctional thoughts. Lastly, behavioral activation intends patients to resume supportive activities (Boelen et al., 2006; Boelen & Van Den Bout, 2010; Eisma et al., 2015).

While internet-based interventions were found to be effective for prolonged grief symptoms for different bereavement groups, individual differences are often overlooked. Differences in changes between intervention and control groups are often significant, leading to medium to high effect sizes (Wagner et al., 2020), however only 37–47% of patients seem to have clinical significant change after the intervention (Eisma et al., 2015; Kaiser et al., 2022; Treml et al., 2021). Therefore, it is necessary to examine influencing factors on symptom change.

While there are many studies examining the influence of patient or therapist characteristics and therapy-specific variables on symptom change (Boelen et al., 2011; Bryant et al., 2017; Haller et al., 2023), the role of patient language for treatment outcome in internet-based interventions is often overlooked. For the objective assessment of patient language during therapy, a program has been established by Pennebaker and colleagues (2015), the linguistic inquiry word count (LIWC). This method analyses patients’ therapy texts by counting and categorizing every word in patients’ writing tasks into different linguistic categories, e.g., social processes (you, we, friend, mother), insight words (know, think, how) or time words (when, then, now). Studies show that different word categories have been found to impact face-to-face therapy outcomes, e.g. affective words (e.g., positive emotion words [love, nice, sweet] or negative emotion words [hurt, ugly, nasty], Arntz et al., 2012), cognitive processes (cause, know, ough, Jennings et al., 2021) or time words (e.g., past focus words [ago, did, talked] or present focus words [today, is, now], Arntz et al., 2012; Huston et al., 2019; Morrison, 2015). However, there are still some inconsistencies, as for example, both a positive and a negative relationship between past focus words and treatment outcome has been found (Huston et al., 2019; Morrison, 2015). Moreover, perceptual processes have been shown to predict treatment outcome in PTSD (Kindt et al., 2007). However, perceptual processes (LIWC: look, heard, feeling) were operationalized as perceptual memory representations in previous studies and not yet studied with the tool of LIWC. Nevertheless, because many Internet-based therapies involve exposure, patients may also address experiences of their own perceptual processes, which in turn could have an impact on treatment outcome and should therefore be studied. Moreover, as face-to-face therapies differ from internet-based approaches, the generalizability of previous results may be limited. For example, while in some cases of face-to-face therapy, sessions were transcripted, other results stem from the analysis of words written in short essays before treatment and therefore differ from structured writing tasks used in internet-based cognitive behavioral therapy (Arntz et al., 2012; Huston et al., 2019).

Studies on the association between patient language and treatment outcome in internet-based interventions are scarce. In internet-based treatments, affective words (e.g., negative emotion words like hurt, ugly, nasty), cognitive processes words (cause, know, ough) or biological processes (eat, blood, pain) were found to be associated with better treatment outcomes (Burkhardt et al., 2021; Owen et al., 2005; Van der Zanden et al., 2014). Moreover, social processes (you, we, friend, mother) were found to predict adherence to therapy (Van der Zanden et al., 2014). Additionally, more words describing behavioral activation and less words describing negative emotions and health were found to be predictive of an increase in patients’ mood (Hernandez-Ramos et al., 2022).

However, there is only one study investigating linguistic predictors of symptom change for prolonged grief symptoms, which found a higher engagement in exposure, as well as cognitive restructuring and a higher time focus at the end of treatment to be associated with a greater reduction in prolonged grief symptoms (Schmidt et al., 2023). While this study investigated predictors of symptom change for prolonged grief symptoms, it only included people bereaved by cancer. However, there are several other high-risk populations for the development of prolonged grief symptoms, including people bereaved by suicide (Young et al., 2012). While grieving after a loss due to suicide may be similar to grief experiences after other losses (Sveen & Walby, 2008), bereaved are confronted with a variety of problems, that are specific for this bereavement group. As the loss of a person due to suicide is sudden, bereaved experience more feelings of shame, rejection and stigmatization after a loss due to suicide (Andriessen et al., 2017; Sveen & Walby, 2008). The differences between bereaved by suicide and bereaved by other causes of death are also evident in their language use. For example, Lester (2012) found bereaved by suicide to use less words related to death and more words describing sadness or anger compared to bereaved by natural causes. Therefore, patient language in internet-based therapies may also differ between bereaved of different causes of death, potentially influencing the impact on symptom change. However, linguistic predictors of symptom change in people bereaved by suicide have been not studied yet. Moreover, while previous work examined the linguistic predictors individually for each of the three elements of the cognitive behavioral model (exposure, cognitive restructuring, behavioral activation), it did not examine how language differs between these three elements of therapy. However, to better understand the language of patients in therapies and potentially improve future interventions, knowledge on the change of language throughout therapy is necessary.

Thus, there is still a research gap in how the language of people bereaved by suicide might change during an internet-based therapy and predict a reduction in prolonged grief symptoms. Nevertheless, it seems important to better understand how text-based interventions may be influenced by patients’ language to provide insights into treatment mechanisms. Thus, therapist feedback in Internet-based therapies could potentially be adapted to tailor future interventions to individual needs. This seems particularly important given the scarcity of grief intervention studies for people bereaved by suicide and their increased vulnerability to poor mental health (Andriessen et al., 2019; Pitman et al., 2014).

Based on these gaps, this study aims to increase knowledge in the specific area of patient language for people bereaved by suicide seeking treatment for prolonged grief symptoms. Specifically, the aims were to investigate (1) patients’ word use as predictors of symptom reduction in prolonged grief symptoms and (2) change of patients’ word use throughout the three elements of treatment (exposure, cognitive restructuring, behavioral activation) in an internet-based cognitive behavioral intervention for people bereaved by suicide suffering from prolonged grief symptoms.

Methods

Procedure

This study is a secondary analysis of a randomized-controlled trial, in which an internet-based cognitive behavioral intervention for people bereaved by suicide was found to be effective (between-group effect size for completers d = 1.03, [details omitted for double-anonymized peer review]). Participants were assigned to either the intervention group or the waitlist-control group using the RITA-Randomization In Treatment Arms (Pahlke et al., 2004). Therapists enrolled participants and assigned them to the intervention or waitlist-control group according to the randomization. Participants from the waitlist-control group also took part in the intervention after a 5-week waiting period. Because both groups completed the intervention, data of both groups was merged.

Ethical considerations

The study was conducted according to the Declaration of Helsinki and approved by the Ethics Committee of the University of Leipzig (reference number: 319-14-06102014) and has the Clinical Registration Number [details omitted for double-anonymized peer review]. All participants provided written informed consent to participate and publish their data anonymously.

Inclusion and exclusion criteria

The study had following inclusion criteria: (1) loss of a loved one due to suicide, (2) loss occurred at least 14 months ago (to avoid anniversary effects), (3) Internet access, (4) age of 18 years or above, (5) provision of written informed consent, and (6) fulfillment of the criteria for prolonged grief symptoms (assessed by a telephone interview, prolonged grief disorder questionnaire, PG-13 by Prigerson et al., 2009).

Because at the time of study, no instrument for measuring PGD according to the recent criteria were available, the PG-13-questionnaire by Prigerson et al. (2009) was used. Moreover, as many previous studies did not assess PGD according to the recent criteria, the term prolonged grief symptoms is used throughout the current study.

The exclusion criteria were: (1) Experience of psychoticism (scale for psychoticism in Brief Symptom Inventory by Derogatis, 1993), (2) change in psychopharmacological treatment during the last six weeks, (3) substance dependence disorder (questions for alcohol or drug dependence, ICD-10, WHO, 2004), (4) current psychotherapy, and (5) acute suicidal ideation (Yale Evaluation of Suicidality Scale > 3, Latham & Prigerson, 2004). If exclusion criteria were met, participants were contacted through telephone to confirm exclusion and/or provide information for support opportunities.

Participants

After screening 129 participants, 59 were randomized and 57 took part in the assessment before the intervention (2 dropouts after randomization, both reported to not have time for the study anymore). Another eight participants dropped out during or after the intervention (4 dropouts because no more time/too burdensome, 4 dropouts because not responsive at post-test/missing data), leading to n = 49 participants at the assessment post-treatment. Due to data storage error of therapy texts of two participants, the final sample of the current study included N = 47 participants (see study enrolment flow in Online Resource 1).

Sampling and sample size

Initially, a sample size of n = 102 was calculated to achieve sufficient power for the detection of a moderate effect (d = 0.50, α = 0.05, power 1-β = 0.80). With the expectation of a 14% dropout rate, a sample size of n = 116 was determined. While this criterion was not met, the sample size for the efficacy of the treatment (n = 58 with a low dropout rate) was enough for the detection of a large effect (see [details omitted for double-anonymized peer review]). Similarly, when merging both groups and analyzing the therapy texts, the sample size of N = 47 was enough to detect a high explained variance (adjusted R² = 0.51, Cohen et al., 1988).

Intervention

The internet-based cognitive behavioral therapy lasted 5 weeks, with two writing assignments every week, each lasting 45 min. It was based on Boelen’s et al. (2006) cognitive behavioral model and consisted of three modules. The first two modules included four writing assignments each and the last module included two writing assignments. During confrontation participants had to write in detail about their loss experience in present tense, including feelings, sensory perceptions and thoughts to facilitate the processing of the loss. During cognitive restructuring participants had to write letters to a friend (real or imaginary) and imagine this friend had suffered their loss. They had to address difficult thoughts, feelings and dysfunctional interpretations to facilitate a new perspective and restructuring of dysfunctional interpretations. Lastly, during social sharing participants had to write a letter to themselves or a friend involved in the loss, sharing experiences of the past loss, recapitulate what was learned in therapy and share their plans and strategies for their future.

Instructions for the modules were standardized and feedback from therapists was highly structured and given within one day after the writing assignments.

Measures

Prolonged grief symptoms were measured according to the criteria by Prigerson et al. (2009) using the Inventory of Complicated Grief (Prigerson et al., 1995). This instrument contains 19 items which can be answered on a 5-point Likert scale (0 = never, 4 = always). The present study showed good internal consistency (α = 0.83). This scale was used at assessment before and after treatment.

For the analysis of patients’ text, the linguistic inquiry and word count program was used in German language (LIWC, Meier et al., 2019; Pennebaker et al., 2015). Beforehand, patient’s text were checked and corrected for typographical errors. The program analyzes each word and assigns it to a word category. A score representing the percentage of the word category compared to the total number of words is then calculated. Therapy texts consisted of writing tasks provided by patients following the instructions described above (in the Intervention section). The program has been shown to be reliable and valid and provides an objective output for different word categories (Pennebaker et al., 2015).

Because the LIWC contains a high number of word categories (97 word categories), and because previous studies frequently only included a subset of subcategories, we included all higher-order summary variables in the analysis. While most higher-order summary variables were mentioned in the introduction, the summary variables drives (success, better, win) and relativity (area, exit, arrive) were not yet studied and therefore included in this present study. In this way we could insure the consideration of each higher-order word category. This seemed important because most previous studies did not investigate word categories individually for each module, possibly limiting generalizability. Furthermore, as our interest was to examine content-related word categories to possibly improve therapist feedback, word categories only including linguistic features or grammar (e.g., articles, prepositions) were excluded. This resulted in the following summary variables for analysis: affective processes (happy, cried), social processes (mother, daughter, talk), cognitive processes (think, know, because, effect), perceptual processes (see, hear, feel), biological processes (blood, pain, eat), drives (success, better, win), time orientations (past focus [ago, did, talked], present focus [today, is now] and future focus [may, will, soon]), relativity (area, exit, arrive) and informal language (lol, ok, thx). To examine the three modules of the internet-based therapy, therapy texts were combined for each module and the eleven summary word categories were calculated individually for each module, resulting in 33 variables.

Data collection

Recruitment took place between July 2015 and March 2017 via posting information about the study on social media platforms, online support groups and psychology blogs and websites, as well as releasing of a press information and via sending information about the study to health offices, clinics, insurance companies and churches. For data collection, participants received a link send to their e-mail address to fill out self-reported questionnaires before, during and after the intervention and/or waitlist. Therapy was administered at the online platform Minddistrict, where participants could send their therapy-texts and received feedback. Therapy-texts were than copied into the LIWC-program.

Statistical analysis

Analyses were performed with SPSS (version 27, SPSS Inc.). As a preliminary analysis, means (SDs) for initial prolonged grief symptoms, symptom reduction and demographic variables were calculated. The equivalence of the intervention and waitlist-control group, as well as completers and dropouts were investigated using two-tailored t-tests and Chi-squared tests or Fisher’s exact tests.

To examine predictors of symptom change, absolute change scores were calculated, subtracting initial prolonged grief symptom scores from post-treatment scores. Absolute change scores have been employed in previous literature on factors associated with change in grief symptoms (Bryant et al., 2017) and described as superior to other measurements for change scores, such as relative change scores (Mattes & Roheger, 2020). Because of the high number of predictor variables, a stepwise forward regression with the Akaike Information Criterion (AIC) as an exploratory analysis was performed using absolute change scores in prolonged grief symptoms as the dependent variable and the different word categories as the independent variables. Assumptions for the regression analyses were checked beforehand. For sensitivity analysis, a stepwise forward regression with adjusted R-squared was performed. Adjusted R-Squared was used as an alternative measure for good model fit, as it relies on a different statistical basis than the AIC (Harrell, 2015).

To investigate the change of the word categories throughout the modules, repeated measures analysis of variances (ANOVA’s) with time (module 1, 2, 3) and word categories that became significant in the regression analysis were calculated and assumptions were checked and met beforehand. The Greenhouse–Geisser adjustment was used to correct for violations of sphericity. Lastly, post-hoc tests for pairwise comparisons of the different modules were examined. To account for multiple tests, all analyses (regression, ANOVA and post-hoc tests) were corrected by the Benjamini and Hochberg (1995) correction.

Results

Preliminary analyses

Most participants were women (89.36%), reported to have had a high education (68.09%), had children (59.57%), were in a partnership (59.57%) and were not religious (59.57%). The mean age of the study sample was 45.19 years (SD = 14.78). Most reported methods for suicide of participants’ loved one were hanging (23.40%), followed by poisoning (19.15%), jumping from high places or in front of vehicles (14.89% respectively) and use of firearm (10.64%).

The intervention and waitlist-control group, as well as completers and dropouts did not significantly differ in demographic variables (see Online Resource 2).

Predictors of symptom change

Regression analysis yielded a significant prediction model (F(8, 38) = 7.07). The model contained eight variables and therefore the number of subjects per variable required for the analysis was in line with Austin and Steyerberg (2015).

Seven variables significantly predicted symptom change in grief symptoms. In the first module more words describing perceptual processes (see, hear, feel, β = − 0.43, p = .002), more words describing cognitive processes (think, know, because, β = − 0.63, p = .002) and less present focus words (today, is now, β = 0.66, p = .002) predicted a greater reduction in prolonged grief symptoms.

During the second module, more words describing drives (success, better, win, β = − 0.40, p = .004), less past focus words (ago, did, talked, β = 0.59, p = .002), and less informal language (lol, ok, thx, β = 0.40, p = .01) predicted a greater reduction in prolonged grief symptoms.

During the last module, more past focus words predicted a greater reduction in prolonged grief symptoms (β = − 0.54, p = .002), while present focus words were non-significant (β = − 0.27, p = .08, see Table 1). Significant effects did not change when controlling for participants’ characteristics (see Online Resource 3). A sensitivity analysis yielded a similar prediction model (see Online Resource 4). While the prediction model with the adjusted R-squared for the alternative goodness-of-fit measure included two additional variables (relativity in module 1 [area, bend, exit] and perceptual processes in module 3 [see, hear, feel]), these variables did not significantly predict the reduction of prolonged grief symptoms (relativity module 1: β = − 0.17, p = .17, perceptual processes module 3: β = 0.17, p = .17). The other variables remained significant, except for present focus in module 3, which also remained insignificant (β = − 0.28, p = .06).

Table 1 Stepwise forward regression of linguistic predictors of symptom change in prolonged grief symptoms

Change of word categories throughout modules

Repeated measures ANOVA’s revealed that all six word categories included in the regression model significantly changed throughout modules (see Table 2, see Online Resource 5).

Table 2 Repeated measures ANOVA’s of change of word use throughout modules

Post-hoc tests showed significantly more perceptual processes in confrontation than in the other two modules (p = .002, p = .002). Moreover, present focus words were significantly higher in confrontation than in social sharing (p = .002), as well as higher in in cognitive restructuring than in social sharing (p = .002).

Post-hoc test further showed significantly more words describing cognitive processes in cognitive restructuring than in the other two modules (p = .007, p = .02). Furthermore, past focus words were significantly higher in social sharing than in cognitive restructuring (p = .002). Additionally, informal language was higher in cognitive restructuring than in the other two modules (p = .05, p = .002), as well as higher in confrontation than in social sharing (p = .002). Lastly, due to the Benjamin-Hochberg correction for post-tests, the differences between the individual modules for words describing drive processes became non-significant.

Discussion

This study set out to investigate linguistic predictors of symptom change, as well as change of word categories throughout therapy in an internet-based intervention for people bereaved by suicide. Results show that words describing perceptual processes (see, hear, feel) decreased significantly from the beginning to the end of therapy and that more words describing perceptual processes during confrontation were predictive of a higher symptom reduction in prolonged grief symptoms. This may be because greater use of words describing perceptual processes implies greater engagement in confrontation with difficult aspects of the loss, as participants describe what they feel, see and hear during their loss experience. Therefore results are in line with previous studies describing exposure as an important component in cognitive-behavioral treatment (Boelen et al., 2007; Bryant et al., 2017; Eisma et al., 2015). For the treatment of prolonged grief symptoms, exposure was found “essential” and has even been found effective as an individual treatment component (Bryant et al., 2014, p. 1337; Eisma et al., 2015). Moreover, it may facilitate subsequent cognitive restructuring, as treatment in which exposure was followed by cognitive restructuring achieved higher effects than treatment with the reverse order (Boelen et al., 2007). Because in some clinical settings there is a concern that exposure may have adverse effects, results confirm that exposure is important in the treatment of prolonged grief symptoms and should be implemented by clinicians (Bryant et al., 2014). Furthermore, previous studies have examined linguistic perceptual processes only in relation to symptom severity of various disorders (e.g., PTSD, anxiety, Paquet et al., 2020; Stamatis et al., 2022), but not to treatment outcome in therapies. Only Schmidt and colleagues (2023) studied perceptual processes in relation to treatment outcome, however they did not emerge as a significant predictor for the reduction of prolonged grief symptoms in bereaved by cancer. Lester (2012, p. 189) found that the language of bereaved by suicide included more words describing sadness and anger, as well as bereavement-related words compared to bereaved by natural causes, therefore he suggested that “the deaths from suicide had a more profound impact” on bereaved than deaths by natural causes. Thus, the inclusion of perceptual processes during exposure could be particularly important for the processing of the loss for bereaved by suicide, as they in some cases may even find the deceased body (Callahan, 2000).

Moreover, words describing cognitive processes (think, know, because, effect) were higher during cognitive restructuring than in confrontation and social sharing, which is in line with the instructions for the writing assignments. Furthermore, more words describing cognitive processes during the first module were predictive of a greater reduction in prolonged grief symptoms, indicating that cognitive processes may be important during exposure. Similarly, a higher use of words for cognitive process throughout therapy has been found to be associated with improvement in quality of life variables (Owen et al., 2005). Moreover, higher cognitive processing was shown to relate to symptom improvement in PTSD or Borderline personality disorder (Jennings et al., 2021; McMain et al., 2013). Furthermore, greater cognitive restructuring has also been found to correlate with improvements in health (Warner, 2005). Therefore, cognitive processing may be important for the treatment of different disorders.

In addition, while present focus words (today, is, now) significantly decreased throughout therapy, more present focus words during the first module predicted less reduction in prolonged grief symptoms. Previous studies found higher use of present focus words in individuals with PTSD compared to individuals who did not develop PTSD following trauma, suggesting that the present tense may be an indication that individuals perceive the event occurring in the present (Jelinek et al., 2010). Therefore, present focus words could indicate a higher activation of the loss experience. However, because the instruction for the first module was to write about the loss experience in present tense, further dismantling studies are needed to investigate effects depending on different tense instructions. Moreover, previous studies have found an increase in present tense verbs throughout treatment in different study samples (e.g., expressive writing treatment in women with history of sexual abuse, Pulverman et al., 2015 or writing of short essays in patients with personality disorders, Arntz et al., 2012), however, as instructions for writing assignments were different, generalizability is limited.

During the second module, more words describing drives (success, better, win) were associated with a greater reduction in prolonged grief symptoms. As words describing drives include achievement, power and reward words (see Meier et al., 2019), this may reflect the change of perspective in patients and therefore indicate cognitive restructuring. Results are consistent with previous studies finding high engagement in cognitive restructuring as a protective factor for prolonged grief symptoms, as well as beneficial for symptom reduction (Harper et al., 2014; Schmidt et al., 2023). Furthermore, less informal language (lol, ok, thy) during the second module was associated with a greater reduction in prolonged grief symptoms. As informal language indicates lower analytic thinking (Jordan et al., 2019), this may impede cognitive restructuring processes. Moreover, informal language may be associated with greater symptoms in different mental disorders, as it has been found to correlate with higher symptoms in anxiety and depression (Stamatis et al., 2022). However, as drives and informal language have only once been investigated in a previous study, where both did not emerge as significant predictors (Schmidt et al., 2023), further studies are necessary.

Results further show that the past focus significantly increased from the second to the third module and that more past focus words during the third module predicted a greater reduction in prolonged grief symptoms, while more past focus words during the second module predicted a lower reduction. While a decrease of past tense words has been found in a previous study by Arntz and colleagues (2012), it was based on the analysis of short essays written by patients about their own life instead of therapy-based writing assignments, limiting generalizability. Moreover, previous studies showed ambivalent results regarding past focus words, as positive and negative relationships with treatment outcomes have been found (Huston et al., 2019; Morrison, 2015). This may be the case because previous studies assessed past focus words throughout treatment and did not distinguish between different modules or time points of therapy. Results imply that while the focus on the past may be detrimental during cognitive restructuring, it may beneficial to include past experiences related to the loss in social sharing at the end of therapy. To integrate results found in this present study into therapies, further studies are necessary. These should also be conducted during particularly challenging times, such as during the COVID-19 pandemic, which not only had a negative impact on the general population in various areas, but also on the grieving process (Amuda et al., 2022; Holland et al., 2021; Sankova et al., 2021).

Limitations

It is important to note that this study has several limitations. First, because 89.36% of participants were women and 68.09% reported to have had a high education, generalizability may be limited. Moreover, because the analyses were exploratory with a relatively small sample size, other potential confounders may not have been considered. Future studies should aim for a larger sample size and may investigate causal relationships.

Moreover, causal attributions were not possible due to the design of the study. Future studies may compare an intervention group with a control group using different writing exercises to allow interaction and repeated measure analysis. Additionally, prolonged grief symptoms were assessed via self-report measures instead of clinical interviews. Nevertheless, criteria for prolonged grief symptoms were checked via a telephone interview before inclusion.

Furthermore, as at the time of the study no measurement tool for the current criteria for PGD existed, future studies should consider capturing PGD according to the ICD-11 or DSM-5-TR. Moreover, results may reflect adherence to instructions for the writing assignments to some degree, although not all word categories are covered in the instructions. Lastly, only patient language was considered in this study, as the number of therapists was limited. Future studies may investigate the influence of therapists’ feedback on symptom improvement by analyzing therapist language.

Conclusions

This present publication is the first study to investigate the association between patients’ language and symptom reduction in people bereaved by suicide. This seems particularly important, as bereaved by suicide face unique challenges and have differences in their language use compared to bereaved by other causes. Results show that a higher reduction in prolonged grief symptoms was predicted by (a) more perceptual and cognitive processes and less present tense during exposure (b) more words describing drives, less informal language and less present tense during cognitive restructuring and (c) more past tense during behavioral activation.

Results suggest that a higher engagement in exposure and cognitive restructuring, as well as mentioning of past experiences during behavioral activation may be beneficial in the treatment of prolonged grief symptoms. This may be important for future studies, as therapists may consider the extent to which patients engage in exposure and cognitive restructuring and directly address lack of perceptual or cognitive processes or change in perspective in their feedback and encourage patients to express different perception modalities. This is important, as perceptual processes in patients’ language have not been studied in previous studies before.

Moreover, this study emphasizes the importance of different tenses throughout the intervention, as previous studies often assessed tenses only at one time of the intervention or did not differentiate between different tenses. Future studies could analyze patients’ language throughout therapy and investigate how therapist feedback based on the language outcomes in the LIWC during therapy may influence treatment outcome. It would also be interesting to examine how therapists’ feedback may be associated with treatment outcome, particularly in a structured intervention similarly to the present study. Lastly, further studies could investigate how future interventions could be adapted to tailor individual patient language.