Background

Social anxiety disorder (SAD) refers to the fear of one or more social situations in which one can behave embarrassingly or be scrutinized by others [1]. Cognitive models of SAD assume that an individual’s negative beliefs related to social situations as well as the fear of behaving inappropriately and the subsequent consequences play an important role in the development and maintenance of the disorder [2]. Although exposure therapy, a psychological intervention that focusses on fear-related overt behaviour, does not directly address maladaptive cognitions, research suggests that this effective treatment produces similar changes in cognitions as cognitive therapy or cognitive behavioural therapy (see [3,4,5]). This suggests that although exposure therapy does not explicitly target cognitions during treatment, changes in cognitions can occur. However, it is unclear whether changes in SAD-related cognitions are associated with treatment outcome of pure exposure therapy. In this article, we examine the role of three cognitive variables in predicting treatment outcome in exposure therapy: self-focused attention, self-efficacy in social situations, and estimated social costs.

Self-focused attention in social situations, where an individual shows increased vigilance for internal stimuli (e.g., cognitions, emotions, physiological reactions), has been suggested to play an important role in the maintenance of SAD [2, 6]. Research indicates that self-focused attention is associated with higher social anxiety levels and biased self- and performance judgements in SAD [7]. Moreover, in cognitive behavioural therapy, higher levels of maladaptive attentional focus predicted slower symptom improvement [8] and a decrease in self-focused attention predicted and mediated reductions in social anxiety (see [9], for a review). Hofmann [10] showed that exposure therapy, although it does not explicitly target cognitions, can lead to reduced self-focused attention in patients with SAD after treatment. However, it remains unclear whether changes in self-focused attention are associated with treatment outcome in pure exposure therapy.

Additionally, social anxiety has been found to be associated with low levels of self-efficacy in social situations, which refers to one’s belief in his or her own ability to achieve certain goals while interacting with other individuals. A lack of self-efficacy might facilitate the use of dysfunctional coping strategies when experiencing anxiety in social situations [11]. Research on cognitive behavioural therapy indicates that in-treatment changes in self-efficacy in social situations [12, 13] and in therapy context [14] are associated with treatment outcome. Yet, there is a lack of research as to whether changes in self-efficacy during exposure treatment that does not explicitly targets cognitions, are associated with treatment outcome.

The expected negative consequences of social behaviour, namely the social costs, might also play an important role in maintaining SAD, as suggested by Foa and Kozak [15]. More specifically, individuals with SAD tend to overestimate the costs of negative social incidents [16]. Changes in estimated social costs during treatment have been positively associated with treatment outcome in cognitive therapy [16], cognitive behavioural therapy [17,18,19], drug treatment [16], and exposure therapy [20]. However, current literature is inconclusive regarding the role of estimated social costs as a predictor of treatment outcome in SAD. While some studies found that decreased estimated social cost mediated improvement during cognitive behavioural therapy [18, 19, 21] and exposure therapy [19], others found contradicting results. More specifically, Calamaras and colleagues [17] concluded from their study, that although change in cost bias mediated treatment outcome of cognitive behavioural therapy, cost bias at midtreatment did not significantly predict treatment outcome. Additionally, decreases in estimated costs did not precede decreases in anxiety levels during exposure therapy [20]. The association between estimated social costs and social anxiety levels might also depend on a temporal component, as suggested by Gregory and colleagues [22] who found cost bias to predict social anxiety levels in early but not in final stages of treatment. Yet, the results from studies on social cost bias in exposure therapy were limited to exposure therapy administered in a group format [19] and public speaking anxiety only, and hence neglected other social situations that are relevant for SAD patients with heterogeneous fears [20]. However, research suggests that working mechanisms can vary across treatment formats. A study by Hedman et al. [23] indicates that although symptom improvement during cognitive therapy was mediated by decreases in self-focused attention in both group and individually administered treatment, decreases in avoidance mediated effects of individual cognitive therapy only, and decreases in anticipatory and post-event processing mediated effects of group therapy only. Therefore, research that addresses various social fears is needed to investigate the role of social cost bias in exposure treatment for SAD and to investigate whether changes in estimated social costs during individual exposure therapy are associated with treatment outcome.

The aim of the current study was to examine the association between change in SAD-related cognitions and treatment outcome in individually administered exposure therapy (without any cognitive components) for SAD. The association between change in self-focused attention, self-efficacy in social situations, and estimated social costs and change in social anxiety symptoms was evaluated across both in vivo exposure therapy (iVET) and virtual reality exposure therapy (VRET) for SAD. We expected that decreases in self-focused attention and estimated social costs, and an increase in self-efficacy during treatment would be associated with treatment outcome across both exposure treatments. If changes in these cognitions are associated with treatment outcome, these findings might form the base for further research on working mechanisms of exposure therapy. Eventually, this research can help to improve the efficacy of exposure treatments by informing us on which cognitions we need to focus on during therapy and which related changes we need to facilitate.

Methods

Participants

Sixty participants (Mage = 36.9 years, age range: 18–65 years, 63.3% women) meeting the diagnostic criteria for a primary diagnosis of SAD [24] were included in the present study after being recruited via online and newspaper advertisements, and project related websites. Of these participants, 90% reported Dutch as native language, 48.3% high, 46.7% middle, and 5% low education, 60% had a paid employment status, and 50% were married. Furthermore, 11.7% fulfilled the criteria for a comorbid anxiety disorder, 10% for a depressive disorder, and 26.7% for a avoidant personality disorder. For more details on sample characteristics and a participant flow-chart, see Kampmann et al. [25].

Measures

Screening

As a first step in the screening procedure, social anxiety levels were assessed using an online version of the Social Interaction Anxiety Scale (SIAS; [26]), a 20-item self-report measure rated on a 5-point Likert scale. If individuals had a mean SIAS score of ≥29, they were invited to an in-person interview in which a psychologist administered the Structured Clinical Interview for DSM-IV-TR Axis I Disorders (SCID-I; [27]) to assess the diagnoses of SAD and other mental disorders.

Outcome measure

The Liebowitz Social Anxiety Scale-Self Report (LSAS-SR; [28]) was used to assess social anxiety symptoms at pre- and postassessment. The LSAS-SR contains 24 items on fear and avoidance in social situations that are rated on a 4-point Likert scale. The LSAS-SR has good psychometric properties [29] and was assessed at pre- and postassessment. The internal consistency in the present study was high (Cronbach’s α = .90–.96).

Potential predictors of SAD symptom improvement

The extent to which participants focused on themselves during in vivo or virtual reality exposure exercises was assessed with the self-focus subscale of the Focus of Attention Questionnaire [30]. The internal consistency has been reported to be good (Cronbach’s α = .76; [31]) and was good in the present study (Cronbach’s α = .76–.81). The FAQ is a 10-item self-report measure rated on a 5-point Likert scale with higher scores on the self-focus subscale indicating greater focus of attention on the self. In line with the goal of the FAQ to assess focus of attention during exposure exercises, this questionnaire was administered after Session 3 (Time 1), which was the first exposure session, and after Session 6 (Time 2).

Self-efficacy was assessed with the Self-Efficacy for Social Situations Scale (SESS; [13]), a 9-item self-report measure rated on a 10-point Likert Scale with higher scores indicating higher self-efficacy for social situations. The SESS assesses beliefs on self-efficacy for social skills, cognitive coping, and affective coping. The SESS was assessed before Session 1 (Time 1) and before Session 7 (Time 2). The internal consistency has been reported in the literature to be high (Cronbach’s α = .82; [13]) with Cronbach’s α = .75–.81 in the current study.

The estimated costs related to social situations were assessed using the social event subscale of the Social Costs Questionnaire (SCQ; [18]) which is a 20-item self-report questionnaire (10 items on social performance situations and 10 items on social nonperformance situations) rated on a 9-point Likert scale ranging from 0 (not at all bad) to 8 (extremely bad). In line with Foa et al. [18], a mean score of performance and nonperformance items was calculated after detecting high correlations between both subscales at all assessment points (r = .75–.86). The internal consistency across both subscales was excellent (Cronbach’s α = .81–.93). The SCQ was assessed at preassessment (Time 1) and before Session 7 (Time 2) because treatment completers were those participants who completed as least six treatment sessions. All completers therefore received Session 1 (therapy rationale), Session 2 (exposure hierarchy), and then four exposure sessions (Session 3–6, in case they continued treatment) or three exposure sessions (Session 3–5) and a closing session containing relapse prevention and evaluation of the treatment (content of Session 10) in case they were going to stop treatment after six sessions. Therefore, completers could only differ in a maximum of one exposure session. See 2.3. and 2.4. for more information on treatment sessions and assessments.

Treatment

Both treatments, VRET and iVET, were based on previous treatment protocols for SAD [32, 33]. However, to investigate the effects of pure exposure on cognitions, we only applied behavioural elements and abandoned all cognitive elements of the treatment protocol. Treatment in both conditions consisted of ten semi-weekly sessions with a duration of 90 min (including 60 min exposure) and was provided by therapists (clinical psychologists and last-semester master’s students) who had undergone training in administering both treatments. In Session 1 and 2, the therapy rationale was discussed and a hierarchy of social situations (available virtual situations for VRET and participant’s individual social situations for iVET) was obtained. Session 3 through 9 contained virtual reality or in vivo exposure, respectively. Session 10 comprised relapse prevention and evaluation of the treatment.

VRET

Participants receiving VRET were exposed to computer-simulated social situations by means of a head-mounted display in a laboratory at the University of Amsterdam. During VRET, participants were instructed to engage in verbal interaction with virtual humans in one-to-one or group situations to confront their social fears. These virtual scenarios covered the following social situations: public speaking, small-talk with a stranger, buying and returning clothes, attending a job interview, being interviewed by journalists, having dinner in a restaurant with a friend, and having a blind date [34]. Verbal interaction was implemented using semi-structured dialogues that were controlled by the therapist [34] who could also tailor exposure exercises to the individual participant by manipulating certain scenario characteristics: dialogue style (friendly or unfriendly), gender of virtual human, number of virtual humans present in the virtual world, dialogue topic’s degree of personal relevance, and virtual human’s gestures (i.e., gaze direction and posture). A nVisor SX60 head-mounted display with 1280 × 1024 pixel resolution, a stereographic projection, and a 60° diagonal field of view was used and connected to the Delft Remote Virtual Reality Exposure Therapy system (DRVRET; [35]) with virtual worlds that were visualized using a Vizard v3.0 software package.

iVET

Exposure exercises in iVET took place at the University of Amsterdam and its neighbourhood (e.g., supermarkets, subway stations, cafés, etc.), depending on the participant’s individual hierarchy of social situations. When relevant social situations could not be practiced at the University of Amsterdam or its neighbourhood, participants could carry out exposure exercises in their personal habitat substituting for a regular session. To keep these sessions comparable to regular sessions regarding structure and duration, participants contacted their therapist via phone before and after the exposure exercise.

Procedure

The data used in the present study is part of a randomized controlled effectiveness trial on VRET and iVET for SAD that was carried out at the University of Amsterdam. A detailed description of the treatment and the analyses of treatment efficacy can be found in Kampmann et al. [25]. The results revealed that both VRET and iVET lead to significant reductions in SAD symptoms when compared to a waiting-list condition, with iVET being superior to VRET. The trial was approved by the Institutional Review Board of the University of Amsterdam and registered (NCT01746667; www.clinicaltrials.gov). After being contacted via the telephone, individuals filled in the SIAS online and were then invited for the in-person SCID-I intake if they scored above the SIAS cut-off. Individuals who did not meet any exclusion criteria as assessed during the intake were included, and informed consent was obtained. Participants were excluded in cases of a) psychotherapy for SAD in the past year; b) current use of tranquilizers or change in dosage of antidepressants in the past 6 weeks; c) a history of psychosis, current suicidal intentions, or current substance dependence; e) severe cognitive impairment; or f) insufficient command of the Dutch language. Eligible participants received a preassessment (LSAS-SR) and were then randomly assigned to either the VRET, iVET, or a wait-list condition using a computerized random number generator (http://www.randomization.com). Randomization and condition allocation was conducted by an individual not involved in the present study. Participants in the wait-list condition completed a second assessment after the waiting period and were then randomized to one of the treatment conditions. For the purpose of this study, we disregarded the wait-list condition such that data from participants who received treatment after the waiting period were pooled with the data from participants who were directly randomized to one of the treatment conditions. Before and after treatments sessions, participants filled in self-report questionnaires assessing potential predictors. For the purpose of this study, SCQ, SESS, and FAQ scores from only two time points (Time 1 and Time 2) were used to calculate change scores (see 2.2.3. for information on assessment points of each predictor variable). After treatment, all participant received a postassessment (LSAS-SR).

Statistical analyses

The data were screened for outliers and normality. The residuals of the predictor variables were plotted for the inspection of nonlinearity and heteroscedasticity, but neither was constituted for any of the predictor variables. To deal with missing data, multiple imputation was applied, generating 20 separate datasets [36]. Next, for each of the predictors separately, a hierarchical multiple regression analysis was conducted including the preassessment of the outcome measure in step 1, the predictor in step 2, treatment condition and predictor × treatment condition in step 3, and LSAS as the outcome measure. Before calculating the product terms for the interaction effects, continuous predictor variables were mean centred [37]. Significant predictors (main effects) and moderators (interaction effects) of the individual predictor analyses (p < .05) were entered into a final multiple regression model assessing the effect of each predictor while controlling for the other predictors. As an indication of the unique contribution to the model, squared semipartial correlations (sr2) were calculated for each predictor. Beta weights and R2 values were separately calculated. We defined treatment drop-out as terminating therapy before at least 50% of the exposure sessions (i.e., at least six sessions) are reached. In literature, different definitions of treatment drop-out are used (Connell et al., [38]) and our decision was based on the expectation that some patients might not need to attend all ten sessions. This procedure has been also applied in other trials (A-Tjak et al., [39]; Masi et al., [40]). As reported in Kampmann et al. [25], treatment completers and dropouts did not significantly differ on demographic characteristics or outcome measures at preassessment. Furthermore, the completer sample did not significantly differed from the intent-to-treat sample in treatment efficacy. To increase power, data were pooled for participants receiving treatment directly and participants receiving treatment after the wait-list period since there was no significant difference between the two groups prior to starting treatment as reported in Table 3 in Kampmann et al. [25]. Furthermore, analyses were based on the aggregated sample of the two treatment groups because we aimed to investigate possible predictors of exposure therapy independent of treatment modality. However, to control for possible differences between the two groups, we included treatment condition as a moderator variable in the analyses.

Results

See Table 1 for means and standard deviations of all predictor variables and Table 2 for regression equations. Individual predictor analyses revealed that a decrease in estimated social costs and self-focused attention in the first six sessions was associated with a better treatment outcome, as indicated by lower social fear and avoidance on the LSAS-SR. An increase in self-efficacy was also associated with lower social fear and avoidance. When including the main effect of treatment condition and the interaction between each predictor and treatment condition, the predictors did not remain significant in Step 3 of the individual predictor models. None of the predictors showed a significant interaction with the variable treatment condition. This indicates that the associations of social costs, self-focused attention, and self-efficacy with treatment outcome did not vary across treatment condition. The results of the final model, including all significant predictors from the initial individual predictor analyses, showed that only social costs remained a significant predictor of outcome on the LSAS-SR.

Table 1 Means and standard deviations for each predictor at the two time points
Table 2 Individual predictor and moderator analyses (a-c) and final model (d) with LSAS-SR as outcome measure

Discussion

The present study aimed at investigating a possible association between cognitions and treatment outcome in exposure therapy for SAD patients with heterogeneous social fears. For this purpose, we examined whether change during the first six sessions regarding self-focused attention, self-efficacy in social situations, and estimated social costs were associated with symptom change in individuals with SAD receiving exposure therapy. The results revealed that, when social costs, self-focused attention, and self-efficacy were separately examined, patients who showed a decrease in estimated social costs during the first six sessions reported a greater decrease of social anxiety symptoms after treatment and decreases in self-focused attention and self-efficacy during treatment were significantly associated with symptom improvement. When treatment condition (VRET and iVET) was part of the separate models, neither of the three predictors was significantly associated with treatment outcome. However, when social costs, self-focused attention, and self-efficacy were combined in one model, social costs were significantly associated with treatment outcome.

These findings are in line with earlier research that found decreases in social costs to be positively associated with treatment outcome in exposure therapy [19, 20]. However, while treatment in Smits et al. [20] focused on public speaking anxiety and treatment in Hofmann [19] was administered in a group format, our findings go further by showing that changes in expected social costs are associated with treatment outcome of individually administered exposure therapy in patients with SAD and heterogeneous social fears. Moreover, our results suggest that the effects of expected social costs as a predictor of treatment outcome might be consistent across different treatment modalities in exposure-based interventions. More specifically, in both in vivo and virtual reality exposure, declined estimated social costs seem to predict decrease of SAD symptoms.

Changes in self-focused attention and self-efficacy in social situations were significantly associated with treatment outcome when examined individually. Focussing less on oneself in social situations and gaining greater self-efficacy seem to foster improvement during exposure treatment. This was in accordance with research on cognitive behavioural therapy, showing that decreases in self-focused attention predict social anxiety reductions (see [9], for a review) and increases in self-efficacy are associated with treatment outcome of cognitive behavioural therapy [12, 13]. However, both variables were no longer significant predictors when they were part of the final model, indicating that neither one of them significantly contributed to the prediction of treatment outcome beyond social costs and treatment modality. Note, the inspection of the intercorrelations of the predictor variables suggests that social costs and self-efficacy might be partly overlapping concepts (r = −.66), but this applied less for social costs and self-focused attention (r = −.36).

The cognitive model of SAD [2] suggests that an individual who manages to focus less on himself/herself during exposure therapy, and therefore has less attention for anxiety symptoms, might report less SAD symptoms after treatment. Likewise, an individual who gains self-efficacy during treatment might feel less afraid of social situations after treatment and expect to better cope with social situations. However, if an individual learns during treatment to be less afraid of the negative consequences that his/her behaviour in social situations might have, he/she might report less fear and avoidance of social situations after treatment regardless of levels of self-focused attention and self-efficacy. In this situation, even if an individual cannot focus on the situation and does not think that he/she can handle the situation very well, he/she might be less afraid of the negative consequences that might follow. Learning that exposure to social situations is not followed by disastrous consequences and/or that individuals can cope with the (negative) consequences of their behaviour might help to decrease both anticipatory anxiety as well as anxiety during the actual social interaction. Yet, further research is needed to better understand the mechanism by which a reduction in expected social costs benefits a reduction of social anxiety symptoms. Moreover, one important question regarding clinical implications of these results is whether a stronger focus on expected social costs during exposure treatment can help to maximize treatment efficacy.

A limitation of the present study is the temporal overlap between the assessment of the predictor variables and the outcome measure given that we controlled for pre-treatment social anxiety in the analyses. While Hofmann [19] and Smits et al. [20] used mediation analyses, we investigated associations between the change in cognitions and treatment outcome rather than causal relationships. This was a first step in order to gather information on possible variables that could function as working mechanisms of exposure therapy. As suggested by Cole and Maxwell [41], for mediation analyses, multiple assessment points throughout treatment are necessary to investigate temporal precedence, which was not feasible within this study. Therefore, as a next step, future research should assess the session-to-session change in self-focused attention, self-efficacy, social costs and social anxiety levels within the framework of mediation analyses, to investigate changes in cognitions as a possible working mechanism of exposure therapy. Furthermore, not all predictor variables were assessed at the same time points. Whereas the self-efficacy and social costs measures referred to social situations in general and therefore could be assessed before the first exposure session, the self-focused attention measure referred to the social situations during the exposure exercises. Consequently, the first assessment of self-focused attention took place after the first exposure session, which was Session 3. However, the time between the assessment points was limited to one week because treatment was administered twice a week. Another limitation is that in addition to social cost bias, probability bias, the overestimation of the estimated probability that a negative social event occurs, was not assessed. A decrease of social cost bias might have resulted from a reduction of probability bias as suggested by Smits et al. [20]. Given the equivocal results on the predominance of social cost and probability bias in the literature, future research is needed that simultaneously examines social cost and probability bias as predictors of treatment outcome after exposure therapy for SAD. Finally, we can only tentatively conclude that the effects of the investigated predictors on treatment outcome do not differ between in vivo and virtual reality exposure therapy, since we cannot rule out that insufficient power is responsible for the lack of differential effects.

Conclusions

The current study suggests that changes in estimated social costs are associated with improvement of social anxiety symptoms after exposure therapy. Thus, individuals who report greater changes of estimated social costs during treatment may benefit more from treatment, as was the case for both in vivo and virtual reality exposure therapy. Changes in self-focused attention and self-efficacy during treatment were not significantly associated with symptom improvement anymore when examined in combination with social costs. This suggests that self-focused attention and self-efficacy did not predict symptom improvement beyond social costs. Future research needs to further investigate estimated social costs as a predictor in relation to other cognitions in SAD patients with heterogeneous social fears and whether maximizing decreases in estimated social costs can increase treatment efficacy.