Comorbidity between depressive and anxiety disorders is common. A hypothesis of the network perspective on psychopathology is that comorbidity arises due to the interplay of symptoms shared by both disorders, with overlapping symptoms acting as so-called bridges, funneling symptom activation between symptom clusters of each disorder. This study investigated this hypothesis by testing whether (i) two overlapping mental states “worrying” and “feeling irritated” functioned as bridges in dynamic mental state networks of individuals with both depression and anxiety as compared to individuals with either disorder alone, and (ii) overlapping or non-overlapping mental states functioned as stronger bridges.
Data come from the Netherlands Study of Depression and Anxiety (NESDA). A total of 143 participants met criteria for comorbid depression and anxiety (65%), 40 participants for depression-only (18.2%), and 37 for anxiety-only (16.8%) during any NESDA wave. Participants completed momentary assessments of symptoms (i.e., mental states) of depression and anxiety, five times a day, for 2 weeks (14,185 assessments). First, dynamics between mental states were modeled with a multilevel vector autoregressive model, using Bayesian estimation. Summed average lagged indirect effects through the hypothesized bridge mental states were compared between groups. Second, we evaluated the role of all mental states as potential bridge mental states.
While the summed indirect effect for the bridge mental state “worrying” was larger in the comorbid group compared to the single disorder groups, differences between groups were not statistically significant. The difference between groups became more pronounced when only examining individuals with recent diagnoses (< 6 months). However, the credible intervals of the difference scores remained wide. In the second analysis, a non-overlapping item (“feeling down”) acted as the strongest bridge mental state in both the comorbid and anxiety-only groups.
This study empirically examined a prominent network-approach hypothesis for the first time using longitudinal data. No support was found for overlapping mental states “worrying” and “feeling irritable” functioning as bridge mental states in individuals vulnerable for comorbid depression and anxiety. Potentially, bridge mental state activity can only be observed during acute symptomatology. If so, these may present as interesting targets in treatment, but not prevention. This requires further investigation.
Comorbidity between depressive and anxiety disorders is common. For instance, of the individuals with a primary depression diagnosis in the Netherlands Study of Depression and Anxiety (NESDA), 67% had a current and 75% had a lifetime comorbid anxiety disorder diagnosis . Similarly, of those with a primary anxiety disorder diagnosis, 63% had a current and 81% a lifetime depressive disorder diagnosis . Although comorbidity rates in community samples are slightly lower [2, 3], the rates reported in NESDA are in line with other studies in primary and clinical settings [4, 5]. Comorbidity is consistently associated with higher illness severity, chronicity, and impairments in everyday life [4, 6, 7]. It is well-known that the presence of one of the disorders acts as a risk factor for developing the other [3, 8, 9]. This holds not only on a disorder level but also on a symptom level, with a meta-analysis by Jacobson and Newman  showing that symptoms of depression and anxiety predicted each other over weeks and months. Experiencing symptoms of one of these disorders may thus be associated with a higher risk of onset of symptoms of the second disorder.
A heightened risk of developing symptoms of a second disorder can be understood from a network perspective on psychopathology, in which causal interactions between symptoms are theorized to drive the development of psychopathology including comorbidity . Central to the network perspective is the proposition that psychiatric disorders arise due to symptoms triggering other symptoms over time, such as when, for instance, feeling listless makes it difficult to become active during the day, which later in the day results in increased sadness and restlessness because a person did not accomplish what he/she intended to do. Hypothetically, the stronger the depression symptoms from the above example trigger one another over time (i.e., the higher the network density), the more difficult it might be to disrupt the activation which eventually may result in the onset of a depressive disorder. This perspective also offers some potential explanations of comorbidity. For example, we can consider both anxiety and depression symptoms as subclusters in an overall network of psychopathology, including some symptoms that are shared between both disorders, the so-called overlapping symptoms. An interest in overlapping symptoms to explain comorbidity rates is not new (e.g., ). However, whereas previously it was examined whether comorbidity rates could be attributed to the presence of these symptoms ([12, 13] found no support, but see  also), in the network approach, these symptoms are hypothesized to play an active role in the development of comorbidity [10, 15]. If there are no direct interactions between anxiety and depression symptoms (as depicted in Fig. 1 (a)), we would expect there to be no comorbidity of both disorders. If such symptoms, like worrying  or irritability , share strong relationships with symptoms from each individual disorder, then the symptoms of disorder A may activate the symptoms of disorder B indirectly through these symptoms (as depicted in Fig. 1 (b)). An alternative view posits that any symptom, so also symptoms that are specific to only one of the two disorders, could potentially act as a bridge between disorder (e.g., [18, 19]). This is depicted in Fig. 1 (c), where symptom activation from the depression-cluster to the anxiety-cluster via non-overlapping anxiety and depression symptoms would too lead to comorbidity.
Multiple cross-sectional network studies have addressed comorbidity between depressive and anxiety disorders [10, 16,17,18,19,20,21,22,23,24,25,26]. In these studies, symptoms of both diagnoses were combined into one network structure, with symptom connections reflecting the statistical relationships between symptoms when the value of all other symptoms variables is controlled for. Symptoms belonging to the same disorder tended to be more strongly connected to symptoms of the same disorder than to symptoms of the other, comorbid disorder ([15, 16, 18,19,20,21,22,23,24,25,26], but see  as exception). Each study identified at least one symptom in the network that connected both to symptoms of the same disorder and to the symptom cluster belonging to the second, comorbid disorder. However, these symptoms were not always overlapping symptoms (e.g., [18, 19]). Irrespective of which bridge symptom conceptualization (i.e., overlapping or non-overlapping symptoms) was used, the structures of cross-sectional networks revealed patterns that we might expect based on the bridge symptom hypothesis.
However, cross-sectional network patterns may not reflect symptom activation within a person over time [27,28,29]. The use of intra-individual time series to model network structures has two immediate advantages over the use of cross-sectional data: first, patterns of dependence within-person can be directly established, avoiding well-known problems with ergodicity [27,28,29], and second, time-series analysis allows us to establish time-lagged (i.e., temporal) dependencies between symptoms often discussed as a necessary though not sufficient condition for the presence of a causal relationship . Temporal networks based on simulated intra-individual time series in which comorbidity could only arise via bridge symptoms showed promising results , in that they reproduced prevalence rates of major depressive disorder (MDD) and generalized anxiety disorder (GAD), and their comorbidity as reported by the National Comorbidity Survey Replication (NCS-R ). The bridge symptom hypothesis has not been investigated yet using empirical time-series data. A next step would thus be to investigate whether the expected temporal pattern is observed in networks based on intra-individual time series of individuals diagnosed with comorbid depression and anxiety. To this end, ecological momentary assessment (EMA) designs could be used, in which momentary experiences of symptoms are assessed by asking participants’ multiple days, and multiple times per day to report on their current mental state (e.g., feeling sad or anxious). Although these mental states map onto symptoms listed in diagnostic criteria of depressive and anxiety disorders, and could therefore be considered as daily proxies of symptoms, they are not symptoms. For the remainder of this paper, we will refer to such momentary experiences of symptoms and affect assessed with EMA as “mental states.”
In the current paper, we investigate the bridge symptom hypothesis using EMA data. Investigating whether we can detect within-individual temporal associations corresponding with this hypothesis is novel. We used data from participants in the Netherlands Study of Depression and Anxiety , who had been diagnosed with depression, anxiety, or both, and reported on multiple depression and anxiety mental states, multiple times a day, for 2 weeks. As such, this dataset provides the opportunity to study whether bridge mental states are stronger in the within-day mental state dynamics in individuals with comorbid depression and anxiety to those with either single disorder. A priori, we hypothesized that two overlapping mental states “feeling irritated” and “worrying,” reflecting momentary expressions of shared symptoms (i.e., irritability and repetitive negative thinking) of depression and anxiety, would function as bridge mental states. In this paper, we consider a mental state to be a “bridge” between two clusters of mental states from different syndromes if indirect effects from depression mental states to anxiety mental states and/or vice versa travel via this mental state (Fig. 2). The degree to which a symptom acts as a bridge can thus be quantified by the strength of all those indirect effects. Our first aim was to test whether overlapping mental states functioned as stronger “bridges” in the network of individuals with comorbid disorders as compared to individuals with single disorders. Our second aim was to evaluate the assumption that overlapping mental states are more likely to act as bridge mental states than are non-overlapping mental states . In the “Discussion” section of this paper, we synthesize our results, identify and elaborate on the barriers to using this type of analytic approach to investigate causal relationships between mental states, and suggest multiple areas for future research.
The aims and analyses of the current paper were preregistered on the Open Science Framework (https://osf.io/jwuz9). When deviations from the preregistered analyses occurred, reasons for this are explained in the footnotes. More detail about the preregistration, deviations, and sensitivity analyses can be found in Additional File 1 [34,35,36,37,38,39].
The current study used data collected in a subsample of participants that completed the Ecological Momentary Assessment & Actigraphy add-on study of the Netherlands Study of Depression and Anxiety (NESDA-EMAA). NESDA is an ongoing multisite longitudinal cohort study of Dutch adults (at baseline: n = 2981; age 18–65 years), with and without depressive and/or anxiety disorders who were recruited from community settings, and primary and secondary healthcare settings. Participants were excluded if they (i) had a primary diagnosis of psychotic, obsessive-compulsive, bipolar, or severe addiction disorder or (ii) were not fluent in Dutch. See  for a detailed description of the rationale, objectives, and methods of NESDA. Six measurement waves, including the baseline measurement, have so far been completed in NESDA.
At the sixth measurement wave (2014–2017), NESDA-EMAA took place. Inclusion criteria of this add-on study were: participation in at least two previous NESDA waves, participation in the regular interview ≤ 31 days prior to starting the EMA measurements, and being familiar with smartphone use. Based on participants’ diagnostic history (derived from diagnostic interviews conducted at each NESDA wave), we selected NESDA-EMAA participants (n = 220) that had > 30%Footnote 1 completed EMA assessments and could be allocated to one of the following three groups: (i) comorbid depression and anxiety at any NESDA measurement wave (n = 143), (ii) only depression at any NESDA measurement wave (n = 40), and (iii) only anxiety at any NESDA measurement wave (n = 37). Participants were assigned to the comorbidity group if they met criteria for both a depressive disorder (MDD or dysthymia) and an anxiety disorder (generalized anxiety disorder (GAD), panic disorder with (out) agoraphobia, agoraphobia, or social phobia) at the most recent or any prior NESDA wave. The episodes of depression or anxiety had to occur at the same NESDA wave. Individuals diagnosed with depression and anxiety at different waves were not included as part of the comorbidity group. Participants who met criteria for a depressive disorder at any NESDA wave and did not meet criteria for an anxiety disorder at any NESDA wave became the depression-only group. Likewise, participants were assigned to the anxiety-only group if they met criteria for an anxiety disorder at any NESDA wave, but did not meet criteria for a depressive disorder at any NESDA wave. However, some of the participants (n = 15; 40.5%) in the anxiety-only group met criteria for a depressive disorder prior to NESDA (> 9 years ago), see page 2 in Additional File 1, for further details on group allocation.
For a more detailed description of the NESDA-EMAA recruitment procedure and inclusion criteria, see . The research protocols of both the main NESDA study and EMAA add-on study were approved by the Ethical Review Board of the VU University Medical Center and thereafter by the local ethical committees of the participating centers. All participants gave verbal and written informed consent.
NESDA-EMAA participants were asked to complete five EMA questionnaires a day according to a fixed sampling scheme with 3-h intervals, for 2 weeks. Questions concerned participants’ current mental state, activities, and company and took between 3 and 5 min to complete. During each day, at the appointed times, participants received a text message on their smartphones with a link to an online EMA questionnaire. Participants had to complete the questionnaire within 60 min after the prompt, but were encouraged to do so as soon as possible (preferably within 15 min of the prompt). The questionnaires were administered and stored via Roqua (www.roqua.nl). If participants answered at least 80% of all diary questions, they received a 20-euro gift-card as remuneration as well as a personalized report of their own EMA responses. The EMA protocol has been described in detail elsewhere .
Ecological momentary assessments
Of the 16 questions on current mental states (positive and negative affect) and cognitions (see  for a complete list), we selected seven questions,Footnote 2 which most directly reflect depression, anxiety, and bridge mental states. Items were translated from Dutch. The three selected depression mental states were as follows: “I feel listless/apathetic” (LIS; “Ik voel me lusteloos), “I feel down” (DOW; “Ik voel me somber”), and “I do not feel cheerful” (CHE; reverse coded from “Ik voel me opgewekt”). The two anxiety items were as follows: “I feel nervous” (NER; “Ik voel me nerveus”) and “I do not feel relaxed” (REL; reverse coded from “Ik voel me ontspannen”). The two bridge mental states were as follows: “I worry/brood a lot” (WOR; “Ik pieker veel”) and “I feel irritated” (IRR; “Ik voel me geïrriteerd”). Participants were asked to rate the extent to which they experienced each mental state at the moment of assessment on a 7-point Likert scale ranging from 1 = “not at all” to 7 = “very.”
The Composite International Diagnostic Interview (CIDI, lifetime version 2.1 ) was used to assess the presence of depressive disorders (major depressive disorder and dysthymia) and anxiety disorders (generalized anxiety disorder, panic disorder, agoraphobia, social phobia) at each NESDA wave, in between NESDA waves, and before enrollment in NESDA.
Current (past week) severity of depressive and anxiety symptoms was assessed using the Inventory of Depressive Symptomatology-Self Report (IDS-SR30 ), the Beck Anxiety Inventory (BAI ), and Fear Questionnaire (FQ ), respectively.
Analyses were conducted in Mplus version 8.3  and in R version 3.6.2 . using packages qgraph  for network visualization and MplusAutomation  for reading Mplus output into R. All R code and Mplus syntax can be found on OSF (https://osf.io/jzru8/) and the Mplus syntax of the main analysis in Additional File 2.
Cross-lagged associations (dynamic mental state networks)
To investigate the dynamic associations between our seven momentary mental states, we fitted a multilevel multivariate first-order vector autoregressive model (VAR(1) ) using the Dynamic Structural Equation Model (DSEM) module in Mplus . There was no multicollinearity among predictors (see Additional file 1: Table S3); therefore, all seven items were included in the model. Moreover, visual inspection of participants’ responses over time revealed no initial elevation bias ; therefore, we included all completed assessments in our model. We evaluated the VAR model assumption of stationarity, by visual inspection and by means of the Kwiatkowksi-Phillips-Schmidt-Shin unit root test (KPSS ). We observed one individual with a clear trend; however, when running our models without this individual, we did not find results to differ and did not exclude this individual. The KPSS test indicated that time series were stationary for the majority of participants (71–91% depending on the variable); we therefore did not linearly detrend the data.Footnote 3
Within DSEM, the total variability across individuals and across time points is decomposed into two components: within-person variability and between-person variability. Each of these parts is modeled separately . For the within-person part, previous values (at t-1) of the mental state variables were used to predict mental state variables at time t. In our case, the majority of assessments were approximately 3 h apart (median = 183 min, IQR = 175–225 min). However, larger intervals also occurred due to the sampling procedure (no nighttime assessments) and missed assessments. One important assumption of VAR models is that time series are equally spaced. This is because the size of the interval between assessments influences the strength of the estimated autoregressive and cross-lagged effects [52,53,54,55]. To account for the unequally spaced intervals, we used the TINTERVAL command in Mplus such that parameter estimates should be taken to reflect lagged relationships at an approximately 180-minFootnote 4 time-interval .
At the between level, we modeled the effect of group membership using dummy variables on the latent variables that we obtained through the within-level model (i.e., the autoregressive and cross-lagged parameters from the within-person level become latent variables at the between-person level). This allowed us to obtain point estimates for the average autoregressive and cross-lagged parameters in each group. Subsequently, we used the average group cross-lagged effects to calculate lag-2 indirect effects (see Fig. 2) for each group to test our two research questions (explained in detail below) .
We used the default specifications of DSEM, which performs Bayesian estimation with non-informative priors based on two independent Monte Carlo Markov Chains (MCMC) . Bayesian estimation has several advantages for the estimation and group comparison of the indirect effects that were of interest in this study. First, the hierarchical model of interest and subject-specific parameters model can be directly estimated (rather than relying on indirect marginal model specification as in maximum likelihood-based methods). Second, the use of MCMC sampling means that we can obtain posterior distributions for each of the bridge effects reported in this paper, by simply recording at every iteration the current estimate of each within-person lagged parameter. This procedure provides both point estimates and uncertainty estimates (in the form of credible intervals) which are computed from the posterior distribution. Using frequentist approaches, it would be difficult to obtain standard errors and p values of the same effects. Third, DSEM allows for fitting a single multivariate model, while separate models for each outcome variable would have been necessary using a frequentist approach. Lastly, the presence of missing observations and unequal time-intervals are handled differently in DSEM as compared to how they would be dealt with in frequentist approaches. Namely, during estimation of multilevel VAR models using maximum likelihood, missing observations are typically deleted, and unequal time-intervals are typically ignored, likely leading to biased parameter estimates . In contrast, in DSEM, missing data are automatically “imputed” as they are sampled from a posterior distribution during each MCMC iteration (i.e., resembling a Kalman filter approach, see ). When combined with the TINTERVAL option (which inserts missing values such that observations are approximately equally spaced), the bias we typically introduce by ignoring unequal time-intervals is avoided. For a more detailed discussion of the differences between DSEM and frequentist approaches, see Mcneish and Hamaker  and Hamaker et al. .
From the estimated posterior distribution for each indirect effect, we obtained a point estimate and Bayesian credible interval (based on the mean and spread of the posterior, respectively), which quantified the uncertainty about each effect. We use the credible interval as a pseudo-significance test (with parameters labeled as “significant” if their 95% CI does not include zero). More information on the preprocessing steps, treatment of missing data, and DSEM specifications can be found in Additional File 1 [35,36,37].
Research question 1: Do overlapping mental states function as stronger bridge mental states in the comorbid group as compared to the single disorder groups?
To test the hypothesis that overlapping mental states functioned as stronger bridge mental states in the network of participants with comorbidity as compared to participants with a single disorder, we first estimated all average within-person indirect effects through both overlapping mental states (“feeling irritated” and “worrying”) for each group separately. These indirect effects represent the overall effect from one cluster to another cluster via the potential bridge mental state. They were estimated as the cross-product of the group-specific fixed effects for lagged associations from an anxious mental state to a bridge state and from a bridge to a depressive state, and vice versa (see Fig. 2 for illustration), and thus reflect the average within-person indirect effect in that group. We then summed these indirect effects, obtaining a group-average summary of all indirect effects through a potential bridge mental state. For the remainder of this paper, we will call this summed indirect effect the “bridge effect,” as this measure quantifies the degree to which the variable acts as a bridge. We subtracted the value of each bridge effect in the anxiety-only and depression-only groups from those of the comorbid group. This resulted in four difference scores (two for both overlapping mental states). To determine whether the estimates (i.e., bridge effects and difference scores) were different from zero, we inspected whether zero fell into the 95% credible intervals of the respective posterior distributions.
Research question 2: Are overlapping mental states the best bridge mental states?
We examined whether the overlapping mental states “worrying” and “feeling irritated” were most likely to act as bridge mental states, by evaluating whether their bridge effects were higher than bridge effects of the non-overlapping mental states. To this end, we computed the bridge effect for all mental states in the network. Because “worrying” and “feeling irritated” are part of both the anxiety and depression mental state clusters, they could represent either anxiety or depression mental states in calculating the indirect effects. For instance, in case “feeling down” was treated as bridge mental state, both the indirect effect of “worrying” → “feeling down” → “feeling listless” (i.e., from anxiety to depressive mental state via the bridge) and “worrying” → “feeling down” → “feeling nervous” (i.e., from depressive to anxiety mental state via the bridge) would be part of the bridge effect for “feeling down.” However, we did not count an effect from “worrying” → “feeling down” → “worrying,” as indirect effects had to begin and end at a different node. Due to unequal numbers of items belonging to the depression (3 items) and anxiety (2 items) mental state clusters, different numbers of indirect effects contributed to the bridge effects. For the “original bridge states” (“worrying” and “feeling down”), the bridge effect consisted of 22 indirect effects, while this was 24 when the anxiety mental states were conceptualized as bridge state, and 26 in case any of the depressive mental states was considered as bridge state. Due to the differences in number of indirect effects contributing to the bridge effect, we report the mean bridge effect for each node and ranked nodes accordingly. The position of “worrying” and “feeling irritated” among that ranking was evaluated descriptively.
We performed two sensitivity analyses to evaluate to what extent findings among the three groups were influenced by (i) anxiety and depression severity differences and (ii) recency of diagnoses.Footnote 5 In the first sensitivity analysis, we compared the single disorder groups to participants (n = 46) in the lowest severity tertile of the comorbid group. Having comorbid disorders is associated with higher severity of complaints . Severity differences could drive possible group differences in dynamic structure, because especially lower levels of severity may coincide with low levels of variability (due to restriction of range ) which in turn may influence the cross-lagged estimates. In the second analysis, we compared the single disorder groups to participants (n = 75) of the comorbid group with a current diagnosis (i.e., diagnosis in the 6 months prior to the EMA study). This sensitivity analysis was done post hoc and aimed to evaluate whether the contrast between groups in terms of bridge effects would become more pronounced.
Together, the 220 participants completed 14,185 observations with on average 64.48 (SD = 6.16, range 24–70) observations per participant. Diagnostic groups did not differ in sex, age, or the number of EMA assessments completed. However, there were differences in level of education, symptom severity, number of diagnoses, and recency of diagnoses (Table 1). Groups also differed in intra-individual means for all variables and intra-individual standard deviations for some of the mental state variables. Table 2 presents these results. Overall, the findings from Tables 1 and 2 indicate that the comorbid group was worse off compared to the single disorder groups. Participants with a depression diagnosis appeared to be slightly better off than participants with an anxiety diagnosis, although differences were not statistically significant.
The estimated average VAR(1) networks for each of the three groups are displayed in Fig. 3 . Here, group-average lagged regression parameters which were not significant (i.e., have a credible interval that contains zero) are omitted. Supplementary Tables 4 and 5 in Additional File 1 present all lagged mental state associations for each group and variances of random effects, respectively. The comorbid group’s network was denser (26 out of 49 edges) than the other two groups (depression-only, 14/49 edges; anxiety-only, 20/49 edges), and all effects were positive. Furthermore, the comorbid group’s network featured the most bidirectional associations between mental states of the three groups The largest effect across all groups was found in the anxiety-only group and concerned the AR effect for “worrying” (beta = 0.36 [95% CI 0.26, 0.41]). The largest cross-lagged effect was also found in the anxiety-only group and concerned the effect from “not cheerful” at t-1 to “not relaxed” at t (beta = 0.13 [95% CI 0.06–0.19]). In both the comorbid group and the depression-only group, there were significant associations going from a depression mental state to the bridge mental state “worrying” to an anxiety mental state. In the comorbid group, the opposite direction (i.e., anxiety to worry to depression) was also observed. In all groups, “worrying” featured more significant effects than “feeling irritated.” In the depression-only group, there was no significant effect to or from the mental state “feeling irritated” at all.
RQ 1: Do overlapping mental states function as stronger bridge mental states in the comorbid group as compared to the single disorder groups?
In Fig. 4, we have plotted the bridge effects of the overlapping mental states “worrying” and “feeling irritated” for each group. In the comorbid and depression-only groups, the bridge effect of “worrying” was significantly different from zero (effect comorbidity 0.024 [95% CI 0.014, 0.035], p < 0.001; effect depression-only 0.017 [95% CI 0.002, 0.037], p = 0.012), but this was not the case for the anxiety-only group (effect anxiety-only 0.005 [95% CI − 0.012, 0.023], p = 0.255). However, the CIs for the difference between the comorbid and depression-only groups (delta = 0.007 [95% CI − 0.015, 0.026], p = 0.251), and the difference between the comorbid and anxiety-only groups (delta = 0.019 [95% CI − 0.002, 0.039], p = 0.035) included zero. The bridge effect of “feeling irritated” was not significantly different from zero for any of the three groups, nor different from each other.
The Bayesian credible intervals (CIs) for the comorbid group are narrower than the CIs of the other two groups, likely due to the differences in group sizes; in the first sensitivity analysis that adjusted for the larger severity and sample size of the comorbid group, CIs of the comorbid group resembled CIs of the other groups (see Additional file 1: Fig. S5). Importantly, in this sensitivity analysis, the bridge effect of worrying for the lowest tertile of the comorbid group was of the same size as the effect for the depression-only group. The results of the second sensitivity analysis (see Additional file 1: Fig. S6, which compared participants in the comorbid group with current diagnoses (< 6 months prior to EMA assessments) to the single disorder groups, showed a larger bridge effect for “worrying” in the comorbid group as compared to the main analysis. The difference in the bridge effect of worrying between the comorbid and single disorder groups became slightly larger (deltacom-dep = 0.012 [95% CI − 0.013, 0.035], p = 0.171; deltacom-anx = 0.024 [95% CI 0.002, 0.047], p = 0.017). Both sensitivity analyses yielded the same result for “feeling irritated” as the main analysis, that is, the bridge effect of “feeling irritated” was not significantly different from zero for any of the three groups, nor different from each other.
RQ 2: Are overlapping mental states the best bridge mental states?
Figure 5 presents the mean bridge effect (i.e., bridge effect divided by number of indirect effects) of each mental state in each group. Within each group, we compared the mental state with the highest mean bridge effect to the other bridge mental states (see Table 3). Not “worrying” but “feeling down” featured the highest bridge effect in the comorbid group. With the exception of “not feeling cheerful,” “feeling down” was also significantly stronger than other mental states in this group. The same pattern was observed for the anxiety-only group. With the exception of “not feeling cheerful,” the mean bridge effect of “feeling down” was stronger than the bridge effects of all other mental states in this group (estimate = 0.0043 [95% CI 0.0021, 0.0069]). The mean bridge effect of “not feeling cheerful” was the only effect significantly different from zero in all three groups (but not different between groups as CIs overlapped considerably), indicating that this mental state funnels activity from depressed to anxiety mental states (and vice versa) irrespective of the diagnostic label. Again, the CIs in the comorbid group are generally smaller than those in the other groups. In all sensitivity analyses, the mean bridge effect of “feeling down” appeared to have the highest point estimate in the comorbid group and anxiety-only group (see Additional file 1: Fig. S6-S7). However, it differed per sensitivity analysis in comparison to which other bridge mental states the mean bridge effect of “feeling down” was significantly stronger (see Additional file 1: Tables S6-S8).
In our study, we tested the hypothesis that bridge mental states play a role in comorbidity among psychiatric disorders. In a sample of individuals with comorbid depression and anxiety, we did not find clear support for a bridge function of mental states in their mental state network. First, we did not find that the two a priori hypothesized overlapping mental states for anxiety and depressive disorders (“worrying” and “feeling irritated”) had a stronger bridging function in the comorbid group compared to the single disorder groups. Second, we observed that “feeling down,” a non-overlapping mental state, featured a bridge effect of comparable strength as “worrying” in both the comorbid group and the anxiety-only group. Thus, our findings are not in line with the bridge symptom hypothesis .
Network theory literature has provided numerous hypothetical examples of which symptoms (i.e., overlapping or non-overlapping) may play which role (e.g., forming the link between disorder symptom clusters) in the development of comorbid disorders. These discussions about the bridge hypothesis have concentrated on the network’s structure, while limited attention has been paid to the network’s state, that is, the activation of symptoms and specifically the timing of this activation in the context of comorbidity development [60, 61]. Questions such as “when is the activation of bridge symptoms, or bridge mental states, relevant and detectable?” have therefore remained largely unaddressed. An exception is provided by Borsboom , who described four phases, in which interactions between network activation and structure are linked to the development of psychopathology. These can also be applied to the development of comorbidity. Borsboom distinguishes (i) an asymptomatic phase, with a dormant structure and no symptom activation, and thus no active psychopathology development; (ii) a network activation phase in which an external event triggers some of the symptoms; (iii) a symptom spread phase in which connected symptoms (incl. bridge symptoms) become activated and psychopathology starts to emerge; and (iv) a symptom maintenance phase, in which activation is perpetuated due to a strongly connected network containing feedback loops and a full-blown episode of a mental disorder is experienced. Although Borsboom’s account of psychopathology development is quite comprehensive, it reflects a progressive process that stops at symptom maintenance. Our view is that symptom remission also forms a relevant part of the course of psychopathology, and may encompass different phases than those previously mentioned. Such a view is in line with the clinical staging model  and with the scar hypothesis . In particular, it is conceivable that a network underlying risk for a first episode of a psychiatric disorder is different from a network underlying risk for a second or third episode . We therefore suggest to add two additional phases, a (v) partial remission phase, in which individuals due to residual symptoms have a heightened risk to return to phase iii, or alternatively progress to a (vi) full remission phase, in which risk for recurrence is still higher as compared to individuals in phase i that have never experienced a psychiatric disorder. Determining in which of these six phases bridge symptoms are relevant and detectable is necessary to establish whether they potentially can be used to prevent or treat comorbidity. Although the question concerning the phase in which to detect bridge effects was not our a priori purpose, our findings aid in further specification thereof, as discussed hereafter.
One of our starting points was that network structure, including the presence of bridge mental states, reflects underlying vulnerability to developing psychopathology [64,65,66]. This would mean that we would be able to observe bridge effects in individuals vulnerable to experiencing comorbid depression and anxiety. Our sample therefore included both individuals with (re) current psychopathology and individuals at conceivable risk of recurrence of comorbid depression anxiety due to previous experience of these disorders. Given this starting point, and due to its various strengths, the NESDA-EMAA design provided an excellent opportunity to test for the expected group differences in bridge effects between individuals with comorbid and single disorders. First, with nearly 400 participants who had been diagnosed with depression, anxiety, or both, it is one of the largest EMA studies to date. Second, the diagnostic history was assessed in multiple waves up to 12 years prior to EMA assessment for each participant, allowing us to rule out possible comorbidity prior to the EMA study and to allocate participants to each diagnostic group with a high degree of certainty. Third, the number of EMA assessments (max. 70 per person) in NESDA-EMAA is on the higher range of what has been used in dynamic network papers [27, 66, 67], and participants had very few missing observations. However, despite the strengths of this dataset, we did not find support for any group differences in bridge effects.
Yet, absence of evidence for the bridge hypothesis does not imply evidence of absence. This requires us to evaluate what aspects of our design may have impeded finding a role for bridge effects specific to comorbid disorders. We identified three aspects. First, the current design did not allow for investigation of the bridge hypothesis during all phases of psychopathology development. For instance, our sample did not include individuals who were in the active phase of developing a first onset of comorbid depression and anxiety during the EMA assessment, and would thus be in phase iii. Participants in the current sample with comorbid depression and anxiety had already experienced both disorders at the time of the EMA assessment, and the vast majority had their first onset at least 9 years back. Although some participants may have been in the process of developing comorbidity recurrence (phase iii) during the EMA assessments, the vast majority of the comorbid group were likely to be in disease phases iv, v, and vi. If bridge mental state activity is particularly relevant during the period that comorbidity first develops or re-develops (both phase iii), our design, in which we studied a sample that showed heterogeneity in the phase of illness participants were in, was not optimal to detect bridge mental states. This may be one of the reasons for observing a null result. In the subset of participants who were roughly in an active episode (52.4%) (i.e., within 6 months of EMA) (phases iv and v), we observed a stronger bridge effect for “worrying” as compared to the total comorbid group, which also included a large subset of individuals in phase vi (42.0%). Although the difference in bridge effects between the subgroup in this approximate acute comorbid state and the depression-only group was still not significant (difference with the anxiety-only group was significant), it provides some initial indication that bridge effects are detectable and potentially of relevance in the activated symptom phase and that bridge effects are difficult to detect or potentially irrelevant in individuals who are vulnerable for comorbidity but in remission. If our initial findings are replicated, such that vulnerable network structures are completely “dormant” until first symptoms are activated , or reactivated (both phase iii), it may be ineffective to target the bridge symptoms in preventative efforts, unless applied during active phases of comorbidity (re-)occurrence. The latter, however, is difficult to predict. Treatment may still be feasible and effective, starting EMA as soon as patients enter care and have active symptoms. Clearly, these ideas need further research.
The second design-related aspect pertains our group-level analyses. Perhaps bridge mental state effects are only discernible at the level of the individual, and not of diagnostic groups. Associations between mental states may vary too much from person to person for average group-level indirect effects to be meaningful. Post hoc inspection of variation in the random effects showed considerable differences between individuals, with lagged association ranging from negative to positive effects, which in turn also affected the sizes of the indirect effects. Individual variation in the size of effects may be due to heterogeneity in symptom presentation and therefore also the experience (and personal relevance) of certain mental states. This is an issue within one disorder category , and likely even more so in a group of individuals with comorbid psychopathology. Therefore, if (i) any mental state (overlapping and non-overlapping) may function as a bridge, and (ii) this bridge is different for each individual, falsifying the bridge symptom hypothesis at the group-level becomes difficult. Person-specific models might be one way forward. Fisher et al. , for instance, modeled networks consisting of 21 depression and anxiety symptoms for 40 individuals. In their discussion of three exemplar participants, it was clear that individuals not only starkly differed from each other, but also that the most important symptoms for each individual were not necessarily the principal diagnostic criteria of their diagnoses. Although person-specific models can provide new insight in person-specific mechanisms, such models may also require sampling of a large range of variables for each individual in order to be able to detect which mental states are most relevant for a specific individual. Furthermore, testing such complex models that require many parameters to be estimated will also require much longer time series in order to obtain reliable estimates at the individual-level. Although also not without problems, future research may consider analytical techniques that provide compromises between idiographic (person-specific) and nomothetic (group-level) analytical approaches [70, 71].
The third design-related aspect pertains to how we model symptom dynamics: using a linear multilevel first-order VAR model fit to data collected at approximately 3-h intervals. Perhaps, bridge-activation dynamics operate over a shorter or over a much longer timescale than the interval sampled in our design (for a discussion see ). In the absence of strong theory to inform us about the optimal lag length at which mental states influence each other, we estimated a lag 1 VAR model to keep our model as parsimonious as possible. It is however, conceivable that some of the modeled effects also occurred over multiple lags, and not accounting for these is thus a limitation of our study. Data-driven approaches to recover the optimal lag of time-series models are developed (e.g., DVTEM developed by ), but do not yet exist for models including random effects or that include more than two variables (i.e., such as the model used in this study). Further development of theory to inform the choice of lag length and data-driven tools to model multiple lag lengths simultaneously is necessary to aid appropriate modeling of within-person dynamics. Moreover, although VAR models are frequently used to model psychological dynamics (e.g., [59, 66, 67]), they are somewhat limited in the types of dynamics they can describe. For example, while they allow for relating all variables to one another at the next measurement occasion, they cannot describe systems which switch from one stable state (e.g., asymptomatic) to another (e.g., symptomatic) over time [55, 72, 74]. The latter may be something we expect to observe in individuals moving between phases of pathology (e.g., phase iii to phase iv). This limitation may be somewhat mitigated by the use of more complex statistical models, such as time-varying VAR models, which allow in principle to whether parameter values change over the study period (see , for an overview). However, these models do not yet have a multilevel extension, and require much longer time series to perform acceptably than we have available for individual participants in the current study (cf. ). The development of more formalized accounts of symptom dynamics is critical in guiding future efforts at capturing dynamic bridge symptom relationships . Absent of such developments, the VAR model is a reasonable first step in approximating those dynamics with a linear model.
A pertinent question arising from this study is which mental states should be considered as bridge mental states in future research? Although the bridge effect of “worrying” was not significantly stronger in the comorbidity compared to the single disorder groups, our findings nonetheless indicate that it did funnel activity from the depression to anxiety mental state cluster and vice versa. This seems in line with findings from epidemiological and clinical research, in which “worrying” or related symptoms such as “ruminating” or “repetitive negative thinking” have been found to function as a mediator between depression and anxiety [78,79,80,81], and may suggest that the mental state worrying reflects a momentary expression of the symptom worrying. In contrast, the other overlapping mental state “feeling irritated” did not feature a bridge effect in any diagnostic group. This effect could not be explained by low within-person variation in this mental state, as feeling irritated was one of the most highly varying mental states in every group. One possibility is that “feeling irritated” is not a good momentary proxy of irritability as symptom. Future research is needed to address the link between symptoms and within-day affect, as currently no study has examined the association between changes in daily symptoms and within-day changes in affect. A second possibility is that our findings indicate that “feeling irritated” is not relevant as bridge mental state, at least in adulthood. Irritability features in diagnostic criteria of several anxiety disorders (i.e., GAD, PTSD). While often associated with major depression  and considered an indicator of depression in children and adolescents in the Diagnostic and Statistical Manual of Mental Disorders, DSM-5 , irritated mood is not officially part of the diagnostic criteria for adults. Therefore, irritated mood might still be an appropriate bridge mental state or symptom in children and adolescents. This needs to be further investigated. Likewise, other bridge mental states or symptoms need to be investigated as well. Currently, only two bridge mental states were assessed, while there are many other symptoms (e.g., insomnia ), behaviors (e.g., avoidance behaviors ), or cognitive processes (e.g., attributional styles ) that have previously been identified as shared features of depressive and anxiety disorders. Ideally, complex constructs like avoidance behavior or repetitive negative thinking would be measured using multiple items. Whether different types of mediators influence development of comorbidity in different people would be particularly interesting follow-up question.
Our finding that “feeling down” featured a large bridge effect in the comorbidity and the anxiety-only groups also requires further study. This finding was somewhat unexpected for two reasons. First, prolonged “sad mood” is part of the criteria of depression and does not officially feature in diagnostic criteria for other psychiatric disorders than depression-related syndromes. Yet “feeling down” included in the EMA might be a less severe, overlapping, mental state in the sense that it accompanies feelings of distress that are present in other conditions. Second, we had not expected “feeling down” to play a role in the dynamics of the anxiety-only group. The majority of this group had never experienced a comorbid depression diagnosis and the others not in at least 9 years. This finding shows two things: (1) apparently, it is more difficult to find “pure” anxiety, than “pure” depression, which might be a consideration to keep in mind for studies wanting to improve the current design, and (2) it shows that subthreshold symptoms (in this case of depression) that may not be sufficient for obtaining a comorbid diagnosis may still play a role in the daily mental state dynamics, which would explain the presence of bridge effects in this group. Future research is necessary to investigate whether the bridge hypothesis may be more about a matter of degree of risk, also including risk for subthreshold complaints of a second disorder.
Because the bridge symptom hypothesis had not previously been investigated using dynamical data, we developed a new approach to estimate bridge mental state effects. We believe that the current approach for estimating the bridge mental state effect, that is, summing all indirect effects from the depression to the anxiety-cluster via the bridge mental states and vice versa, has face validity. It has conceptual similarity to bridge centrality, which estimates nodes’ bridging function in relation to multiple symptom clusters . Bridge centrality has however not been extended to directed networks based on time-series data, for which it is possible to take into account that a bridge effect would unfold over multiple time points (i.e., lags). Future research may come up with alternative methods to estimate the bridge mental state effects in dynamic data.
A limitation of the current study is that individuals could start EMA assessments within 31 days of the clinical interview; it was therefore difficult to establish whether patients at the time of the EMA assessments were in an acute episode. Also, statistical power is potentially an issue. No standard exists for conducting power analyses to determine an appropriate sample size and number of observations in multilevel VAR models . For multilevel models more generally, power is determined both by the number of participants and repeated measures . A recent simulation study of a multilevel autoregressive (AR) model showed that particularly the number of participants (and their similarity) was important for the estimation precision of the parameters , but these results are difficult to generalize to a 7-variate VAR model, since it has previously been shown that sample size requirements for the recovery of VAR parameter depend heavily on the true parameter values (particularly the size of the true cross-lagged parameters ). In the current study however, due to relatively few missing assessments, the average number of time points per person (i.e., 60 time points) does exceed the length of the time series used in many previous analyses of this type (e.g., [59, 92,93,94]). Although we have a large sample size for the comorbid group (n = 143), a limitation of the current study is the smaller sample sizes in the single disorder groups. This means that average parameter estimates in those groups were estimated with more uncertainty, and thus should be viewed in that light.
Finally, it is important to consider that although the network approach theorizes causal relations between symptom variables, the use of observational data in general precludes us from applying a direct causal interpretation to the statistical relationships estimated in the current paper. For instance, the statistical relationships estimated here are likely influenced by the presence of unmeasured confounding variables. Although multilevel lagged regression models with person mean-centering have been discussed as a method that can control for the effect of unmeasured time-invariant confounding variables (cf. ), there are likely numerous unobserved time-varying confounders present in the current setting (such as additional unmeasured symptoms, mental states, and contextual factors). Additionally, misspecification of the causal timescale, as previously discussed, and the functional form of the temporal relationships would also undermine veracity of causal conclusions made on the basis of estimated cross-lagged effects . To improve the study of causal symptom relationships, we likely need to develop a combination of novel experimental manipulations and more precise formal theoretical models of symptom dynamics which incorporate contextual factors .
This study was the first to investigate whether mental states of “worrying” and “irritability” that are part of both depression and anxiety serve as bridge mental states in the daily mental state dynamics in individuals with comorbid anxiety and depression. Although particularly “worrying” may still be a candidate in future research, we did not find strong support for a bridging role in the dynamic mental state network that is specific to risk for comorbid depression and anxiety. Potentially, bridge mental state activity is most relevant (and detectable) during the period that comorbidity (re-)develops, or bridge mental states are only detectable in person-specific networks rather than group-level models. If bridge mental states in person-specific networks are found to play a role in the development of comorbid depression and anxiety, these would be highly interesting targets for treatment in clinical practice. Therefore, more research is needed, especially prospective studies during active development of comorbidity and/or at the individual-level.
Availability of data and materials
According to European law (GDPR), data containing potentially identifying or sensitive patient information are restricted; our data involving clinical participants are not freely available in a public repository. However, data are available upon request via the NESDA Data Access Committee (email@example.com).
Four participants, who based on their diagnostic history could be allocated to the comorbidity group (n = 1), depression-only group (n = 2), or anxiety-only group (n = 1), were excluded due to completing < 30% of EMA assessments. We do not think that excluding these four individuals has influenced our results.
Please note that this is a deviation from our preregistration. We had planned to model eight mental states instead of seven. During the modeling process, it appeared that although the model including the momentary mental state “I feel anxious” (ANX; “Ik voel me angstig”) converged, the Mplus tracing plots showed convergence problems for parameters involving this variable. This means that estimates for these parameters would likely be unreliable. Moreover, proposed sensitivity analyses would not converge for the eight-variable model. We therefore excluded “I feel anxious” from further analyses. “Feeling anxious” had very low variance in all groups. For transparency, we present the results of our main analyses which do include “feeling anxious” in Additional File 1 in Supplementary Figures S1-S2
Please note that this is a deviation from the preregistration. The preregistration was informed by a previous intensive longitudinal study during which data was collected during an intervention. For that study, non-stationarity was therefore expected. Data in the current study was not collected during an intervention. Additionally, as a sensitivity analysis, we have run our models based on linearly detrended data, which yielded the exact same results. Plots based on these models are presented in Additional File 1 Fig. S3-S4.
Using the shortest time-interval (i.e., 120 min) available in the dataset did not lead us to draw different conclusions.
Please note that this is a different sensitivity analysis than that was proposed in our preregistration. Our original plan was to only include individuals who did not have a current diagnosis (no diagnosis in the 6 months prior to the EMA study; n = 68 in the comorbid group, n = 33 in the depression-only group, and n = 25 in the anxiety-only group). This was to evaluate whether effects remained if individuals with most recent and therefore more severe psychopathology were excluded. However, because no group differences were observed, it was not of interest to investigate whether effects remained.
Lamers F, van Oppen P, Comijs HC, Smit JH, Spinhoven P, Van Balkom AJLM, et al. Comorbidity patterns of anxiety and depressive disorders in a large cohort study: the Netherlands Study of Depression and Anxiety (NESDA). J Clin Psychiatry. 2011;72(3):341–8.
Hirschfeld RMA. The comorbidity of major depression and anxiety disorders: recognition and management in primary care. Prim Care Companion J Clin Psychiatry. 2001;3(6):244–54.
Wittchen HU, Kessler RC, Pfister H, Höfler M, Lieb R. Why do people with anxiety disorders become depressed? A prospective-longitudinal community study. Acta Psychiatr Scand Suppl. 2000;102(406):14–23.
Olfson M, Fireman B, Weissman MM, Leon AC, Sheehan D, Kathol RG, et al. Mental disorders and disability among patients in a primary care group practice. Am J Psychiatry. 1997;154(12):1734–40.
Brown TA, Campbell LA, Lehman CL, Grisham JR, Mancill RB. Current and lifetime comorbidity of the DSM-IV anxiety and mood disorders in a large clinical sample. J Abnorm Psychol. 2001;110(4):585–99.
Brown C, Schulberg HC, Madonia MJ, Shear MK, Houck PR. Treatment outcomes with major depression. Am J Psychiatry. 1996;153(10):1293–300.
Belzer K, Schneier FR. Comorbidity of anxiety and depressive disorders: issues in conceptualization, assessment, and treatment. J Psychiatr Pract. 2004;10(5):296–306.
Sher KJ, Trull TJ. Methodological issues in psychopathology research. Annu Rev Psychol. 1996;47:371–400.
Jacobson NC, Newman MG. Anxiety and depression as bidirectional risk factors for one another: a meta-analysis of longitudinal studies. Psychol Bull. 2017;143(11):1155–200.
Cramer AOJ, Waldorp LJ, Van Der Maas HLJ, Borsboom D. Comorbidity: a network perspective. Behav Brain Sci. 2010;33(2–3):137–50.
Caron C, Rutter M. Comorbidity in child psychopathology: concepts, issues and research strategies. J Child Psychol Psychiatry. 1991;32(7):1063–80.
Franklin CL, Zimmerman M. Posttraumatic stress disorder and major depressive disorder: investigating the role of overlapping symptoms in diagnostic comorbidity. J Nerv Ment Dis. 2001;189(8):548–51.
Milberger S, Biederman J, Faraone SV, Murphy J, Tsuang MT. Attention deficit hyperactivity disorder and comorbid disorder: issues of overlapping symptoms. Am J Psychiatry. 1995;152(12):1793–9.
van Loo HM, Schoevers RA, Kendler KS, de Jonge P, Romeijn J. Psychiatric comorbidity does not only depend on diagnostic thresholds: an illustration with major depressive disorder and generalized anxiety disorder. Depress Anxiety. 2016;33(2):143–52.
Borsboom D, Epskamp S, Kievit RA, Cramer AOJ, Schmittmann VD. Transdiagnostic networks: commentary on Nolen-Hoeksema and Watkins (2011). Perspect Psychol Sci. 2011;6(6):610–4.
Beard C, Millner AJ, Forgeard MJC, Fried EI, Hsu KJ, Treadway MT, et al. Network analysis of depression and anxiety symptom relationships in a psychiatric sample. Psychol Med. 2016;46(16):3359–69.
Afzali MH, Sunderland M, Teesson M, Carragher N, Mills K, Slade T. A network approach to the comorbidity between posttraumatic stress disorder and major depressive disorder: the role of overlapping symptoms. J Affect Disord. 2017;208:490–6.
Heeren A, Jones PJ, McNally RJ. Mapping network connectivity among symptoms of social anxiety and comorbid depression in people with social anxiety disorder. J Affect Disord. 2018;228:75–82.
McNally RJ, Mair P, Mugno BL, Riemann BC. Co-morbid obsessive-compulsive disorder and depression: a Bayesian network approach. Psychol Med. 2017;47(7):1204–14.
Choi KW, Batchelder AW, Ehlinger PP, Safren SA, O’Cleirigh C. Applying network analysis to psychological comorbidity and health behavior: depression, PTSD, and sexual risk in sexual minority men with trauma histories. J Consult Clin Psychol. 2017;85(12):1158–70.
Blanken TF, Deserno MK, Dalege J, Borsboom D, Blanken P, Kerkhof GA, et al. The role of stabilizing and communicating symptoms given overlapping communities in psychopathology networks. Sci Rep. 2018;8(1):1–8.
Price M, Legrand AC, Brier ZMF, Hébert-Dufresne L. The symptoms at the center: examining the comorbidity of posttraumatic stress disorder, generalized anxiety disorder, and depression with network analysis. J Psychiatr Res. 2019;109:52–8.
Jones PJ, Mair P, Riemann BC, Mugno BL, McNally RJ. A network perspective on comorbid depression in adolescents with obsessive-compulsive disorder. J Anxiety Disord. 2018;53:1–8.
Garabiles MR, Lao CK, Xiong Y, Hall BJ. Exploring comorbidity between anxiety and depression among migrant Filipino domestic workers: a network approach. J Affect Disord. 2019;250:85–93.
Langer JK, Tonge NA, Piccirillo M, Rodebaugh TL, Thompson RJ, Gotlib IH. Symptoms of social anxiety disorder and major depressive disorder: a network perspective. J Affect Disord. 2019;243:531–8.
de la Torre-Luque A, Essau CA. Symptom network connectivity in adolescents with comorbid major depressive disorder and social phobia. J Affect Disord. 2019;255:60–8.
Bos FM, Snippe E, De Vos S, Hartmann JA, Simons CJP, Van Der Krieke L, et al. Can we jump from cross-sectional to dynamic interpretations of networks? Implications for the network perspective in psychiatry. Psychother Psychosom. 2017;86(3):175–7.
Hamaker EL. Why researchers should think “within-person”: a paradigmatic rationale. In: Handbook of research methods for studying daily life. New York: The Guilford Press; 2012. p. 43–61.
Molenaar PCM. A manifesto on psychology as idiographic science: bringing the person back into scientific psychology, this time forever. Meas Interdiscip Res Perspect. 2004;2(4):201–18.
Granger CWJ. Investigating causal relations by econometric models and cross-spectral methods. Econom J Econom Soc. 1969:424–38.
Borsboom D, Cramer AOJ, Schmittmann VD, Epskamp S, Waldorp LJ. The small world of psychopathology. PLoS One. 2011;6(11):e27407.
Kessler RC, Berglund P, Demler O, Jin R, Koretz D, Merikangas KR, et al. The epidemiology of major depressive disorder. JAMA. 2003;4(4):186–7.
Penninx BW, Beekman AT, Smit JH, et al. The Netherlands Study of Depression and Anxiety (NESDA): rationale, objectives and methods. Int J Methods Psychiatr Res. 2008;17(3):121-140.
Borsboom D. A network theory of mental disorders. World Psychiatry. 2017;16(1):5–13.
Hamaker EL, Asparouhov T, Brose A, Schmiedek F, Muthén B. At the frontiers of modeling intensive longitudinal data: dynamic structural equation models for the affective measurements from the COGITO study. Multivariate Behav Res. 2018;53(6):820–41.
Bulteel K, Tuerlinckx F, Brose A, Ceulemans E. Using raw VAR regression coefficients to build networks can be misleading. Multivariate Behav Res. 2016;51(2–3):330–44.
Schuurman NK, Ferrer E, de Boer-Sonnenschein M, Hamaker EL. How to compare cross-lagged associations in a multilevel autoregressive model. Psychol Methods. 2016;21(2):206.
Asparouhov T, Hamaker EL, Muthén B. Dynamic structural equation models. Struct Equ Model. 2018;25(3):359–88.
Borsboom D, Cramer AOJ. Network analysis: an integrative approach to the structure of psychopathology. Annu Rev Clin Psychol. 2013;9(1):91–121.
Schoevers RA, van Borkulo CD, Lamers F, Servaas MN, Bastiaansen JA, Beekman AT, van Hemert AM, Smit JH, Penninx BW, Riese H. Affect fluctuations examined with ecological momentary assessment in patients with current or remitted depression and anxiety disorders. Psychol Med 2020 1:1–0.
Difrancesco S, Lamers F, Riese H, Merikangas KR, Beekman ATF, van Hemert AM, et al. Sleep, circadian rhythm, and physical activity patterns in depressive and anxiety disorders: a 2-week ambulatory assessment study. Depress Anxiety. 2019;36(10):975–86.
WHO. Composite International Diagnostic Interview, Core Version 2.1: Interviewer’s manual. Geneva: World Health Organization; 1997.
Rush JA, Giles DE, Schlesser MA, Fulton CL, Weissenburger J, Burns C. The inventory for depressive symptomatology (IDS): preliminary findings. Psychiatry Res. 1986;18(1):65–87.
Beck AT, Brown G, Kiyosaki RT, Lechter SL. An inventory for measuring clinical anxiety: psychometric properties. J Consult Clin Psychol. 1988;56(6):893–7.
Marks IM, Mathews AM. Brief standard self-rating for phobic patients. Behav Res Ther. 1979;17(3):263–7.
Muthén LK, Muthén BO. Mplus user’s guide. 8th ed. Los Angeles: Muthén & Muthén.
R Core Team. R: a language and environment for statistical computing. Vienna: R Foundation for Statistical Computing; 2019.
Epskamp S, Cramer AOJ, Waldorp LJ, Schmittmann VD, Borsboom D. Qgraph: network visualizations of relationships in psychometric data. J Stat Softw. 2012;48.
Hallquist MN, Wiley JF. MplusAutomation: an R package for facilitating large-scale latent variable analyses in Mplus. Struct Equ Model A Multidiscip J. 2018;25(4):621-38.
Shrout PE, Stadler G, Lane SP, Mcclure MJ, Jackson GL, Clavél FD, et al. Initial elevation bias in subjective reports. PNAS. 2018;115(1):E15–23.
Kwiatkowski D, Phillips PCB, Schmidt P, Shin Y. Testing the null hypothesis of stationarity against the alternative of a unit root. Journal of Econometrics. 1992;54(1-3):159–178.
Gollob HF, Reichardt CS. Taking account of time lags in causal models. Child Dev. 1987;58(1):80–92.
Voelkle MC, Oud JHL, Schmidt P. An SEM approach to continuous time modeling of panel data: relating authoritarianism and anomia. Psychol Methods. 2012;17(2):176–92.
Kuiper RM, Ryan O, Kuiper RM, Ryan O. Drawing conclusions from cross-lagged relationships : re-considering the role of the time-interval. Struct Equ Model A Multidiscip J. 2018;25(5);809-23.
Ryan O, Kuiper RM, Hamaker EL. A continuous-time approach to intensive longitudinal data: what, why, and how? In: van Montfort K, Oud JHL, Voelkle MC, editors. Continuous time modeling in the behavioral and related sciences. New York: Springer US; 2018. p. 27–54.
Cole DA, Maxwell SE. Testing Mediational Models With Longitudinal Data: Questions and Tips in the Use of Structural Equation Modeling. Journal of Abnormal Psychology. 2003;112(4):558–577.
McNeish D. Hamaker EL. Psychol Methods: A primer on two-level dynamic structural equation models for intensive longitudinal data in Mplus; 2019.
Mestdagh M, Pe M, Pestman W, Verdonck S, Kuppens P, Tuerlinckx F. Sidelining the mean: the relative variability index as a generic mean-corrected variability measure for bounded variables. Psychol Methods. 2018;23(4):690–707.
Bringmann LF, Vissers N, Wichers M, Geschwind N, Kuppens P, Peeters F, et al. A network approach to psychopathology: new insights into clinical longitudinal data. PLoS One. 2013;8(4).
Cramer AOJ, Waldorp LJ, van der Maas HLJ, Borsboom D. Complex realities require complex theories: Refining and extending the network approach to mental disorders. Behavioral and Brain Sciences. 2010;33 (2-3):178–193.
Robinaugh DJ, Hoekstra RHA, Toner ER, Borsboom D. The network approach to psychopathology: a review of the literature 2008–2018 and an agenda for future research. Psychological Medicine. 2020;50(3):353–366.
Hickie IB, Scott EM, Hermens DF, Naismith SL, Guastella AJ, Kaur M, et al. Applying clinical staging to young people who present for mental health care. Early Interv Psychiatry. 2013;7(1):31–43.
Lewinsohn PM, Steinmetz JL, Larson DW, Franklin J. Depression-related cognitions: antecedent or consequence? J Abnorm Psychol. 1981;90(3):213–9.
Bringmann LF, Pe ML, Vissers N, Ceulemans E, Borsboom D, Vanpaemel W, et al. Assessing temporal emotion dynamics using networks. Assessment. 2016;23(4):425–35.
Isvoranu AM, Borsboom D, Van Os J, Guloksuz S. A network approach to environmental impact in psychotic disorder: brief theoretical framework. Schizophr Bull. 2016;42(4):870–3.
Klippel A, Viechtbauer W, Reininghaus U, Wigman J, van Borkulo C, Myin-Germeys I, et al. The cascade of stress: a network approach to explore differential dynamics in populations varying in risk for psychosis. Schizophr Bull. 2018;44(2):328–37.
Wigman JTW, Van Os J, Borsboom D, Wardenaar KJ, Epskamp S, Klippel A, et al. Exploring the underlying structure of mental disorders: cross-diagnostic differences and similarities from a network perspective using both a top-down and a bottom-up approach. Psychol Med. 2015;45(11):2375–87.
Fried EI, Nesse RM. Depression is not a consistent syndrome: an investigation of unique symptom patterns in the STAR∗D study. J Affect Disord. 2015;172:96–102. A.
Fisher AJ, Reeves JW, Lawyer G, Medaglia JD, Rubel JA. Exploring the idiographic dynamics of mood and anxiety via network analysis. J Abnorm Psychol. 2017;126(8):1044–56.
Lane ST, Gates KM, Pike HK, Beltz AM, Wright AGC. Uncovering general, shared, and unique temporal patterns in ambulatory assessment data. Psychol Methods. 2019;24(1):54–69.
Gates KM, Molenaar PCM. Group search algorithm recovers effective connectivity maps for individuals in homogeneous and heterogeneous samples. Neuroimage. 2012;63(1):310–9.
Haslbeck, J. M. B., & Ryan, O. (2020). Recovering within-person dynamics from psychological time series. https://psyarxiv.com/dymhw/.
Jacobson NC, Chow S-M, Newman MG. The differential time-varying effect model (DTVEM): a tool for diagnosing and modeling time lags in intensive longitudinal data. Behav Res Methods. 2019;51(1):295–315.
Strogatz S. Nonlinear dynamics and chaos: with applications to physics, biology, chemistry, and engineering (studies in nonlinearity); 2001.
Haslbeck JMB, Bringmann LF, Waldorp LJ. A tutorial on estimating time-varying vector autoregressive models. Multivariate Behav Res. 2020:1–30.
Bringmann LF, Ferrer E, Hamaker EL, Borsboom D, Tuerlinckx F. Modeling nonstationary emotion dynamics in dyads using a time-varying vector-autoregressive model. Multivariate Behav Res. 2018;53(3):293–314.
Haslbeck J, Ryan O, Robinaugh D, Waldorp L, Borsboom D. Modeling psychopathology: from data models to formal theories. 2019. https://doi.org/10.31234/osf.io/jgm7f.
Spinhoven P, van Hemert AM, Penninx BW. Repetitive negative thinking as a mediator in prospective cross-disorder associations between anxiety and depression disorders and their symptoms. J Behav Ther Exp Psychiatry . 2019;63:6–11.
Starr LR, Davila J. Responding to anxiety with rumination and hopelessness: mechanism of anxiety-depression symptom co-occurrence? Cognit Ther Res. 2012;36(4):321–37.
Roelofs J, Huibers M, Peeters F, Arntz A, van Os J. Rumination and worrying as possible mediators in the relation between neuroticism and symptoms of depression and anxiety in clinically depressed individuals. Behav Res Ther. 2008;46(12):1283–9.
McLaughlin KA, Nolen-Hoeksema S. Rumination as a transdiagnostic factor in depression and anxiety. Behav Res Ther. 2011;49(3):186–93.
Perlis RH, Fraguas R, Fava M, Trivedi MH, Luther JF, Wisniewski SR, et al. Prevalence and clinical correlates of irritability in major depressive disorder: a preliminary report from the sequenced treatment alternatives to relieve depression study. J Clin Psychiatry. 2005;66(2):159–66.
American Psychiatric Association. Diagnostic and statistical manual of mental disorders. 5th ed. Washington, DC; 2013.
Li YI, Starr LR, Wray-Lake L. Insomnia mediates the longitudinal relationship between anxiety and depressive symptoms in a nationally representative sample of adolescents. Depress Anxiety. 2018;35(6):583–91.
Moitra E, Herbert JD, Forman EM. Behavioral avoidance mediates the relationship between anxiety and depressive symptoms among social anxiety disorder patients. J Anxiety Disord. 2008;22(7):1205–13.
Swendsen JD. Anxiety, depression, and their comorbidity: an experience sampling test of the helplessness-hopelessness theory. Cognit Ther Res. 1997;21(1):97–114.
Jones PJ, Ma R, McNally RJ. Bridge centrality: a network approach to understanding comorbidity. Multivariate Behav Res. 2019;0(0):1–15.
Jordan DG, Winer ES, Salem T. The current status of temporal network analysis for clinical science: considerations as the paradigm shifts? J Clin Psychol. 2020;1–22.
Hox J. Sample sizes and power analysis in multilevel regression. Multilevel Anal Tech Appl. 2010.
Schultzberg M, Muthén B. Number of subjects and time points needed for multilevel time-series analysis: a simulation study of dynamic structural equation modeling. Struct Equ Model A Multidiscip J. 2018;25(4):495–515.
Dablander F, Ryan O, Haslbeck J. Choosing between AR (1) and VAR (1) models in typical psychological applications; 2019.
Pe ML, Kircanski K, Thompson RJ, Bringmann LF, Tuerlinckx F, Mestdagh M, et al. Emotion-network density in major depressive disorder. Clin Psychol Sci. 2015;3(2):292–300.
van Winkel M, Wichers M, Collip D, Jacobs N, Derom C, Thiery E, et al. Unraveling the role of loneliness in depression: the relationship between daily life experience and behavior. Psychiatry. 2017;80(2):104–17.
Groen RN, Snippe E, Bringmann LF, Simons CJP, Hartmann JA, Bos EH, et al. Capturing the risk of persisting depressive symptoms: a dynamic network investigation of patients’ daily symptom experiences. Psychiatry Res. 2019;271:640–8.
Usami S, Murayama K, Hamaker EL. A unified framework of longitudinal models to examine reciprocal relations. Psychol Methods. 2019;24(5):637.
The authors thank all NESDA participants and research assistants who made the data acquisition possible.
The NESDA study (www.nesda.nl) is funded through the Geestkracht program of the Netherlands Organisation for Health Research and Development (ZonMw, grant number 10-000-1002) and financial contributions by participating universities and mental health care organizations (VU University Medical Center, GGZ inGeest, Leiden University Medical Center, Leiden University, GGZ Rivierduinen, University Medical Center Groningen, University of Groningen, Lentis, GGZ Friesland, GGZ Drenthe, Rob Giel Onderzoekscentrum). This research was funded by the Netherlands Organization for Scientific Research (NWO) (R.N.G. research talent grant number 406.16.507, O.R. research talent grant number 406-15-128, and J.T.W. Wigman Veni grant number 016.156.019) and the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovative program (M.W., grant number 681466). None of the funding bodies was involved in the design of the study; in the collection, analysis, and interpretation of data; and in the writing of the manuscript.
Ethics approval and consent to participate
The authors assert that all procedures contributing to this work comply with the ethical standards of the relevant national and institutional committees on human experimentation and with the Helsinki Declaration of 1975, as revised in 2008. The NESDA study, including the EMAA component, was approved by the VUmc ethical committee (reference number 2003/183). All participants provided informed consent prior to participation in both the regular interview and the EMAA component.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Additional file 1.
Additional file 2.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Groen, R.N., Ryan, O., Wigman, J.T.W. et al. Comorbidity between depression and anxiety: assessing the role of bridge mental states in dynamic psychological networks. BMC Med 18, 308 (2020). https://doi.org/10.1186/s12916-020-01738-z
- Network analysis
- Bridge symptoms
- Time series
- Intensive longitudinal data
- Ecological momentary assessment