# Robust EEG/MEG Based Functional Connectivity with the Envelope of the Imaginary Coherence: Sensor Space Analysis

- 2k Downloads
- 1 Citations

## Abstract

The brain’s functional connectivity (FC) estimated at sensor level from electromagnetic (EEG/MEG) signals can provide quick and useful information towards understanding cognition and brain disorders. Volume conduction (VC) is a fundamental issue in FC analysis due to the effects of instantaneous correlations. FC methods based on the imaginary part of the coherence (iCOH) of any two signals are readily robust to VC effects, but neglecting the real part of the coherence leads to negligible FC when the processes are truly connected but with zero or π-phase (modulus 2π) interaction. We ameliorate this issue by proposing a novel method that implements an envelope of the imaginary coherence (EIC) to approximate the coherence estimate of supposedly active underlying sources. We compare EIC with state-of-the-art FC measures that included lagged coherence, iCOH, phase lag index (PLI) and weighted PLI (wPLI), using bivariate autoregressive and stochastic neural mass models. Additionally, we create realistic simulations where three and five regions were mapped on a template cortical surface and synthetic MEG signals were obtained after computing the electromagnetic leadfield. With this simulation and comparison study, we also demonstrate the feasibility of sensor FC analysis using receiver operating curve analysis whilst varying the signal’s noise level. However, these results should be interpreted with caution given the known limitations of the sensor-based FC approach. Overall, we found that EIC and iCOH demonstrate superior results with most accurate FC maps. As they complement each other in different scenarios, that will be important to study normal and diseased brain activity.

## Keywords

Imaginary coherence Functional and effective connectivity Electroencephalography and magnetoencephalography Volume conduction Semi-realistic simulations Hilbert transform## Introduction

Communication of information across the cortex, vital for cognitive function, has been suggested to involve neural dynamic oscillations and related (de)synchronization activity (Buzsáki and Draguhn 2004; Makeig et al. 2004; Singer 1999; Tallon-Baudry and Bertrand 1999). The basis of continuously changing oscillatory behavior can be found in the complex nonlinear and unpredictable interactions among neural populations, whose patterns are still unable to be completely disclosed with modern neuroimaging techniques. A successful statistical approach should be simple and efficient to deal with massive data analysis and for allowing clear interpretation of the results. Functional connectivity (FC) analysis in the frequency domain, based on coherence methods, has been proposed to efficiently elucidate such networks of information transfer (Fries 2005; Jensen et al. 2007; Nunez et al. 1997; Rodriguez et al. 1999; Schnitzler and Gross 2005; Shaw 1984; Simoes et al. 2003; Stam and van Straaten 2012; Wheaton et al. 2005). The implicit use of frequency based analytical tools such as wavelets and Fourier transform (FT) has an important advantage of circumventing issues that arise from the nonlinearity and non-stationarity of the underlying neural dynamics (Bendat and Piersol 2011; Grandchamp and Delorme 2011). Particularly, the computational efficiency of these techniques and their simplicity, allows the analysis of a large number of regions of interest (ROIs) and clear-cut interpretation.

Due to superior time resolution, magnetoencephalography/electroencephalography (M/EEG) is often used to study brain dynamics (Lopes da Silva 2013; Palva and Palva 2012). However, the mixing and field spreading of the local field potentials, eventually reflected at the sensor level, pose a serious challenge for the connectivity analysis. One possible solution is to first solve the inverse problem with one of the well-established methods (Friston et al. 2008; Grave de Peralta; Menendez et al. 2001; Gross et al. 2001; Hämäläinen and Ilmoniemi 1994; Huang et al. 2014; Pascual-Marqui 2007; Van Veen et al. 1997) and then assess FC from the estimated source activities. Although Schoffelen and Gross (2009) suggested that FC must be analyzed at source instead of sensor space, their work also warned against excessive optimism mainly due to volume conduction (VC) effects that are still present in the estimated source activities. Another important limitation of the latter approach is the lack of realism of currently popularly used forward models which could be addressed by using more realistic but complex and time consuming finite element methods (Cho et al. 2015; Dannhauer et al. 2011; Lanfer et al. 2012a, b; Vorwerk et al. 2012, 2014). Other important cause of bias is the presence of deep sources that are not well estimated, and particularly may lead to the estimation of a nearby related superficial source or even two or more superficial sources with mixed estimated dynamics that deceitfully provide a better fit of the observed M/EEG signals. Obviously, the spread of estimated source fields, biased estimation of the number of sources, localization errors and poor separation of mixed signals will lead to false connectivity inferences.

FC analyses in sensor space are important for quick analysis of brain functions, i.e. without resorting to more complex source based analyses. They have been robustly addressed by Nolte et al. (2004) who proposed the imaginary part of the coherence (iCOH) method as an essential technique to circumvent the VC effects for FC estimation. They demonstrated an improved FC estimation using iCOH measure in comparison to coherence analysis, and showed transient interactions between left–right motor cortical signals as a function of time and frequency in a real dataset. However, due to its exclusive dependency on the iCOH, FC estimate based on iCOH becomes negligible in some situations even in the presence of a significant true interaction, e.g. the phase difference between two signals is near zero or π (modulus 2π). Later improvements on this limitation were achieved by proposing the phase lag index (PLI) (Stam et al. 2007) and the weighted PLI (wPLI) (Vinck et al. 2011), demonstrated by simulations based on the Kuramoto-model as well as with real data.

As further evidence of iCOH based techniques’ effectiveness, Haufe et al. (2013) explored iCOH and phase slope index (PSI) (Nolte et al. 2008), together with multivariate Granger causality (Granger-MVAR) (Granger 1969) and partial directed coherence (PDC) approaches (Baccalá and Sameshima 2001) in sensor and source spaces using semi-realistic brain simulated data based on only two interacting sources (acting as ground truth). They found that Granger-MVAR and PDC have serious problems with VC in sensor and source spaces. Additionally, they showed that methods based on the imaginary part of the cross-spectral or complex coherence were able to better identify the true interactions. In a more recent simulation study, Haufe and Ewald (2016) proposed a threefold procedure to study FC, which consisted of: (1) estimating source activity with a reliable M/EEG inverse solver when signal-to-noise (SNR) ratio is sufficiently high for the activity of interest; (2) testing for significant interactions using iCOH while comparing against a baseline estimate; and (3) assessing the connectivity direction using PSI. They were able to show that their approach can partially recover active regions, identify a possible interaction and determine the lagging region. However, their simulations used only two linearly interacting regions and it is unclear whether the same procedure can be successfully applied to more realistic nonlinear neural models, and/or with the use of a higher number of ROIs and their interactions.

From the above, it is clear that iCOH-derived techniques are useful for FC analysis using simulated, real and clinical datasets (see also Ewald et al. 2012; Guggisberg et al. 2008; Hardmeier et al. 2014; Olde Dubbelink et al. 2014; Polanía et al. 2012; Stam et al. 2006, 2007, 2008; Vinck et al. 2011). But despite current advances, these methods are still very dependent on the imaginary part of coherence (or cross-spectral), hence limiting their potential in FC analysis.

In this work, we address the “imaginary-part” limitation by proposing a new iCOH-derived measure: the envelope of the imaginary coherence (EIC) operator, defined here as the absolute value of the analytical signal estimated from the iCOH measure when the latter is regarded as a function in the frequency domain. We will empirically demonstrate that this operator is able to compensate for the missing real part and can readily approximate the coherence value between possibly interacting underlying sources. We will also provide arguments against using a conventional normalization procedure for the original estimation of the iCOH method while proposing a different normalization approach. In a simulation study considering two possibly interacting sources, we will compare our proposed EIC method with state-of-the-art coherence based approaches: classical coherence (COH), phase lock value (PLV) (Lachaux et al. 1999), iCOH (Nolte et al. 2004), PLI (Stam et al. 2007) and wPLI (Vinck et al. 2011). A surrogate-based statistical procedure proposed by Lachaux et al. (1999) will be used to assess significant FC between two sensors which are assumed to be located nearby the underlying active sources.

Furthermore, based on synthetically generated M/EEG signals which are more realistic and complex than in previous simulation studies, we compare EIC against other iCOH-derived techniques using receiver operating curves (ROC) analysis, where the latter was based on ROIs defined over the sensor space. This is done to avoid the selection of potential biased thresholds for each FC measure, separately, and to introduce a novel procedure to evaluate the feasibility of sensor-based FC analysis. Specifically, we will present simulations of 3 and 5 interacting ROIs with neural dynamics described by multivariate autoregressive (MVAR) model and a system of stochastic delay differential equations (SDDEs), projected onto 102 MEG channels to compute sensor-based FC measures. Throughout, we show that EIC is more robust than other methods in terms of found true FC and reduced spurious results, i.e. EIC is robust to VC as other iCOH based measures but distinctly allows to infer significant FC even in the presence of zero or \(\pi\)-phase interactions. We also showed that the classical iCOH method (Nolte et al. 2004) can accurately detect complex FC interactions despite its limitations, thus we recommend to use EIC as a complement to iCOH in practical analysis. Overall, our work has shed light on the usefulness and limitations of iCOH-derived techniques for analysis of M/EEG data and the feasibility of analysis of FC in sensor space.

## Materials and Methods

In this study, we limit ourselves to the study of brain regional interactions as reflected at sensor space; the estimation of these interactions in source space with iCOH methods will be discussed in future work, though interested readers can consult the vast existing literature (e.g. Brookes et al. 2014; Colclough et al. 2015; Haufe et al. 2013; Haufe and Ewald 2016; O’Neill et al. 2015; Schoffelen and Gross 2009; Siems et al. 2016; Van de Steen et al. 2016). In Fig. 1 we illustrate an example of the generation of M/EEG signals from active brain sources, which is used to introduce the FC estimation in sensor space with iCOH-derived techniques, and illustrates how the VC effects in sensor space are directly related to the field spread of local active underlying sources. Specifically, two interacting sources are simulated in a sagittal view of the brain together with two nearby sensors located over the scalp in the same projection plane. The interactions between the sources as well as local leadfield effect over the sensors are indicated with continuous and dashed arrows, respectively. Given the sensor signals, the complete challenge is to make inferences about active source locations, their temporal signatures and identifying possible interactions among the sources. However, in this work, we shall focus only on the latter problem.

As can be observed in this last derivation, the main VC effect is the contamination of the real-part (\(\Re\)) of \({S_{uv}}(f)\) with auto-spectral terms, whereas the imaginary-part (\(\Im\)) of \({S_{uv}}(f)\) (the last term on the right-hand side of the equation) is exactly a scaled version of the imaginary-part of \({S_{xy}}(f)\). That means that we can recover very well the imaginary part of unknown interacting processes if we are able to obtain measurements from nearby sensors. Otherwise, the real part is a combination of terms which include the real-part of interacting underlying sources \(\Re \{ {S_{xy}}(f)\}\) but this term cannot be easily extracted. The imaginary-part of \({S_{uv}}(f)\) hardly goes to zero for all frequencies, unless \(\Im \{ {S_{xy}}(f)\} =0\) for all frequency values, or the determinant of the local leadfield coefficients (\({a_1}{b_2} - {a_2}{b_1}\)) is zero, both of which are rare in practice; although the former can be the case for oscillatory signals with very narrow bandwidth. Thus, the imaginary-part as measured from the harmonic analysis of the interaction of the sensor dynamics, can be used to obtain a measure that captures well the interactions of underlying sources, a fact that has been exploited by methods such as iCOH, PLI and wPLI (Nolte et al. 2004; Stam et al. 2007; Vinck et al. 2011).

One important observation from these derivations is that the denominator used for computing the complex coherence value, i.e. \(\sqrt {{S_{uu}}\left( f \right){S_{vv}}\left( f \right)}\), is contaminated by a weighted average of the cosine of the phase differences of interacting processes across trials, and thus the denominator magnitude fluctuates with dependence of the particular value of the phase difference. If we estimate the iCOH measure directly as the imaginary part of the complex coherence as originally stated (Nolte et al. 2004), then iCOH will lose its direct relationship to the corresponding imaginary-part of possibly interacting underlying sources and can potentially become less stable. Therefore, it may be preferable to obtain iCOH directly from the cross-spectra as \({\rm E}[\Im \{ U\left( f \right){V^*}(f)\} ]\) (without normalization) or using a different normalization factor. Notice that a normalization is recommended in order to make fair comparisons across frequencies or among groups/conditions and to guarantee that values are in a controlled range, i.e. \(\left[ { - 1,1} \right]\) or \(\left[ {0,1} \right]\). Therefore, we introduce a more convenient normalization for iCOH in “Coherence and Imaginary Coherence Based Measures” section, which is used in the derivation of the new proposed method.

In the discussion so far, we have not mentioned a critical problem that is still present and is usually ignored in the literature; namely, the rejection of the real-part in current state-of-the-art iCOH-derived techniques causing the loss of information that is important for producing better FC maps. A direct consequence of this omission is that these measures show negligible values when truly connected processes have a zero or \(\pi\)-phase interaction. As a main objective in our work, we propose here a new method derived from the imaginary part that allows us to approximate and consider the missing real-part of the coherence, and therefore is sensitive to these interactions whilst being robust to VC.

### Coherence and Imaginary Coherence Based Measures

The modified iCOH version introduced in Eq. (14) is normalized conveniently using a denominator estimated by using the Hilbert’s transform (HT). Here, the function \(\mathcal{H}( \cdot )\) produces the analytical signal from the cross-spectral imaginary values, while the expected value of its magnitude is taken to produce a robust normalization factor. Notice that the HT of a cosine produces a sine and vice versa. Thus, our aim with this operation is to (approximately) recover the missing real-part content of possible underlying interacting sources when only the non-contaminated imaginary-part is used for the reasons discussed above. The theoretical proof on the effectiveness of this operation to recover the ignored real-part information is beyond the scope of this paper. However, we will empirically show in the next section the feasibility of this approach.

The PLI is obtained from the expected value of the signum of the imaginary part, \({\rm E}\left[ {\operatorname{sgn} \left( {\Im \left\{ {{U_n}\left( f \right)V_{n}^{*}(f)} \right\}} \right)} \right]\), being equivalent to \(\pm E\left[ {\operatorname{sgn} \left( {Phase\{ X\left( f \right)\} - Phase\left\{ {Y\left( f \right)} \right\}} \right)} \right]\), with a sign indeterminacy (for the example illustrated in Fig. 1, this indeterminacy refers to the sign of \({a_1}{b_2} - {a_2}{b_1}\)). Otherwise, wPLI is its weighted version in order to achieve more stability. Finally, we have included the lCOH for completeness in our study given its close similarity to iCOH measure, but also to explore the effect of using a different normalization that can either improve the sensitivity to detect FC or deteriorate performance in different VC or noise level scenarios.

### Envelope of the Imaginary Coherence (EIC) Operator

The HT is appropriate for constructing the envelope of narrow band signals in time domain. Wavelets analysis has been used in more general cases but both techniques have been used after a band-pass filtering to extract the oscillatory components within the frequency of interest in the signal. These techniques are applied indistinctively in signal processing and particularly for time–frequency decomposition analysis and there is no evidence to state the superiority of one approach over the other (Grandchamp and Delorme 2011). Our focus here is to recover the local envelope of the signal represented by the iCOH measure (in frequency domain), in an attempt to partially recover and incorporate the information contained in its accompanying real part, as we demonstrate next.

Figure 2 illustrates the EIC idea with a simple example. Suppose a 40 Hz sinusoidal function is weighted by a Gaussian belt (envelope curve) with mean of 0.5 s and standard deviation of 0.02 s (Fig. 2a). The envelope curve can be recovered exactly if the HT is used in the time domain to estimate the analytical signal (Fig. 2b). But instead, we may proceed to analyze the signal in the frequency domain using the FT and compute the envelope of the imaginary (EI) part as the absolute value of the analytical signal obtained by applying HT only to the imaginary part of the FT coefficients (see Fig. 2c). As shown in Fig. 2d, the EI curve quite closely resembles the magnitude spectral density (MSD) of the original signal even when the EI curve is computed using only the imaginary-part, which shows evidence of the practicability of using HT for recovering information that is lost when the real part is ignored like in the example (Fig. 2c). The case concerned in our study is similar to this simple example in relation to the imaginary-part of the coherence or cross-spectra. Following a similar reasoning, we heuristically support our case that EIC can recover missing information and thus provide more valuable content in comparison to other related iCOH-derived techniques.

In this example, the EI curve shows heavier tails compared to the MSD due to some border effects in the estimation of the analytical signal, but the important point is that the peak of both functions occurs nearby the same point. In the Supplementary Material, further evidences are provided to show the robustness of the EIC operator (Figs. S1 and S2). In particular, in Fig. S2, using the same signal as in Fig. 2, we demonstrate that if this type of envelope is computed only from the real part (blue curve in Fig. 2c), then the result is similar and we are again able to readily recover the missing information. Therefore, with respect to any frequency of interest, we can be confident that EIC can recover information about the FC strength that is lost when the real part is ignored, while being relatively robust with respect to the varying local phase and the waxing-waning behavior of the imaginary-part in the frequency domain.

### Simulation of Source Activity with Autoregressive and Neural Mass Models

To compare the performance of the coherence based measures, we prepared two types of simulations, one consisting of simple (linear) autoregressive model and the other based on more realistic nonlinear neural mass models (NMM) (Jansen and Rit 1995). These models simulate the interaction of activities among sources (e.g. \(x(t)\) and \(y(t)\) represented in Fig. 1), acting as ground truth, while their activities are only observed indirectly (e.g. \(u(t)\) and \(v(t)\) representing either EEG or MEG sensor recordings in Fig. 1). The values for the mixing coefficients are \({a_1}=0.75\), \({b_1}=0.5\), \({a_2}=0.5\) and \({b_2}=0.75\) [see Eqs. (1) and (2)]. Dynamics are generated by considering two different cases: (1) dependency given by influence from, say process \(y(t)\) onto \(x(t)\) in Fig. 1, mediated by a connectivity strength (\({C_{y \to x}} \ne 0\)) and information transmission delay, that can both be varied; and (2) independence of the processes, i.e. obtained by setting \({C_{y \to x}}=0\). To produce stable FC measurements, we simulate 1 s long epochs and 100 trials with same parameter values for each model, but using different noise replications. Although we present in this section a simulation framework for two regions, this can be straightforwardly extended to simulate any number of ROIs.

This system of SDDEs was numerically simulated using the Euler–Maruyama algorithm, which is appropriate for generating stochastic dynamics with Wiener processes (Higham 2001; Mao 2007; Touboul et al. 2012). Furthermore, this SDDEs system was also tested for analysis of stability and convergence as shown in Supplementary Material, Sect. 2. The stochastic integration was done with high time resolution (100 kHz or Δ*t* = 0.01 ms) and later downsampled to 250 Hz using MATLAB custom code which is also provided in the Supplementary Material. Finally, the signals \(x(t)\) and \(y(t)\) are generated as the local potentials, \(x\left( t \right)={x_2}\left( t \right) - {x_3}\left( t \right)\) and \(y\left( t \right)={y_2}\left( t \right) - {y_3}\left( t \right)\), according to the Jansen and Rit (1995) model.

### Realization of M/EEG Signals from Realistic Head/Source Model

We introduce in this section more complex and realistic brain simulations for generating synthetic M/EEG signals. First, we use the SPM anatomical template with pre-computed meshes for internal/external skull, skin and cortical surfaces. The cortical surface consists of 20,484 vertices and 40,960 triangles that provided a detailed representation of subject’s gyri and sulci formation as an excellent space for modelling activity and connectivity patterns in the brain. This choice is done for simplicity but it is also supported by the well known fact that pyramidal cells are the main contributors of M/EEG signals given their convenient pallisade structure and orientation within the cortical surface (Nunez and Srinivasan 2006). We also took the particular coordinates for an Elekta-Neuromag 102 magnetometers positions after corregistering appropriately with the anatomical image of a test subject, and computed a boundary element method leadfield using the Fieldtrip toolbox (Oostenveld et al. 2011). Although the realistic simulation study is limited to the MEG case, our conclusions can be extended to analogous EEG analysis given their similarities.

We shall consider several cases in this part of our simulation study with signals generated using the MVAR and stochastic NMM. In particular, we simulate 3 and 5 dipoles or ROIs with their interactions as shown in Fig. 3. Dynamics were generated by extending the set of equations that were introduced above for bivariate models. In the MVAR case, for 5 ROIs, five equations were used by directly extending from Eq. (22) using the same autoregressive coefficients, while the connectivity (\(C\)) and transfer delay (\(\delta\)) values were selected as \({C_{1 \to 2}}={C_{1 \to 3}}={C_{1 \to 4}}={C_{4 \to 5}}=0.1\), \({C_{5 \to 4}}= - 0.1\), \({\delta _{1 \to 2}}=1\), \({\delta _{1 \to 3}}=2\), \({\delta _{1 \to 4}}=3\), \({\delta _{4 \to 5}}=5\), \({\delta _{5 \to 4}}=5\). For 3 ROIs, \({C_{1 \to 2}}={C_{2 \to 3}}=0.1\), \({C_{3 \to 2}}= - 0.1\), \({\delta _{1 \to 2}}=2\), \({\delta _{2 \to 3}}=3\), \({\delta _{3 \to 2}}=3\). These values were selected to satisfy the stability condition (Lütkepohl 2005) while setting a sufficiently high value for the connectivity parameter.

For simulation using the SDDEs system, 30 and 18 equations are needed for the 5 and 3 ROIs, respectively (six equations per ROI). The NMM parameters are the same as in the bivariate simulation except for the connectivity strength (\(C\)) and transfer delay (\(\tau\)) values: \({C_{1 \to 2}}={C_{1 \to 3}}={C_{1 \to 4}}={C_{4 \to 5}}={C_{5 \to 4}}=200\), \({\tau _{1 \to 2}}=1\) ms, \({\tau _{1 \to 3}}=5\;{\text{ms}}\), \({\tau _{1 \to 4}}=10\;{\text{ms}}\), \({\tau _{4 \to 5}}=20\;{\text{ms}}\), \({\tau _{5 \to 4}}=20\;{\text{ms}}\) for 5 ROIs; and \({C_{1 \to 2}}={C_{2 \to 3}}={C_{3 \to 2}}=200\), \({\tau _{1 \to 2}}=1\;{\text{ms}}\), \({\tau _{2 \to 3}}=10\;{\text{ms}}\), \({\tau _{3 \to 2}}=10\;{\text{ms}}\) for 3 ROIs.

In parallel, as the data will be observed only in sensor space, we have defined ROIs in this space corresponding to the actual source ROIs in the 5 and 3 ROIs scenarios. For example, Fig. 4 shows for the case when the 6 nearest sensors (KNS = 6) to each underlying source are considered. Later, in a ROC analysis we will consider this number as a free parameter to avoid bias. Although the influences are mostly unidirectional as in Fig. 3, the represented bidirectional arrows in Fig. 4 show that in the sensor space the association between two regions, as commonly reflected by FC methods, lack directionality. More generally, transitivity rule applies to FC measures as discussed here, e.g. \(x \to y\) and \(y \to z\) interactions might also lead to \(x \to z\) estimation, which is not shown in the expected interactions in Fig. 4 for clarity reasons.

### ROC Analysis of Recovered FC Networks

For each particular FC measure, we defined the full FC map as the graph with nodes corresponding to the MEG sensors and edge weights corresponding to the magnitude of estimated FC values. This is a dense graph containing all the possible paired connections as all the weights have positive values. Using the full FC map as reference, a collection of sparse FC graphs \(m=0,1, \ldots ,M\) can be obtained using the \((100m{\text{/}}M){\text{th}}\) percentile to extract out those connections corresponding to higher weights, e.g. \(0{\text{th}}\), \(50{\text{th}}\) and \(100{\text{th}}\) percentiles denote the sparse FC maps corresponding to all, the 50% more relevant and none of the connections, respectively, as identified in the full FC map. Based on the simulated ground truth and selected K nearest sensors (KNS) ROIs, we can classify the sparse graph connections as true positive (TP) or false positive (FP), according to whether the identified connections connect two different predefined ROIs or not, for some given neighborhood size (e.g. ROIs as represented in Fig. 4 for KNS = 6). Consequently, we can obtain \(TP(m)\) and \(FP(m)\) measurements from each full FC map (see Figs. S12, S13 in Supplementary Material for an example of classification of full FC graph connections as TP/FP for increasing threshold values). To evaluate the performance of each estimated FC measure, we compute the classical receiver operator curve (ROC) and its area under the curve (\(0 \le AUC \le 1\)) statistics. The ROC is a non-decreasing graphical plot of the true positive rate (TPR) as a function of the false positive rate (FPR), where these quantities can be directly obtained from our analysis as \(TPR\left( m \right)=TP(m)/TP(0)\) and \(FPR\left( m \right)=FP(m)/FP(0)\).

## Results

### Proposed Normalization Procedure Improves iCOH Measure

Figure 5a, b show the iCOH and the EIC envelope obtained directly from the complex-coherence (\(iCO{H_1}\) and \(EI{C_1}\)) and using the new normalization procedure introduced here (\(iCO{H_2}\) and \(EI{C_2}\)), respectively [see Eqs. (13), (14), (20) and (21)]. These measures were compared using time-series for two interacting sources that were generated using the bivariate autoregressive model in “Simulation of Source Activity with Autoregressive and Neural Mass Models” section. We considered time delays from 4 to 48 ms (\(\delta \epsilon \left\{ {1, \ldots ,12} \right\}\), time step is 4 ms) to induce changes in the phase difference between the interacting processes.

It is evident that the classic coherence normalization produces excessive ripples in the imaginary coherence derived EIC function (lags from 9 to 12 in second row). Additionally, the unique peak that should be obtained for the main component of 20 Hz is not stable for all the considered lags in Fig. 5a. The \(EI{C_1}\) peak appears at the right side of the 20 Hz line for lags from 1 to 3 and left side for subplots corresponding to lags from 6 to 8, and in lags from 9 to 12 we can observe up to two peaks. However, when we apply the HT-derived normalization, as for the \(EI{C_2}\) measure, the peak and curves become stable and unimodal. Importantly, as shown in Fig. 5b, the \(EI{C_2}\) peak is now rightly centered at the 20 Hz (black dashed) line. Due to the superior results, from now onwards we will refer implicitly to the \(EI{C_2}\) version wherever we discuss EIC results. Since iCOH with the new normalization also produced negligible FC for zero and \(\pi\)-phase interactions, as the original iCOH and similar waxing-waning irregular behaviour, we will henceforth only use the original formulation (Nolte et al. 2004).

### EIC Is Most Robust Among iCOH Indices for Bivariate FC Analysis

The previous simulation based on a bivariate autoregressive model is also a fine example to show the robustness of EIC when compared to other iCOH related FC estimators. Similar to Fig. 5 example, Fig. 6 shows the iCOH and EIC curve but in separated rows, together with the ground truth, lCOH, PLI and wPLI estimators for the same simulated data. In the first row of Fig. 6, we show the golden true estimator (i.e. source-based coherence measure); whereas lCOH, iCOH, PLI, wPLI and EIC were estimated from the signals collected at the sensors (e.g. \(u(t)\) and \(v(t)\) represented in Fig. 1), the golden true estimator is the coherence measure that is obtained directly from the source signals (e.g. \(x(t)\) and \(y(t)\) in Fig. 1), which are unknown in a real scenario. The significance of FC values are determined by a threshold curve which was computed using the maximum (minimum) value statistics of FC values obtained from surrogate data (Lachaux et al. 1999). We used 1000 randomized samples in our simulation and computed this statistics for each frequency, separately.

Notice that at the communication delays \(\delta =5\) and \(\delta =11\), (i.e. almost 25 and 50 ms delays, respectively, and consequently with signals’ phase difference near zero or \(\pi\), modulus \(2\pi\)), lCOH, iCOH, PLI and wPLI produced negligible FC whereas EIC correctly reflected the true FC value. Also, except EIC the other FC methods exhibited a defective FC curve due to other negligible values that appeared, apparently, as a result of the interaction between ongoing and incoming oscillations. The most outstanding result shown is that EIC is the FC estimator that most closely resembled the golden true value as a consequence of the use of the HT operator to partially recover the ignored real part.

On the other hand, for data generated from two interacting sources with the SDDEs system introduced above [see Eq. (23)], we tested different transfer delays and connectivity values to study the relationship between these parameters over the FC estimation. Figure 7a shows that for iCOH related indices (i.e. lCOH, iCOH, PLI, wPLI and EIC), the estimated FC strength at 10.87 Hz increased proportionally for higher values of the connectivity parameter and reached the maximum value for \({C_{y \to x}}=500\). At the same time, their FC estimates were non-significant for the lower values, \({C_{y \to x}}=50\) and \({C_{y \to x}}=100\), according to the surrogate-based statistics (Lachaux et al. 1999). This is consistent with the golden true estimated curve (shown at the first row) which also gradually increased with higher values of the connectivity parameter being significant for values \({C_{y \to x}} \ge 50\). Moreover, COH and PLV showed higher values around 10.87 Hz independently of the simulated connectivity strength, which is related to VC as further supported in the next example. In general, it can be noticed that EIC seems to be the smoothest across frequencies and the most stable estimator compared to the other methods, and was remarkably sharper for the estimation of the FC strength at the dominant frequency (i.e. 10.87 Hz); though the other FC indices also showed good results for this type of simulation. In the Supplementary Material, we showed the effect of varying the delay on the phase difference for a fixed connectivity strength, \({C_{y \to x}}=200\), which also demonstrated the superior performance of EIC (see Fig. S9).

Interestingly, EIC seems to be affected by the surrogate-based statistics which overestimated the threshold at 10.87 Hz. The latter might be due to the failure to exactly recover the missing real part using the HT operator, particularly for estimating the normalization term. However, it may also arise as an effect of a highly stable synchronization which is characterized by an almost constant phase difference (Lachaux et al. 1999). The latter seems to be the more plausible explanation given that this situation did not appear for the EIC threshold curve shown in Fig. 6, and considering that the bivariate autoregressive model produces broad-band signals whereas the SDDE’s signals have narrow-band characteristics. For PLI and wPLI, this statistics also showed relative higher values whereas it showed smaller values for lCOH, which did not affect the results.

Next, we consider the specific case when there is no interaction by setting \({C_{y \to x}}=0\) in the simulation. In Fig. 7b it is clear that COH and PLV measures are prone to find spurious connections due to VC—as there should be none or very few points of the connectivity curve over the estimated cutoff. Otherwise, the iCOH related indices correctly measured the non-interaction. We shall henceforth narrow our study focusing mainly on iCOH indices based FC measures using more realistic simulated data.

Finally, we explored the performance of iCOH and EIC measures only, using signals that were obtained as narrow-band filtered Gaussian white noise. As presented in “Simulation of Source Activity with Autoregressive and Neural Mass Models” section, we simulated the interaction between two processes for different values of the communication delay, filter bandwidth, and SNR to create different situations. Figure 8 showed that iCOH and EIC effectively ignored instantaneous interactions (1st column, lag = 0) for the different SNR and signal bandwidth values. At the frequency of interest (15.625 Hz), iCOH showed the higher values for lag = 2 (2nd column, π/4. phase difference) and lag = 4 (3rd column, \(\pi /2\) phase difference). For lags = 8, 16, 32 (corresponding to \(\pi\), \(2\pi\) and \(4\pi\)-phase interactions) and higher bandwidth values (\(\varpi =2.0,5.0\;{\text{Hz}}\)), iCOH showed negligible values as expected with a clear full oscillation about 15.625 Hz for \(\pi\)-phase difference; interestingly EIC showed a very clear peak at 15.625 Hz at these values. The only cases where EIC failed to find any interaction are in very noisy scenarios (SNR = − 20 dB) and if the signal bandwidth is too small (\(\varpi =0.5,1.0\;{\text{Hz}}\) in the simulations). In this analysis, we used only iCOH as representation of the other iCOH indices because they similarly failed for zero or \(\pi\)-phase interactions as evidenced earlier in Fig. 6. As a complement, we showed in the Supplementary Material (Fig. S10) the significance of the above results using the surrogate-based statistics. In the latter case, we used the same settings but simulating 100 and 1000 trials.

### EIC and iCOH Are the Most Accurate in Sensor Space

Now, we demonstrate the methodology introduced here by using a synthetic MEG data generated with a large-scale model simulation as presented in “Realization of M/EEG Signals from Realistic Head/Source Model” section. In summary, we simulated MEG data for 100 trials using different MVAR’s or SDDEs’ generated signals as the dynamics for the selected 3 and 5 ROIs, as well as different realizations of Gaussian noise separately generated for each of the remaining cortical vertices and sensors, for modelling background activity and measurement noise. Specifically, the data for the ROIs, background and measurement noise signals, were added using Eqs. (25) and (26), to produce the MEG data that was used for the estimation of the FC methods under study. Additionally, we produced 100 Monte Carlo realizations of this process in order to compute the same amount of ROC curves and AUC statistics in the subsequent performance analysis of the FC measures. When creating the 100 Monte Carlo realizations, we kept the same SDDEs’ data that was generated for all the trials to reduce computational cost, whereas the MVAR’s simulated data as well as background and measurement signals were independently generated for each realization.

In the following analysis, we have varied the connectivity threshold in the min–max range to produce ROC curves (not shown) as discussed in “ROC Analysis of Recovered FC Networks” section, and allowed sensor ROIs size to vary in the range KNS = 1–10 (only shown for the range from KNS = 6 to 10). Figure 9 shows boxplots graphs summarizing the outcome of the AUC values for the 100 realizations to compare among the FC methods for analyses corresponding to 3 and 5 ROIs, using signals generated with VAR and SDDEs models, and different SNR levels corresponding to − 20, 0 and 20 dB. In general, the results for KNS = 1, 2 are poor for all FC methods due to a higher variance and lower mean AUC (not shown), possibly as a consequence of a weak correspondence of the interaction among sources nearest sensors and the estimated predominant connections. However, for KNS = 6 onwards the results are stable with non-significant differences among higher KNS values. Per row, the panels’ boxplots use the same y-axis scale so it can be possible to make some visual comparisons between the AUC values obtained for MVAR and SDDEs models; though it is also possible to visually find some differences among the outcome for the different SNR values, and also between 3 and 5 ROIs. This graphical outcome is better understood with the results shown in Tables 1, 2, 3 and 4 as discussed below.

Summary of non-parametric test #1, showing the SNR level(s) used in the simulations for which each FC measure (shown per row) produced higher significant AUC values for all possible combinations of ground truth scenarios and signal generation models (the latter two are interleaved across columns)

− 20 dB (\(\alpha =0.1\)) versus 0 dB (\(\alpha =0.5\)) versus 20 dB (\(\alpha =0.9\)) | ||||
---|---|---|---|---|

3 ROIs | 5 ROIs | |||

VAR (dB) | SDDE (dB) | VAR (dB) | SDDE (dB) | |

lCOH | 0 | − 20, 0 | 0 | − 20 |

iCOH | 0 | − 20 | 0 | − 20 |

PLI | 0 | − 20, 0 | 0 | − 20 |

wPLI | 0 | − 20 | 0 | − 20 |

EIC | 0 | − 20, 0 | 0 | − 20 |

Summary of non-parametric tests #2 (first half of the table) and #3 (second half)

Test #2: VAR’s versus SDDE’s signal generation models | Test #3: 3 versus 5 ROIs | |||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|

− 20 dB | 0 dB | 20 dB | − 20 dB | 0 dB | 20 dB | |||||||

3 ROIs | 5 ROIs | 3 ROIs | 5 ROIs | 3 ROIs | 5 ROIs | VAR | SDDE | VAR | SDDE | VAR | SDDE | |

lCOH | SDDE | SDDE | SDDE | VAR | SDDE | VAR | 3 ROIs | 3 ROIs | 3 ROIs | 3 ROIs | 5 ROIs | NS |

iCOH | SDDE | SDDE | VAR | VAR | SDDE | NS | 3 ROIs | 3 ROIs | 3 ROIs | 3 ROIs | 5 ROIs | 5 ROIs |

PLI | SDDE | SDDE | NS | VAR | SDDE | VAR | 3 ROIs | 3 ROIs | 3 ROIs | 3 ROIs | 5 ROIs | 3 ROIs |

wPLI | SDDE | SDDE | NS | VAR | SDDE | VAR | 3 ROIs | 3 ROIs | 3 ROIs | 3 ROIs | 5 ROIs | 5 ROIs |

EIC | SDDE | SDDE | VAR | VAR | NS | VAR | 3 ROIs | 3 ROIs | 3 ROIs | 3 ROIs | 5 ROIs | NS |

Score Win-W, Loss-L, Draw-D (W–L–D) results are shown for the pairwise comparisons among FC methods, together with the total accumulated W–L–D and points for the classical significance level α = 0.05 (first half) and Bonferroni’s multiple comparison correction (second half)

α = 0.05 | Bonferroni correction (N = 120 pairs) | |||||||||
---|---|---|---|---|---|---|---|---|---|---|

lCOH | iCOH | PLI | wPLI | EIC | lCOH | iCOH | PLI | wPLI | EIC | |

lCOH | X | 9–3–0 | 2–8–2 | 4–7–1 | 7–3–2 | X | 9–3–0 | 2–7–3 | 3–6–3 | 6–3–3 |

iCOH | X | X | 2–9–1 | 3–8–1 | 4–6–2 | X | X | 2–8–2 | 3–8–1 | 3–6–3 |

PLI | X | X | X | 6–2–4 | 11–1–0 | X | X | X | 4–2–6 | 10–1–1 |

wPLI | X | X | X | X | 10–1–1 | X | X | X | X | 8–1–3 |

EIC | X | X | X | X | X | X | X | X | X | X |

Total | 21–22–5 | 32–12–4 | 7–34–7 | 14–27–7 | 32–11–5 | 19–20–9 | 31–11–6 | 7–29–12 | 11–24–13 | 27–11–10 |

CL | 68 | 100 | 28 | 49 | 101 | 66 | 99 | 33 | 46 | 91 |

Chess | 23.5 | 34.0 | 10.5 | 17.5 | 34.5 | 23.5 | 34.0 | 13.0 | 17.5 | 32.0 |

Overall comparison among the FC methods: one versus all like in Athletics

VAR’s MEG generated signals | SDDE’s MEG generated signals | |||
---|---|---|---|---|

3 ROIs | 5 ROIs | 3 ROIs | 5 ROIs | |

SNR = − 20 dB (\(\alpha =0.1\)) | lCOH, iCOH, wPLI, EIC | iCOH | iCOH, wPLI, EIC | iCOH, EIC |

SNR = 0 dB (\(\alpha =0.5\)) | EIC | EIC | EIC | iCOH |

SNR = 20 dB (\(\alpha =0.9\)) | iCOH | iCOH | iCOH | iCOH |

We conclude our simulation study with a detailed statistical analysis of the differences among the simulated scenarios. Recall that in this part we are using five different FC measures (iCOH indices), three SNR levels (− 20, 0, 20 dB), two signals generation models (VAR and SDDEs), and two ground truth scenarios (3 and 5 ROIs). However, with respect to the outcome shown in Fig. 9, for each separated MC realization we are averaging the AUC values corresponding to KNS = 6–10 for all the possible simulated scenarios. For clarity, the analysis has been carried out as follows:

- 1.
Separately, for each combination of FC measure, signal generation model and ground truth scenario, compare AUC values for − 20 dB (\(\alpha =0.1\)) versus 0 dB (\(\alpha =0.5\)) versus 20 dB (\(\alpha =0.9\)).

- 2.
Separately, for each combination of FC measure, ground truth scenario and SNR level, compare AUC values for MVAR’s versus SDDEs’ FC outcome.

- 3.
Separately, for each combination of FC measure, signal generation model and SNR level, compare AUC values for 3 versus 5 ROIs’ outcome.

- 4.
Separately, for each combination of signal generation model, ground truth scenario and SNR level, compare AUC values for paired FC measures, i.e. lCOH versus iCOH versus PLI versus wPLI versus EIC.

The statistics used for tests 1–3 was the ranksum test which implements the two-sided Mann–Whitney U test (null hypotheses: equal medians) because the data used for computing each population samples differed between them. For test 4, we used the two-sided signed rank test (null hypotheses: median of paired samples differences is zero) because in this case the AUC samples were produced by applying different FC methods but each pair of matched samples was estimated from the same simulated data.

For test #1, as evidenced in Fig. 9 and Table 1, AUC values were significantly higher when SNR = 0 dB for MVAR model for all iCOH indices, whereas for SDDEs model the best noise level was SNR = − 20 dB for most cases. Notice that SDDEs’ generated signals have much narrower band compared to MVAR’s, which then causes the FC estimates in this frequency band to be more tolerant to lower SNR. The outcome of Table 2 for test #2 (first half) is somewhat complementary to the above results since for the lowest SNR level (− 20 dB) the highest AUC values were obtained when using SDDEs compared to MVAR model. For SNR = 0 or 20 dB, highest significant AUC values were achieved for MVAR when 5 ROIs were simulated in most cases, whereas for 3 ROIs and SNR = 20 dB, again the best results were achieved for SDDEs model. Interestingly, test #3 outcome for 3 versus 5 ROIs comparison (Table 2, second half) showed that highest significant AUC values were obtained when 3 ROIs were simulated for SNR = − 20 or 0 dB, which can be interpreted as an increased difficulty for recovering underlying FC networks when more ROIs/interactions are involved.

The comparison among the iCOH indices is conducted in test #4. We first do an overall summary of each pairwise comparison of two iCOH indices using an analogy with a sport competition where the FC method that produced highest AUC values is declared the winner of each comparison if the test is significant or both compared methods “draw” if it is non-significant. Then we can summarize across all 12 combinations (games) (i.e. 12 = 3 SNR levels × 2 generation models × 2 ground truth scenarios) where we have compared each pair. Table 3 shows these results including scores for the “competition” using two different scoring systems. We can observe that the two clear “winners” in this analysis are iCOH and EIC, which stand over the other FC measures. Moreover, Table 4 allows us to study in more detail the above result. In summary, we can observe that iCOH produced the best results for highest SNR (20 dB) whereas EIC was noticeably better for moderate SNR (0 dB). For the lowest SNR (− 20 dB), several methods but mainly iCOH and EIC produced better results.

## Discussion

In this study, we have proposed a new technique (EIC) to circumvent the heavy reliance of imaginary coherence based FC methods (lCOH, iCOH, PLI, wPLI) on the imaginary part of the cross-spectral or complex coherence. EIC was stated as the absolute value of the analytical signal that was estimated from the iCOH function in the frequency domain, which approximately rendered an iCOH envelope. As a result, EIC inherited the resilience against VC effects. We used a simplified representation of the EEG/MEG forward problem [Fig. 1, and Eqs. (1) and (2)], to demonstrate that the idea of using the imaginary part was rightly justified given that only the imaginary part of the cross-spectrum of two sensor signals is directly related with the imaginary part of the cross-spectrum of two possible interacting underlying sources as shown in Eq. (5). The real part is contaminated due to VC and, thus, it is usually ignored by techniques such as lCOH, iCOH, PLI and wPLI, even though it contains important information. One immediate negative effect is that these measures show negligible connectivity when the phase difference of interacting processes is near zero or \(\pi\)-phase (modulus \(2\pi\)) (Stam et al. 2007; Vinck et al. 2011; O’Neill et al. 2017).

Although the EIC method is estimated only from the imaginary term, we demonstrated that it is able to partially recover information from the real part (see Figs. 5, 6, 8). The main reason is that the EIC is based on the HT, which applied on the imaginary-part, is able to roughly produce its counterpart. Particularly, we showed with a simple example that the EIC curve can recover very well the magnitude spectrum that is, obviously, estimated using both the real and imaginary parts (Fig. 2). In practice, we have shown the superior performance of EIC versus other iCOH related indices using synthetic signals generated by bivariate autoregressive and SDDEs based NMM [see Eqs. (22) and (23)]. We extended these simulations and comparison framework for the study of more realistic simulations that produced synthetic MEG signals based on 3 and 5 simulated ROIs (Fig. 3), which in turn were used to evaluate the feasibility of FC analysis in sensor space using these techniques and a novel sensor-nearest ROIs based ROC analysis.

### EIC Versus Other iCOH Related Indices

The main advantage of imaginary coherence indices (lCOH, iCOH, PLI, wPLI, EIC) is their robust performance in VC situations, though the usual iCOH measure proposed in the literature may be negatively affected by an unstable normalization as discussed in this work (“Proposed Normalization Procedure Improves iCOH Measure” section). That can also be claimed as a drawback for lCOH method (Pascual-Marqui et al. 2011), which uses the real part of the coherence in the denominator (normalization term) and thus its scale could be affected as result of VC and noise. PLI and wPLI did not suffer the same problem due to their exclusive dependency on the phase difference part and proper normalizations.

On the other hand, the basic limitation of these measures is that they heavily rely on the imaginary part while directly ignoring any useful information that might be contained in the real part. As we demonstrated with simulations, the above methods effectively avoid spurious FC due to VC effects in the absence of true connectivity (Fig. 7b); however they also fail to capture true connectivity when that happen with zero or \(\pi\)-phase interactions (Figs. 6, 8). With the introduction of EIC we solved the latter problem to some extent; particularly we demonstrated with the simulation and results shown in Fig. 8 that EIC can capture true interactions despite of zero or \(\pi\)-phase interactions if the signals bandwidth is broad enough, while being robust to VC effects. With EIC method, we also highlighted the fact that lCOH, iCOH, PLI and wPLI are point-wise estimators given that their computations are made independently from single frequency entries. As can be seen in harmonic analysis of M/EEG signals, amplitude and phase tend to vary smoothly across frequency, thus taking into account such smoothness is essential to produce more robust estimators that can be more consistent, e.g. in noisy scenarios. From this perspective, EIC is potentially a more robust measure which exploits better the content of the imaginary part by implicitly using the HT [see Eq. (19)].

The impact of time-delay and the connectivity strength parameter on the coupling of two oscillators has been well studied in the literature (Dhamala et al. 2004; Gollo et al. 2014; Strogatz 2000). Here we studied both parameters using bivariate autoregressive and SDDEs based NMM and found that only the information transfer delay has a visible impact in the phase difference of interacting oscillators. The main effect of the connectivity strength is that at least a minimum value is required to guarantee synchronization of the ongoing activity as shown in Fig. 7a. However, the problem of negligible connectivity found by iCOH indices may appear in more complex scenarios and not only caused by time delay, which could hinder interpretation (see Fig. 6 and discussion therein). Our newly proposed EIC method was almost non-affected by a varying transfer delay as a consequence of exploiting the smooth variability across the frequency domain. Consequently, EIC showed more resilience than other iCOH-derived methods, which may translate into improved FC estimation for real M/EEG data analysis. We presented here the EIC measure based on the HT, but any operator that could produce a robust envelope can do a similar work. The HT is attractive because of its mathematical properties and it is particularly useful for computing the envelope of band-limited oscillators. Our objective was to “recover” the real part of underlying interacting processes’ signal complex coherence when we can rely only in a good estimation of its imaginary part. Assuming that the real-part could be approximately recovered by using and integrating the content of the imaginary part, the HT can produce the desired effect.

In other context, it has always been questionable to use linear estimators to study inherently nonlinear systems such as brain dynamics. In this sense coherence based measures enjoy a nice duality: on the one hand they are formulated directly using linear transforms; but on the other, they are also directly represented in the form of harmonics which are ideal for studying stationary signals regardless of their linear or nonlinear origins. Even in more complex nonlinear/non-stationary systems analyses, these techniques could find useful applications given their flexibility and properties based on established mathematical theory (Bendat and Piersol 2011; Oppenheim et al. 1983). We have tested the robustness of coherence based FC measures using autoregressive (linear) and neural mass (nonlinear) models. In the more complex scenario of nonlinear dynamics, we tested bivariate as well as interactions among 3 and 5 ROIs in realistic brain simulations. In general, iCOH indices showed robustness in nonlinear situations and, particularly, our proposed EIC method showed stable, accurate and superior results for most cases.

### FC Sensor Based Approach Validation with Large-Scale Synthetic Data

With a large-scale simulation that produced synthetic MEG data, a comparative framework among iCOH indices was presented to extend our study to a more complex and realistic scenario. We used MVAR and SDDEs based simulations to evaluate the performance of all these measures and, particularly, the validity of the FC approach in the sensor space. In general, we were able to show with different configurations based on signals generated using two ground truth scenarios (3 and 5 ROIs), two signals generation models (MVAR and SDDEs), and three SNR levels (− 20, 0 and 20 dB), together with a novel sensor-nearest ROIs based ROC analysis (“ROC Analysis of Recovered FC Networks” section), that the FC estimation in sensor space could provide a good approximation for the map of true connections, particularly with the use of iCOH and EIC techniques (see Fig. 9 and discussion therein).

As an important conclusion, we found that the original iCOH technique (Nolte et al. 2004) was one of the best methods of our FC analysis. This is surprising if we realize that PLI and wPLI are built on top of iCOH, and consequently we may expect superior results for PLI and wPLI. Specifically, iCOH is derived plainly from theoretical arguments whereas PLI and wPLI add extra information that empirically should improve their estimators, but these latter transformations seem to cause loss of valuable information as shown by our simulation results. In our study, lCOH was the method with the 3rd highest performance though “lagging significantly” behind of iCOH and EIC according to the results shown in Tables 3 and 4. Unlike PLI and wPLI, lCOH is strictly derived from theoretical arguments (Pascual-Marqui et al. 2011) without extra transformations. Otherwise, EIC also adds extra information to the iCOH content like PLI and wPLI, but in contrast it seems that the EIC use of HT can indeed improve the iCOH estimator, especially under conditions such as broad band signals with moderate noise level. Interestingly, our study shows that the presence of noise can “obscure the visibility” of more distant sensors [with lower scale factor; see Eq. (5)]. Hence, some moderate level of noise is necessary to render good results, whereas too much noise will mask the signal. This is the case for the results shown with the MVAR model where we obtained the best results for SNR = 0 dB but also for SDDE case which was more robust to noise than MVAR (Fig. 9; Tables 1, 2, 3, 4).

An essential step in our study was the use of a heuristic approach based on the ROIs created from sensors in the nearest neighborhood of simulated sources. An important justification for the latter is that the separation of a local dipolar source from nearby sensors has a worst negative impact than its particular dipole orientation (Hillebrand and Barnes 2002). Therefore, we assumed that the closest sensors signals contain a good representation of the underlying cortical neural dynamics. The use of this heuristic allowed us to develop a novel sensor-nearest ROIs based ROC analysis to evaluate the performance of FC methods under study. As demonstrated using this approach, the EIC method could be particularly useful to estimate true interactions among large areas, e.g. brain lobes, but it can also be important to detect short-range connectivity as well.

Furthermore, as evidenced by the significantly high ROC’s area under the curve values (Fig. 9), and the connectivity distribution of thresholded FC maps that were used for computing the ROC statistics (e.g. see Figs. S12, S13 in Supplementary Material), we believe that the estimation of sensor-based FC can help to disclose the map of brain region interactions (see also Ewald et al. 2012; Hardmeier et al. 2014; Nolte et al. 2004; Stam et al. 2007; Vinck et al. 2011). However, in our simulation study, we noted that recurrent connections, e.g. between ROIs 4 and 5 in the simulation with 5 ROIs, were most difficult to estimate. That may be due to the simulated counter-phase interactions, which can also negatively combine with the dipoles orientation, possibly causing a biased projection in sensor space that was worsened by the interaction of simultaneous active (anti-phase) dipoles. The latter observation is rooted on the fact that similar recurrent interactions, e.g. between ROIs 2 and 3 in the simulation with 3 ROIs, was much better estimated. This problem may be worsened in practice when using standard iCOH indices as they cannot capture well zero or \(\pi\)-phase (modulus \(2\pi\)) interactions as a consequence of simply relying on the imaginary part. As discussed here, in this situation the EIC method should produce more accurate FC maps according to our simulation analysis using narrow-band and broad-band interacting signals (see Fig. 8 and discussion therein). In general, we observed that iCOH and EIC can capture well the FC as reflected in sensor space; however we have to be cautious with the presence of false connections, which has a dramatic negative effect due to the lack of knowledge about the delimitation and extension of unknown interacting areas.

### Limitation of Sensor-Based FC Approach and Future Work

According to our results with simulated data, the sensor-based FC approach using iCOH indices has the potential to uncover medium and short-range connectivity; though the complex dynamics of the brain (e.g. nonlinear interactions among regions in deep/superficial and more/less central areas) are actually oversimplified in the connectivity maps observed at the sensor level, which obviously hinder the application of any technique. However, if we have a priori information of active brain regions, and if there is a clear and non-overlapped localization for these ROIs, then FC analysis based on imaginary coherence methods, particularly iCOH and EIC, can provide useful information about the interacting neural population as shown here.

An important alternative to sensor-based FC analysis is to estimate the source activity and its FC which will eventually allow us to combine information from different imaging modalities, including EEG and MEG’s magnetometers and planar gradiometers, as well as fMRI and other data. For the case of M/EEG data as discussed in this work, several issues still must be overcome to make critical progress in source-based FC analysis, i.e. control of signal leakage, signal mixing and other VC effects. Nevertheless, the generality of our proposed methodology and its robustness to VC, would facilitate its application to source-based FC analysis, which will be important to study normal and diseased brain activity.

## Notes

### Acknowledgements

This work was supported by the Northern Ireland Functional Brain Mapping Project Facility (1303/101154803), funded by Invest Northern Ireland and the University of Ulster.

## Supplementary material

## References

- Baccalá L, Sameshima K (2001) Partial directed coherence: a new concept in neural structure determination. Biol Cybern 84:463–474. https://doi.org/10.1007/PL00007990 CrossRefPubMedGoogle Scholar
- Bendat J, Piersol A (2011) Random data: analysis and measurement procedures. Wiley, New YorkGoogle Scholar
- Brookes MJ, O’neill GC, Hall EL, Woolrich MW, Baker A, Corner SP, Robson SE, Morris PG, Barnes GR (2014) Measuring temporal, spectral and spatial changes in electrophysiological brain network connectivity. Neuroimage 91:282–299CrossRefGoogle Scholar
- Buzsáki G, Draguhn A (2004) Neuronal oscillations in cortical networks. Science 304:1926–1929. https://doi.org/10.1126/science.1099745 CrossRefPubMedGoogle Scholar
- Cho J, Vorwerk J, Wolters CH, Knösche TR (2015) Influence of the head model on EEG and MEG source connectivity analyses. Neuroimage 110:60–77. https://doi.org/10.1016/j.neuroimage.2015.01.043 CrossRefPubMedGoogle Scholar
- Colclough GL, Brookes MJ, Smith SM, Woolrich MW (2015) NeuroImage A symmetric multivariate leakage correction for MEG connectomes. Neuroimage 117:439–448. https://doi.org/10.1016/j.neuroimage.2015.03.071 CrossRefPubMedPubMedCentralGoogle Scholar
- Dannhauer M, Lanfer B, Wolters CH, Knösche TR (2011) Modeling of the human skull in EEG source analysis. Hum Brain Mapp 32:1383–1399. https://doi.org/10.1002/hbm.21114 CrossRefPubMedGoogle Scholar
- Dhamala M, Jirsa VK, Ding M (2004) Enhancement of neural synchrony by time delay. Phys Rev Lett 92:74104. https://doi.org/10.1103/PhysRevLett.92.074104 CrossRefGoogle Scholar
- Ewald A, Marzetti L, Zappasodi F, Meinecke FC, Nolte G (2012) Estimating true brain connectivity from EEG/MEG data invariant to linear and static transformations in sensor space. Neuroimage 60:476–488. https://doi.org/10.1016/j.neuroimage.2011.11.084 CrossRefPubMedGoogle Scholar
- Fries P (2005) A mechanism for cognitive dynamics: Neuronal communication through neuronal coherence. Trends Cogn Sci 9:474–480. https://doi.org/10.1016/j.tics.2005.08.011 CrossRefPubMedGoogle Scholar
- Friston K, Harrison L, Daunizeau J, Kiebel S, Phillips C, Trujillo-Barreto N, Henson R, Flandin G, Mattout J (2008) Multiple sparse priors for the M/EEG inverse problem. Neuroimage 39:1104–1120. https://doi.org/10.1016/j.neuroimage.2007.09.048 CrossRefPubMedGoogle Scholar
- Gollo LL, Mirasso C, Sporns O, Breakspear M (2014) Mechanisms of zero-lag synchronization in cortical motifs. PLoS Comput Biol. https://doi.org/10.1371/journal.pcbi.1003548 CrossRefPubMedPubMedCentralGoogle Scholar
- Grandchamp R, Delorme A (2011) Single-trial normalization for event-related spectral decomposition reduces sensitivity to noisy trials. Front Psychol. https://doi.org/10.3389/fpsyg.2011.00236 CrossRefPubMedPubMedCentralGoogle Scholar
- Granger CWJ (1969) Investigating causal relations by econometric models and cross-spectral methods. Econometrica 37:424–438. https://doi.org/10.2307/1912791 CrossRefGoogle Scholar
- Gross J, Kujala J, Hamalainen M, Timmermann L, Schnitzler A, Salmelin R (2001) Dynamic imaging of coherent sources: studying neural interactions in the human brain. Proc Natl Acad Sci 98:694–699. https://doi.org/10.1073/pnas.98.2.694 CrossRefPubMedGoogle Scholar
- Guggisberg AG, Homma SM, Findlay AM, Dalal SS, Kirsch HE, Berger MS, Nagarajan SS (2008) Mapping functional connectivity in patients with brain lesions. Ann Neurol 63:193–203. https://doi.org/10.1002/ana.21224.Mapping CrossRefPubMedPubMedCentralGoogle Scholar
- Hämäläinen MS, Ilmoniemi RJ (1994) Interpreting magnetic fields of the brain: minimum norm estimates. Med Biol Eng Comput 32:35–42. https://doi.org/10.1007/BF02512476 CrossRefPubMedGoogle Scholar
- Hardmeier M, Hatz F, Bousleiman H, Schindler C, Stam CJ, Fuhr P (2014) Reproducibility of functional connectivity and graph measures based on the phase lag index (PLI) and weighted phase lag index (wPLI) derived from high resolution EEG. PLoS ONE 9:e108648. https://doi.org/10.1371/journal.pone.0108648 CrossRefPubMedPubMedCentralGoogle Scholar
- Haufe S, Ewald A (2016) A simulation framework for benchmarking EEG-based brain connectivity estimation methodologies. Brain Topogr. https://doi.org/10.1007/s10548-016-0498-y CrossRefPubMedGoogle Scholar
- Haufe S, Nikulin VV, Müller K-R, Nolte G (2013) A critical assessment of connectivity measures for EEG data: a simulation study. Neuroimage 64:120–133. https://doi.org/10.1016/j.neuroimage.2012.09.036 CrossRefPubMedGoogle Scholar
- Higham DJ (2001) An algorithmic introduction to numerical simulation of stochastic differential equations. SIAM Rev 43:525–546CrossRefGoogle Scholar
- Hillebrand A, Barnes GR (2002) A quantitative assessment of the sensitivity of whole-head MEG to activity in the adult human cortex. Neuroimage 16:638–650. https://doi.org/10.1006/nimg.2002.1102 CrossRefPubMedGoogle Scholar
- Huang M-X, Huang CW, Robb A, Angeles A, Nichols SL, Baker DG, Song T, Harrington DL, Theilmann RJ, Srinivasan R, Heister D, Diwakar M, Canive JM, Edgar JC, Chen Y-H, Ji Z, Shen M, El-Gabalawy F, Levy M, McLay R, Webb-Murphy J, Liu TT, Drake A, Lee RR (2014) MEG source imaging method using fast L1 minimum-norm and its applications to signals with brain noise and human resting-state source amplitude images. Neuroimage 84:585–604. https://doi.org/10.1016/j.neuroimage.2013.09.022 CrossRefPubMedGoogle Scholar
- Izhikevich EM, Edelman GM (2008) Large-scale model of mammalian thalamocortical systems. Proc Natl Acad Sci USA 105:3593–3598. https://doi.org/10.1073/pnas.0712231105 CrossRefPubMedGoogle Scholar
- Jansen BH, Rit VG (1995) Biological cybernetics in a mathematical model of coupled cortical columns. Biol Cybern 366:357–366CrossRefGoogle Scholar
- Jensen O, Kaiser J, Lachaux JP (2007) Human gamma-frequency oscillations associated with attention and memory. Trends Neurosci 30:317–324. https://doi.org/10.1016/j.tins.2007.05.001 CrossRefPubMedGoogle Scholar
- Lachaux J-P, Rodriguez E, Martinerie J, Varela FJ (1999) Measuring phase synchrony in brain signals. Hum Brain Mapp 8:194–208. https://doi.org/10.1002/(SICI)1097-0193(1999)8:4<194::AID-HBM4>3.0.CO;2-C.CrossRefGoogle Scholar
- Lanfer B, Jordanov IP, Scherg M, Wolters CH (2012a) Influence of interior cerebrospinal fluid compartments on EEG source analysis. Biomed Tech 57:623–626. https://doi.org/10.1515/bmt-2012-4020 CrossRefGoogle Scholar
- Lanfer B, Scherg M, Dannhauer M, Knösche TR, Burger M, Wolters CH (2012b) Influences of Skull Segmentation Inaccuracies on EEG Source Analysis. Neuroimage 62:418–431CrossRefGoogle Scholar
- Lopes da Silva F (2013) EEG and MEG: Relevance to neuroscience. Neuron 80:1112–1128. https://doi.org/10.1016/j.neuron.2013.10.017 CrossRefPubMedGoogle Scholar
- Lütkepohl H (2005) New introduction to multiple time series analysis. Springer, BerlinCrossRefGoogle Scholar
- Makeig S, Debener S, Onton J, Delorme A (2004) Mining event-related brain dynamics. Trends Cogn Sci 8:204–210. https://doi.org/10.1016/j.tics.2004.03.008 CrossRefPubMedGoogle Scholar
- Mao X (2007) Stochastic differential equations and applications, 2nd edn. Elsevier, AmsterdamGoogle Scholar
- Menendez GP, Andino RGonzalez, Lantz S, Michel G, Landis CM, T (2001) Noninvasive localization of electromagnetic epileptic activity. I. Method descriptions and simulations. Brain Topogr 14:131–137. https://doi.org/10.1023/A:1012944913650 CrossRefGoogle Scholar
- Nolte G, Bai O, Wheaton L, Mari Z, Vorbach S, Hallett M (2004) Identifying true brain interaction from EEG data using the imaginary part of coherency. Clin Neurophysiol 115:2292–2307. https://doi.org/10.1016/j.clinph.2004.04.029 CrossRefPubMedGoogle Scholar
- Nolte G, Ziehe A, Nikulin VV, Schlögl A, Krämer N, Brismar T, Müller K-R (2008) Robustly estimating the flow direction of information in complex physical systems. Phys Rev Lett 100:234101. https://doi.org/10.1103/PhysRevLett.100.234101 CrossRefPubMedGoogle Scholar
- Nunez PL, Srinivasan R (2006) Electric fields of the brain: the neurophysics of EEG. Oxford University Press, OxfordCrossRefGoogle Scholar
- Nunez PL, Srinivasan R, Westdorp AF, Wijesinghe RS, Tucker DM, Silberstein RB, Cadusch PJ (1997) EEG coherency I: statistics, reference electrode, volume conduction, Laplacians, cortical imaging, and interpretation at multiple scales. Electroencephalogr Clin Neurophysiol 103:499–515. https://doi.org/10.1016/S0013-4694(97)00066-7 CrossRefPubMedGoogle Scholar
- O’Neill GC, Barratt EL, Hunt BAE, Tewarie PK, Brookes MJ (2015) Measuring electrophysiological connectivity by power envelope correlation: a technical review on MEG methods. Phys Med Biol 60:R271. https://doi.org/10.1088/0031-9155/60/21/R271 CrossRefPubMedGoogle Scholar
- O’Neill GC, Tewarie P, Vidaurre D, Liuzzi L, Woolrich MW, Brookes MJ, (2017) Dynamics of large-scale electrophysiological networks: a technical review. Neuroimage. https://doi.org/10.1016/j.neuroimage.2017.10.003 CrossRefPubMedPubMedCentralGoogle Scholar
- Olde Dubbelink KTE, Hillebrand A, Stoffers D, Deijen JB, Twisk JWR, Stam CJ, Berendse HW (2014) Disrupted brain network topology in Parkinson’s disease: a longitudinal magnetoencephalography study. Brain 137:197–207. https://doi.org/10.1093/brain/awt316 CrossRefPubMedGoogle Scholar
- Oostenveld R, Fries P, Maris E, Schoffelen JM (2011) FieldTrip: open source software for advanced analysis of MEG, EEG, and invasive electrophysiological data. Comput Intell Neurosci. https://doi.org/10.1155/2011/156869 2011.CrossRefPubMedPubMedCentralGoogle Scholar
- Oppenheim A, Willsky A, Nawab S (1983) Signals and systems. Prentice-Hall, Englewood CliffsGoogle Scholar
- Palva S, Palva JM (2012) Discovering oscillatory interaction networks with M/EEG: challenges and breakthroughs. Trends Cogn Sci 16:219–229. https://doi.org/10.1016/j.tics.2012.02.004 CrossRefPubMedGoogle Scholar
- Pascual-Marqui RD (2007) Discrete, 3D distributed, linear imaging methods of electric neuronal activity. Part 1: exact, zero error localization. Neurosci Lett 485:198–203. https://doi.org/10.1016/j.neulet.2010.09.011 CrossRefGoogle Scholar
- Pascual-Marqui RD, Lehmann D, Koukkou M, Kochi K, Anderer P, Saletu B, Tanaka H, Hirata K, John ER, Prichep L, Biscay-Lirio R, Kinoshita T (2011) Assessing interactions in the brain with exact low-resolution electromagnetic tomography. Philos Trans R Soc A Math Phys Eng Sci 369:3768–3784. https://doi.org/10.1098/rsta.2011.0081 CrossRefGoogle Scholar
- Polanía R, Nitsche MA, Korman C, Batsikadze G, Paulus W (2012) The importance of timing in segregated theta phase-coupling for cognitive performance. Curr Biol 22:1314–1318. https://doi.org/10.1016/j.cub.2012.05.021 CrossRefPubMedGoogle Scholar
- Ringo JL, Doty RW, Demeter S, Simard PY (1994) Time is of the essence: a conjecture that hemispheric specialization arises from interhemispheric conduction delay. Cereb Cortex 4:331–343. https://doi.org/10.1093/cercor/4.4.331 CrossRefPubMedGoogle Scholar
- Rodriguez E, George N, Lachaux J-P, Martinerie J, Renault B, Varela FJ (1999) Perception’s shadow: long-distance synchronization of human brain activity. Nature 397:430–433. https://doi.org/10.1038/17120 CrossRefPubMedGoogle Scholar
- Schnitzler A, Gross J (2005) Normal and pathological oscillatory communication in the brain. Nat Rev Neurosci 6:285–296. https://doi.org/10.1038/nrn1650 CrossRefPubMedGoogle Scholar
- Schoffelen JM, Gross J (2009) Source connectivity analysis with MEG and EEG. Hum. Brain Mapp 30:1857–1865. https://doi.org/10.1002/hbm.20745 CrossRefGoogle Scholar
- Shaw C (1984) Correlation and coherence analysis a selective tutorial review of the eeg. Int J Psychophysiol 1:255–266. https://doi.org/10.1016/0167-8760(84)90045-X CrossRefPubMedGoogle Scholar
- Siems M, Pape A, Hipp JF, Siegel M (2016) Measuring the cortical correlation structure of spontaneous oscillatory activity with EEG and MEG. Neuroimage 129:345–355. https://doi.org/10.1016/j.neuroimage.2016.01.055 CrossRefPubMedGoogle Scholar
- Simoes C, Jensen O, Parkkonen L, Hari R (2003) Phase locking between human primary and secondary somatosensory cortices. Proc Natl Acad Sci 100:2691–2694. https://doi.org/10.1073/pnas.0437944100 CrossRefPubMedGoogle Scholar
- Singer W (1999) Neuronal synchrony: a versatile code for the definition of relations? Neuron 24:49–65. https://doi.org/10.1016/S0896-6273(00)80821-1 CrossRefPubMedGoogle Scholar
- Stam CJ, van Straaten ECW (2012) The organization of physiological brain networks. Clin Neurophysiol 123:1067–1087. https://doi.org/10.1016/j.clinph.2012.01.011 CrossRefPubMedGoogle Scholar
- Stam CJ, Jones BF, Manshanden I, van Cappellen van Walsum AM, Montez T, Verbunt JPA, de Munck, JC, van Dijk BW, Berendse HW, Scheltens P (2006) Magnetoencephalographic evaluation of resting-state functional connectivity in Alzheimer’s disease. Neuroimage 32:1335–1344. https://doi.org/10.1016/j.neuroimage.2006.05.033 CrossRefPubMedGoogle Scholar
- Stam CJ, Nolte G, Daffertshofer A (2007) Phase lag index: assessment of functional connectivity from multi channel EEG and MEG with diminished bias from common sources. Hum Brain Mapp 28:1178–1193. https://doi.org/10.1002/hbm.20346 CrossRefPubMedGoogle Scholar
- Stam CJ, de Haan W, Daffertshofer A, Jones BF, Manshanden I, van Cappellen van Walsum AM, Montez T, Verbunt JPA, de Munck, JC, van Dijk BW, Berendse HW, Scheltens P (2008) Graph theoretical analysis of magnetoencephalographic functional connectivity in Alzheimer’s disease. Brain 132:213–224. https://doi.org/10.1093/brain/awn262 CrossRefPubMedGoogle Scholar
- Strogatz SH (2000) From Kuramoto to Crawford: exploring the onset of synchronization in populations of coupled oscillators. Physica D 143:1–20. https://doi.org/10.1016/S0167-2789(00)00094-4 CrossRefGoogle Scholar
- Tallon-Baudry C, Bertrand O (1999) Oscillatory gamma activity in humans and its role in object representation. Trends Cogn Sci 3:151–162. https://doi.org/10.1016/S1364-6613(99)01299-1 CrossRefPubMedGoogle Scholar
- Touboul J, Hermann G, Faugeras O (2012) Noise-induced behaviors in neural mean field dynamics. SIAM J Appl Dyn Syst 11:49–81CrossRefGoogle Scholar
- Van Veen B, Van Drongelen W, Yuchtman M, Suzuki A (1997) Localization of brain electrical activity via linearly constrained minimum variance spatial filtering. IEEE Trans Biomed Eng 44:867–880. https://doi.org/10.1109/10.623056 CrossRefPubMedGoogle Scholar
- Van de Steen F, Faes L, Karahan E, Songsiri J, Valdes-Sosa PA, Marinazzo D (2016) Critical comments on EEG sensor space dynamical connectivity analysis. Brain Topogr. https://doi.org/10.1007/s10548-016-0538-7 CrossRefPubMedGoogle Scholar
- Vinck M, Oostenveld R, van Wingerden M, Battaglia F, Pennartz CMA (2011) An improved index of phase-synchronization for electrophysiological data in the presence of volume-conduction, noise and sample-size bias. Neuroimage 55:1548–1565. https://doi.org/10.1016/j.neuroimage.2011.01.055 CrossRefPubMedGoogle Scholar
- Vorwerk J, Clerc M, Burger M, Wolters C (2012) Comparison of boundary element and finite element approaches to the EEG forward problem. Biomed Tech 57:795–798Google Scholar
- Vorwerk J, Cho J, Rampp S, Hamer H, Thomas R, Wolters CH (2014) A guideline for head volume conductor modeling in EEG and MEG. Neuroimage 100:590–607CrossRefGoogle Scholar
- Wheaton La, Nolte G, Bohlhalter S, Fridman E, Hallett M (2005) Synchronization of parietal and premotor areas during preparation and execution of praxis hand movements. Clin Neurophysiol 116:1382–1390. https://doi.org/10.1016/j.clinph.2005.01.008 CrossRefPubMedGoogle Scholar
- Zygmund A (2002) Trigonometric series, 3rd edn. Cambridge University Press, CambridgeGoogle Scholar

## Copyright information

**Open Access**This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.