In this section, we describe the PAC indexes that we will evaluate in “Results”. There are two widely used methods: direct PAC estimator (dPAC) (Özkurt and Schnitzler 2011), and Modulation Index (MI) (Tort et al. 2010), which will serve as reference methods, and the method we propose here – eMI. Further, in this section, we consider a signal s(t) of duration T seconds. The low- and high-frequency oscillations are considered to be present in the same signal, to simplify the description. But, it is possible to use two signals as separate sources of information about low- and high-frequency oscillations. The presumed coupling is between the phase of a low-frequency oscillation \({\Phi }_{f_{P}}\) from the range of phase frequencies fP, and amplitude of a high-frequency oscillation \(A_{f_{A}}\). We denote the high-frequencies fA.
Reference methods
Direct PAC estimator
Mean Vector Length (MVL) proposed by Canolty et al. (2006), although commonly used, has been shown to be dependent on the absolute amplitude level of the high-frequency oscillation (Tort et al. 2010). The dPAC index circumvents this caveat by including a normalization factor (Özkurt and Schnitzler 2011):
$$ \text{dPAC}(f_{P}, f_{A}) = \frac{1}{\sqrt{T}} \frac{\left|{{\sum}_{t=0}^{T} A_{f_{A}}(t) \cdot e^{i{\Phi}_{f_{P}}(t)}}\right|}{\sqrt{{\sum}_{t=0}^{T} A_{f_{A}}(t)^{2}}} \\ $$
(1)
where \({\Phi }_{f_{P}}(t)\) is the instantaneous phase of low-frequency oscillation, and \(A_{f_{A}}(t)\) is the instantaneous amplitude of high-frequency oscillation. The low- and high-frequency oscillations are obtained by filtering the signal s(t) around, respectively, low-frequency fP and high-frequency fA using EEGLAB toolbox routine eegfilt.m which employs a two-way least-squares FIR filter. The order of the filter is equal to the number of samples in three cycles of the corresponding frequency band. The high-frequency filtration bandwidth is equal to twice the maximal fP in order to capture the spectral effect of coupling. The low-frequency filtration bandwidth is set to ΔfP. To avoid edge effects of filtration, the first and last second of data are excluded from further analysis. The comodulogram is obtained by applying (1) for each pair of frequency for phase fP and for amplitude fA. In this study, we used the MatlabⓇ implementation provided by the authors in the Supplementary materials (Özkurt and Schnitzler 2011).
Modulation Index
Modulation Index (MI) proposed by Tort et al. (2010) is also widely used for evaluation of PAC. This measure applies the Kullback–Leibler distance to infer how much an empirical high-frequency amplitude distribution over low-frequency phase bins deviates from the uniform distribution.
For each pair of frequencies for phase and for amplitude (fP, fA) the composite time series \([ {\Phi }_{f_{P}}(t),A_{f_{A}}(t) ] \) is produced. Instantaneous phase \({\Phi }_{f_{P}}(t)\) and amplitude \(A_{f_{A}}(t)\) are obtained in an analogous way as in case of dPAC. The only difference is that the first and last second of data after filtration are not excluded from further analysis. The range of phases 〈−π,π〉 is divided into J bins, and the elements of the composite time series are assigned to the corresponding phase bins. The distribution of high-frequency amplitude over low-frequency phase bins is given by:
$$ P_{(f_{P}, f_{A})}(j) = \frac{\langle A_{f_{A}}\rangle_{{\Phi}_{f_{P}}}(j)}{{\sum}_{k=1}^{J} \langle A_{f_{A}}\rangle_{{\Phi}_{f_{P}}}(k)} $$
(2)
where \(\langle A_{f_{A}}\rangle _{{\Phi }_{f_{P}}}(j)\) is the mean amplitude for phase bin j. The distance of this distribution form the uniform one is measured by Kullback–Leibler distance:
$$ \text{MI}(f_{P},f_{A}) = \frac{\log(J)+{\sum}_{k=1}^{J} P(k)\log [ P(k) ] }{\log(J)} $$
(3)
The comodulogram is obtained by applying equation (3) to each pair of frequency for phase fP and amplitude fA. In this study, we used the MatlabⓇ implementation based on Tort et al. (2010).
Surrogate data for reference methods
Below, we propose a methodology of producing surrogate data, which is proper both for continuous and epoched data and is suitable to estimate the statistical significance of comodulograms. To generate comodulograms corresponding to data with no-coupling, but with otherwise identical spectral properties, we propose to alter the process of obtaining the instantaneous phase \({\Phi }_{f_{P}}(t)\) for the surrogate data. The surrogate low-frequency oscillation is produced by filtering white Gaussian noise around fP with the same filters as for extracting the low-frequency oscillations in case of original data. Surrogate comodulograms are obtained by substituting the \({\Phi }_{f_{P}}(t)\) in formulas (1) and (3) with the instantaneous surrogate phase \({\Phi }^{s}_{f_{P}}(t)\).
Extended Modulation Index Analysis
The eMI analysis is based on the approach introduced by Tort et al. (2010) and recommended by Hülsemann et al. (2019) as it allows detection of a multi-modal coupling. eMI uses the time-frequency (TF) representation of the signal instead of initially proposed filtering to obtain information about the high-frequency oscillations and introduces an automated selection of frequencies for phase exhibiting oscillatory behavior. Moreover, it implements a heuristics for discrimination between reliable and ambiguous couplings.
The eMI toolbox provides additional information on the characteristic of the coupling and addresses most of the recommendations presented in Aru et al. (2015). In the following subsections, we describe the subsequent steps of the procedure. The outline of eMI is illustrated in Fig. 1. Panels a–c depict the key steps of computation and aligning of the original and surrogate time-frequency representations. Panels d–f show the three types of plots, which together inform on the existence and properties of the detected PAC.
Obtaining significant low-frequency oscillation
One of the recommendations by Aru et al. (2015) concerned the presence of meaningful oscillations. To ensure the significance of extracted low-frequency, first, we identify low-frequency spectral components that stand out against the background.
For this purpose, we create 200 repetitions of pink noise of the same length as the original signal. For each repetition, we calculate the Welch’s power spectral density estimate.Footnote 1 For each resulting spectrum, we estimate a background level by using piecewise cubic interpolationFootnote 2 between the spectral minima. Next, we produce a distribution of ratios of the pink noise spectrum to the background level for each frequency in the range of frequencies for phase.
The procedure of calculating the spectrum and its background described above is also applied to original data. For each frequency for phase fP, the spectrum to background ratio is obtained and compared with 95th percentile of the pink noise spectrum to background ratio distribution. If the original data ratio value is above this threshold, the frequency for phase fP is labeled as significant, and it undergoes further analysis.
For each significant frequency for phase fP the low-frequency oscillation is obtained using two-way, zero-phase shift, filtrationFootnote 3. The filter was designed as the bandpass Butterworth filter 4th order, with ΔfP bandwidth.Footnote 4 We will come back to the issue of selecting ΔfP later. The filtration of s(t) around fP yields the low-frequency oscillation \(s_{f_{P}}(t)\).
Identification of phase
The time positions of the subsequent maxima of \(s_{f_{P}}(t)\) are identified. The maxima with a prominence lower than 5% of the median of prominences of all maxima are excluded from further analysis, to focus the investigation only on the meaningful low-frequency oscillations. The subsequent analysis is divided into two paths: (A) leads to measuring PAC and building a comodulogram, and (B) results in labeling given coupling as Reliable or Ambiguous and producing auxiliary plots (Fig. 1d). The path (A) utilizes sections of the length ΔtA adjusted for each fP to contain 1 cycle, while in the second path (B) to contain 3 cycles of the low frequency to analyze the coupling in a broader context. The maxima occurring earlier than \(\frac {1}{2}\frac {3}{f_{P}}\) or later than \(T-\frac {1}{2}\frac {3}{f_{P}}\) are excluded from further analysis.
Beginning with the first maximum, the section of length ΔtA centered at this maximum is extracted from \(s_{f_{P}}(t)\). Subsequent sections are centered at such consecutive maxima so that the sections do not overlap (Fig. 1b). Afterward, those sections are averaged, yielding the averaged low-frequency oscillation \(SP^{A}_{f_{P}}(t)\):
$$ SP^{A}_{f_{P}}(t) = \frac{1}{N^{max}_{f_{P}}}{\sum\limits_{n_{f_{P}}=0}^{N^{max}_{f_{P}}} s_{f_{P}}\left( \left[\!t_{n_{f_{P}}}\!-\frac{\Delta t_{A}}{2}\!\right]:\left[\!t_{n_{f_{P}}} + \frac{\Delta t_{A}}{2}\!\right]\right)} $$
(4)
where \(N^{max}_{f_{P}}\) stands for number of non-overlapping sections centered at consecutive maxima at time \(t_{n_{f_{P}}}\) for a given low frequency fP. If \(N^{max}_{f_{P}}\) is lower than 3 the analysis for fP is abandoned. This restriction further supports the requirement of meaningful low-frequency oscillation.
The phase of the averaged low-frequency oscillation \(SP^{A}_{f_{P}}(t)\) is computed as the instantaneous phase \({\Phi }_{f_{P}}(t)\) of the analytic signal corresponding to \(SP^{A}_{f_{P}}(t)\).
In the path (B), the extraction of subsequent sections of \(s_{f_{P}}(t)\) is carried out in the same way but with the length of segments ΔtB. This results in averaged low-frequency oscillation \(SP^{B}_{f_{P}}(t)\) which is presented in auxiliary plots (Fig. 1d).
Obtaining the time-frequency representation of the signal
We use continuous wavelet transform (CWT) with Morlet wavelets to estimate the energy density of the signal s(t) in the TF domain (E(t,f)) for a specified range of amplitude frequencies fA and the whole time T (Goupillaud et al. 1984). Caiola et al. (2019) recommendations justify the choice of CWT. For a Morlet wavelet, with the wavenumber, w, and translation in time, u, the energy density in the time-frequency domain is given by:
$$ E(t,f) = \sqrt{\frac{2 \sqrt{\pi} f}{w}} \left| {\int}_{-\infty}^{\infty} s(u) e^{-\frac{1}{2} \left( \frac{2 \pi f(u-t)}{w} \right)^{2}} e^{i2\pi f(u-t)} du \right|^{2} $$
(5)
The presence of edge effects is the issue in the estimation of energy density distributions. In the case of CWT, it can be estimated that these effects will span a time interval equal to the effective support of the wavelet at the lowest frequency on the E(t,f) map on both sides of the analyzed section. To minimize this problem, we cut off fragments of length \(\frac {w}{\min \limits (f_{A})}\) distorted by edge effects.
Averaging TF map and signal with respect to maxima of low-frequency oscillation
The sections of length ΔtA are extracted from E(t,f) analogously to “Identification of phase” (Fig. 1b). Those sections are averaged, yielding the \(M^{A}_{f_{P}}(t,f)\) map (Fig. 1d):
$$ M^{A}_{f_{P}}(t,f) = \frac{1}{N^{max}_{f_{P}}}{\sum\limits_{n_{f_{P}}=0}^{N^{max}_{f_{P}}} E\left( \left[t_{n_{f_{P}}}-\frac{\Delta t_{A}}{2}\right]:\left[t_{n_{f_{P}}}+\frac{\Delta t_{A}}{2}\right],f\right)} $$
(6)
In the path (B) the sections of length ΔtB are extracted from E(t,f) and from s(t). Those sections are averaged, yielding the \(M^{B}_{f_{P}}(t,f)\) map and an averaged raw signal \(S^{B}_{f_{P}}(t)\) (Fig. 1d):
$$ M^{B}_{f_{P}}(t,f) = \frac{1}{N^{max}_{f_{P}}}{\sum\limits_{n_{f_{P}}=0}^{N^{max}_{f_{P}}} E\left( \left[t_{n_{f_{P}}}-\frac{\Delta t_{B}}{2}\right]:\left[t_{n_{f_{P}}}+\frac{\Delta t_{B}}{2}\right],f\right)} $$
(7)
$$ S^{B}_{f_{P}}(t) = \frac{1}{N^{max}_{f_{P}}}{\sum\limits_{n_{f_{P}}=0}^{N^{max}_{f_{P}}} s\left( \left[t_{n_{f_{P}}}-\frac{\Delta t_{B}}{2}\right]:\left[t_{n_{f_{P}}}+\frac{\Delta t_{B}}{2}\right]\right)} $$
(8)
\(M^{B}_{f_{P}}(t,f)\) and \(S^{B}_{f_{P}}(t)\) are presented in auxiliary plots (Fig. 1d). They carry additional information that is useful in interpretation of the results.
Surrogate data for eMI
Surrogate data should have the same time-frequency structure in the high-frequency range as the original signal, but any potential relation to a low-frequency phase should be removed. To achieve this goal, we altered the process of extracting and aligning sections of the TF maps (Fig. 1c).
The extraction and alignment of ΔtA sections of E(t,f) is similar as in “Averaging TF map and signal with respect to maxima of low-frequency oscillation” except of two differences. First, the locations are randomly displaced by adding a random value from a uniform distribution (in the range of half of the period of the low-frequency oscillation, i.e., \(-\frac {1}{2f_{P}}\) to \(+\frac {1}{2f_{P}}\)) to the locations of the original maxima. Second, before extracting each section, the map is either squeezed or stretched by a random factor sampled from a uniform distribution 〈0.9,1.1〉Footnote 5. The transformation of the map imitates the variability of the original frequency, fP, due to the nonzero bandwidth of low-frequency.
This step yields one averaged TF surrogate map, denoted \(M^{s}_{f_{P}}(t,f)\), for a given low frequency fP. To generate the distribution of possible \(M^{s}_{f_{P}}(t,f)\) maps which a piori represent no-PAC signals for a given low frequency fP, the above steps are repeated Ns times.
Construction of comodulogram
The next step is to quantify the modulation of high-frequency power by low-frequency phase. For each low-frequency fP the phase \({\Phi }_{f_{P}}(t)\) is obtained (as described in “Identification of phase”). For each high-frequency fA the power \(A_{f_{A}}(t)\) is obtained by \(M^{A}_{f_{P}}(t,f_{A})\). The PAC is evaluated by modulation index, utilizing the formulas (2) and (3). The comodulogram is obtained by repeating this operations for each pair of (fP, fA).
The procedure described above is also used to evaluate PAC for surrogate data. The only difference is that the power \(A_{f_{A}}(t)\) is obtained by \(M^{s}_{f_{P}}(t,f_{A})\). Repeating this operations for each pair of (fP, fA) and each s results in Ns surrogate comodulograms. Both original and surrogate MI values are centered around mean surrogate MI value for each pair of (fP, fA). This operation ensures the comparability between all pairs of (fP, fA) in comodulograms and thus enables us to use the extreme values statistic.
Polar phase histogram
For each pair of frequencies (fP, fA), we save the normalized-mean-amplitudes, \(P_{(f_{P},f_{A})}(j)\) (2), assigned to phase bins j. We also compute the threshold, \(th_{(f_{P},f_{A})}(j)\), corresponding to pPC percentile of the distribution of maximal values of surrogate data normalized-mean-amplitudes. We perform the thresholding for each pair of frequencies (fP, fA) separately. The above threshold values of \(P_{(f_{P},f_{A})}(j)\) will be used in creation of auxiliary plots.
For each separate region in comodulogram, the phase histogram is prepared using \(P_{(f_{P},f_{A})}(j)\). The count values are normalized by the number of all elements in a given region. The outline color of the phase histogram is consistent with the outline color of the corresponding region in the comodulogram (Fig. 1f).
Obtaining average spectrum and spectrum of average signal
A vital part of the heuristics of assessing given coupling as Reliable or Ambiguous are the average spectrum and the spectrum of an average signal (Fig. 1d). For each section of length ΔtB extracted from s(t) (as in “Averaging TF map and signal with respect to maxima of low-frequency oscillation”), the power spectral density is estimated for the whole amplitude-frequency range using periodogram with Blackman-Harris window. Next, all of those spectra are averaged, resulting in the average spectrum, \(AS_{f_{P}}(f)\), for each frequency for phase fP. The spectrum of average signal \(SA_{f_{P}}(f)\) for each frequency for phase fP is estimated for average signal \(S^{B}_{f_{P}}(t)\), using periodogram with the same parameters as above. Each spectrum is normalized to the total power within the whole amplitude-frequency range.
Assignment of Reliable/Ambiguous label
The problem of differentiating coupling with epiphenomenal and proper origins is very complicated. Here, we try to address it, making use of the requirement of the presence of meaningful oscillations proposed by Aru et al. (2015). One of the first steps in the analysis (“Obtaining significant low-frequency oscillation”) ensures the significance of the examined frequency for phase fP. To complete the requirement, we postulate that the statistically significant coupling is reliable when the local maximum in the spectrum within the frequency for amplitude and local maximum in the comodulogram is congruent. In other cases, the coupling should be considered ambiguous. Further, in this subsection, we describe the algorithm implementing this idea.
For each separate region of significant coupling (\(\langle {f^{m}_{A}}, {f^{n}_{A}} \rangle \)) and for each frequency for phase fP:
-
The frequency for amplitude with maximal MI value is determined (\(f^{MAX}_{A}\)).
-
If it is on the lower edge of frequency for amplitude range, it is an uncertain situation, because it is not possible to know if it corresponds to a falling slope of an MI peak in lower frequencies or there is no peak at all. Thus this region is labeled as ambiguous, and a warning is displayed.Footnote 6 In other cases, this region is still a candidate for a reliable coupling.
-
Calculate \({\Delta } f^{max}_{A}\)—the frequency span (full width at half maximum) of the wavelet envelope at frequency \(f^{MAX}_{A}\). The frequency range for a \(\langle f^{max}_{A}-\frac {1}{2}{\Delta } f^{max}_{A},f^{max}_{A}+\frac {1}{2}{\Delta } f^{max}_{A} \rangle \) corresponds to the maximum of comodulogram taking into account the frequency resolution of the wavelet. This range is the shaded area in the spectrum in Fig. 1d).
-
A local maximum in frequency for amplitude spectrum should be sought within sets union \({f^{M}_{A}} = \langle {f^{m}_{A}}, {f^{n}_{A}} \rangle \cup \langle f^{max}_{A}-\frac {1}{2}{\Delta } f^{max}_{A},f^{max}_{A}+\frac {1}{2}{\Delta } f^{max}_{A} \rangle \).
-
It has to be decided which estimate of spectral power to consider for finding a peak, potentially corresponding to the extremum of comodulogram: the average spectrum \(AS_{f_{P}}(f)\) or spectrum of average \(SA_{f_{P}}(f)\). When the coupled bursts of high-frequency oscillation are strongly synchronized, this high-frequency activity should be more pronounced in the spectrum of average signal than in the average spectrum. Otherwise, the average spectrum is a better choice to look for a peak.
To find out which type of spectrum contains a more pronounced peak, for each spectrum, the sum of power in frequencies (from \({f^{M}_{A}}\) range) where it exceeds the other spectrum is obtained. The spectrum with a higher sum is used for a search of a maximal power value in frequency range \({f^{M}_{A}}\). The frequency corresponding to this maximum is denoted as \(f^{MAX}_{A}\) (marked with a blue circle in spectrum in Fig. 1d). Only proper peaks (with descending slopes on both sides) are considered, hence if the spectrum in \(f^{MAX}_{A}\) is a top of a rising slope, the coupling is labeled as ambiguous.
-
If \(f^{MAX}_{A} \in \langle f^{max}_{A}-\frac {1}{2}{\Delta } f^{max}_{A},f^{max}_{A}+\frac {1}{2}{\Delta } f^{max}_{A} \rangle \) the coupling is labeled Reliable. Otherwise, the coupling is labeled Ambiguous.
After repeating all steps described above for each frequency for phase fP and each separate region of significant coupling, the whole comodulogram consists of areas of coupling labeled as Reliable or Ambiguous. At this point, it is possible to employ one more recommendation presented in Aru et al. (2015)—caution in the presence of harmonics. If there is a harmonic structure in the comodulogram and the coupling for a base frequency is labeled as ambiguous, the rest of harmonics is also labeled as ambiguous.
When the labeling process is done, all Ambiguous MI values are presented in the comodulogram in shades of gray. The color of shading of frequency ranges in spectrum \(\langle f^{max}_{A}-\frac {1}{2}{\Delta } f^{max}_{A},f^{max}_{A}+\frac {1}{2}{\Delta } f^{max}_{A} \rangle \) also reflects the coupling label. Finally, each separate Reliable and Ambiguous region in the comodulogram is outlined with a different color (Fig. 1e).
Presentation of the results: Comodulogram and Auxiliary plots
The eMI toolbox presents the results of the analysis in three types of plots. The overview is given in the comodulogram (e.g., Fig. 1e), where the statistically significant coupled pairs of frequencies are marked in color (Reliable) or shades of gray (Ambiguous). The intensity of the color corresponds to the value of MI evaluated according to Eq. 3. Each compact area is outlined with a colored line. The second type of output is the polar phase histogram (e.g., Fig. 1f). It displays phase histogram for each outlined region from the comodulogram—the color in the phase histogram corresponds to the color of the outline of the area in the comodulogram. Values are normalized by the number of all elements in a given area. A fragment of cosine plotted aside serves as an illustration of how a given phase is related to the time course of low-frequency oscillation. Polar phase histograms are useful when investigating phase relations between various areas on the comodulogram. The third type of output is a composite figure (e.g., Fig. 1d, panel B). It is especially useful for the interpretation of PAC. It consists of averaged scalograms covering 3 cycles of the low frequency. The black lines outline areas that correspond to the significant coupling in the comodulogram. Below the map, there are two types of signal: average signal \(S^{B}_{f_{P}}(t)\) in turquoise and average low-frequency oscillation \(SP^{B}_{f_{P}}(t)\) in black. On the right side, there are two spectra—average spectrum \(AS_{f_{P}}(f)\) in black and spectrum of averaged signal \(SA_{f_{P}}(f)\) in turquoise. The shaded frequency range \(\langle f^{max}_{A}-\frac {1}{2}{\Delta } f^{max}_{A},f^{max}_{A}+\frac {1}{2}{\Delta } f^{max}_{A} \rangle \) shows where the spectral peak should appear to consider it as congruent with the comodulogram. The automatically detected peak in the spectrum, \(f^{MAX}_{A}\), which is taken into account while deciding the congruence, is marked with a circle. The composite figures are produced for each significant frequency for phase fP. Besides the figures, the eMI toolbox stores the results in ⋆.mat files for eventual further analysis.
Statistics
When testing each of the \(\left (f_{P}, f_{A} \right )\) pairs of frequencies in a comodulogram, a multiple comparison problem arises. We use the extreme values statistics to take this into account. We generate Ns surrogate comodulograms and select the maximal value from each of them. These extreme values form a distribution. We estimate the threshold corresponding to the pC percentile from this distribution. The values in the original comodulogram exceeding the threshold pC indicate a significant PAC in the sense that they are less than \(1-\frac {p_{C}}{100}\) likely to be observed in the case of comodulograms of no-PAC signals.
Moreover, we record the corresponding percentile of surrogate data distribution (Pvals) for each value in the original comodulogram. Those Pvals allow controlling the False Discovery Rate (FDR) while presenting combined results from more than one time-epoch.
For eMI method to ensure that the coupling corresponds to a reliable augmentation in the time-frequency map, we reject those coupled pairs of frequencies (fP, fA), which do not exceed the \(th_{(f_{P},f_{A})}(j)\) threshold for any j.