Time domain measures of inter-channel EEG correlations: a comparison of linear, nonparametric and nonlinear measures
- First Online:
- Cite this article as:
- Bonita, J.D., Ambolode, L.C.C., Rosenberg, B.M. et al. Cogn Neurodyn (2014) 8: 1. doi:10.1007/s11571-013-9267-8
Correlations between ten-channel EEGs obtained from thirteen healthy adult participants were investigated. Signals were obtained in two behavioral states: eyes open no task and eyes closed no task. Four time domain measures were compared: Pearson product moment correlation, Spearman rank order correlation, Kendall rank order correlation and mutual information. The psychophysiological utility of each measure was assessed by determining its ability to discriminate between conditions. The sensitivity to epoch length was assessed by repeating calculations with 1, 2, 3, …, 8 s epochs. The robustness to noise was assessed by performing calculations with noise corrupted versions of the original signals (SNRs of 0, 5 and 10 dB). Three results were obtained in these calculations. First, mutual information effectively discriminated between states with less data. Pearson, Spearman and Kendall failed to discriminate between states with a 1 s epoch, while a statistically significant separation was obtained with mutual information. Second, at all epoch durations tested, the measure of between-state discrimination was greater for mutual information. Third, discrimination based on mutual information was more robust to noise. The limitations of this study are discussed. Further comparisons should be made with frequency domain measures, with measures constructed with embedded data and with the maximal information coefficient.
KeywordsEEG Quantitative EEG Pearson product moment correlation Spearman rank order correlation Kendall rank order correlation Mutual information
The connectivity of the human central nervous system is its most distinctive feature. Classically connectivity was investigated anatomically. An alternative view emerged in the twentieth Century which emphasized the movement of information. Like many concepts, the seemingly straightforward idea of connectivity was found to be far more complicated than originally anticipated when it was examined with sufficient care. This can be seen in the report of the 2002 Functional Connectivity Workshop (Lee et al. 2003). Three distinct conceptualizations of connectivity have emerged: anatomical, functional and effective. Anatomical complexity might seem to be the least problematical, and arguably it is, but nonetheless complications present themselves. A complete anatomical description requires not merely knowledge of geometrical proximity but an understanding of receptor subtypes and the availability of neurotransmitters (Lee et al. 2003). Functional connectivity is defined as the “temporal correlations between spatially remote neurophysiological events” (Friston et al. 1993a), and effective complexity is defined as “the influences that one neural system exerts over another either directly or indirectly” (Friston et al. 1993b). Horowitz (2003), using the word “elusive,” found that all three conceptualizations of connectivity present subtleties of definition and that these problems were compounded when an attempt was made to integrate results obtained from different observational technologies. His analysis led to three conclusions. First, “we should think of functional (and effective) connectivity not as a single concept or quantity, but rather as forming a class of concepts with multiple members.” Second, “functional and effective connectivity must be operationally defined by each investigator who evaluates these quantities.” Third, “it is crucial to relate each of the macroscopic definitions to an underlying neural substrate.”
Fingelkurts et al. (2005) concurred in recognizing that theoretical and methodological clarifications are needed to bring precision to the analysis of CNS connectivity. They argue that the time scale of neuroanatomical change is such that an examination of anatomical connectivity cannot provide a basis for a dynamical investigation of perceptual and cognitive processes. They further argue that effective connectivity is identified by first establishing functional connectivity and combining it with a model specifying the causal links between participating units. They therefore conclude that “functional connectivity is the most central and challenging of the three conceptions of brain connectivity for theories about neural interactions.” Given the millisecond time scale of dynamical behavior in the central nervous system, Fingelkurts et al. argue for an essential role of EEG and MEG in investigations of functional connectivity. We concur, and the analysis of temporal correlations of EEG signals is the focus of this contribution. Four time domain procedures for quantifying correlations are compared. A physiological criterion, the ability to discriminate between behavioral states, is used as an adjudicating criterion. Additional measures that should be incorporated in an expanded study are considered in the “Discussion” section of this paper.
When using scalp EEG signals in the analysis of functional connectivity an additional question should be considered. Can the analysis be conducted with the original scalp signals, or is it essential to transform these signals to provide an estimate of the current source density? It is not our present purpose to participate in this debate. Conclusions about the comparative effectiveness of different measures for identifying correlations in scalp signals, which is our objective, will be applicable to calculations with current source density estimates. Two additional observations in this regard can be made. First, in practice, calculations should be performed with both original voltage signals and with transformed signals, and the results should be compared. Second, we should bear in mind Horwitz’s very valuable observation that each investigator should define the operational definition of connectivity being implemented.
The earliest example of interregional EEG correlation measurement that has come to our attention is Imahori and Suhara (1949 cited by Gevins 1987) where hand calculated autocorrelations of short EEG segments were presented. The use of autocorrelation and cross-correlations to study electroencephalograms is reported to have been suggested by Norbert Wiener in 1949 to a group of researchers at the Massachusetts General Hospital (Barlow 1997). Among this group were Mary Brazier and James Casby who in 1950 started their pioneering work on correlation analysis of the EEG using an electronic digital correlator at the Massachusetts Institute of Technology (Brazier and Casby 1952). An important continuing application of cross-correlation calculations is the correlation of EEGs with templates of averaged event related potentials where the procedure is used to locate single trial event related potentials, ERPs, in background EEG signals (McGillem and Aunou 1987 reviewed by Spencer 2005). This procedure was introduced by Woody (1967) to detect epileptic spikes. It was first applied to ERP signals by Kutas et al. (1977). This method continues to be applied in the analysis of epileptic seizures (Filligoi et al. 2011) and in the construction of brain computer interfaces (Cabestang et al. 2007).
The study of CNS correlations evolved to include more sophisticated measures. An important step in this evolutionary process was the introduction of mutual information, a nonlinear measure of correlation, to the analysis of EEGs. The earliest application of mutual information in electroencephalography that we have seen is Callaway and Harris (1974) where it was called the coefficient of information transmission. In this application, mutual information was not calculated directly from voltage time series. Digitizing at 250 Hz, each entry was coded for polarity (positive or negative) and derivative (increasing or decreasing). Callaway and Harris showed that a reading task increased occipital to left hemisphere coupling while a visual processing task increased occipital to right hemisphere coupling. In a subsequent publication (Yagi et al. 1976), Callaway and his colleagues investigated the sensitivity of this measure to epoch length and sampling frequency. Mars and Lopes da Silva (1987) showed that mutual information can identify significant correlations that are not detected by linear measures. Other applications of this measure in electroencephalography were published by Xu et al. (1997), Albano et al. (2000) and Chen et al. (2000). A limiting factor in use of mutual information has been data requirements for the estimation, computational times and uncertainty about the accuracy of the estimate. This point is addressed presently.
Pathological conditions associated with altered functional connectivity (representative examples)
Ponten et al. (2007)
Intra-arterial amobarbital injection
Douw et al. (2010)
Autism spectrum disorder
Mullen et al. (2011)
Grefkes and Fink (2012)
Traumatic brain injury
Correlation measures assessed
Four time domain measures for quantifying relationships between time series are compared in this investigation: Pearson product moment correlation, Spearman rank order correlation, Kendall rank order correlation and mutual information. These measures will be used to quantify between-channel correlations in EEGs recorded from healthy participants in two behavioral conditions: eyes open, no task and eyes closed, no task. The psychophysiological utility of each measure is assessed by determining its ability to discriminate between these conditions.
A brief presentation of the mathematical properties of these measures is given in the “Appendix”. Qualitative descriptions are given here. The Pearson product moment correlation quantifies linear correlations between variables. The Spearman rank order correlation is the product moment correlation of ranks, and the Kendall rank order correlation uses the relative ordering of ranks. The mutual information of two time series is the average number of bits of each that can be predicted by measuring the other. The numerical estimation of mutual information can be computationally demanding, and the accuracy of the estimate can be sensitive to the algorithm used. This was demonstrated by the comparison studies conducted by Quian Quiroga et al. (2002) and by Duckrow and Albano (2003). In a valuable study, Quian Quiroga et al. compared five measures of interhemispheric correlations (nonlinear dependencies, phase synchronization, mutual information, cross correlation and coherence). Except for mutual information, the measures showed qualitatively similar results, and, importantly the computations identified interhemispheric dependencies that were not apparent on conventional visual examination performed by a Board certified electroencephalographer. Quian Quiroga et al. used a fixed bin-width histogram method for estimating the joint probability distributions. Estimating the joint probability distribution is a critical element in the estimation of mutual information (see the “Appendix” for the mathematical details). Using the same data, Duckrow and Albano used the Fraser–Swinney (1986) adaptive partition when estimating joint probability distributions. This computation of mutual information produced results consistent with the other measures. Several methods for estimating mutual information are reviewed in Khan et al. (2007). In the calculations presented here, we used the algorithm constructed in Cellucci et al. (2005). This is a computationally efficient procedure. In test calculations it requires 0.5 % of the computation time required by the Fraser–Swinney algorithm (comparison calculations reported in Cellucci et al. 2005). Also, in contrast with other algorithms, the Cellucci algorithm incorporates an explicit calculation of the probability of the null hypothesis of no predictive relationship between the two variables. This statistical validation is particularly important in calculations with noisy psychophysiological data.
Correlation calculations (modified from Cellucci et al. 2005)
Normally distributed random
r = −0.0037
r = 0.9934
r = 0.0001
PNULL = 0.7112
PNULL ≈ 0
PNULL = 0.9912
ρS = −0.0040
ρS = 0.9936
ρS ≤ 10−4
PNULL = 0.6854
PNULL ≈ 0
PNULL = 0.9928
τ = 0.0027
τ = 0.9270
τ ≤ 10−5
PNULL = 0.6845
PNULL ≈ 0
PNULL ≈ 0.9989
Mutual information (bits)
I = 0.1356
I = 2.9186
I = 3.0304
Mutual information PNULL
PNULL = 0.7851
PNULL ≈ 0
PNULL ≈ 0
Two conclusions follow from the examples considered here. (1) Nonlinear measures should be used in combination with linear and nonparametric measures. (2) Evidence for time domain correlation should be examined as a function of epoch duration.
The University’s Institutional Review Board reviewed and approved all procedures involving human subjects. Informed consents were obtained from each participant. There were thirteen participants. Participants were healthy adults without a history of head injury or serious psychiatric illness. Multichannel monopolar recordings, referenced to linked earlobes, were obtained from FZ, CZ, PZ, OZ, F3, F4, C3, C4, P3, and P4 using an Electrocap and Sensorium EPA-6 amplifiers. Vertical and horizontal eye movements were recorded from electrode sites above and below the right eye and from near the outer canthi of each eye. Artifact corrupted records were removed from the analyses. Artifact corruption was defined as an amplitude difference greater than 120 μV peak-to-peak within 500 msec or a blink in the EOG channel. All EEG impedances were less than 5 KOhm. Signals were amplified, Gain = 18,000, and amplifier frequency cutoff settings of 0.03 and 200 Hz were used. Signals were digitized at 1,024 Hz using a twelve-bit digitizer. Multichannel records were obtained in two conditions: eyes closed, resting and eyes open, resting. Continuous artifact-free records were obtained from each subject in the two conditions (eyes open and eyes closed). Given the results shown in Fig. 2, measures were calculated as a function of epoch duration (1–8 s).
Comparing measures in between-state discriminations
The psychophysiological utility of each measure was assessed by determining its ability to discriminate between eyes open, no task and eyes closed, no task conditions. For concreteness of presentation, the experiment is described by considering the first measure, the product moment correlation which is denoted by r. The EEGs are ten-channel recordings. Thus for a single participant there are 45 distinct channel pairs. The correlation between channel i and channel j, rij, is measured in each condition to give 45 values of (rij)closed and 45 values of (rij)open. The operational question becomes can we discriminate between states by comparing (rij)closed against (rij)open? As noted above, there were thirteen participants in the study. This gives 585 (number of participants × number of channel pairs) (rij)closed versus (rij)open pairs. They are compared in a paired t test. The test produces a value of t and the corresponding probability of the null hypothesis. In this application the null hypothesis supposes that there is no difference in between-channel correlations in the eyes open and eyes closed correlation. A high value of t, and hence a low value of PNULL, indicates a successful discrimination.
This process is performed for all four measures. As operationalized in this study, the comparative assessment of these measures of correlation can now be stated in a single question. Which measure gives the largest value of t and lowest values of PNULL? Concerns have been expressed (Gevins 1987) about the amount of data required to estimate mutual information. The calculations have, therefore, been repeated for 1, 2, …, 8 s epochs.
Robustness to noise
At SNR = 10 dB all four measures failed to discriminate between conditions when 1 s epochs were examined. All four measures successfully made the discrimination for greater epoch lengths, but as in the case of uncorrupted signals, a greater statistical separation was obtained with mutual information.
At higher noise levels (lower SNR) the degree of between state discrimination as quantified by PNULL is reduced, but the pattern observed with SNR = 10 dB is preserved. Specifically, all four measures fail to discriminate between eyes closed and eyes open with 1 s epochs. All four measures successfully discriminate at longer epochs, and the degree of discrimination obtained with mutual information is greater than that observed with the other three measures.
Three results were obtained in these calculations. First, a nonlinear measure, mutual information, effectively discriminated between states with less data, specifically a 1 s epoch, when other measures failed to discriminate between conditions. Second, at all epoch durations tested, the measure of between-state discrimination was greater for mutual information. Third, discrimination based on mutual information was more robust to noise.
The limitations of this study should be recognized. Three points should be addressed. First, the study is based on signals obtained from thirteen participants. Because the method that is best for one database is not necessarily best in all cases, a different outcome may be obtained with different data. Second, in this study the test criterion was the ability to discriminate between the eyes-open and eyes-closed condition. It is possible that a different measure, a measure other than mutual information, would be more effective if a different test criterion was implemented. Third, this study was limited to a comparison of four time domain measures of correlation. Several other measures have been used to quantify correlation and should be considered. Reshef et al. (2011) have constructed a maximal information criterion that has some properties in common with mutual information. Additional methods include coherence (Nunez et al. 1997, 1999), phase locking index (Stam et al. 2009; Hurtado et al. 2004; Sazonov et al. 2009), imaginary coherency (Stam et al. 2007a, b; Nolte et al. 2004) and phase lag index (Stam et al. 2007a, b, 2009). As outlined by several authors (Cao and Slobounov 2010; Schiff 2005; Guevara et al. 2005), care must be exercised in the application of these procedures. Recently more sophisticated procedures for assessing correlation have been investigated. Stam and van Djik (2002) and Wendling et al. (2009) have used methods based on embedded data (Takens 1981) to quantify correlation. Cao and Slobounov (2010) analyzed nineteen channel resting EEGs in a three step process. First, independent component analysis (Hyvärinen et al. 2001) was used to identify independent processes. Second, a source reconstruction algorithm (standardized low resolution electromagnetic tomography, sLORETA (Pascual-Marqui et al. 2002; Pascual-Marqui 2002) was used to identify cortical regions associated with functional activity. Third, using this localization, graph theory was used to quantify connectivity in the resting state. These procedures should be incorporated into an expanded comparison study. The Wendling et al. (2009) results obtained with computationally generated data indicated that no single procedure was best for all cases. This is almost certainly true for biological data. The importance of using more than one measure was further indicated by the results of Dauwels et al. (2010) who found that different measures of synchronization were not well correlated. They concluded that “therefore they each seem to capture a specific kind of interdependence.” Our best recommendation is to perform functional connectivity studies with several methods including both original scalp signals and estimates of current source density and compare the results.
It is possible to use mutual information calculations in synchronization studies. In this experimental design, the original EEG signal is bandpass filtered into specified frequency bands. Given the restricted spectrum of the filtered signal, it is possible to estimate its phase by calculating the Hilbert transform (Boashash 1992; Pikovsky et al. 2001). Mutual information calculations can then determine if there is a nonrandom relationship between phase functions measured at different electrode sites.
While recognizing the limitations of this study, the results suggest that when implemented with an adaptive partition of the joint probability distribution, mutual information provides an effective noise-robust measure of correlation. This result may extend beyond functional connectivity studies to include analysis of CNS causal networks and analysis of CNS small world networks, which are briefly considered.
Investigation of CNS causal relationships, the time dependent directional movement of information, may be important in the study of traumatic brain injury. As previously noted, Goldstein’s pioneering work on the behavioral neurology of traumatic brain injury led him to conclude that restitution of function following injury resulted from adaptation rather than from repair. This suggests that post-injury alteration of causal networks may provide a sensitive measure of altered CNS function following injury. While measures like correlation, coherence and mutual information can be used to establish the presence of correlative relationships between signals they do not provide any information about the direction of information movement. Additional procedures must be introduced. In most cases, the quantitative assessment of causal relationships between variables is constructed on the following idea. If measuring variable X improves the prediction of variable Y, then Y is, in this limited operational sense, causally dependent on X. It should be stressed that this relationship is not necessarily unidirectional. It can also be the case that with the same data, measuring Y also improves the prediction of X. This conceptualization of causality appears in Wiener (1956) and may be original with Wiener.
An early implementation of this operationalization of causality was published by Granger (1969) in the econometrics literature and popularized by Sims (1972). Granger causality is constructed using linear regression models. If past values of X are useful in predicting the current value of Y in a linear regression, then X is said to be a causal drive of time series Y. As with any statistical procedure, causality tests based on linear regression must be implemented with care. A growing literature has identified circumstances that lead to spurious identification of linear causality (Breitung and Swanson 2002; He and Maekawa 2001).
An extension of mutual information may provide a noise-robust measure of causality. Recall that the mutual information of time series X and Y, I(X, Y) is the average number of bits of one variable that can be predicted by measuring the other. Mutual information can be shown to be symmetrical, that is I(X, Y) = I(Y, X). Therefore while mutual information can establish the presence of a nonrandom relationship between time series, it cannot identify causal relationships. However, a time lagged mutual information in which one of the two variables is time shifted can be used to determine, if, for example, measuring variable X in the past allows prediction of future values of variable Y. We can shift time series X by lag τ and calculate I(Xτ, Y) as a function of τ. Similarly, we can calculate I(X, Yτ). If measuring Xτ allows better prediction of Y, than the other way around, then it can be argued that information is transferred from X to Y. The magnitude of the mutual information and the time lag which produces the greatest value can be used to quantify both the magnitude of the information transfer and the time delay associated with that transfer. A number of investigators have proposed using lagged mutual information to investigate information transfer in distributed systems (Kaneko 1986; Vastano and Swinney 1988; Albano et al. 1999). The procedure has a long history in electroencephalography. Inouye et al. (1983) used an “entropy analysis” which was what would now be described as directed mutual information to quantify the direction of information flow and concluded that the dominant longitudinal direction of alpha activity was anterior to posterior. A subsequent publication (Inouye et al. 1993) used directed mutual information to show change in information flow during a cognitively demanding arithmetic task. Mars and his colleagues (Mars and Lopes da Silva 1983; Mars et al. 1985) used mutual information to quantify time delays in the transmission of epileptic seizures. Several other investigators have used lagged mutual information to quantify between-channel information transfer in multichannel EEGs (Xu et al. 1997; Chen et al. 2000; Lopes da Silva 1987). Schreiber (2000), however, has presented valuable results which produced examples where standard lagged mutual information failed to detect information exchange. This motivated the construction of a related measure, transfer entropy, that successfully identified these relationships. The Schreiber results should be considered in the light of the previously cited Duckrow and Albano (2003) calculations that demonstrated the sensitivity of mutual information calculations on the choice of algorithm. This may have been a factor in the Schreiber study. Madulara et al. (2012) calculated transfer entropy using the EEG records analyzed in this paper. Mutual information was generally lower in the eyes open than in the eyes closed condition. In contrast, transfer entropies increased by a factor of two in the eyes open condition. As would be anticipated, the largest one-way transfer entropies were observed to and from the occipital lobe. Consistent with our previous recommendations, we suggest computing both measures (lagged mutual information and transfer entropy). Clinical utility is the final arbiter.
Stated in abstract terms a network is a collection of nodes and connections between the nodes. A small world network is defined as a network that has dense local clusters that are connected by a limited number of long range connections. In a seminal paper, Watts and Strogatz (1998) showed how small world networks can be characterized quantitatively. Small world networks are highly efficient. They can support a high degree of dynamical complexity with a minimum investment in connections (Latora and Marchiori 2001). This is an attractive metaphor for describing the central nervous system. Local networks provide areas of specialization, but these specialized domains can communicate efficiently with the entire brain by long range connections. When applied to multichannel EEG data, the electrode sites are the nodes and the connections are identified by correlation measures. Three types of connections can be identified. In a binary network, a connection is either present or absent. Operationally this is established by assigning a threshold value (connection present/absent) to a measure of correlation. In a weighted network, the value of a connection’s strength is assigned on a continuum determined by the correlation measure. In directed networks, the direction of information transfer, not just the strength of the connection, is incorporated into the analysis. These methods are now being utilized in the analysis of the central nervous system (Smith-Bassett and Bullmore 2006; Sporns and Honey 2006; Stam and Reijneveld 2007). Altered small world networks have been observed in clinical populations including patients with CNS tumors (Bartolomei et al. 2006), epilepsy (Ponten et al. 2007; van Dellen et al. 2009), schizophrenia (Rubinov et al. 2009), and Alzheimer’s disease (Stam et al. 2007a, b). As would be anticipated alterations in networks are associated with traumatic brain injury (Cao and Slobounov 2010; Nakamura et al. 2009; Tsirka et al. 2011; Zouridakis et al. 2011; Catsellanos et al. 2011a, b). The calculations presented in this paper and in Madulara et al. (2012) suggest that when calculated using an adaptive partition of the joint probability distribution, mutual information, lagged mutual information and transfer entropy can provide computationally efficient, noise-robust metrics for the analysis of CNS small world networks.
The mathematical results showing the efficiency of networks composed of highly connected local regions with limited, but essential, long range connections can inform the discussion of CNS localization of function. The localizationist conceptualization began with Broca’s localization of expressive aphasia to the third left frontal convolution (Broca 1861) and Wernicke’s localization of receptive aphasia to the posterior section of the superior temporal convolution (Wernicke 1908). By the early twentieth century, however, several neurologists argued against a strict localizationist model (Tesak and Code 2008). Kurt Goldstein was a significant contributor to the debate (Goldstein 1927; Ludwig 2012). Goldstein’s views were complex and it would be an oversimplification to describe his views as inflexibly antilocalizationist (Ludwig 2012). For example, in his Lokalisation in der Großhirnrinde, Goldstein recognizes Broca’s “flawless establishment of the dependency of the impairment of articulated speech from a lesion in the third left frontal convolution” (Goldstein 1927, translated Ludwig 2012). He similarly accepts Wernicke’s identification of the role of the superior temporal convolution in some presentations of receptive aphasia, but based on clinical observations Goldstein concluded that language functions could not be decomposed into discrete anatomically isolated components. Goldstein’s acceptance of localizationist results but his argument for the incompleteness of a localizationist account caused Geschwind (1997) to describe his views as a “paradoxical position.” Ludwig proposes that the paradox can be resolved by recognizing that Goldstein introduced a distinction between weak localization (the correlation of symptoms with lesions) and strong localization (the implementation of a process exclusively in a defined locality). We suggest that a quantitative examination of these questions can be constructed by comparing CNS network geometries generated by language dependent ERP tasks in healthy controls and in patients presenting well characterized aphasias.
The opinions and assertions contained herein are the private opinions of the authors and are not to be construed as official or reflecting the views of the United States Department of Defense. PER and BMR would like to acknowledge support from the Traumatic Injury Research Program of the Uniformed Services University of the Health Sciences, from the Defense Medical Research and Development Program and from the United States Marine Corps Systems Command. JDB, LCCA and AMA were supported in part by the Department of Science and Technology, Republic of the Philippines.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution License which permits any use, distribution, and reproduction in any medium, provided the original author(s) and the source are credited.