Abstract
Neuroscientific analyses balance between capturing the brain’s complexity and expressing that complexity in meaningful and understandable ways. Here we present a novel approach that fully characterizes neural network activity and does so by uniquely transforming raw signals into easily interpretable and biologically relevant metrics of network behavior. We first prove that third-order (triple) correlation describes network activity in its entirety using the triple correlation uniqueness theorem. Triple correlation quantifies the relationships among three events separated by spatial and temporal lags, which are triplet motifs. Classifying these motifs by their event sequencing leads to fourteen qualitatively distinct motif classes that embody well-studied network behaviors including synchrony, feedback, feedforward, convergence, and divergence. Within these motif classes, the summed triple correlations provide novel metrics of network behavior, as well as being inclusive of commonly used analyses. We demonstrate the power of this approach on a range of networks with increasingly obscured signals, from ideal noiseless simulations to noisy experimental data. This approach can be easily applied to any recording modality, so existing neural datasets are ripe for reanalysis. Triple correlation is an accessible signal processing tool with a solid theoretical foundation capable of revealing previously elusive information within recordings of neural networks.
Similar content being viewed by others
Introduction
Meaningfully capturing the complexity of neural networks is a daunting task: a range of different approaches are currently in use to quantify network behavior1,2,3,4,5,6,7,8. Intuitively, we assume that completely characterizing this complexity should require correlations of such high-order as to be incomprehensible, perhaps even unenumerable9. However here we show that third-order correlations fully characterize even the most complex neural recordings.
This full characterization arises from the unique correspondence between a dataset and its triple correlation, per the triple correlation uniqueness (TCU) theorem. Introduced decades ago in optical sciences10, this theorem states that any finite image has unique triple correlation. Originally, the theory was invoked in arguments about the Julesz conjecture11,12,13,14,15, which stated that infinite textures with identical third-order correlations are indistinguishable to a human observer (though textures are not the same as images15). The TCU theorem has since languished, but we hope to bring triple correlation to the forefront of data analysis with one simple observation: any finite dataset can be interpreted as an “image.” In neuroscience, this encompasses any completed recording of neural activity: functional magnetic resonance imaging, local field potential, single-unit electrophysiology, multi-electrode array electrophysiology, voltage-sensitive dye imaging, etc. Beyond these, the TCU theorem applies to any finite dataset in any field.
Here, we bring the TCU theorem into the heart of neuroscience with a focus on analysis of spike rasters as the representation of neuronal population activity. We propose that the activity patterns of a neural network can be ideally characterized by its triple correlation, \(c_3\). We begin by defining \(c_3\), which comprises triplet motifs, the relationships among three events. We briefly summarize the proof of the uniqueness of \(c_3\) and explore the implications of this uniqueness for neural data. We then classify the triplet motifs by event sequencing and neuron recruitment to derive a natural summary of \(c_3\) in fourteen motif classes. This summary falls out naturally and maps onto network properties of both computational and biological interest, including synchrony, feedback, feedforward, convergence, and divergence. We illustrate the utility of that simple summary with some straightforward simulations and apply our analysis to experimental recordings. In sum, we present a novel, theory-based approach to quantifying network activity.
Methods
We worked with a multi-neuron raster of spikes (Fig. 1A) to outline our approach, though the analysis works the same for any finite dataset (see Supporting Materials).
Defining triple correlation
Unlike pairwise correlation (a function of one lag between two spikes), triple correlation characterizes three-way interactions as a function of two lags among three spikes (Fig. 1B). We will call \({\mathcal {C}}_3\) the triple correlation transform, which transforms a spatiotemporal raster into its triple correlation. So for a spatiotemporal raster, r(n, t) (n, space; t, time), the triple correlation \(c_3\) is a function of four variables: \({\mathcal {C}}_3[r] = c_3(n_1, t_1, n_2, t_2) = \langle r(n, t) r(n + n_1, t + t_1) r(n + n_2, t + t_2)\rangle _{n, t}\). The operation \(\langle ... \rangle _{n,t}\) computes the average over all bins (n, t) in the raster. The argument ... is 1 when (n, t) is part of a spiking triplet with lags \((n_1, t_1, n_2, t_2)\), and 0 otherwise. In practice, we only calculate the triple correlation up to a certain maximum spatiotemporal lag which we determine based on experimental and computational considerations on a per-experiment basis (noted in each figure). In most cases calculating the full \(c_3\) would be a needless computational expense as usually the triple correlations with longer lags become more likely to be dominated by chance. See “Computing the triple correlation” in Online Methods for implementation details.
Overview of uniqueness proof
To prove uniqueness, we apply the Triple Correlation Uniqueness (TCU) theorem, originally applied in optical sciences10,13,14. It states that if we have two images x and y with equal triple correlations (\({\mathcal {C}}_3[x] = {\mathcal {C}}_3[y]\)), then the images themselves must be equal (\(x = y\)). The TCU theorem applies to any finite bounded dataset, including continuous signals and multi-dimensional data—a fact that can be understood by interpreting any dataset as an image—so we apply it to a spike raster. We begin with two rasters x and y whose triple correlations are equal. This implies that the triple correlations’ Fourier transforms (bispectra) are equal, which we can write as equality between the product of three characteristic functions. Characteristic functions are the Fourier transform of probability distributions and are well-known in statistics to have certain nice properties16. Using those properties, we perform simple algebraic manipulations of that equality to derive that the Fourier transform of x equals the Fourier transform of y times an exponential function, \({\mathcal {F}}[x](\sigma ) = {\mathcal {F}}[y](\sigma ) e^{ja\sigma }\), where \(\sigma\) is frequency, j is the imaginary number, and a is some constant. This means that raster x equals raster y translated by some constant a. Thus, rasters with equal triple correlations are themselves equal up to translation See the Online Methods for the full proof, both in the two dimensions of a typical raster and in the fully general N dimensions. As a consequence of this result, spiking activity can in principle be recovered in its entirety from triple correlation (see “Reconstruction Algorithms for Finite Images” in13).
Summarizing triple correlation with motif classes
In order to better interpret triple correlation, which is inherently high-dimensional, we summarized it along lines meaningful to the underlying neural dynamics, combining the motifs into qualitatively distinct motif classes, \(M_i\). To do this, we asked what differences between three-spike motifs constitute fundamental differences. First, we grouped motifs according to whether their lags are zero or non-zero, producing \(2^4=16\) groups for the four spatio-temporal lags (in Table S2’s numbering, the first number). Next we distinguished within these groups according to the signs of the lags, which expanded those 16 groupings into 169 lag-sign motifs (proven in the Online Methods section “The number of lag-sign motifs;” enumerated in Table S2). These 169 lag-sign motifs enumerate all possible shapes of the motifs where the identity of each node matters, and where space is ordered. However, for our purposes many of these shapes are functionally the same. For example, we only distinguished between zero and non-zero spatial lags: zero meaning “intra-neuronal” and non-zero meaning “inter-neuronal.” Further, node identity is irrelevant. Using these considerations, we grouped together these 169 lag-sign motifs according to those invariant under reflecting over the horizontal axis and node identity permutation (compare “Configurations” in Table S2). As a result, we found fourteen motif classes (Fig. 1C; proven in the Online Methods section “The number of motif classes.”) .
Controlling for expected contributions
When using motif classes to quantify network patterns, it is essential to distinguish between the occurrence of these motif classes due to underlying network behavior versus due to chance. Based on simple combinatorics, we expect contributions for each motif class to differ by orders of magnitude. For example, motif classes I and III each have only one varying lag, whereas motif class XIII has four. So, if \(\lambda\) is the maximum lag between spikes in a motif, the expected contributions of motif classes I and III are \(O(\lambda )\), while the expected contribution of motif class XIII is \(O(\lambda ^4)\). Intuitively, we also expect the motif class contributions to vary depending on the number of spikes required in the motif: while there are more motifs in motif class XIII, the chances of any one of them occurring is lower than motif class I because a motif needs three spikes for motif class XIII but only two for motif class I. So given a fixed spike rate p, we calculated the theoretically expected motif class contributions under the simplifying assumption that every neuron is a Poisson process with rate p per bin: \(E[M_i\mid p,\lambda ] = NT \#(M_i\mid \lambda ) p^{n_i}\) where NT is the size of the raster, \(\#(M_i\mid \lambda )\) is the number of motifs given maximum lags \(\lambda\), and \(n_i\) is the number of events in a motif in motif class i. (See Online Methods “Expected contributions per motif class” for case-by-case calculation)
We note that the higher-motifs are composed of lower-order motifs, e.g. looking at motif class X in Fig. 1C, it is constructed of two kinds of arrows: those of motif classes I and V. We say that motif classes I and V are constituent motif classes of motif class X (see also Fig. 4 for more explicitly deconstructed examples). We want to control also for this dependency. By computing the expected relationship between the contribution of a higher-order motif class and the contributions of its lower-order constituent motif classes, we derived \(E_c[M_i]\) which is the expected motif-class contributions given a spike rate and controlling for lower-order constituent motif-class contributions (constituent-controlled expectation). For lower order motifs, this is the same (e.g. \(E_c[M_I] = E[M_I]\)), but for higher order motifs this reflects the expected contribution in a raster of Poisson processes with the observed contributions of its constituent motifs, i.e. \(E_c[M_X] \approx E[M_X\mid M_I, M_V]\). We report \(M_i/E_c[M_i]-1\) so that positive values indicate higher contribution than expected, negative indicate less, and zero indicates contributions in line with those expected due to noise and the observed lower-order constituent motif-class contributions.
Results
Our principal goal is to bring triple correlation into general usage, with the triple correlation uniqueness theorem providing theoretical foundation for its use. Since triple correlation is entirely untested in the field, we approached it as we would any new tool: we showed that it works in the simplest possible case, before adding noise and testing it across the whole gamut of possible patterns. After these checks, we applied triple correlation to open-source real-world data.
Application of triple correlation summary
For a simple example to test this approach, we simulated a network spike raster with synchronous, periodic firing at a frequency of \(f=0.08\) arbitrary units (Fig. 2A). From this raster, we determined contributions of all motif classes by summing the raster’s triple correlation across all motifs in each motif class (\(M = \{M_i\}_{i \in 0:\text {XIII}}\), where \(M_i = \sum c_3(m)\) for motifs m in motif class i). We also simulated rate-matched pure-noise rasters (Fig. 2B) as surrogates and calculated their motif-class contributions (\(\hat{\mu }\) where \(\mu = \{E[M_i]\}_{i \in 0:\text {XIII}}\)). These surrogates were simulated Poisson processes with identical firing rates for every neuron. In addition we calculated a theoretical value, the constituent-controlled expectation (\(\mu _c= \{E_c[M_i]\}_{i \in 0:\text {XIII}}\); see Methods). We plotted all three quantities for each motif class (Fig. 2C). These quantities on their own are difficult to read: any difference between motif classes is completely overshadowed by the inevitable combinatorial differences in the number of triplet motifs per motif class. To account for these expected combinatorics and effectively report the contribution of each motif class, we calculated the constituent-controlled ratio (\(M/\mu _c-1{}\); Fig. 2D), which highlights the deviation of each motif-class contribution from that expected due to noise and lower-order constituent motif class contributions. To demonstrate that the contributions \(m_i\) from surrogate rasters do not differ much from the constituent-controlled expectation \(E_c[M_i]{}\), we plotted the estimated-to-constituent-controlled ratio (\(\hat{\mu }/\mu _c-1{}{}\)) for all \(n=100\) surrogate rasters (Fig. 2E).
We see that our summary of the triple correlation reflects the simple underlying structure: motif-classes III and IV, which correspond purely to neural synchrony, are highest above the expected contributions. Motif-classes VI, VII, XI, and XII, which each includes a synchronous component, are also above chance expectations (Fig. 2D). Thus as a single facet of our analysis, we are able to detect not only second-order synchrony (motif class III), which is considered important in neuroscience research17,18,19, but also third-order synchrony (motif class IV). We recognize that this is an ideal case, in which the synchronicity is also visibly apparent from the raster itself. We will now proceed to show that this particular detection works in the face of noise, and that all the other facets of our analysis (i.e. the other motif classes) also work.
Noise is no obstacle
We explored the effects of increasing noise on detecting network structure using faster synchronous firing with added uniform noise input (\(f=0.12\) AU, SNR = 0 dB; Fig. 3A). Similar to the results of those with slower synchronous firing (Fig. 2D), motif classes III, IV, VI, VII, XI, and XII (those with elements of synchrony) are found more often than chance (Fig. 3B). We increased noise (SNR = − 9 dB; Fig. 3C), resulting in lower magnitude signals across all motif classes, yet still detecting synchronous signals (Fig. 3D). In this case, the underlying network structure is still overtly present in the raster. We then increased the noise such that the synchronous network structure in the raster is not overtly present (SNR = − 17 dB; Fig. 3E), and found that while all signals move even closer to 0, those with synchrony are still elevated (Fig. 3F). Thus, triple correlation reflects underlying structure in the face of added noise. Finally, we show that in an extremely noisy raster (SNR = − 40 dB; Fig. 3G), the synchronous signals are no longer detected as all motif classes now show even lower magnitude signals, approaching 0 (Fig. 3H). In this overwhelmingly noisy simulation, the motif-class spectrum is dominated by chance.
Detecting various spiking sequences
Next we tested that our method correctly detects various isolated spike sequences (triplets). Our approach correctly detected third-order motifs by the appropriate motif class. We illustrate six simulations, each including only one repeated triplet across the raster. In addition to motif class 0, all motif classes are composed of one or more constituent motif classes (I, III, and/or V). Of the simulations depicted, the first three show triplets whose motif classes are purely composed of a single constituent motif class (Fig. 4A–C), and the other three show motif classes composed of a mix of two different constituent motifs (Fig. 4D–F). Fig. 4A–C show that the second- and third- order motifs for local dynamics (Fig. 4A; I & II), synchrony (Fig. 4B; III & IV), and feedforward (Fig. 4C; V & XIII) are correctly detected. Note that motif class V (simple second-order cross-correlation, which we describe as “spike propagation”) is in fact a constituent part of every third-order motif other than those in motif classes II and IV , and so was detected at lower levels in every subsequent test. Figure 4D–F shows the other three cases: feedback (IX; composed of I and V), divergence (XI; composed of III and V), and convergence (XII; composed of III and V).
In every case, including those not depicted, the tested triplets were reflected by the correct motif-class contribution (along with the triplets’ constituent parts). For example, a feedback triplet elevates the contribution from motif-class IX, along with contributions from motif-classes I and V, which together constitute motif-class IX (Fig. 4D). Note that the particular summary used in this approach does not depend on quantitative details. Because of this, our detector works purely on 1) the qualitative spike sequencing that defines the motif-class, and 2) the presence of that motif class anywhere within the raster.
Application to experimental data
We further tested our approach using open-source, publicly available network data recorded from rat cortical cultures (details of this dataset are described in20 and obtained from21). Briefly, rat cortical neurons were cultured in microelectrode array (MEA) well plates consisting of 16 (4x4 array) electrodes. Data were collected at 22 days in vitro. The datasets consisted of already-detected spike time data from baseline wells (\(n=35\) wells) and from wells treated with the following pharmacological agents (\(n=35\) wells):
-
1.
Control (n=7 wells)
-
2.
\(\gamma\)-aminobutyric acid (GABA, 10 \(\upmu \,\textrm{M}\), n=7 wells)
-
3.
6-cyano-7-nitroquinoxaline-2,3-dione (CNQX, 50 \(\upmu \,\textrm{M}\), n=7 wells), an \(\alpha\)-amino-3-hydroxy-5-methyl-4-isoxazolepropionic acid (AMPA)/kainate receptor antagonist
-
4.
D-(-)-2-amino-5-phosphonopentanoic acid (D-AP5, 50 \(\upmu \,\textrm{M}\), n=7 wells), an N-methyl-D-aspartate (NMDA) receptor antagonist
-
5.
Gabazine (30 \(\upmu \,\textrm{M}\), n=7 wells), a GABAA receptor antagonist
The raw data were sampled at 12,500 samples/s/channel, and the spikes were detected by the researchers as described in21. We downsampled the spike rasters to 500 samples/s/channel. Where multiple spikes were occasionally binned together, we counted them as a single spike. Representative 1-min snippets of each raster per condition are depicted in Fig. 5. We computed the triple correlation for each well of the MEA plate with temporal lags of − 50 ms:50 ms and spatial lags of − 1:2 electrodes (The spatial lags are asymmetric in order to cover the MEA without overlap, given periodic boundary conditions) in each of the two dimensions of the 4x4 array. We first show that the results from the triple correlation approach to quantify spike rate (contributions of motif class 0, Fig. 6A) concur with the results reported in20. Then for each pair of baseline and treatment wells, we calculated the ratio between \(M/\mu _c-1{}\) for the treatment well over the baseline well, and reported these values with a boxplot for each treatment (Fig. 6B–D). In these box-and-whisker plots, the center line represents the median (50th percentile), the bottom and top edges of the box represent the first (25th percentile) and third (75th percentile) quartiles, the whiskers represent the minimum and maximum range of data not considered outliers, and individual data points outside of the box-and-whisker plot represent outliers.
The network effects of the following pharmacological agents were examined in this study: (1) GABA increases inhibitory synaptic function; (2) gabazine, a GABA antagonist, decreases inhibitory synaptic function; (3) CNQX, an AMPA/kainate antagonist, blocks faster glutamatergic excitatory synapses; and (4) D-AP5, an NMDA antagonist, blocks slower glutamatergic excitatory synapses. As reported by20, these agents have broadly straightforward effects on the network’s firing rate motif class 0: potentiating inhibitory synapses (GABA) or blocking excitatory synapses (CNQX, D-AP5) decreases the firing rate, while blocking inhibitory synapses (gabazine) increases the firing rate (Fig. 6A). Modulating the inhibitory synapses has a similar gross effect: excess inhibition in response to GABA suppresses motif-class contributions (Fig. 6B, red), while decreasing inhibition in response to gabazine leads to an increase in structured firing across the motif-class spectrum (Fig. 6B, blue). When antagonizing particular excitatory receptors—with either faster or slower post-synaptic potentials—the triple correlation reflects changes in network behavior beyond simple firing rate modulation. While antagonizing faster excitatory AMPA/kainate receptors with CNQX results in a decrease in synchrony and most higher-order motifs involving synchrony (Fig. 6C), antagonizing slower excitatory NMDA synapses with D-AP5 (while not affecting faster glutamatergic synaptic transmission via AMPA/kainate receptors) results in a marked increase across the motif-class spectrum (Fig. 6D). This occurs despite the overall reduction in activity (as measured by motif class 0; Fig. 6A). Here, the particularly high prevalence of third-order synchrony (motif class IV) reflects the fact that the remaining firing is overwhelmingly synchronous, well above the expectation governed by chance (Figs. 5E, 6D). These results agree with the connectivity graphs comparing faster and slower correlations in AMPA and NMDA networks22.
Discussion
The essence of this study is the introduction of a new analytical tool that fully characterizes network activity using triplet motifs. Our mathematically unique statistical analysis not only encompasses typical first- and second-order analyses (e.g. auto-correlation, cross-correlation; Fig. 1), but also includes third-order correlations that are reflective of nonlinear network behaviors. In the preceding section, we demonstrated the robustness of our approach with networks of escalating complexity: in a simple synchronous test case (Fig. 2), in the face of substantial noise (Fig. 3), and in an experimental dataset (Figs. 5, 6). We also validated our simple summary metric in response to all computationally relevant motif classes (Fig. 4). The beauty of this approach lies in its flexible application to a multitude of finite data sets, including spike raster plots, fMRI images, local field potential (LFP), electroencephalogram (EEG), and data analyses in many other disciplines. Thus, we are excited to introduce this new analytical approach and eagerly anticipate its use as a tool to uncover new insights into network behavior.
Historically, neural network activity has been an important topic of investigation23. Hebb’s foundational idea of cell assemblies, which aimed to link physiology and function24, have often been investigated by searching for repeated patterns of spiking. Typically, these cell assemblies are investigated in the context of searching for multispike pattern activation that may not be time-locked to any external stimulus or action, as “would be the case for internal processes like recalling a memory or planning a movement”1. The field has expanded considerably over the decades, fostering research in precise zero-phase lag synchronization25,26,27, temporally-coded sequential patterns8,28, and so-called “synfire” chain-like structures29,30,31,32. Our approach builds on this active area of research by integrating across multiple patterns within spatiotemporal motifs. Much as multispike patterns are putatively reflective of cell assemblies, these spatiotemporal motifs are potentially reflective of underlying structure, and thus, changes in structure could be indicative of network state shift, for example: the transition between normal and seizure states33, preparation-to-movement in monkeys34, sleep/wake states35, or neuromodulation in response to pharmacological agents36.
When applying our approach to investigate a particular hypothesis, there are two critical questions that should be asked: (1) what choice of spatiotemporal lags is relevant for the dataset (e.g. are there a priori synaptically relevant temporal lags?); and (2) depending on the null hypothesis, what choice of method for random chance firing is best suited for the dataset? The former presents an exciting and unexplored frontier that allows researchers to tailor this approach to a variety of hypotheses. The latter can be informed by prior literature either on null hypothesis distributions (to calculate theoretical expectations) or surrogate generation (to estimate the same). In order to present a foundational concept, we used Poisson processes to model our neurons, both in theory and in surrogate datasets (as shown in Fig. 2B). For future applications, when testing specific hypotheses using experimental data, a more nuanced surrogate (e.g.37,38,39) should be used. For example, a stimulated neuron will not obey a simple Poisson process. For another example, modeled data may have heterogeneous firing rates, in which case the surrogates should be spike-shuffled within channels rather than across all the raster. The particular surrogate would depend on the hypothesis being tested and must match the null hypothesis so that, in the general case where theoretical expectations cannot be derived,a bootstrapped distribution of surrogate motif-class spectra can generate confidence intervals for the observed motif-class spectrum.
We can further investigate and differentiate within motif classes by finding peaks in the contributions of motifs with particular spatiotemporal lags. For example, a peak in longer lags for motif class I would indicate long-term autocorrelation, for motif class V long-term cross-correlation, and for higher-order motif classes more nuanced features of long-term correlation. On the other hand, peaks in shorter lags could indicate individual neuronal bursting (e.g. I, II), synchronized network bursting (e.g. III, IV), or even burst correlations with other activity (e.g. VIII, X). Further, a similar kind of fine-grained analysis of the bispectrum would reveal phase-amplitude couplings between frequency bands, such as those found between theta and gamma bands40.
Among signal processing tools, a prominent example of another unique transform of neural data is the Fourier transform, with amplitudes and phases of frequencies as fundamental units41. Much of medical imaging relies on the uniqueness of the Fourier transform, including computerized tomography (CT) and magnetic resonance imaging (MRI), which uses the Fourier transform to generate images41. Since triple correlation also constitutes a unique characterization of neural data, we present our approach as a more complex yet still useful tool, as it is not only nonlinear and higher-order, but also comprises fundamental units, triplet motifs, that are still intuitively informative. Analogous to the typical summary of the Fourier transform’s frequency spectrum into frequency bands (alpha, beta, gamma, etc.), we summarize the triple correlation’s motifs into a spectrum of fourteen motif classes. However, unlike the EEG frequency bands, which depend on clinically defined ranges, the motif-class spectrum arises directly from theory and is purely derived from possible spike sequences. It is a natural summary, and the classes themselves reflect their parsimony: they distinguish fundamental properties of computation, such as synchrony (motif classes III and IV), feedback (motif class IX), etc. (Fig. 1C). Furthermore, the constituent motif classes (I, III, and V) capture the well-known second-order correlations in analyzing neural spike data. Thus, while there are many alternative summaries, ours is both natural and useful in quantifying activity patterns (as exemplified in Figs. 2, 3, 4, 6). Curiously, these theoretically defined fundamental units agree with previously data-driven work that has pointed to the primacy of third-order network motifs2,3,4,42.
Not only is triple correlation unique in the time domain, but its own Fourier transform, the bispectrum, is unique in the frequency domain. For the spike raster, the spectral aspect also includes the well-known power spectrum and cross-spectrum (and coherence), the Fourier transform of autocorrelation (I) and cross-correlation (V) respectively (e.g.41). The bispectrum’s uniqueness gives theoretical weight to the growing consensus among researchers that insights about neural signals are encoded in the bispectrum43,44. Specifically, this underscores the importance of the fundamental elements of the bispectrum, which are the relationships between frequencies’ amplitudes and phases. In some cases, as in our simulated rasters (Figs. 2, 3, 4), the spatial frequencies may not be relevant due to the arbitrary ordering of neuron rows in the rasters. In other cases, where the spatial dimension has a real ordering (e.g. our MEA dataset; Figs. 5, 6) the spatial frequency bands can be an untapped source of insight.
Both triplet motifs and inter-frequency analyses are already important topics of investigation in neuroscience (e.g.2,5,6,7,42,45). Here, we have provided a direct avenue for these investigations and proven the fundamental importance of these topics to any spatiotemporal neural data. Furthermore, the success of using the bispectrum as an input to artificial neural network seizure classifiers43 suggests that the equivalently-unique and also-meaningful triple correlation might also prove a good feature space on which to train machine learning algorithms. While we applied triple correlation to simulated and experimental spiking activity, our methodology can extend beyond spike rasters to even higher dimensionality rasters and to continuous-valued signals, such as multi-electrode LFP data or EEG recordings (see proof section “Proof in Online Materials”). Ultimately, just as frequency bands have been considered fundamental components of brain activity with Fourier transform, here we propose triplet motifs as new fundamental building blocks, one step more complex, that hold promise as an innovative approach to analyzing spatiotemporal neural activity across the breadth of recording modalities.
Data availability
All data used is publicly available from21.
Code availability
This Github repository, https://github.com/grahamas/RasterUniqueCharacterizationCode, contains the Matlab scripts used to generate the figures in this paper and the functions used in those scripts which may in turn be used to apply our analysis to any dataset. We also provide that functionality via Julia packages used to double-check our results, linked in the same repository.
References
Abeles, M. & Gerstein, G. L. Detecting spatiotemporal firing patterns among simultaneously recorded single neurons. J. Neurophysiol. 60, 909–924. https://doi.org/10.1152/jn.1988.60.3.909 (1988).
Dechery, J. B. & MacLean, J. N. Functional triplet motifs underlie accurate predictions of single-trial responses in populations of tuned and untuned V1 neurons. PLoS Comput. Biol. 14, e1006153. https://doi.org/10.1371/journal.pcbi.1006153 (2018).
Schneidman, E., Berry, M. J., Segev, R. & Bialek, W. Weak pairwise correlations imply strongly correlated network states in a neural population. Nature 440, 1007–1012. https://doi.org/10.1038/nature04701 (2006).
Jiang, M., Gao, X., An, H., Li, H. & Sun, B. Reconstructing complex network for characterizing the time-varying causality evolution behavior of multivariate time series. Sci. Rep. 7, 10486. https://doi.org/10.1038/s41598-017-10759-3 (2017).
Sporns, O. & Kötter, R. Motifs in brain networks. PLoS Biol. 2, e369. https://doi.org/10.1371/journal.pbio.0020369 (2004).
Jovanović, S. & Rotter, S. Interplay between graph topology and correlations of third order in spiking neuronal networks. PLoS Comput. Biol. 12, e1004963. https://doi.org/10.1371/journal.pcbi.1004963 (2016).
Milo, R. et al. Network motifs: Simple building blocks of complex networks. Science 298, 824–827. https://doi.org/10.1126/science.298.5594.824 (2002).
Buzsáki, G. & Draguhn, A. Neuronal oscillations in cortical networks. Science 304, 1926–1929. https://doi.org/10.1126/science.1099745 (2004).
Yu, S. et al. Higher-order interactions characterized in cortical activity. J. Neurosci. 31, 17514–17526. https://doi.org/10.1523/JNEUROSCI.3127-11.2011 (2011).
Bartelt, H., Lohmann, A. W. & Wirnitzer, B. Phase and amplitude recovery from bispectra. Appl. Opt. 23, 3121–3129. https://doi.org/10.1364/AO.23.003121 (1984).
Julesz, B. Visual pattern discrimination. IRE Trans. Inf. Theory 8, 84–92. https://doi.org/10.1109/TIT.1962.1057698 (1962).
Julesz, B., Gilbert, E. N., Shepp, L. A. & Frisch, H. L. Inability of humans to discriminate between visual textures that agree in second-order statistics-revisited. Perception 2, 391–405. https://doi.org/10.1068/p020391 (1973).
Yellott, J. I. & Iverson, G. J. Uniqueness properties of higher-order autocorrelation functions. J. Opt. Soc. Am. A 9, 388–404. https://doi.org/10.1364/JOSAA.9.000388 (1992).
Yellott, J. I. Implications of triple correlation uniqueness for texture statistics and the Julesz conjecture. J. Opt. Soc. Am. A 10, 777–793. https://doi.org/10.1364/JOSAA.10.000777 (1993).
Victor, J. D. Images, statistics, and textures: Implications of triple correlation uniqueness for texture statistics and the Julesz conjecture: Comment. J. Opt. Soc. Am. A 11, 1680–1684. https://doi.org/10.1364/JOSAA.11.001680 (1994).
Feller, W. An Introduction to Probability Theory and Its Applications 1st edn. (Wiley, 1950).
Roscoe, D. D., Hamm, T. M., Reinking, R. M. & Stuart, D. G. Detection of synchrony in the discharge of a population of neurons. II. Implementation and sensitivity of a synchronization index. J. Neurosci. Methods 13, 51–64. https://doi.org/10.1016/0165-0270(85)90043-3 (1985).
Kreuz, T., Chicharro, D., Greschner, M. & Andrzejak, R. G. Time-resolved and time-scale adaptive measures of spike train synchrony. J. Neurosci. Methods 195, 92–106. https://doi.org/10.1016/j.jneumeth.2010.11.020 (2011).
Kreuz, T., Chicharro, D., Houghton, C., Andrzejak, R. G. & Mormann, F. Monitoring spike train synchrony. J. Neurophysiol. 109, 1457–1472. https://doi.org/10.1152/jn.00873.2012 (2013).
Hyvärinen, T. et al. Functional characterization of human pluripotent stem cell-derived cortical networks differentiated on laminin-521 substrate: Comparison to rat cortical cultures. Sci. Rep. 9, 17125. https://doi.org/10.1038/s41598-019-53647-8 (2019).
Kapucu, F. E., Vinogradov, A., Hyvärinen, T., Ylä-Outinen, L. & Narkilahti, S. Comparative microelectrode array data of the functional development of hPSC-derived and rat neuronal networks. Sci. Data 9, 1–10. https://doi.org/10.1038/s41597-022-01242-4 (2022).
Suresh, J. et al. Network burst activity in hippocampal neuronal cultures: The role of synaptic and intrinsic currents. J. Neurophysiol. 115, 3073–3089. https://doi.org/10.1152/jn.00995.2015 (2016).
McCulloch, W. S. & Pitts, W. A logical calculus of the ideas immanent in nervous activity. Bull. Math. Biophys. 5, 115–133. https://doi.org/10.1007/BF02478259 (1943).
Hebb, D. O. The Organization of Behavior: A Neuropsychological Theory 1st edn. (Wiley, 1949).
Abeles, M. Corticonics: Neural Circuits of the Cerebral Cortex 1st edn. (Cambridge University Press, 1991).
Singer, W. Neuronal synchrony: A versatile code for the definition of relations?. Neuron 24, 49–65. https://doi.org/10.1016/S0896-6273(00)80821-1 (1999).
Russo, E. & Durstewitz, D. Cell assemblies at multiple time scales with arbitrary lag constellations. Elife 6, e19428. https://doi.org/10.7554/eLife.19428 (2017).
Skaggs, W. E. & McNaughton, B. L. Replay of neuronal firing sequences in rat hippocampus during sleep following spatial experience. Science 271, 1870–1873. https://doi.org/10.1126/science.271.5257.1870 (1996).
Abeles, M. Local Cortical Circuits 1st edn, Vol. 6 (Springer, 1982).
Hertz, J. & Prügel-Bennett, A. Learning synfire chains: Turning noise into signal. Int. J. Neural Syst. 7, 445–450. https://doi.org/10.1142/s0129065796000427 (1996).
Diesmann, M., Gewaltig, M.-O. & Aertsen, A. Stable propagation of synchronous spiking in cortical neural networks. Nature 402, 529–533. https://doi.org/10.1038/990101 (1999).
Ikegaya, Y. et al. Synfire chains and cortical songs: Temporal modules of cortical activity. Science 304, 559–564. https://doi.org/10.1126/science.1093173 (2004).
Jirsa, V. K., Stacey, W. C., Quilichini, P. P., Ivanov, A. I. & Bernard, C. On the nature of seizure dynamics. Brain 137, 2210–2230. https://doi.org/10.1093/brain/awu133 (2014).
Riehle, A., Grün, S., Diesmann, M. & Aertsen, A. Spike synchronization and rate modulation differentially involved in motor cortical function. Science 278, 1950–1953. https://doi.org/10.1126/science.278.5345.1950 (1997).
Saper, C. B., Fuller, P. M., Pedersen, N. P., Lu, J. & Scammell, T. E. Sleep state switching. Neuron 68, 1023–1042. https://doi.org/10.1016/j.neuron.2010.11.032 (2010).
Iorio, F., Saez-Rodriguez, J. & Bernardo, D. Network based elucidation of drug response: From modulators to targets. BMC Syst. Biol. 7, 139. https://doi.org/10.1186/1752-0509-7-139 (2013).
Stella, A., Bouss, P., Palm, G. & Grün, S. Comparing surrogates to evaluate precisely timed higher-order spike correlations. eNeurohttps://doi.org/10.1523/ENEURO.0505-21.2022 (2022).
Baker, S. N. & Lemon, R. N. Precise spatiotemporal repeating patterns in monkey primary and supplementary motor areas occur at chance levels. J. Neurophysiol. 84, 1770–1780 (2000).
Grün, S. Data-driven significance estimation for precise spike correlation. J. Neurophysiol. 101, 1126–1140. https://doi.org/10.1152/jn.00093.2008 (2009).
Tort, A. B. L., Komorowski, R. W., Manns, J. R., Kopell, N. J. & Eichenbaum, H. Theta-gamma coupling increases during the learning of item-context associations. PNAS 106, 20942–20947. https://doi.org/10.1073/pnas.0911331106 (2009).
van Drongelen, W. Signal Processing for Neuroscientists: Introduction to the Analysis of Physiological Signals 2nd edn. (Elsevier, 2018).
Bojanek, K., Zhu, Y. & MacLean, J. Cyclic transitions between higher order motifs underlie sustained asynchronous spiking in sparse recurrent networks. PLoS Comput. Biol. 16, e1007409 (2020).
Bou Assi, E., Gagliano, L., Rihana, S., Nguyen, D. K. & Sawan, M. Bispectrum features and multilayer perceptron classifier to enhance seizure prediction. Sci. Rep. 8, 15491. https://doi.org/10.1038/s41598-018-33969-9 (2018).
Gagliano, L., Bou Assi, E., Nguyen, D. K. & Sawan, M. Bispectrum and recurrent neural networks: Improved classification of interictal and preictal states. Sci. Rep. 9, 15649. https://doi.org/10.1038/s41598-019-52152-2 (2019).
Jansen, N. A. et al. Impaired \(\beta -\gamma\) coupling indicates inhibitory dysfunction and seizure risk in a Dravet syndrome mouse model. J. Neurosci. Off. J. Soc. Neurosci. 41, 524–537. https://doi.org/10.1523/JNEUROSCI.2132-20.2020 (2021).
Acknowledgements
We would like to thank Andrew K.Tryba, PhD, Rashi Bhatt, Benjamin Wang, Jason N. MacLean, PhD, and Stephan A. van Gils, PhD for thoughtful discussion and feedback. W.v.D. is supported by NIH Grant R01 NS-084142. S.S.D. is supported by University of Chicago MSTP Training Grant T32GM007281. G.A.S. is supported by the Pritzker Endowment for the Neurosciences.
Author information
Authors and Affiliations
Contributions
S.S.D and G.A.S contributed equally to this work. All authors designed research, performed research, and wrote the manuscript. S.S.D prepared the figures. G.A.S wrote the mathematics listed in the supplemental materials. All authors reviewed the manuscript.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Deshpande, S.S., Smith, G.A. & van Drongelen, W. Third-order motifs are sufficient to fully and uniquely characterize spatiotemporal neural network activity. Sci Rep 13, 238 (2023). https://doi.org/10.1038/s41598-022-27188-6
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-022-27188-6
- Springer Nature Limited