Machine Learning

, Volume 79, Issue 1, pp 5–27

Temporal kernel CCA and its application in multimodal neuronal data analysis

  • Felix Bießmann
  • Frank C. Meinecke
  • Arthur Gretton
  • Alexander Rauch
  • Gregor Rainer
  • Nikos K. Logothetis
  • Klaus-Robert Müller
Article

DOI: 10.1007/s10994-009-5153-3

Cite this article as:
Bießmann, F., Meinecke, F.C., Gretton, A. et al. Mach Learn (2010) 79: 5. doi:10.1007/s10994-009-5153-3

Abstract

Data recorded from multiple sources sometimes exhibit non-instantaneous couplings. For simple data sets, cross-correlograms may reveal the coupling dynamics. But when dealing with high-dimensional multivariate data there is no such measure as the cross-correlogram. We propose a simple algorithm based on Kernel Canonical Correlation Analysis (kCCA) that computes a multivariate temporal filter which links one data modality to another one. The filters can be used to compute a multivariate extension of the cross-correlogram, the canonical correlogram, between data sources that have different dimensionalities and temporal resolutions. The canonical correlogram reflects the coupling dynamics between the two sources. The temporal filter reveals which features in the data give rise to these couplings and when they do so. We present results from simulations and neuroscientific experiments showing that tkCCA yields easily interpretable temporal filters and correlograms. In the experiments, we simultaneously performed electrode recordings and functional magnetic resonance imaging (fMRI) in primary visual cortex of the non-human primate. While electrode recordings reflect brain activity directly, fMRI provides only an indirect view of neural activity via the Blood Oxygen Level Dependent (BOLD) response. Thus it is crucial for our understanding and the interpretation of fMRI signals in general to relate them to direct measures of neural activity acquired with electrodes. The results computed by tkCCA confirm recent models of the hemodynamic response to neural activity and allow for a more detailed analysis of neurovascular coupling dynamics.

Canonical correlation analysis CCA kCCA tkCCA Neurovascular coupling 
Download to read the full article text

Copyright information

© The Author(s) 2009

Authors and Affiliations

  • Felix Bießmann
    • 1
  • Frank C. Meinecke
    • 1
  • Arthur Gretton
    • 2
  • Alexander Rauch
    • 3
  • Gregor Rainer
    • 4
  • Nikos K. Logothetis
    • 3
  • Klaus-Robert Müller
    • 1
  1. 1.Machine Learning GroupTU BerlinBerlinGermany
  2. 2.Dept. Empirical InferenceMPI Biological CyberneticsTübingenGermany
  3. 3.Dept. Physiology of Cognitive ProcessesMPI Biological CyberneticsTübingenGermany
  4. 4.Visual Cognition LaboratoryUniversity of FribourgFribourgSwitzerland