Information Geometry of Multiple Spike Trains

  • Shun-ichi Amari
Part of the Springer Series in Computational Neuroscience book series (NEUROSCI, volume 7)


Information geometry studies a family probability distributions by using modern geometry. Since a stochastic model of multiple spike trains is described by a family of probability distributions, information geometry provides not only intuitive understanding, but also useful tools to analyze complex spike trains. A stochastic model of neuronal spikes represents average firing rates and correlations of spikes. We separate correlations of spikes from their firing rates orthogonally. We further separate higher-order correlations from lower-order ones, and thus the effect of correlations is decomposed orthogonally. However, a general model is too complicated and is not adequate for practical use. So we study characteristics of various tractable models. We study among them a mixture model, which is simple and tractable and has many interesting properties. We also study a marginal model and its characteristics.


Mixture Model Marginal Distribution Fisher Information Spike Train Exponential Family 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Ackley DH, Hinton GE, Sejnowski TJ (1985) A learning algorithm for Boltzmann machines. Cogn Sci 9:147–169 CrossRefGoogle Scholar
  2. Amari S (2001) Information geometry on hierarchy of probability distributions. IEEE Trans Inform Theory 47:1701–1711 CrossRefGoogle Scholar
  3. Amari S (2009a) Measure of correlation orthogonal to change in firing rate. Neural Comput 21:960–972 CrossRefPubMedGoogle Scholar
  4. Amari S (2009b) α-Divergence is unique, belonging to both f-divergence and Bregman divergence class. IEEE Transactions on Information Theory 55:November Google Scholar
  5. Amari S (2010) Conditional mixture model for correlated neuronal spikes. Neural Comput 22(7):1718–1736 CrossRefPubMedGoogle Scholar
  6. Amari S, Kawanabe M (1997) Information geometry of estimating functions in semi parametric statistical models. Bernoulli 3:29–54 CrossRefGoogle Scholar
  7. Amari S, Kurata K, Nagaoka H (1992) Information geometry of Boltzmann machines. IEEE Trans Neural Networks 3:260–271 CrossRefGoogle Scholar
  8. Amari S, Nagaoka H (2000) Methods of information geometry. Translations of mathematical monographs, vol 191. AMS & Oxford University Press, Providence Google Scholar
  9. Amari S, Nakahara H, Wu S, Sakai Y (2003) Synchronous firing and higher-order interactions in neuron pool. Neural Comput 15:127–142 CrossRefPubMedGoogle Scholar
  10. Bohte SM, Spekreijse H, Roelfsema PR (2000) The effect of pair-wise and higher-order correlations on the firing rate of a postsynaptic neuron. Neural Comput 12:153–159 CrossRefPubMedGoogle Scholar
  11. Brette R (2009) Generation of correlated spike trains. Neural Comput 21:188–215 CrossRefPubMedGoogle Scholar
  12. Chentsov NN (1972) Statistical decision rules and optimal inference. American Mathematical Society, Providence 1982. Originally published in Russian, Nauka, Moscow Google Scholar
  13. Cover TM, Thomas JA (1991) Elements of information theory. Wiley, New York CrossRefGoogle Scholar
  14. Dayan P, Abbott LF (2005) Theoretical neuroscience: computational and mathematical modeling of neural systems. MIT Press, Cambridge Google Scholar
  15. Feng J, Brown D (2000) Impact of correlated inputs on the output of the integrate-and-fire model. Neural Comput 12:671–692 CrossRefPubMedGoogle Scholar
  16. Godambe VP (1991) Estimating functions. Oxford University Press, London Google Scholar
  17. Kang K, Amari S (2008) Discrimination with spike times and ISI distributions. Neural Comput 20:1411–1426 CrossRefPubMedGoogle Scholar
  18. Kass RE, Ventura V, Brown EN (2005) Statistical issue in the analysis of neuronal data. J Neurophysiol 94:8–25 CrossRefPubMedGoogle Scholar
  19. Kuhn A, Rotter S, Aertsen A (2002) Correlated input spike trains and their effects on the leaky integrate-and-fire neuron. Neurocomputing 44–46:121–126 CrossRefGoogle Scholar
  20. Kuhn A, Aertsen A, Rotter S (2003) Higher-order statistics of input ensembles and the response of simple model neurons. Neural Comput 15:67–101 CrossRefPubMedGoogle Scholar
  21. Miura K, Okada M, Amari S (2006) Estimating spiking irregularities under changing environments. Neural Comput 18:2359–2386 CrossRefPubMedGoogle Scholar
  22. Montani F, Ince RAA, Senatore R, Arabzadeh E, Diamond M, Panzeri S (2009) The impact of higher-order interactions on the rate of synchronous discharge and information transmission in somatosensory cortex. Philosophical Trans R Soc A 367:3297–3310 CrossRefGoogle Scholar
  23. Nakahara H, Amari S (2002) Information-geometric measure for neural spikes. Neural Comput 14:2269–2316 CrossRefPubMedGoogle Scholar
  24. Nakahara H, Amari S, Richmond B (2006) A comparison of descriptive models of a single spike train by information-geometric measure. Neural Comput 18:545–568 CrossRefPubMedGoogle Scholar
  25. Niebur E (2007) Generation of synthetic spike trains with defined pairwise correlations. Neural Comput 19:1720–1738 CrossRefPubMedGoogle Scholar
  26. Salinas E, Sejnowski TJ (2001) Correlated neuronal activity and the flow of neural information. Nature Rev Neurosci 2:539–550 CrossRefGoogle Scholar
  27. Simazaki H, Gruen S, Amari S (2010) Analysis of subsets of higher-order correlated neurons based on marginal correlation coordinates. Cosyne 10 Google Scholar
  28. Shinomoto S, Shima K, Tanji J (2003) Differences in spiking patterns among cortical neurons. Neural Comput 15:2823–2842 CrossRefPubMedGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC 2010

Authors and Affiliations

  1. 1.RIKEN Brain Science InstituteWakoshiJapan

Personalised recommendations