Skip to main content

Information Geometry of Multiple Spike Trains

  • Chapter
Analysis of Parallel Spike Trains

Part of the book series: Springer Series in Computational Neuroscience ((NEUROSCI,volume 7))

Abstract

Information geometry studies a family probability distributions by using modern geometry. Since a stochastic model of multiple spike trains is described by a family of probability distributions, information geometry provides not only intuitive understanding, but also useful tools to analyze complex spike trains. A stochastic model of neuronal spikes represents average firing rates and correlations of spikes. We separate correlations of spikes from their firing rates orthogonally. We further separate higher-order correlations from lower-order ones, and thus the effect of correlations is decomposed orthogonally. However, a general model is too complicated and is not adequate for practical use. So we study characteristics of various tractable models. We study among them a mixture model, which is simple and tractable and has many interesting properties. We also study a marginal model and its characteristics.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Ackley DH, Hinton GE, Sejnowski TJ (1985) A learning algorithm for Boltzmann machines. Cogn Sci 9:147–169

    Article  Google Scholar 

  • Amari S (2001) Information geometry on hierarchy of probability distributions. IEEE Trans Inform Theory 47:1701–1711

    Article  Google Scholar 

  • Amari S (2009a) Measure of correlation orthogonal to change in firing rate. Neural Comput 21:960–972

    Article  PubMed  Google Scholar 

  • Amari S (2009b) α-Divergence is unique, belonging to both f-divergence and Bregman divergence class. IEEE Transactions on Information Theory 55:November

    Google Scholar 

  • Amari S (2010) Conditional mixture model for correlated neuronal spikes. Neural Comput 22(7):1718–1736

    Article  PubMed  Google Scholar 

  • Amari S, Kawanabe M (1997) Information geometry of estimating functions in semi parametric statistical models. Bernoulli 3:29–54

    Article  Google Scholar 

  • Amari S, Kurata K, Nagaoka H (1992) Information geometry of Boltzmann machines. IEEE Trans Neural Networks 3:260–271

    Article  CAS  Google Scholar 

  • Amari S, Nagaoka H (2000) Methods of information geometry. Translations of mathematical monographs, vol 191. AMS & Oxford University Press, Providence

    Google Scholar 

  • Amari S, Nakahara H, Wu S, Sakai Y (2003) Synchronous firing and higher-order interactions in neuron pool. Neural Comput 15:127–142

    Article  PubMed  Google Scholar 

  • Bohte SM, Spekreijse H, Roelfsema PR (2000) The effect of pair-wise and higher-order correlations on the firing rate of a postsynaptic neuron. Neural Comput 12:153–159

    Article  CAS  PubMed  Google Scholar 

  • Brette R (2009) Generation of correlated spike trains. Neural Comput 21:188–215

    Article  PubMed  Google Scholar 

  • Chentsov NN (1972) Statistical decision rules and optimal inference. American Mathematical Society, Providence 1982. Originally published in Russian, Nauka, Moscow

    Google Scholar 

  • Cover TM, Thomas JA (1991) Elements of information theory. Wiley, New York

    Book  Google Scholar 

  • Dayan P, Abbott LF (2005) Theoretical neuroscience: computational and mathematical modeling of neural systems. MIT Press, Cambridge

    Google Scholar 

  • Feng J, Brown D (2000) Impact of correlated inputs on the output of the integrate-and-fire model. Neural Comput 12:671–692

    Article  CAS  PubMed  Google Scholar 

  • Godambe VP (1991) Estimating functions. Oxford University Press, London

    Google Scholar 

  • Kang K, Amari S (2008) Discrimination with spike times and ISI distributions. Neural Comput 20:1411–1426

    Article  PubMed  Google Scholar 

  • Kass RE, Ventura V, Brown EN (2005) Statistical issue in the analysis of neuronal data. J Neurophysiol 94:8–25

    Article  PubMed  Google Scholar 

  • Kuhn A, Rotter S, Aertsen A (2002) Correlated input spike trains and their effects on the leaky integrate-and-fire neuron. Neurocomputing 44–46:121–126

    Article  Google Scholar 

  • Kuhn A, Aertsen A, Rotter S (2003) Higher-order statistics of input ensembles and the response of simple model neurons. Neural Comput 15:67–101

    Article  PubMed  Google Scholar 

  • Miura K, Okada M, Amari S (2006) Estimating spiking irregularities under changing environments. Neural Comput 18:2359–2386

    Article  PubMed  Google Scholar 

  • Montani F, Ince RAA, Senatore R, Arabzadeh E, Diamond M, Panzeri S (2009) The impact of higher-order interactions on the rate of synchronous discharge and information transmission in somatosensory cortex. Philosophical Trans R Soc A 367:3297–3310

    Article  Google Scholar 

  • Nakahara H, Amari S (2002) Information-geometric measure for neural spikes. Neural Comput 14:2269–2316

    Article  PubMed  Google Scholar 

  • Nakahara H, Amari S, Richmond B (2006) A comparison of descriptive models of a single spike train by information-geometric measure. Neural Comput 18:545–568

    Article  PubMed  Google Scholar 

  • Niebur E (2007) Generation of synthetic spike trains with defined pairwise correlations. Neural Comput 19:1720–1738

    Article  PubMed  Google Scholar 

  • Salinas E, Sejnowski TJ (2001) Correlated neuronal activity and the flow of neural information. Nature Rev Neurosci 2:539–550

    Article  CAS  Google Scholar 

  • Simazaki H, Gruen S, Amari S (2010) Analysis of subsets of higher-order correlated neurons based on marginal correlation coordinates. Cosyne 10

    Google Scholar 

  • Shinomoto S, Shima K, Tanji J (2003) Differences in spiking patterns among cortical neurons. Neural Comput 15:2823–2842

    Article  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Shun-ichi Amari .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer Science+Business Media, LLC

About this chapter

Cite this chapter

Amari, Si. (2010). Information Geometry of Multiple Spike Trains. In: Grün, S., Rotter, S. (eds) Analysis of Parallel Spike Trains. Springer Series in Computational Neuroscience, vol 7. Springer, Boston, MA. https://doi.org/10.1007/978-1-4419-5675-0_11

Download citation

Publish with us

Policies and ethics