Encyclopedia of Computational Neuroscience

2015 Edition
| Editors: Dieter Jaeger, Ranu Jung

Information Measures of Redundancy and Synergy in Neural Activity

Reference work entry
DOI: https://doi.org/10.1007/978-1-4614-6675-8_162

Definition

Two descriptions of an underlying signal should be expected to be more informative than either one of the descriptions itself. However, several scenarios can be imagined. First, if the two descriptions each represent independent aspects of the underlying signal, then the two descriptions should be twice as informative as any one by itself. Second, if the two descriptions provide partially overlapping information, then the two descriptions together should be less than twice as informative as any one by itself. In this case, we say that the two descriptions are redundant. A third scenario requires a somewhat more specific setup. Namely, suppose now that each description provides a noisy version of the underlying signal, but with different noises. Then, it could happen that the two noises cancel each other out and, hence, that the two descriptions together are much morethan twice as informative as any one by itself. A similar observation applies if the noises only...

This is a preview of subscription content, log in to check access

References

  1. Amin N, Gastpar MC, Theunissen FE (2013) Selective and efficient neural coding of communication signals depends on early acoustic and social environment. PLoS ONE 8:e61417PubMedCentralPubMedGoogle Scholar
  2. Machens CK, Stemmler MB, Prinz P, Krahe R, Ronacher B, Herz AVM (2001) Representation of acoustic communication signals by insect auditory receptor neurons. J Neurosci 21:3215–3227PubMedGoogle Scholar
  3. Narayanan NS, Kimchi EY, Laubach M (2005) Redundancy and synergy of neuronal ensembles in motor cortex. J Neurosci 25:4207–4216PubMedGoogle Scholar
  4. Nirenberg S, Carcieri SM, Jacobs AL, Latham PE (2001) Retinal ganglion cells act largely as independent encoders. Nature 411:698–701PubMedGoogle Scholar
  5. Reich DS, Mechler F, Victor JD (2001) Independent and redundant information in nearby cortical neurons. Science 294:2566–2568PubMedGoogle Scholar
  6. Rieke F, Warland D, de Ruyter van Steveninck R, Bialek W (1996) Spikes. MIT Press, Cambridge, MAGoogle Scholar
  7. Schneidman E, Bialek W, Berry MJ (2003) Synergy, redundancy, and independence in population codes. J Neurosci 23:11539–11553PubMedGoogle Scholar
  8. Shannon CE (1948) A mathematical theory of communication. Bell Syst Tech J 27:379–423, and 623–656Google Scholar
  9. So K, Ganguly K, Jimenez J, Gastpar MC, Carmena JM (2012) Redundant information encoding in primary motor cortex during natural and prosthetic motor control. J Comput Neurosci 32:555–561PubMedGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2015

Authors and Affiliations

  1. 1.University of CaliforniaBerkeleyUSA
  2. 2.Ecole Polytechnique Fédérale de Lausanne (EPFL)LausanneSwitzerland