Abstract
Encoding, transmission and decoding of information are ubiquitous in biology and human history: from DNA transcription to spoken/written languages and languages of sciences. During the last decades, the study of neural networks in brain performing their multiple tasks was providing more and more detailed pictures of (fragments of) this activity. Mathematical models of this multifaceted process led to some fascinating problems about “good codes” in mathematics, engineering, and now biology as well. The notion of “good” or “optimal” codes depends on the technological progress and criteria defining optimality of codes of various types: error-correcting ones, cryptographic ones, noise-resistant ones etc. In this note, I discuss recent suggestions that activity of some neural networks in brain, in particular those responsible for space navigation, can be well approximated by the assumption that these networks produce and use good error-correcting codes. I give mathematical arguments supporting the conjecture that search for optimal codes is built into neural activity and is observable.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Curto, C., Itskov, V.: Cell groups reveal structure of stimulus space. PLoS Comput. Biol. 4(10), 1–13 (2008)
Curto, C., Itskov, V., Veliz-Cuba, A., Youngs, N.: The neural ring: an algebraic tool for analysing the intrinsic structure of neural codes. Bull. Math. Biol. 75(9), 1571–1611 (2013)
Dehaine, S., Brannon, E. (eds.): Space, time and number in the brain. Elsevier Academic Press, Amsterdam (2011)
Dehaene, S., Mehler, J.: Cross-linguistic regularities in the frequency of number words. Cognition 43, 1–29 (1992)
Delahaye, J.-P.: Les entiers ne naissent pas égaux. Pour la Science 421, 80–85 (2012)
Derdikman, D., Moser, E.: A manifold of spatial maps in the brain. In: [3], pp. 41–57
Gastpar, M., Rimoldi, B., Vetterli, M.: To code or not to code: lossy source-channel communication revisited. IEEE Trans. Inf. Theory 49(5), 1147–1158 (2003)
Giusti, C., Itskov, V.: A No-Go Theorem for one-layer feedforward networks. Neural Comput. 26, 25–27 (2014). doi:10.162/NECO_a_00657
Levin, L.A.: Various measures of complexity for finite objects (axiomatic description). Soviet Math. Dokl. 17(2), 522–526 (1976)
Levin, L.A.: A concrete way of defining measures of complexity. Soviet Math. Dokl. 18(3), 727–731 (1976)
Maguire, E.A., Gadian, D.G., Jongsrude, I.S., Good, C.D., Ashburner, J., Frackowiak, R.S., Frith, C.D.: Navigation-related structural change in the hippocampi of taxi drivers. Proc. Natl. Acad. Sci. USA 97(8), 4398–4403 (2000)
Manin, Y.I.: A computability challenge: asymptotic bounds and isolated error-correcting codes. In: Dinneen, M.J., et al. (eds.) WTCS 2012 (Calude Festschrift), Lecture Notes in Computer Sci. 7160, pp. 174–182 (2012). Preprint arXiv:1107.4246
Manin, Y.I.: Zipf’s law and L. Levin’s probability distributions. Funct. Anal. Appl. (2014). doi:10.1007/s10688-014-0052-1. arXiv:1301.0427
Manin, Y.I.: Neural codes and homotopy types: mathematical models of place field recognition. Moscow Math. J. 15, 741–748 (2015). arXiv:1501.00897
Manin, Y.I., Marcolli, M.: Error-correcting codes and phase transitions. Math. Comput. Sci. 5, 133–170 (2011). arXiv:0910.5135 [math.QA]
Manin, Y.I., Marcolli, M.: Kolmogorov complexity and the asymptotic bound for error-correcting codes. J. Diff. Geom. 97, 91–108 (2014). arXiv:1203.0653
Manin, Y.I., Marcolli, M.: Semantic spaces. 32 pp. arXiv:1605.04328
Meteyard, L., Cuadrado, S.R., Bahrami, B., Vigliocco, V.: Coming of age: a review of embodiment and the neuroscience of semantics. Cortex 48, 788–804 (2012)
Mora, T., Deny, S., Marre, O.: Dynamical criticality in the collective activity of a population of retinal neurons. arXiv:1410.6769 [q-bio.NC]
Manin, D.Y.: Zipf’s law and avoidance of excessive synonymy. Cognit. Sci. 32, 1075–1098 (2008). arXiv:0710.0105 [cs.CL]
Nonnenmacher, M., Behrens, C., Berens, P., Bethge, M., Macke, J.: Signatures of criticality arise in simple neural models with correlations. 36 pp. arXiv:1603.00097 [q-bio.NC]
Tkačik, G., Mora, T., Marre, O., Amodei, D., Palmer, S., Berry, M., Bialek, W.: Thermodynamics and signatures of criticality in a network of neurons. Proc. Natl. Acad. Sci 112(37), 11508–11517 (2015)
Vladut, S.G., Nogin, D.Y., Tsfasman, M.A.: Algebraic Geometric Codes: Basic Notions. Mathematical Surveys and Monographs, vol. 139. American Mathematical Society, Providence, RI (2007)
Youngs, N.E.: The neural ring: using algebraic geometry to analyse neural rings. arXiv:1409.2544 [q-bio.NC], 108 pp
Author information
Authors and Affiliations
Corresponding author
Additional information
To Sasha Beilinson, most cordially
Io mirava, e chiedea: Musa, la lima ov’è? Disse la Dea: lima è consumata; or facciam senza. Ed io, ma di rifarla Non vi cal, soggiungea, quand’ella è stanca? Rispose: hassi a rifar, ma il tempo manca.
Giacomo Leopardi, Canti. XXXVI, Scherzo
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.