Skip to main content
SpringerLink
Log in

Cognition and biology: perspectives from information theory

  • Review
  • Published:
Cognitive Processing Aims and scope Submit manuscript

Abstract

The intimate relation between biology and cognition can be formally examined through statistical models constrained by the asymptotic limit theorems of communication theory, augmented by methods from statistical mechanics and nonequilibrium thermodynamics. Cognition, often involving submodules that act as information sources, is ubiquitous across the living state. Less metabolic free energy is consumed by permitting crosstalk between biological information sources than by isolating them, leading to evolutionary exaptations that assemble shifting, tunable cognitive arrays at multiple scales, and levels of organization to meet dynamic patterns of threat and opportunity. Cognition is thus necessary for life, but it is not sufficient: An organism represents a highly patterned outcome of path-dependent, blind, variation, selection, interaction, and chance extinction in the context of an adequate flow of free energy and an environment fit for development. Complex, interacting cognitive processes within an organism both record and instantiate those evolutionary and developmental trajectories.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Adams F (2003) The informational turn in philosophy. Minds Mach 13:471–501

    Article  Google Scholar 

  • Arnold V (1989) Mathematical methods of classical mechanics. Springer, New York

    Book  Google Scholar 

  • Ash R (1990) Information theory. Dover, New York

    Google Scholar 

  • Atiyah M, Singer I (1963) The index of elliptical operators on compact manifolds. Bull Am Math Soc 69:322–433

    Article  Google Scholar 

  • Atlan H, Cohen I (1998) Immune information, self-organization, and meaning. Int Immunol 10:711–717

    Article  CAS  PubMed  Google Scholar 

  • Baars B (1988) A cognitive theory of consciousness. Cambridge University Press, New York

    Google Scholar 

  • Baars B (2005) Global workspace theory of consciousness: toward a cognitive neuroscience of human experience. Prog Brain Res 150:45–53

    Article  PubMed  Google Scholar 

  • Baars B., Franklin S (2003) How conscious experience and working memory interact. Trends Cogn Sci 7:166–172

    Article  PubMed  Google Scholar 

  • Backdahl L, Bushell A, Beck S (2009) Inflammatory signalling as mediator of epigenetic modulation in tissue-specific chronic inflammation. Int J Biochem Cell Biol 41:176–184

    Article  CAS  PubMed  Google Scholar 

  • Beck C, Schlogl F (1993) Thermodynamics of chaotic systems. Cambridge University Press, New York

    Google Scholar 

  • Bennett C (1988) Logical depth and physical complexity. In: Herkin R (ed.) The universal turing machine: a half-century survey, pp. 227–257, Oxford University Press, New York

    Google Scholar 

  • Boccaletti S, Latora V, Moreno Y, Chavez M, Hwang D (2006) Complex networks: structure and dynamics. Phys Rep 424:175–208

    Article  Google Scholar 

  • Bonner J (1980) The evolution of culture in animals. Princeton University Press, Princeton, NJ

    Google Scholar 

  • Byers N (1999) E. Noether’s discovery of the deep connection between symmetries and conservation laws. Israel mathematical conference proceedings, vol 12, ArXiv physics/9807044

  • Champagnet N, Ferriere R, Meleard S (2006) Unifying evolutionary dynamics: from individual stochastic process to macroscopic models. Theor Popul Biol 69:297–321

    Article  Google Scholar 

  • Chiang M, Boyd S (2004) Geometric programming duals of channel capacity and rate distortion. IEEE Trans Infom Theory 50:245–255

    Article  Google Scholar 

  • Cohen I (1992) The cognitive principle challenges clonal selection. Immunol Today 13:441–444

    Article  CAS  PubMed  Google Scholar 

  • Cohen I (2000) Tending Adam’s Garden: evolving the cognitive immune self. Academic Press, New York

    Google Scholar 

  • Cohen I (2006) Immune system computation and the immunological homunculus. In: Nierstrasz O, Whittle J, Harel D, Reggio G (eds.) MoDels 2006, LCNS, vol 4199, Springer, Heidelberg, pp 499–512

  • Cohen I, Harel D (2007) Explaining a complex living system: dynamics, multiscaling, and emergence. J R Soc Interface 4:175–182

    Article  CAS  PubMed Central  PubMed  Google Scholar 

  • Cover T, Thomas J (2006) Elements of information theory, 2nd edn. Wiley, New York

    Google Scholar 

  • de Groot S, Mazur P (1984) Non-equilibrium thermodynamics. Dover, New York

    Google Scholar 

  • Dembo A, Zeitouni O (1998) Large deviations: techniques and applications, 2nd edn. Springer, New York

    Book  Google Scholar 

  • Dretske F (1981) Knowledge and the flow of information. MIT Press, Cambridge, MA

    Google Scholar 

  • Dretske F (1988) Explaining behavior. MIT Press, Cambridge, MA

    Google Scholar 

  • Dretske F (1993) Mental events as structuring causes of behavior. In: Mele A, Heil J (eds.), Mental causation. Oxford University Press, New York, pp 121–136

    Google Scholar 

  • Dretske F (1994) The explanatory role of information. Philos Transac R Soc A 349:59–70

    Article  Google Scholar 

  • Durham W (1991) Coevolution: genes, culture, and human diversity. Stanford University Press, Palo Alto, CA

    Google Scholar 

  • El Gamal A, Kim Y, (2010) Lecture notes on network information theory. ArXiv:1001.3404v4

  • English T (1996) Evaluation of evolutionary and genetic optimizers: no free lunch. In: Fogel L, Angeline P, Back T (eds) Evolutionary programming V, In: Proceedings of the fifth annual conference on evolutionary programming. MIT Press, Cambridge, MA, pp 163–169

    Google Scholar 

  • Erdos P, Renyi A (1960) On the evolution of random graphs. Publication of the Mathematical Institute of the Hungarian Academy of Sciences pp 17–61

  • Feynman R (2000) Lectures on computation. Westview Press, New York

    Google Scholar 

  • Forlenza M, Baum A (2000) Psychosocial influences on cancer progression: alternative cellular and molecular mechanisms. Curr Opin Psychiatry 13:639–645

    Article  Google Scholar 

  • Froese T, Stewart J (2010) Life after Ashby: ultrastability and the autopoietic foundations of biological autonomy. Cybern Human Knowing 17(4):7–50

    Google Scholar 

  • Glazebrook JF, Wallace R (2009a) Rate distortion manifolds as model spaces for cognitive information. Informatica 33:309–346

    Google Scholar 

  • Glazebrook JF, Wallace R (2009b) Small worlds and red queens in the global workspace: an information-theoretic approach. Cogn Syst Res 10:333–365

    Article  Google Scholar 

  • Gould S (2002) The structure of evolutionary theory. Harvard University Press, Cambridge, MA

    Google Scholar 

  • Gould S, Lewontin R (1979) The spandrels of San Marco and the Panglossian paradigm: a critique of the adaptationist programme. Proc R Soc Lond B 205:581–598

    Article  CAS  PubMed  Google Scholar 

  • Hazewinkel M (2002) Encyclopedia of mathematics ‘Index Formulas’. Springer, New York

    Google Scholar 

  • Hollan J, Hutchins J, Kirsch D (2000) Distributed cognition: toward a new foundation for human-computer interaction research. ACM Trans Comput Human Interact 7:174–196

    Article  Google Scholar 

  • Jablonka E (2004) Epigenetic epidemiology. Int J Epidemiol 33:929–935

    Article  PubMed  Google Scholar 

  • Jablonka E, Lamb M (1995) Epigenetic inheritance and evolution: the Lamarckian dimension. Oxford University Press, Oxford, UK

    Google Scholar 

  • Jablonka E, Lamb M (1998) Epigenetic inheritance in evolution. J Evol Biol 11:159–183

    Article  Google Scholar 

  • Janisch R, Bird A (2003) Epigenetic regulation of gene expression: how the genome integrates intrinsic and environmental signals. Nat Genet Suppl 33:245–254

    Article  Google Scholar 

  • Khasminskii R (2012) Stochastic stability of differential equations, 2nd edn. Springer, New York

    Book  Google Scholar 

  • Khinchin A (1957) The mathematical foundations of information theory. Dover, New York

    Google Scholar 

  • Kitano H (2004) Biological robustness. Nat Genet 5:826–837

    Article  CAS  Google Scholar 

  • Landau L, Lifshitz E (2007) Statistical physics, part I. Elsevier, New York

    Google Scholar 

  • Maturana H, Varela F (1980) Autopoiesis and cognition. Reidel Publishing Company, Dortrecht

    Book  Google Scholar 

  • Mindwood K, Valenick Williams L, Schwarzbauer J (2004) Tissue repair and the dynamics of the extracellular matrix. Int J Biochem Cell Biol 36:1031–1037

    Article  Google Scholar 

  • Nunney L (1999) Lineage selection and the evolution of multistage carcinogenesis. Proc R Soc B 266:493–498

    Article  CAS  PubMed  Google Scholar 

  • O’Nullain S (2008) Code and context in gene expression, cognition, and consciousness. In: Barbiere M (ed.) The codes of life: the rules of macroevolution, Ch 15, Springer, New York, pp 347–356

  • Pettini M (2007) Geometry and topology in Hamiltonian dynamics and statistical mechanics. Springer, New York

    Book  Google Scholar 

  • Protter P (1990) Stochastic integration and differential equations. Springer, New York

    Book  Google Scholar 

  • Richerson P, Boyd R (2006) Not by genes alone: how culture transformed human evolution. Chicago University Press, Chicago, IL

    Google Scholar 

  • Scherrer K, Jost J (2007a) The gene and the genon concept: a functional and information-theoretic analysis. Mol Syst Biol 3:87–95

    Article  PubMed Central  PubMed  Google Scholar 

  • Scherrer K, Jost J (2007b) Gene and genon concept: coding versus regulation. Theory Biosci 126:65–113

    Article  CAS  PubMed Central  PubMed  Google Scholar 

  • Sergent C, Dehaene S (2004) Is consciousness a gradual phenomenon? Evidence for an all-or-none bifurcation during the attentional blink. Psychol Sci 15:720–725

    Article  PubMed  Google Scholar 

  • Shannon C (1959) Coding theorems for a discrete source with a fidelity criterion. Inst Radio Eng Intern Conv Rec 7:142–163

    Google Scholar 

  • Spenser J (2010) The giant component: the golden anniversary. Notices AMS 57:720–724

    Google Scholar 

  • Turner B (2000) Histone acetylation and an epigenetic code. Bioessays 22:836–845

    Article  CAS  PubMed  Google Scholar 

  • Wallace R (2000) Language and coherent neural amplification in hierarchical systems: renormalization and the dual information source of a generalized spatiotemporal stochastic resonance. Int J Bifurcation Chaos 10:493–502

    Article  Google Scholar 

  • Wallace R (2005) Consciousness: a mathematical treatment of the global neuronal workspace model. Springer, New York

    Google Scholar 

  • Wallace R (2006) Pitfalls in biological computing: canonical and idiosyncratic dysfunctions of conscious machines. Mind Matter 4:91–113

    Google Scholar 

  • Wallace R (2007) Culture and inattentional blindness: a global workspace perspective. J Theor Biol 245:378–390

    Article  PubMed  Google Scholar 

  • Wallace R (2008) Toward formal models of biologically inspired, highly parallel machine cognition. Int J Parallel Emergent Distrib Syst 23:367–408

    Article  Google Scholar 

  • Wallace R (2009) Programming coevolutionary machines: the emerging conundrum. Int J Parallel Emergent Distrib Syst 24:443–453

    Article  Google Scholar 

  • Wallace R (2010a) Expanding the modern synthesis. Comptes Rendus Biol 333:701–709

    Article  Google Scholar 

  • Wallace R (2010b) Tunable epigenetic catalysis: programming real-time cognitive machines. Int J Parallel Emergent Distrib Syst 25:209–222

    Article  Google Scholar 

  • Wallace R (2012) Consciousness, crosstalk, and the mereological fallacy: an evolutionary perspective. Phys Life Rev 9:426–453

    Article  PubMed  Google Scholar 

  • Wallace R, Wallace D, Wallace RG (2003) Toward cultural oncology: the evolutionary information dynamics of cancer. Open Syst Inf Dyn 10:159–181

    Article  Google Scholar 

  • Wallace R, Fullilove M (2008) Collective consciousness and its discontents. Springer, New York

    Book  Google Scholar 

  • Wallace R, Wallace D (2008) Punctuated equilibrium in statistical models of generalized coevolutionary resilience: how sudden ecosystem transitions can entrain both phenotype expression and Darwinian selection. Trans Computat Syst Biol IX LNBI 5121:23–85

    Article  Google Scholar 

  • Wallace R, Wallace D (2009) Code, context, and epigenetic catalysis in gene expression. Trans Computat Syst Biol IX LNBI 5750:283–334

    Google Scholar 

  • Wallace R, Wallace D (2010) Gene expression and its discontents: the social production of chronic disease. Springer, New York

    Book  Google Scholar 

  • Wallace R, Wallace D (2013) A mathematical approach to multilevel, multiscale health interventions: pharmaceutical industry decline and policy response. Imperial College Press, London

    Book  Google Scholar 

  • West-Eberhard M (2003) Developmental plasticity and evolution. Oxford University Press, New York

    Google Scholar 

  • Wilson K (1971) Renormalization group and critical phenomena. I renormalization group and the Kadanoff scaling picture. Phys Rev B 4:3174–3183

    Article  Google Scholar 

  • Wolpert D, MacReady W (1995) No free lunch theorems for search. Santa Fe Institute SFI-TR-02-010

  • Wolpert D, MacReady W (1997) No free lunch theorems for optimization. IEEE Trans Evol Comput 1:67–82

    Article  Google Scholar 

  • Zhu R, Rebirio A, Salahub D, Kaufmann S (2007) Studying genetic regulatory networks at the molecular level: delayed reaction stochastic models. J Theor Biol 246:725–745

    Article  CAS  PubMed  Google Scholar 

Download references

Acknowledgments

The author thanks a reviewer for comments useful in revision.

Author information

Authors and Affiliations

  1. New York State Psychiatric Institute, 1051 Riverside Dr., Box 47, New York, NY, 10032, USA

    Rodrick Wallace

Authors
  1. Rodrick Wallace
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Rodrick Wallace.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Wallace, R. Cognition and biology: perspectives from information theory. Cogn Process 15, 1–12 (2014). https://doi.org/10.1007/s10339-013-0573-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10339-013-0573-1

Keywords

Search

Navigation