Abstract
Much has been written about the free energy principle (FEP), and much misunderstood. The principle has traditionally been put forth as a theory of brain function or biological self-organisation. Critiques of the framework have focused on its lack of empirical support and a failure to generate concrete, falsifiable predictions. I take both positive and negative evaluations of the FEP thus far to have been largely in error, and appeal to a robust literature on scientific modelling to rectify the situation. A prominent account of scientific modelling distinguishes between model structure and model construal. I propose that the FEP be reserved to designate a model structure, to which philosophers and scientists add various construals, leading to a plethora of models based on the formal structure of the FEP. An entailment of this position is that demands placed on the FEP that it be falsifiable or that it conform to some degree of biological realism rest on a category error. To this end, I deliver first an account of the phenomenon of model transfer and the breakdown between model structure and model construal. In the second section, I offer an overview of the formal elements of the framework, tracing their history of model transfer and illustrating how the formalism comes apart from any interpretation thereof. Next, I evaluate existing comprehensive critical assessments of the FEP, and hypothesise as to potential sources of existing confusions in the literature. In the final section, I distinguish between what I hold to be the FEP—taken to be a modelling language or modelling framework—and what I term “FEP models.”
This is a preview of subscription content, access via your institution.
Notes
For a thorough overview of the FEP/MaxEnt connection, refer to Gottwald and Braun 2020.
We may think of the Hamiltonian of a physical system as the net kinetic and potential energies of all of the particles in the system.
Friston notes that it is interesting that the formulation of free energy minimisation using gradient flows (otherwise known as gradient descent) was an important practical development for the data analysis tools commonly applied in neuroscience—for example, in dynamic causal modelling. In brief, this freed one from the analytic derivations of vanilla variational Bayes and the use of conjugate priors; enabling a generic variational scheme for modelling empirical data known as variational Laplace.
References
Attias H (2000) A variational Bayesian framework for graphical models In Advances in neural information processing systems (pp 209-215)
Beal MJ (2003) Variational algorithms for approximate Bayesian inference. Doctoral dissertation, University College London
Bruineberg J, Kiverstein J, Rietveld E (2016) The anticipating brain is not a scientist: the free-energy principle from an ecological-enactive perspective. Synthese 195(6): 2417–2444
Bruineberg J, Rietveld E (2014) Self-organization, free energy minimization, and optimal grip on a field of affordances. Frontiers Human Neurosci 8:599
Colombo M (2017) Social motivation in computational neuroscience Or if brains are prediction machines, then the Humean theory of motivation is false. In: Kiverstein J (ed) Routledge handbook of philosophy of the social mind. Routledge, London, pp 320–340
Colombo M, Wright C (2017) Explanatory pluralism: An unrewarding prediction error for free energy theorists. Brain Cogn 112:3–12
Colombo M, Wright C (2018) First principles in the life sciences: the free-energy principle, organicism, and mechanism. Synthese. 1-26
Downes SM (2011) Scientific models. Philosophy. Compass 6(11):757–764
Downes SM (2020) Models and Modeling in the Sciences: A Philosophical Introduction. Routledge
van Es T (2020) Living models or life modelled? On the use of models in the free energy principle Adaptive Behavior, 1059712320918678
Feynman RP (1972) Statistical mechanics: a set of lectures Reading. W A Benjamin, Mass
Friston K (2009) The free-energy principle: A rough guide to the brain? Trends Cognitive Sci 13(7):293–301
Friston K (2010) The free-energy principle: A unified brain theory? Nat Rev: Neurosci 11(2):127–138
Friston K (2012) A free energy principle for biological systems. Entropy 14(11):2100–2121
Friston K (2013) Life as we know it. J Royal Soc Interface 10(86):20130475
Friston K (2019) A free energy principle for a particular physics arXiv preprint arXiv:190610184
Friston K, Ao P (2012) Free energy, value, and attractors Computational and mathematical methods in medicine
Friston KJ, Fagerholm ED, Zarghami TS, Parr T, Hipólito I, Magrou L, Razi A (2020) Parcels and particles: Markov blankets in the brain arXiv preprint, arXiv:200709704
Friston K, Frith CD (2015) Active inference, communication and hermeneutics. Cortex 68:129–143
Friston KJ, Wiese W, Hobson JA (2020) Sentience and the origins of consciousness: From Cartesian duality to Markovian monism. Entropy 22(5):516
Friston K, Levin M, Sengupta B, Pezzulo G (2015) Knowing one’s place: a free-energy approach to pattern regulation. J Royal Soc Interface 12(105):20141383
Friston K, Mattout J, Trujillo-Barreto N, Ashburner J, Penny W (2006) Variational free energy and the Laplace approximation. Neuroimage 34(1):220–234
Friston K, Stephan K (2007) Free energy and the brain. Synthese 159(3):417–458
Friston K, Trujillo-Barreto N, Daunizeau J (2008) DEM: a variational treatment of dynamic systems. Neuroimage. 41(3):849–885
Gershman SJ (2019) What does the free energy principle tell us about the brain? Neurons, Behav, Data Anal, Theory 2(3):1–10
Gershman S J, Daw N D (2012) Perception, action and utility: The tangled skein Principles of brain dynamics: Global state interactions, 293-312
Gottwald S, Braun DA (2020) The two kinds of free energy and the Bayesian revolution. PLoS Comput Biol 16(12):e1008420
Hinton GE, Van Camp D (1993) Keeping the neural networks simple by minimizing the description length of the weights In: Proceedings of the sixth annual conference on Computational learning theory (pp 5-13)
Hinton G E, Zemel R S (1993) Autoencoders, minimum description length and Helmholtz free energy. Advances in neural information processing systems (pp 3-10)
Hobson JA, Friston KJ (2014) Consciousness, dreams, and inference: The Cartesian theatre revisited. J Consciousness Stud 21(1–2):6–32
Hohwy J (2016) The Self-Evidencing Brain. Noûs. 50:259–285
Jaynes ET (1957) Inform Theory Statist Mech Phys Rev 106(4):620
Jiang D Q, Jiang D, Qian M (2004) Mathematical theory of nonequilibrium steady states: on the frontier of probability and dynamical systems (No 1833) Springer Verlag
Kiefer AB (2020) Psychophysical identity and free energy Journal of the Royal Socety. Interface 17:20200370
Kiefer AB, Hohwy J (2018) Content and misrepresentation in hierarchical generative models. Synthese 195(6):2387–2415
Kiefer A B, Hohwy J (2019) Representation in the Prediction Error Minimization Framework. In: Sarah K Robins, John Symons Paco Calvo (Eds), The Routledge Companion to Philosophy of Psychology: 2nd Edition London, UK: pp 384-409
Kirchhoff MD, Froese T (2017) Where there is life there is mind: In support of a strong life-mind continuity thesis. Entropy 19(4):169
Kirchhoff M, Parr T, Palacios E, Friston K, Kiverstein J (2018) The Markov blankets of life: Autonomy, active inference and the free energy principle. J Royal Soc Interface 15:138
Kirchhoff M, Robertson I (2018) Enactivism and predictive processing: A non-representational view. Philoso Explor 21:264–281
Klein C (2018) What do predictive coders want? Synthese 195(6):2541–2557
Kuchling F, Friston K, Georgiev G, Levin M (2019) Morphogenesis as Bayesian inference: A variational approach to pattern formation and control in complex biological systems Physics of life reviews
Lotka AJ (1910) Contribution to the theory of periodic reactions. J Phys Chem 14(3):271–274
Lotka AJ (1956) Elements of Mathematical Biology New York. Dover Publications, New York
MacKay DJ (1995a) Developments in probabilistic modelling with neural networks–ensemble learning In Neural Networks: Artificial Intelligence and Industrial Applications. Springer, London, pp 191–198
MacKay D J (1995b) Ensemble learning and evidence maximization In Proc Nips (Vol 10, No 154, p 4083)
MacKay DJ (1995c) Free energy minimisation algorithm for decoding and cryptanalysis. Electron Lett 31(6):446–447
MacKay DJ (2001) Local minima, symmetry-breaking, and model pruning in variational free energy minimization Inference Group. Cavendish Laboratory, Cambridge, UK
Neal RM, Hinton GE (1998) A view of the EM algorithm that justifies incremental, sparse, and other variants. In Jordan MI (ed) Learning in Graphical Model
Nguyen J, Frigg R (2017) Mathematics is not the only language in the book of nature. Synthese, 1-22
de Oliveira G S (2018) Representationalism is a dead end. Synthese, 1-27
Palacios ER, Isomura T, Parr T, Friston K (2019) The emergence of synchrony in networks of mutually inferring neurons. Sci Rep 9(1):1–14
Pearl J (1988) Probabilistic reasoning in intelligent systems: networks of plausible inference. Elsevier
Ramstead MJD, Badcock PB, Friston KJ (2018) Answering Schrödinger’s question: A free-energy formulation. Phys Life Rev 24:1–16
Ramstead MJ, Kirchhoff MD, Friston KJ(2019) A tale of two densities: Active inference is enactive inference. Adaptive Behavior, 1059712319862774
Ramstead MJ, Veissiére SP, Kirmayer LJ (2016) Cultural affordances: Scaffolding local worlds through shared intentionality and regimes of attention. Front Psychol 7:1090
Sims A (2016) A problem of scope for the free energy principle as a theory of cognition. Philos Psychol 29(7):967–980
Volterra V (1926) Variazioni e fluttuazioni del numero d’individui in specie animali conviventi. Memoria della Reale Accademia Nazionale dei Lincei 2:31–113
Weisberg M (2013) Simulation and similarity: Using models to understand the world. Oxford University Press
Weisberg M (2007) Who is a Modeler? Br J Philos Sci 58(2):207–233
Williams D (2020) Is the Brain an Organ for Prediction Error Minimization? PhilSciArchive Preprint
Wimsatt WC (1987) False models as a means to truer theories. In: Nitecki M, Hoffmann A (eds) Neutral models in biology. Oxford University Press, Oxford, pp 23–55
Zhang XJ, Qian H, Qian M (2012) Stochastic theory of nonequilibrium steady states and its applications. Part I Phys Rep 510(1–2):1–86
Acknowledgements
This paper has benefited tremendously from thoughtful feedback and lengthy discussions with many people, most notably Liam Bright, Tony Chemero, Andrew Corcoran, Carolyn Dicey Jennings and the Philosophy Lab at UC Merced, Krzysztof Dołega, Thomas van Es, Karl Friston, Cecilia Heyes, Bryce Huebner, Alex Kiefer, Michael Kirchhoff, Maxwell Ramstead, and Dalton Sakthivadivel.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Declarations
The author declares no conflicts of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Andrews, M. The math is not the territory: navigating the free energy principle. Biol Philos 36, 30 (2021). https://doi.org/10.1007/s10539-021-09807-0
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10539-021-09807-0