Normalization for probabilistic inference with neurons
Recently, there have been a number of proposals regarding how biologically plausible neural networks might perform probabilistic inference (Rao, Neural Computation, 16(1):1–38, 2004; Eliasmith and Anderson, Neural engineering: computation, representation and dynamics in neurobiological systems, 2003; Ma et al., Nature Neuroscience, 9(11):1432–1438, 2006; Sahani and Dayan, Neural Computation, 15(10):2255–2279, 2003). To be able to repeatedly perform such inference, it is essential that the represented distributions be appropriately normalized. Past approaches have considered normalization mechanisms independently of inference, often leaving them unexplored, or appealing to a notion of divisive normalization that requires pooling across many neurons. Here, we demonstrate how normalization and inference can be combined into an appropriate connection matrix, eliminating the need for pooling or a division-like operation. We algebraically demonstrate that such a solution is available regardless of the inference being performed. We show that such a solution is relevant to neural computation by implementing it in a recurrent spiking neural network.
KeywordsNeural computation Probabilistic inference Spiking network Attractor network Normalization NEF
Unable to display preview. Download preview PDF.
- Eliasmith C, Anderson CH (2003) Neural engineering: computation, representation and dynamics in neurobiological systems. MIT Press, CambridgeGoogle Scholar
- Fischer BJ (2005) A model of the computations leading to a representation of auditory space in the midbrain of the barn owl. PhD thesis, Washington University, St. LouisGoogle Scholar
- Rieke F, Warland D, deRuytervan Steveninick R, Bialek W (1997) Spikes: exploring the neural code. MIT Press, Cambridge, MAGoogle Scholar
- Shi J, Wielaard J, Sajda P (2006) Analysis of a gain control model of V1: is the goal redundancy reduction? Conference proceedings: ... Annual international conference of the IEEE engineering in medicine and biology society. IEEE Eng Med Biol Soc 1:4991–4994.Google Scholar