An Experimental Study on the Relationships Among Neural Codes and the Computational Properties of Neural Networks
- 667 Downloads
Biological neural networks (BNNs) have inspired the creation of artificial neural networks (ANNs) . One of the properties of BNNs is computational robustness, but this property is often overlooked in computer science because ANNs are usually virtualizations executed in a physical machine that lacks computational robustness. However, it was recently proposed that computational robustness could be a key feature that drives the selection of the computational model in the evolution of animals . Until now, only energetic cost and processing time had been considered as the features that drove the evolution of the nervous system. The new standpoint leads us to consider whether computational robustness could have driven the evolution of not only the computational model but also other nervous system traits in animals through the process of natural selection. Because an important feature of an animal’s nervous system is its neural code, we tested the relationship among the computational properties of feed-forward neural networks and the neural codes through in silico experiments. We found two main results: There is a relationship between the number of epochs needed to train a feed-forward neural network using back-propagation and the neural code of the neural network, and a relationship exists between the computational robustness and the neural code of a feed-forward neural network. The first result is important to ANNs and the second to BNNs.
KeywordsComputational robustness Neural code Neural network Back-propagation
- 9.Guerguiev, J., et al.: Towards deep learning with segregated dendrites. eLife 6, e22901 (2017)Google Scholar
- 10.Gulyás, A.E.A.: Navigable networks as nash equilibria of navigation games. Nat. Commun. 6(7651), 1–10 (2015)Google Scholar
- 23.Rumelhart, D.E., Hinton, G.E., Williams, R.J.: Learning internal representations by error propagation. In: Parallel Distributed Processing: Explorations in the Microstructure of Cognition, vol. 1, pp. 318–362. MIT Press (1986)Google Scholar
- 24.Werbos, P.: Beyond regression: new tools for prediction and analysis in the behavior sciences. Doctor in philosophy, Harvard University (1974)Google Scholar