The Importance of Self-excitation in Spiking Neural Networks Evolved to Recognize Temporal Patterns
Biological and artificial spiking neural networks process information by changing their states in response to the temporal patterns of input and of the activity of the network itself. Here we analyse very small networks, evolved to recognize three signals in a specific pattern (ABC) in a continuous temporal stream of signals (...CABCACB...). This task can be accomplished by networks with just four neurons (three interneurons and one output). We show that evolving the networks in the presence of noise and variation of the intervals of silence between signals biases the solutions towards networks that can maintain their states (a form of memory), while the majority of networks evolved without variable intervals between signals cannot do so. We demonstrate that in most networks, the evolutionary process leads to the presence of superfluous connections that can be pruned without affecting the ability of the networks to perform the task and, if the unpruned network can maintain memory, so does the pruned network. We then analyse how these small networks can perform their tasks, using a paradigm of finite state transducers. This analysis shows that self-excitatory loops (autapses) in these networks are crucial for both the recognition of the pattern and for memory maintenance.
KeywordsTemporal pattern recognition Spiking neural networks Ex-loops Self-loops Artificial evolution Minimal cognition Complex networks Genetic algorithm Finite state transducer
This work was supported by the Polish National Science Center (project EvoSN, UMO-2013/08/M/ST6/00922). MY acknowledges the support of the KNOW RNA Research Center in Poznan (No. 01/KNOW2/2014) and POWR.03.02.00-00-I006/17.
- 3.Bialek, W., Rieke, F., van Steveninck, R.R.d.R., Warland, D., et al.: Reading a neural code. In: Neural Information Processing Systems, pp. 36–43 (1989)Google Scholar
- 10.Florian, R.V.: Biologically inspired neural networks for the control of embodied agents. Center for Cognitive and Neural Studies (Cluj-Napoca, Romania), Tech. rep. Coneural-03-03 (2003)Google Scholar
- 38.Yaqoob, M., Wróbel, B.: Robust very small spiking neural networks evolved with noise to recognize temporal patterns. In: ALIFE 2018: Proceedings of the 2018 Conference on Artificial Life - MIT Press, pp. 665–672 (2018)Google Scholar
- 39.Yaqoob, M., Wróbel, B.: Very small spiking neural networks evolved to recognize a pattern in a continuous input stream. In: 2017 IEEE Symposium Series on Computational Intelligence (SSCI) - IEEE, pp. 3496–3503 (2017)Google Scholar