Solving a Delayed Response Task with Spiking and McCulloch-Pitts Agents
This paper investigates the evolution of evolved autonomous agents that solve a memory-dependent delayed response task. Two types of neurocontrollers are evolved: networks of McCulloch-Pitts neurons, and spiky networks, evolving also the parameterization of the spiking dynamics. We show how the ability of a spiky neuron to accumulate voltage is utilized for the delayed response processing. We further confront new questions about the nature of “spikiness”, showing that the presence of spiking dynamics does not necessarily transcribe to actual spikiness in the network, and identify two distinct properties of spiking dynamics in embedded agents. Our main result is that in tasks possessing memory-dependent dynamics, neurocontrollers with spiking neurons can be less complex and easier to evolve than neurocontrollers employing McCulloch-Pitts neurons. Additionally the combined utilization of spiking dynamics with incremental evolution can lead to the successful evolution of response behavior over very long delay periods.
KeywordsAutonomous Agent Delay Period Success Ratio Counting Process Localization Score
Unable to display preview. Download preview PDF.
- 4.Floreano, D., Mattiussi, C.: Evolution of Spiking Neural Controllers for Autonomous Vision-based Robots, Evolutionary Robotics IV. Springer, Berlin (2001)Google Scholar
- 5.Paolo, E.A.D.: Spike-timing dependent plasticity for evolved robot control: neural noise, synchronization and robustness. To appear in Adaptive Behavior 10 (2003)Google Scholar
- 7.Aharonov, R., Segev, L., Meilijson, I., Ruppin, E.: Localization of Function Via Lesion Analysis. Neural Computation 15 (2003)Google Scholar
- 8.Keinan, A., Hilgetag, C.C., Meilijson, I.: Fair attribution of contribution: Shapley value analysis of neurocontrollers (2003) (preprint)Google Scholar