Abstract
In this paper we present a neural sequence machine that can learn temporal sequences of discrete symbols, and perform better than machines that use Elman’s context layer, time delay nets or shift register-like context memories. This machine can perform sequence detection, prediction and learning of new sequences. The network model is an associative memory with a separate store for the sequence context of a pattern. Learning is one-shot. The model is capable of both off-line and on-line learning. The machine is based upon a sparse distributed memory which is used to store associations between the current context and the input symbol. Numerical tests have been done on the machine to verify its properties. We have also shown that it is possible to implement the memory using spiking neurons.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Vocal interface for a man-machine dialog. Dominique Beroule. ACL Proceedings, First European Conference (1983)
Durand, S., Alexandre, F.: Learning Speech as Acoustic Sequences with the Unsupervised Model, tom. In: NEURAP, 8th Intl. conference on neural networks and their applications, France (1995)
Kanerva, P.: Sparse Distributed Memory. MIT Press, Cambridge (1988)
Elman, J.L.: Finding structure in time. Cognitive Science 14 (1990)
Furber, S.B., Cumpstey, J.M., Bainbridge, W.J., Temple, S.: Sparse distributed memory using N-of-M codes. Neural Networks 10 (2004)
Lang, K.J., Hinton, G.E.: The development of the time delay neural network architecture for speech recognition. Tech. Report 88152, Carnegie Mellon (1988)
Sun, R., Giles, C.L. (eds.): Sequence Learning. Springer, Heidelberg (2000)
Maass, W., Bishop, C.M. (eds.): Pulsed Neural Networks. MIT Press, Cambridge (1998)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Bose, J., Furber, S.B., Shapiro, J.L. (2005). A Spiking Neural Sparse Distributed Memory Implementation for Learning and Predicting Temporal Sequences. In: Duch, W., Kacprzyk, J., Oja, E., Zadrożny, S. (eds) Artificial Neural Networks: Biological Inspirations – ICANN 2005. ICANN 2005. Lecture Notes in Computer Science, vol 3696. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11550822_19
Download citation
DOI: https://doi.org/10.1007/11550822_19
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-28752-0
Online ISBN: 978-3-540-28754-4
eBook Packages: Computer ScienceComputer Science (R0)