Optimizing Hierarchical Temporal Memory for Multivariable Time Series
Hierarchical Temporal Memory (HTM) is an emerging computational paradigm consisting of a hierarchically connected network of nodes. The hierarchy models a key design principle of neocortical organization. Nodes throughout the hierarchy encode information by means of clustering spatial instances within their receptive fields according to temporal proximity. Literature shows HTMs’ robust performance on traditional machine learning tasks such as image recognition. Problems involving multi-variable time series where instances unfold over time with no complete spatial representation at any point in time have proven trickier for HTMs. We have extended the traditional HTMs’ principles by means of a top node that stores and aligns sequences of input patterns representing the spatio-temporal structure of instances to be learned. This extended HTM network improves performance with respect to traditional HTMs in machine learning tasks whose input instances unfold over time.
KeywordsOptimal Topology Input Vector Child Node Parent Node Temporal Group
Unable to display preview. Download preview PDF.
- 2.Hawkings, J.: Hierarchical temporal memory, concepts, theory, and terminology. Numenta, Tech. Rep. (2006)Google Scholar
- 3.George, D., Jarosy, B.: The HTM learning algorithms. Numenta, Tech. Rep. (2007)Google Scholar
- 9.Hawkings, J.: On Intelligence. Cambridge University Press, Cambridge (1991)Google Scholar
- 10.Numenta: Problems that fit htm, Numenta, Tech. Rep. (2006)Google Scholar
- 11.George, D., Hawkins, J.: A hierarchical bayesian model of invariant pattern recognition in the visual cortex. In: Proceedings of 2005 IEEE International Joint Conference on Neural Networks, IJCNN 2005, July 4-August, vol. 3, pp. 1812–1817 (2005)Google Scholar
- 12.Abeles, M.: Corticonics: neural circuits of the cerebral cortex. Henry Holt and Company (2004)Google Scholar
- 15.Kadous, M.W.: Australian sign language signs data set, UCI Machine Learning Repository, Tech. Rep., http://archive.ics.uci.edu/ml/datasets/
- 16.Kadous, M.W.: Temporal classification: Extending the classification paradigm to multivariate time series. Ph.D. dissertation, The University of New South Wales (2002)Google Scholar