Skip to main content

Abstract

This chapter presents the general background information about the Hierarchical Temporal Memory (HTM). HTM is a recently proposed cognitive learning algorithm that is intended to emulate the overall structural and functionality of the human neocortex responsible for the high-order functions such as cognition, learning and making predictions. The main properties of HTM is hierarchical structure, sparsity and modularity. HTM consists of two main parts: HTM Spatial Pooler (SP) and HTM Temporal Memory (TM). The HTM SP performs the encoding of the input data and produces sparse distributed representation (SDR) of the input pattern useful for visual data processing and classification tasks. The HTM TM detects the temporal changes in the input data and performs prediction making.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 149.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 199.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Ahmad S, Lewis M (2017) Temporal memory algorithm. Technical report, Numenta, Inc

    Google Scholar 

  2. Cui Y, Ahmad S, Hawkins J (2017) The HTM spatial Pooler- a neocortical algorithm for online sparse distributed coding. Technical report, Numenta, Inc

    Google Scholar 

  3. Fan D, Sharad M, Sengupta A, Roy K (2016) Hierarchical temporal memory based on spin-neurons and resistive memory for energy-efficient brain-inspired computing. IEEE Trans Neural Netw Learn Syst 27(9):1907–1919

    Article  MathSciNet  Google Scholar 

  4. Hawkins J (2004) On Intelligence. Griffin, Macmillan

    Google Scholar 

  5. Hawkins J (2016) Biological and machine intelligence. Numenta. http://numenta.com/biological-and-machine-intelligence/

  6. Ahmad S, Hawkins J (2016) How do neurons operate on sparse distributed representations? A mathematical theory of sparsity, neurons and active dendrites. Technical report, Numenta, Inc

    Google Scholar 

  7. Hawkins J, Ahmad S (2016) Why neurons have thousands of synapses, a theory of sequence memory in neocortex. Technical report, Numenta, Inc

    Google Scholar 

  8. Hawkins J, Ahmad S, Dubinsky D (2010) Hierarchical temporal memory including HTM cortical learning algorithms. Techical report, Numenta, Inc, Palto Alto. http://www.numenta.com/htmoverview/education/HTM_CorticalLearningAlgorithms.pdf

  9. Hawkins J, Ahmad S, Purdy S, Lavin A (2016) Biological and machine intelligence (bami). Initial online release 0.4

    Google Scholar 

  10. Ibrayev T, Krestinskaya O, James AP (2017) Design and implication of a rule based weight sparsity module in HTM spatial pooler. In: 24th IEEE international conference on electronics, circuits and systems (ICECS). IEEE, pp 274–277

    Google Scholar 

  11. Ibrayev T, Myrzakhan U, Krestinskaya O, Irmanova A, James AP (2018) On-chip face recognition system design with memristive hierarchical temporal memory. J Intell Fuzzy Syst 34(3):1393–1402

    Article  Google Scholar 

  12. James A, Ibrayev T, Krestinskaya O, Dolzhikova I (2018) Introduction to memristive HTM circuits. In: Memristor and memristive neural networks. InTech

    Google Scholar 

  13. Krestinskaya O, James AP (2018) Feature extraction without learning in an analog spatial pooler memristive-CMOS circuit design of hierarchical temporal memory. Analog Integr Circuits Signal Process 95(3):457–465

    Article  Google Scholar 

  14. Krestinskaya O, Dolzhikova I, James AP (2018) Hierarchical temporal memory using memristor networks: a survey. IEEE Trans Emerg Top Comput Intell 2(5):380–395. https://doi.org/10.1109/TETCI.2018.2838124

    Article  Google Scholar 

  15. Krestinskaya O, Ibrayev T, James AP (2018) Hierarchical temporal memory features with memristor logic circuits for pattern recognition. IEEE Trans Comput-Aided Des Integr Circuits Syst 37(6):1143–1156

    Article  Google Scholar 

  16. Krestinskaya O, James AP, Chua LO (2018) Neuro-memristive circuits for edge computing: a review. arXiv:1807.00962

  17. Lavin A, Ahmad S (2017) Sparse distributed representations. Technical report, Numenta, Inc

    Google Scholar 

  18. Purdy S (2017) Encoding data for HTM systems. Technical report, Numenta, Inc

    Google Scholar 

  19. Spruston N (2008) Pyramidal neurons: dendritic structure and synaptic integration. Nat Rev Neurosci 9(3):206

    Article  MathSciNet  Google Scholar 

  20. Webster D, Popper A (1992) The mammalian auditory pathway: neuroanatomy. Springer, New York

    Book  Google Scholar 

  21. Zyarah AM (2015) Design and analysis of a Re-configurable hierarchical temporal memory architecture. Technical report, Rochester institute of technology

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Alex Pappachen James .

Editor information

Editors and Affiliations

Chapter Highlights

Chapter Highlights

  • HTM is a recently proposed cognitive learning algorithm that is intended to emulate the overall structural and functionality of the human neocortex responsible for the high-order functions such as cognition, learning and making predictions.

  • The main properties of HTM is hierarchical structure, sparsity and modularity.

  • HTM consists of two main parts: HTM Spatial Pooler (SP) and HTM Temporal Memory (TM). The HTM SP performs the encoding of the input data and produces sparse distributed representation (SDR); while the HTM TM detects the temporal changes in the input data and performs prediction making.

  • HTM algorithm showed the promising results in various tasks, especially for visual data processing and classification, such as handwritten digits, face and speech recognition.

  • There are several hardware implementations of HTM; however, it is still an open problem.

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Dauletkhanuly, Y., Krestinskaya, O., James, A.P. (2020). HTM Theory. In: James, A. (eds) Deep Learning Classifiers with Memristive Networks. Modeling and Optimization in Science and Technologies, vol 14. Springer, Cham. https://doi.org/10.1007/978-3-030-14524-8_13

Download citation

Publish with us

Policies and ethics