Skip to main content
SpringerLink
Log in

Hardware Spiking Artificial Neurons, Their Response Function, and Noises

  • Chapter
  • First Online:
Advances in Neuromorphic Hardware Exploiting Emerging Nanoscale Devices

Part of the book series: Cognitive Systems Monographs ((COSMOS,volume 31))

Abstract

In this chapter, overviewed are hardware-based spiking artificial neurons that code neuronal information by means of action potential, viz. spike, in hardware artificial neural networks (ANNs). Ongoing attempts to realize neuronal behaviours on Si ‘to a limited extent’ are addressed in comparison with biological neurons. Note that ‘to a limited extent’ in this context implicitly means ‘sufficiently’ for realizing key features of neurons as information processors. This ambiguous definition is perhaps open to a question as to what neuronal behaviours the key features encompass. The key features are delimited within the framework of neuromorphic engineering, and thus, they approximately are (i) integrate-and-fire; (ii) neuronal response function, i.e. spike-firing rate change upon synaptic current; and (iii) noise in neuronal response function. Hardware-based spiking artificial neurons are aimed to achieve these goals that are ambitious albeit challenging. Overviewing a number of attempts having made up to now illustrates approximately two seemingly different approaches to the goal: a mainstream approach with conventional active circuit elements, e.g. complementary metal-oxide-semiconductor (CMOS), and an emerging one with monostable resistive switching devices, i.e. threshold switches. This chapter will cover these approaches with particular emphasis on the latter. For instance, available types of threshold switches, which are classified upon underlying physics will be dealt with in detail.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 119.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 159.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 159.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Averbeck, B.B., Latham, P.E., Pouget, A.: Nat. Rev. Neurosci. 7, 358–366 (2006)

    Article  Google Scholar 

  2. Averbeck, B.B., Lee, D.: J. Neurophysiol. 95, 3633–3644 (2006)

    Article  Google Scholar 

  3. Indiveri, G., Linares-Barranco, B., Hamilton, T.J., van Schaik, A., Etienne-Cummings, R., Delbruck, T., Liu, S.-C., Dudek, P., Häfliger, P., Renaud, S., Schemmel, J., Cauwenberghs, G., Arthur, J., Hynna, K., Folowosele, F., Saighi, S., Serrano-Gotarredona, T., Wijekoon, J., Wang, Y., Boahen, K.: Front. Neurosci. 5, 1–23 (2011)

    Google Scholar 

  4. Hamann, C.H., Hamnett, A., Vielstich, W.: Electrochemistry, 2nd edn. WILEY-VCH Verlag GmbH & Co., Weinheim (2007)

    Google Scholar 

  5. Gadsby, D.C.: Nat. Rev. Mol. Cell Biol. 10, 344–352 (2009)

    Article  Google Scholar 

  6. Jeong, D.S., Kim, I., Ziegler, M., Kohlstedt, H.: RSC Adv. 3, 3169–3183 (2013)

    Article  Google Scholar 

  7. Malenka, R.C., Nicoll, R.A.: Science 285, 1870–1874 (1999)

    Article  Google Scholar 

  8. Dayan, P., Abbott, L.F.: Theoretical Neuroscience. The MIT Press, London (2001)

    MATH  Google Scholar 

  9. Butts, D.A., Goldman, M.S.: PLoS Biol. 4, e92 (2006)

    Article  Google Scholar 

  10. Deneve, S., Latham, P.E., Pouget, A.: Nat. Neurosci. 4, 826–831 (2001)

    Article  Google Scholar 

  11. Knill, D.C., Pouget, A.: Trends Neurosci. 27, 712–719 (2004)

    Article  Google Scholar 

  12. Ma, W.J., Beck, J.M., Latham, P.E., Pouget, A.: Nat. Neurosci. 9, 1432–1438 (2006)

    Article  Google Scholar 

  13. Calvin, W.H., Stevens, C.F.: Science 155, 842–844 (1967)

    Article  Google Scholar 

  14. Bialek, W., Rieke, F.: de Ruyter van Steveninck R. Warland D. Science 252, 1854–1857 (1991)

    Google Scholar 

  15. Gerstner, W.: Neural Comput. 12, 43–89 (2000)

    Article  Google Scholar 

  16. Chance, F.S., Abbott, L.F., Reyes, A.D.: Neuron 35, 773–782 (2002)

    Article  Google Scholar 

  17. Eliasmith, C., Anderson, C.H.: Neural Engineering: Computation, Representation, and Dynamics in Neurobiological Systems. MIT Press, Cambridge, MA (2003)

    Google Scholar 

  18. Anderson, C.: Computational Intelligence Imitating Life. IEEE Press, New York (1994)

    Google Scholar 

  19. Pouget, A., Dayan, P., Zemel, R.S.: Annu. Rev. Neurosci. 26, 381–410 (2003)

    Article  Google Scholar 

  20. Weiss, Y., Fleet, D.J.: Velocity Likelihoods in Biological and Machine Vision. In Statistical Theories of the Cortex. MIT Press, Cambridge, MA (2002)

    Google Scholar 

  21. Lim, H., Kornijcuk, V., Seok, J.Y., Kim, S.K., Kim, I., Hwang, C.S., Jeong, D.S.: Sci. Rep. (2015)

    Google Scholar 

  22. Lapicque, L.: J. Physiol. Pathol. Gen. 9, 620–635 (1907)

    Google Scholar 

  23. Abbott, L.F.: Brain Res. Bull. 50, 303–304 (1999)

    Article  Google Scholar 

  24. Gerstner, W., Kistler, W.M.: Spiking Neuron Models: Single Neurons, Populations. Cambridge University Press, Plasticity (2002)

    Book  MATH  Google Scholar 

  25. Jolivet, R., Lewis, T.J., Gerstner, W.: Generalized Integrate-and-Fire Models of Neuronal Activity Approximate Spike Trains of a Detailed Model to a High Degree of Accuracy, vol 92. vol 2. doi:10.1152/jn.00190.2004 (2004)

  26. Hodgkin, A.L., Huxley, A.F.: J. Physiol. 117, 500–544 (1952)

    Article  Google Scholar 

  27. FitzHugh, R.: Biophys. J. 1, 445–466 (1961)

    Article  Google Scholar 

  28. Nagumo, J., Arimoto, S., Yoshizawa, S.: Proc. IRE 50, 2061–2070 (1962)

    Article  Google Scholar 

  29. Destexhe, A.: Neural Comput. 9, 503–514 (1997)

    Article  Google Scholar 

  30. Kepler, T., Abbott, L.F., Marder, E.: Biol. Cybern. 66, 381–387 (1992)

    Article  Google Scholar 

  31. Mead, C.: Analog VLSI and Neural Systems. Adison-Wesley, Reading, MA (1989)

    MATH  Google Scholar 

  32. Mead, C.: Proc. IEEE 78, 1629–1636 (1990)

    Article  Google Scholar 

  33. Indiveri, G., Chicca, E., Douglas, R.: IEEE Trans. Neural Netw. 17, 211–221 (2006)

    Article  Google Scholar 

  34. Pickett, M.D., Medeiros-Ribeiro, G., Williams, R.S.: Nat. Mater. 12, 114–117 (2012)

    Article  Google Scholar 

  35. Crane, H.D.: Proc. IRE 50, 2048–2060 (1962)

    Article  Google Scholar 

  36. Jeong, D.S., Thomas, R., Katiyar, R.S., Scott, J.F., Kohlstedt, H., Petraru, A., Hwang, C.S.: Rep. Prog. Phys. 75, 076502 (2012)

    Article  Google Scholar 

  37. Jeong, D.S., Lim, H., Park, G.-H., Hwang, C.S., Lee, S.: Cheong B-k. J. Appl. Phys. 111, 102807 (2012)

    Article  Google Scholar 

  38. Ovshinsky, S.R.: Phys. Rev. Lett. 21, 1450–1453 (1968)

    Article  Google Scholar 

  39. Lee, M.-J., Lee, D., Cho, S.-H., Hur, J.-H., Lee, S.-M., Seo, D.H., Kim, D.-S., Yang, M.-S., Lee, S., Hwang, E., Uddin, M.R., Kim, H., Chung, U.I., Park, Y., Yoo, I.-K.: Nat. Commun. 4, 2629 (2013)

    Google Scholar 

  40. Ahn, H.-W., Jeong, D.S., Cheong, B.-K., Kim, S.-D., Shin, S.-Y., Lim, H., Kim, D., Lee, S.: ECS Solid State Lett. 2, N31–N33 (2013)

    Google Scholar 

  41. Mott, N.F.: Proc. Phys. Soc. Sect. A 62, 416 (1949)

    Article  Google Scholar 

  42. Cario, L., Vaju, C., Corraze, B., Guiot, V., Janod, E.: Adv. Mater. 22, 5193–5197 (2010)

    Article  Google Scholar 

  43. Han, J.-W.: Choi Y-K Bistable resistor (biristor)—gateless silicon nanowire memory. Symp. VLSI Technol. 15–17(2010), 171–172 (2010). doi:10.1109/vlsit.2010.5556215

    Google Scholar 

  44. Pickett, M.D., Williams, R.S.: Nanotechnology 23, 215202 (2012)

    Article  Google Scholar 

  45. Liu, X., Sadaf, S.M., Son, M., Shin, J., Park, J., Lee, J., Park, S., Hwang, H.: Nanotechnology 22, 475702 (2011)

    Article  Google Scholar 

  46. Bienenstock, E., Cooper, L., Munro, P.: J. Neurosci. 2, 32–48 (1982)

    Google Scholar 

  47. Deneve, S., Latham, P.E., Pouget, A.: Nat. Neurosci. 2, 740–745 (1999)

    Article  Google Scholar 

  48. DerChang, K., Tang, S., Karpov, I.V., Dodge, R., Klehn, B., Kalb, J.A., Strand, J., Diaz, A., Leung, N., Wu, J., Lee, S., Langtry, T., Kuo-wei, C., Papagianni, C., Jinwook, L., Hirst, J., Erra, S., Flores, E., Righos, N., Castro, H.: Spadini G A stackable cross point Phase Change Memory. In: IEEE International Electron Devices Meeting, vol. 7–9, pp. 1–4 (2009)

    Google Scholar 

  49. Merolla, P.A., Arthur, J.V., Alvarez-Icaza, R., Cassidy, A.S., Sawada, J., Akopyan, F., Jackson, B.L., Imam, N., Guo, C., Nakamura, Y., Brezzo, B., Vo, I., Esser, S.K., Appuswamy, R., Taba, B., Amir, A., Flickner, M.D., Risk, W.P., Manohar, R., Modha, D.S.: Science 345, 668–673 (2014)

    Article  Google Scholar 

  50. Gehlhaar, J.: Neuromorphic processing: a new frontier in scaling computer architecture. In: Architectural Support for Programming Languages and Operating Systems, Salt Lake City, UT, USA, pp. 317–318 (2014)

    Google Scholar 

Download references

Acknowledgements

DSJ acknowledges the Korea Institute of Science and Technology grant (Grant No 2Z04510). DSJ also thanks Mr. Hyungkwang Lim for his kind help.

Author information

Authors and Affiliations

  1. Center for Electronic Materials Research, Korea Institute of Science and Technology, Hwarangno 14-gil 5, Seongbuk-gu, Seoul, 136-791, Republic of Korea

    Doo Seok Jeong

Authors
  1. Doo Seok Jeong
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Doo Seok Jeong .

Editor information

Editors and Affiliations

  1. Department of Electrical Engineering, Indian Institute of Technology Delhi, New Delhi, Delhi, India

    Manan Suri

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer (India) Pvt. Ltd.

About this chapter

Cite this chapter

Jeong, D.S. (2017). Hardware Spiking Artificial Neurons, Their Response Function, and Noises. In: Suri, M. (eds) Advances in Neuromorphic Hardware Exploiting Emerging Nanoscale Devices. Cognitive Systems Monographs, vol 31. Springer, New Delhi. https://doi.org/10.1007/978-81-322-3703-7_1

Download citation

  • DOI: https://doi.org/10.1007/978-81-322-3703-7_1

  • Published:

  • Publisher Name: Springer, New Delhi

  • Print ISBN: 978-81-322-3701-3

  • Online ISBN: 978-81-322-3703-7

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation