Skip to main content
SpringerLink
Log in

Modular neuron comprises of memristor-based synapse

  • Review
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Design of analog modular neuron based on memristor is proposed here. Since neural networks are built by repetition of basic blocks that are called neurons, using modular neurons is essential for the neural network hardware. In this work modularity of the neuron is achieved through distributed neurons structure. Some major challenges in implementation of synaptic operation are weight programmability, weight multiplication by input signal and nonvolatile weight storage. Introduction of memristor bridge synapse addresses all of these challenges. The proposed neuron is a modular neuron based on distributed neuron structure which it uses the benefits of the memristor bridge synapse for synaptic operations. In order to test appropriate operation of the proposed neuron, it is used in a real-world application of neural network. Off-chip method is used to train the neural network. The results show 86.7 % correct classification and about 0.0695 mean square error for 4-5-3 neural network based on proposed modular neuron.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

References

  1. Misra J, Saha I (2010) Artificial neural networks in hardware: a survey of two decades of progress. Neurocomputing 74:239–255

    Article  Google Scholar 

  2. Eberhardt S, Duong T, Thakoor A (1989) Design of parallel hardware neural network systems from custom analog VLSI `building block’ chips. In: Conference on neural networks 1989 IJCNN international joint

  3. Adhikari SP, Yang C, Kim H, Chua LO (2012) Memristor bridge synapse-based neural network and its learning. IEEE Trans Neural Netw Learn Syst 23(9):1426–1435

    Article  Google Scholar 

  4. Rahimi Azghadi M, Iannella N, Al-Sarawi SF, Indiveri G, Abbott G (2014) Spike-based synaptic plasticity in silicon: design, implementation, application, and challenges. In: Proceedings of the IEEE, vol 102(5), pp 717–737

  5. Chua LO (1971) Memristor—the missing circuit element. IEEE Trans Circuit Theory 18(5):507–519

    Article  Google Scholar 

  6. Strukov DB, Snider GS, Stewart DR, Williams RS (2008) The missing memristor found. Nature 453:80–83

    Article  Google Scholar 

  7. Jo SH, Chang T, Ebong I, Bhadviya BB, Mazumder P, Lu W (2010) Nanoscale memristor device as synapse in neuromorphic systems. Nano Lett 10:1297–1301

    Article  Google Scholar 

  8. Lehtonen E, Laiho M (2010) CNN using memristors for neighborhood connections. In: 12th international workshop on cellular nanoscale networks and their applications CNNA 2010, pp 1–4

  9. Laiho M, Lehtonen E (2010) Cellular nanoscale network cell with memristors for local implication logic and synapses. In: Proceedings of 2010 IEEE international symposium on circuits and systems ISCAS, pp 2051–2054

  10. Kim H, Sah MP, Yang C, Roska T, Chua LO (2012) Memristor bridge synapses. Proc IEEE 100(6):2061–2070

    Article  Google Scholar 

  11. Satyanarayana S, Tsividis Y, Graf HP (1989) Analogue neural networks with distributed neurons. Electron Lett 25(5):302

    Article  Google Scholar 

  12. Satyanarayana S, Tsividis YP, Graf HP (1989) A reconfigurable VLSI neural network. In: 1989 Proceedings of international conference on wafer scale integration, vol 27, pp 67–81

  13. Biolek Z, Biolek D, Biolková V (2009) SPICE model of memristor with nonlinear dopant drift. Radioengineering 18:210–214

    Google Scholar 

  14. Joglekar YN, Wolf SJ (2008) The elusive memristor: signatures in basic electrical circuits. Physics 30(4):1–22

    Google Scholar 

  15. Djahanshahi H, Ahmadi M, Jullien GA, Miller WC (1996) A unified synapse-neuron building block for hybrid VLSI neural networks. In: 1996 IEEE international symposium on circuits and systems. Circuits and systems connecting the world. ISCAS 96, vol 3, pp 483–486

  16. Khodabandehloo G, Mirhassani M, Ahmadi M (2012) Analog implementation of a novel resistive-type sigmoidal neurons. IEEE Trans Very Large Scale Integr (VLSI) Syst 20(4):750–754

    Article  Google Scholar 

  17. Blake CL, Merz CJ (1998) UCI machine learning repository. University of California, Irvine, School of Information and Computer Sciences [Online]. http://archive.ics.uci.edu/ml

  18. Draghici S (2000) Neural networks in analog hardware—design and implementation issues. Int J Neural Syst 10:19–42

    Google Scholar 

  19. Aggarwal A, Hamilton B (2012) Training artificial neural networks with memristive synapses: HSPICE-matlab co-simulation. In: 11tneuron”h symposium on neural network applications in electrical engineering, pp 101–106

  20. Linn E, Siemon A, Waser R, Menzel S (2014) Applicability of Well-Established Memristive Models for Simulations of Resistive Switching Devices. IEEE Transactions on Circuits and Systems I 20(4):750–754

    Google Scholar 

  21. Pickett MD, Strukov DB, Borghetti JL, Yang JJ, Snider GS, Stewart DR, Williams RS (2009) Switching dynamics in titanium dioxide memristive devices. J Appl Phys 106(7):074508

    Article  Google Scholar 

  22. Kvatinsky S, Friedman EG, Kolodny A, Weiser UC (2013) TEAM: threshold adaptive memristor model. IEEE Trans Circuits Syst I Regul Papers 60(1):211–221

    Article  MathSciNet  Google Scholar 

  23. Kvatinsky S, Talisveyberg K, Fliter D, Friedman EG, Kolodny A, Weiser UC (2012) Models of memristors for SPICE simulations. In: Proceedings of the IEEE convention of electrical and electronics engineers in Israel, pp 1–5

Download references

Author information

Authors and Affiliations

  1. Iran University of Science and Technology, Tehran, Iran

    Jafar Shamsi & Sattar Mirzakuchaki

  2. University of Windsor, Windsor, Canada

    Amirali Amirsoleimani & Majid Ahmadi

Authors
  1. Jafar Shamsi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Amirali Amirsoleimani
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sattar Mirzakuchaki
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Majid Ahmadi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Amirali Amirsoleimani.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Shamsi, J., Amirsoleimani, A., Mirzakuchaki, S. et al. Modular neuron comprises of memristor-based synapse. Neural Comput & Applic 28, 1–11 (2017). https://doi.org/10.1007/s00521-015-2047-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-015-2047-0

Keywords

Search

Navigation