Skip to main content
SpringerLink
Log in

Memristive competitive hopfield neural network for image segmentation application

  • Research Article
  • Published:
Cognitive Neurodynamics Aims and scope Submit manuscript

Abstract

Image segmentation implementation provides simplified and effective feature information of image. Neural network algorithms have made significant progress in the application of image segmentation task. However, few studies focus on the implementation of hardware circuits with high-efficiency analog calculations and parallel operations for image segmentation problem. In this paper, a memristor-based competitive Hopfield neural network circuit is proposed to deal with the image segmentation problem. In this circuit, the memristive cross array is applied to store synaptic weights and perform matrix operations. The competition module based on the Winner-take-all mechanism is composed of the competition neurons and the competition control circuit, which simplifies the energy function of the Hopfield neural network and realizes the output function. Operational amplifiers and ABM modules are used to integrate operations and process external input information, respectively. Based on these designs, the circuit can automatically implement iteration and update of data. A series of PSPICE simulations are designed to verify the image segmentation capability of this circuit. Comparative experimental results and analysis show that this circuit has effective improvements both in processing speed and segmentation accuracy compared with other methods. Moreover, the proposed circuit shows good robustness to noise and memristive variation.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17

Similar content being viewed by others

References

  • Achanta R, Shaji A, Smith K, Lucchi A, Fua P, Süsstrunk S (2012) SLIC superpixels compared to state-of-the-art superpixel methods. IEEE Trans Pattern Anal Mach Intell 34(11):2274–2282

    PubMed  Google Scholar 

  • Al-Dmour H, Al-Ani A (2018) A clustering fusion technique for MR brain tissue segmentation. Neurocomputing 275:546–559

    Google Scholar 

  • Arora Anjali, Niranjan Vandana (2017) Low power filter design using memristor, meminductor and memcapacitor. In: 2017 4th IEEE Uttar Pradesh section international conference on electrical, computer and electronics (UPCON), pp 113–117

  • Badrinarayanan V, Kendall A, Cipolla R (2017) Segnet: a deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans Intell Transp Syst 39(12):2481–2495

    Google Scholar 

  • Bhattacharyya S, Maulik U, Dutta P (2011) Multilevel image segmentation with adaptive image context based thresholding. Appl Soft Comput 11(1):946–962

    Google Scholar 

  • Chen LC, Papandreou G, Kokkinos I, Murphy K, Yuille AL (2017) Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs. IEEE Trans Pattern Anal Mach Intell 40(4):834–848

    PubMed  Google Scholar 

  • Cheng KS, Lin JS, Mao CW (1996) The application of competitive Hopfield neural network to medical image segmentation. IEEE Trans Med Imag 15(4):560–567

    CAS  Google Scholar 

  • Choi J, Sheu BJ (1993) A high-precision VLSI winner-take-all circuit for self-organizing neural networks. IEEE J Solid State Circuit 28(5):576–584

    Google Scholar 

  • Comaniciu D, Meer P (2002) Mean shift: a robust approach toward feature space analysis. IEEE Trans Pattern Anal Mach Intell 24(5):603–619

    Google Scholar 

  • Deng Y, Manjunath BS (2001) Unsupervised segmentation of color-texture regions in images and video. IEEE Trans Pattern Anal Mach Intell 23(8):800–810

    Google Scholar 

  • Dong G, Xie M (2005) Color clustering and learning for image segmentation based on neural networks. IEEE Trans Neural Netw 16(4):925–936

    PubMed  Google Scholar 

  • Felzenszwalb PF, Huttenlocher DP (2004) Efficient graph-based image segmentation. Int J Comput Vis 59(2):167–181

    Google Scholar 

  • Fish A, Milrud V, Yadid-Pecht O (2005) High-speed and high-precision current winner-take-all circuit. IEEE Trans Circuits Syst II Exp Briefs 52(3):131–135

    Google Scholar 

  • Gu Z, Cheng J, Fu H, Zhou K, Hao H, Zhao Y, Zhang T, Gao S, Liu J (2019) CE-Net: context encoder network for 2D medical image segmentation. IEEE Trans Med Imag 38(10):2281–2292

    Google Scholar 

  • Han X, Xiong X, Duan F (2015) A new method for image segmentation based on BP neural network and gravitational search algorithm enhanced by cat chaotic mapping. Appl Intell 43(4):855–873

    Google Scholar 

  • Hong Q, Li Y, Wang X (2020) Memristive continuous Hopfield neural network circuit for image restoration. Neural Comput Appl 32(12):8175–8185

    Google Scholar 

  • Hsu WY (2012) Improved watershed transform for tumor segmentation: application to mammogram image compression. Exp Syst Appl 39(4):3950–3955

    Google Scholar 

  • Hu SG, Liu Y, Liu Z, Chen TP, Wang JJ, Yu Q, Deng LJ, Yin Y, Hosaka S (2015) Associative memory realized by a reconfigurable memristive Hopfield neural network. Nat Commun 6:7522

    CAS  PubMed  Google Scholar 

  • Hu X, Duan S, Chen G, Chen L (2017) Modeling affections with memristor-based associative memory neural networks. Neurocomputing 223:129–137

    Google Scholar 

  • Ji X, Hu X, Zhou Y, Dong Z, Duan S (2019) Adaptive sparse coding based on memristive neural network with applications. Cogn Neurodyn 13(5):475–488

    PubMed  PubMed Central  Google Scholar 

  • Kanungo T, Mount DM, Netanyahu NS, Piatko CD, Silverman R, Wu AY (2002) An efficient K-means clustering algorithm: analysis and implementation. IEEE Trans Pattern Anal Mach Intell 24(7):881–892

    Google Scholar 

  • Khan Tariq M, Bailey Donald G, Khan Mohammad AU, Kong Yinan (2020) Real-time iris segmentation and its implementation on FPGA. J Real Time Image Process 17(5):1089–1102

  • Khan JF, Bhuiyan SM, Adhami RR (2011) Image segmentation and shape analysis for road-sign detection. IEEE Trans Intell Transp Syst 12(1):83–96

    Google Scholar 

  • Li C, Li Y (2011) Fast and robust image segmentation by small-world neural oscillator networks. Cogn Neurodyn 5(2):209–220

    PubMed  PubMed Central  Google Scholar 

  • Liao M, Wang C, Sun Y, Lin H, Xu C (2022) Memristor-based affective associative memory neural network circuit with emotional gradual processes. Neural Comput Appl 34:13667–13682

    Google Scholar 

  • Lin H, Wang C, Hong Q, Sun Y (2021) A multi-stable memristor and its application in a neural network. IEEE Trans Circuits Syst II Exp Briefs 67(12):3472–3476

    Google Scholar 

  • Liu Beiye, Li Hai, Chen Yiran, Li Xin, Huang Tingwen, Wu Qing, Barnell Mark (2014) Reduction and IR-drop compensations techniques for reliable neuromorphic computing systems. In: 2014 IEEE/ACM international conference on computer-aided design (ICCAD), pp 63–70

  • Liu Beiye, Li Hai, Chen Yiran, Li Xin, Wu Qing, Huang Tingwen (2015) Vortex: Variation-aware training for memristor X-bar. In: 2015 52nd ACM/EDAC/IEEE design automation conference (DAC), pp 1–6

  • Liu Han, Zhao Yue, Xie Guo (2017) Image segmentation implementation based on FPGA and SVM. In: 2017 3rd International conference on control, automation and robotics (ICCAR), pp 405–409

  • Liu Ye, Wang Yin, Chang Liang, Zhou Jun (2020) A Fast and Efficient FPGA-based Level Set Hardware Accelerator for Image Segmentation. In: 2020 IEEE international conference on integrated circuits, technologies and applications (ICTA), pp 61–62

  • Liu X, Zeng Z, Wen S (2016) Implementation of memristive neural network with full-function pavlov associative memory. IEEE Trans Circuits Syst I-Regul Pap 63(9):1454–1463

    Google Scholar 

  • Liu C, Ji H, Qiu A (2021) Fast vertex-based graph convolutional neural network and its application to brain images. Neurocomputing 434:1–10

    Google Scholar 

  • Maffezzoni P, Bahr B, Zhang Z, Daniel L (2016) Analysis and design of boolean associative memories made of resonant oscillator arrays. IEEE Trans Circuits Syst I-Regul Pap 63(11):1964–1973

    Google Scholar 

  • Moeskops P, Viergever MA, Mendrik AM, De Vries LS, Benders MJ, Išgum I (2016) Automatic segmentation of MR brain images with a convolutional neural network. IEEE Trans Med Imag 35(5):1252–1261

    Google Scholar 

  • Moro-Frias D, Ventura-Arizmendi C, Sanz-Pascual MT, de la Cruz-Blas CA (2015) Current-mode winner-take-all circuit with improved dynamic response. Circuits Syst Signal Process 34(2):625–639

    Google Scholar 

  • Pajares G, Guijarro M, Ribeiro A (2010) A Hopfield neural network for combining classifiers applied to textured images. Neural Netw 23(1):144–153

    PubMed  Google Scholar 

  • Rahiminejad E, Saberi M, Lotfi R, Taherzadeh-Sani M, Nabki F (2019) A low-voltage high-precision time-domain winner-take-all circuit. IEEE Trans Circuits Syst II Exp Briefs 67(1):4–8

    Google Scholar 

  • Rahman M, Baishnab K, Talukdar F (2009) A high speed and high resolution VLSI winner-take-all circuit for neural networks and fuzzy systems. In: Proc IEEE Int Symp Signals Circuits Syst, pp 1–4

  • Reddick WE, Glass JO, Cook EN, Elkin TD, Deaton RJ (1997) Automated segmentation and classification of multispectral magnetic resonance images of brain using artificial neural networks. IEEE Trans Med Imag 16(6):911–918

    CAS  Google Scholar 

  • Ren Z, Zhang Q, Cheng J, Hao F, Gao X (2021) Segment spatial-temporal representation and cooperative learning of convolution neural networks for multimodal-based action recognition. Neurocomputing 433:142–153

    Google Scholar 

  • Ronneberger O, Fischer P, Brox T (2015) U-net: Convolutional networks for biomedical image segmentation. In: International conference on medical image computing and computer-assisted intervention, pp 234–241. Springer

  • Rosenfeld A (1981) The max roberts operator is a hueckel-type edge detector. IEEE Trans Pattern Anal Mach Intell 3(1):101–103

    CAS  PubMed  Google Scholar 

  • Sheridan PM, Cai F, Du C, Ma W, Zhang Z, Lu WD (2017) Sparse coding with memristor networks. Nat Nanotechnol 12(8):784

    CAS  PubMed  Google Scholar 

  • Shi J, Malik J (2000) Normalized cuts and image segmentation. IEEE Trans Pattern Anal Mach Intell 22(8):888–905

    Google Scholar 

  • Strukov DB, Snider GS, Stewart DR, Williams RS (2008) The missing memristor found. Nature 453(7191):80–83

    CAS  PubMed  Google Scholar 

  • Sun J, Han G, Zeng Z, Wang Y (2020) Memristor-based neural network circuit of full-function pavlov associative memory with time delay and variable learning rate. IEEE Trans Cybern 50(7):2935–2945

    PubMed  Google Scholar 

  • Sun J, Xiao X, Yang Q, Liu P, Wang Y (2021) Memristor-based hopfield network circuit for recognition and sequencing application. AEU Int J Electron Commun 134:153698

    Google Scholar 

  • Wang Z, Shi X (2020) Electric activities of time-delay memristive neuron disturbed by gaussian white noise. Cogn Neurodyn 14(1):115–124

    PubMed  Google Scholar 

  • Wang Z, Wang X (2017) A novel memristor-based circuit implementation of full-function pavlov associative memory accorded with biological feature. IEEE Trans Circuits Syst I-Regul Pap 65(7):2210–2220

    Google Scholar 

  • Wang Z, Joshi S, Savel’ev S, Jiang H, Midya R, Lin P, Hu M, Ge N, Strachan JP, Li Z (2016) Memristors with diffusive dynamics as synaptic emulators for neuromorphic computing. Nat Mater 16(1):101–108

    PubMed  Google Scholar 

  • Wang Z, Wang X, Lu Z, Wu W, Zeng Z (2020) The design of memristive circuit for affective multi-associative learning. IEEE Trans Biomed Circuits Syst 14(2):173–185

    PubMed  Google Scholar 

  • Wang L, Zou H (2020) A new emotion model of associative memory neural network based on memristor. Neurocomputing

  • Wong WK, Yuen C, Fan D, Chan L, Fung E (2009) Stitching defect detection and classification using wavelet transform and BP neural network. Expert Syst Appl 36(2):3845–3856

    Google Scholar 

  • Wouapi MK, Fotsin BH, Ngouonkadi EBM, Kemwoue FF, Njitacke ZT (2021) Complex bifurcation analysis and synchronization optimal control for Hindmarsh-Rose neuron model under magnetic flow effect. Cogn Neurodyn 15(2):315–347

    PubMed  Google Scholar 

  • Xia Q, Yang JJ (2019) Memristive crossbar arrays for brain-inspired computing. Nat Mater 18(4):309–323

    CAS  PubMed  Google Scholar 

  • Xie W, Wang C, Lin H (2021) A fractional-order multistable locally active memristor and its chaotic system with transient transition, state jump. Nonlinear Dyn pp 1–19

  • Xu C, Wang C, Sun Y, Hong Q, Deng Q, Chen H (2021) Memristor-based neural network circuit with weighted sum simultaneous perturbation training and its applications. Neurocomputing 462:581–590

    Google Scholar 

  • Xu C, Wang C, Jiang J, Sun J, Lin H (2022) Memristive circuit implementation of context-dependent emotional learning network and its application in multitask. IEEE Trans Comput Aided Des Integr Circuits Syst 41(9):3052–3065

  • Yang L, Wang C (2021) Emotion model of associative memory possessing variable learning rates with time delay. Neurocomputing 460(14):117–125

    Google Scholar 

  • Yang L, Wang C (2021) Emotion model of associative memory possessing variable learning rates with time delay. Neurocomputing 460(14):117–125

    Google Scholar 

  • Yang X, Cao J, Yu W (2014) Exponential synchronization of memristive Cohen-Grossberg neural networks with mixed delays. Cogn Neurodyn 8(3):239–249

    PubMed  PubMed Central  Google Scholar 

  • Yang J, Wang L, Wang Y, Guo T (2017) A novel memristive hopfield neural network with application in associative memory. Neurocomputing 227:142–148

    Google Scholar 

  • Yao W, Wang C, Cao J (2019) Hybrid multisynchronization of coupled multistable memristive neural networks with time delays. Neurocomputing 363:281–294

    Google Scholar 

  • Yao W, Wang C, Sun Y, Zhou C, Lin H (2020) Synchronization of inertial memristive neural networks with time-varying delays via static or dynamic event-triggered control. Neurocomputing 404:367–380

    Google Scholar 

  • Yao W, Wang C, Sun Y, Zhou C (2022) Robust multimode function synchronization of memristive neural networks with parameter perturbations and time-varying delays. IEEE Trans Syst Man Cybern Syst 52(1):260–274

    Google Scholar 

  • Yen JC, Chang FJ, Chang S (1995) A new criterion for automatic multilevel thresholding. IEEE Trans Image Process 4(3):370–378

    CAS  PubMed  Google Scholar 

  • Zhang Y, Wang X, Li Y, Friedman EG (2016) Memristive model for synaptic circuits. IEEE Trans Circuits Syst II Exp Briefs 64(7):767–771

    Google Scholar 

  • Zhang Y, Li Y, Wang X, Friedman EG (2017) Synaptic characteristics of Ag/AgInSbTe/Ta-based memristor for pattern recognition applications. IEEE Trans Ind Electron 64(4):1806–1811

    Google Scholar 

  • Zhang L, Hu X, Zhou Y, Zhou G, Duan S (2021) Memristive deeplab: A hardware friendly deep CNN for semantic segmentation. Neurocomputing 451:181–191

    Google Scholar 

  • Zhao L, Hong Q, Wang X (2018) Novel designs of spiking neuron circuit and STDP learning circuit based on memristor. Neurocomputing 314:207–214

    Google Scholar 

  • Zhou C, Wang C, Sun Y, Yao W (2020) Weighted sum synchronization of memristive coupled neural networks. Neurocomputing 403:211–223

    Google Scholar 

  • Zhou J, Tang Y, Wu J, Yi X (2013) Image segmentation with threshold based on memristors. In: 2013 IEEE 4th international conference on electronics information and emergency communication, pp 41–44. IEEE

Download references

Acknowledgements

This work is supported by the Major Research Plan of the National Natural Science Foundation of China (No.91964108), the National Natural Science Foundation of China (No.61971185), Natural Science Foundation of Hunan Province (2020JJ4218) and the National Natural Science Foundation of China under Grant (No.62171182).

Author information

Authors and Affiliations

  1. College of Computer Science and Electronic Engineering, Hunan University, Changsha, 410082, China

    Cong Xu, Meiling Liao, Chunhua Wang, Jingru Sun & Hairong Lin

Authors
  1. Cong Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Meiling Liao
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Chunhua Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jingru Sun
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Hairong Lin
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Chunhua Wang.

Ethics declarations

Conflict of interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Xu, C., Liao, M., Wang, C. et al. Memristive competitive hopfield neural network for image segmentation application. Cogn Neurodyn 17, 1061–1077 (2023). https://doi.org/10.1007/s11571-022-09891-2

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11571-022-09891-2

Keywords

Search

Navigation