Neural Computing and Applications

, Volume 20, Issue 1, pp 1–7 | Cite as

Comparison on Zhang neural dynamics and gradient-based neural dynamics for online solution of nonlinear time-varying equation

  • Yunong Zhang
  • Chenfu Yi
  • Dongsheng Guo
  • Jinhuan Zheng
Original Article


Different from gradient-based neural dynamics, a special kind of recurrent neural dynamics has recently been proposed by Zhang et al. for solving online time-varying problems. Such a recurrent neural dynamics is designed based on an indefinite error-monitoring function instead of a usually norm- or square-based energy function. In addition, Zhang neural dynamics (ZND) are depicted generally in implicit dynamics, whereas gradient-based neural dynamics (GND) are associated with explicit dynamics. In this paper, we generalize the ZND design method to solving online nonlinear time-varying equations in the form of f (x, t) = 0. For comparative purposes, the GND model is also employed for such time-varying equations’ solving. Computer-simulation results via power-sigmoid activation functions substantiate the theoretical analysis and efficacy of the ZND model for solving online nonlinear time-varying equations.


Recurrent neural networks Gradient-based neural dynamics Time-varying nonlinear equations Exponential convergence 



This work is supported by the National Natural Science Foundation of China under Grants 61075121, 60935001 and 60775050, and also by the Fundamental Research Funds for the Central Universities of China.


  1. 1.
    Sharma JR (2005) A composite third order newton-steffensen method for solving nonlinear equations. Appl Math Comput 169:242–246zbMATHCrossRefMathSciNetGoogle Scholar
  2. 2.
    Chun C (2006) Construction of Newton-like iteration methods for solving nonlinear equations. Numerische Mathematik 104:297–315zbMATHCrossRefMathSciNetGoogle Scholar
  3. 3.
    Ujevic N (2006) A method for solving nonlinear equations. Appl Math Comput 174:1416–1426zbMATHCrossRefMathSciNetGoogle Scholar
  4. 4.
    Zhang Y, Leithead WE, Leith DJ (2005) Time-series Gaussian process regression based on Toeplitz computation of O(N 2) operations and O(N)-level storage. In: Proceedings of the 44th IEEE conference on decision and control, pp 3711–3716Google Scholar
  5. 5.
    Guo B, Wang D, Shen Y, Li Z (2008) A Hopfield neural network approach for power optimization of real-time operating systems. Neural Comput Appl 17:11–17CrossRefGoogle Scholar
  6. 6.
    Wu A, Tam PKS (1999) A neural network methodology and strategy of quadratic optimization. Neural Comput Appl 8:283–289CrossRefGoogle Scholar
  7. 7.
    Zhang Y (2005) Revisit the analog computer and gradient-based neural system for matrix inversion. In: Proceedings of IEEE international symposium on intelligent control, Limassol, Cyprus, pp 1411–1416Google Scholar
  8. 8.
    Zhang Y, Chen K (2008) Comparison on Zhang neural network and gradient neural network for time-varying linear matrix equation AXB = C solving. In: Proceedings of IEEE international conference on industrial technology, Chendu, pp 1–6Google Scholar
  9. 9.
    Zhang Y, Jiang D, Wang J (2002) A recurrent neural network for solving Sylvester equation with time-varying coefficients. IEEE Trans Neural Netw 13:1053–1063CrossRefGoogle Scholar
  10. 10.
    Zhang Y, Ge SS (2005) Design and analysis of a general recurrent neural network model for time-varying matrix inversion. IEEE Trans Neural Netw 16:1477–1490CrossRefGoogle Scholar
  11. 11.
    Zhang Y, Chen Z, Chen K, Cai B (2008) Zhang neural network without using time-derivative information for constant and time-varying matrix inversion. In: Proceedings of international joint conference on neural networks, Hong Kong, pp 142–146Google Scholar
  12. 12.
    Zhang Y, Guo X, Ma W (2008) Modeling and simulation of Zhang neural network for online linear time-varying equations solving based on MATLAB Simulink. In: Proceedings of the seventh international conference on machine learning and cybernetics, Kunming, pp 12–15Google Scholar
  13. 13.
    Zhang Y (2006) A set of nonlinear equations and inequalities arising in robotics and its online solution via a primal neural network. Neurocomputing 70:513–524CrossRefGoogle Scholar
  14. 14.
    Steriti RJ, Fiddy MA (1993) Regularized image reconstruction using SVD and a neural network method for matrix inversion. IEEE Trans Signal Process 41:3074–3077zbMATHCrossRefGoogle Scholar
  15. 15.
    Tank D, Hopfield J (1986) Simple neural optimization networks: an A/D converter, signal decision circuit, and a linear programming circuit. IEEE Trans Circuits Syst 33:533–541CrossRefGoogle Scholar
  16. 16.
    Zhang Y, Peng H (2007) Zhang neural network for linear time-varying equation solving and its robotic application. In: Proceedings of the sixth international conference on machine learning and cybernetics, Hong Kong, pp 19–22Google Scholar
  17. 17.
    Cichocki A, Unbehauen R (1993) Neural networks for optimization and signal processing. Wiley, ChichesterzbMATHGoogle Scholar
  18. 18.
    Zhang Y, Ma W, Yi C (2008) The link between Newton iteration for matrix inversion and Zhang neural network. In: Proceedings of IEEE international conference on industrial technology, Chendu, pp 1–6Google Scholar
  19. 19.
    Zhang Y, Ma W, Cai B (2009) From Zhang neural network to Newton iteration for matrix inversion. IEEE Trans Circuits Syst I Regul Pap 56:1405–1415CrossRefMathSciNetGoogle Scholar
  20. 20.
    Manherz RK, Jordan BW, Hakimi SL (1968) Analog methods for computation of the generalized inverse. IEEE Trans Automat Contr 13:582–585CrossRefGoogle Scholar
  21. 21.
    Mead C (1989) Analog VLSI and neural systems. Addison-Wesley, ReadingzbMATHGoogle Scholar
  22. 22.
    Zhang Y (2007) Dual neural networks: design, analysis, and application to redundant robotics. In: Kang GB (eds) Progress in neurocomputing research. Nova Science Publishers, New York, pp 41–81Google Scholar
  23. 23.
    Mathews JH, Fink, KD (2004) Numerical methods using MATLAB, 4th edn. Prentice Hall, New JerseyGoogle Scholar

Copyright information

© Springer-Verlag London Limited 2010

Authors and Affiliations

  • Yunong Zhang
    • 1
  • Chenfu Yi
    • 1
    • 2
  • Dongsheng Guo
    • 1
  • Jinhuan Zheng
    • 3
  1. 1.School of Information Science and TechnologySun Yat-sen UniversityGuangzhouChina
  2. 2.School of Information EngineeringJiangxi University of Science and TechnologyGanzhouChina
  3. 3.School of SoftwareSun Yat-sen UniversityGuangzhouChina

Personalised recommendations