Skip to main content
Log in

Discrete-time ZD, GD and NI for solving nonlinear time-varying equations

  • Original Paper
  • Published:
Numerical Algorithms Aims and scope Submit manuscript

Abstract

A special class of neural dynamics called Zhang dynamics (ZD), which is different from gradient dynamics (GD), has recently been proposed, generalized, and investigated for solving time-varying problems by following Zhang et al.’s design method. In view of potential digital hardware implemetation, discrete-time ZD (DTZD) models are proposed and investigated in this paper for solving nonlinear time-varying equations in the form of \(f(x,t)=0\). For comparative purposes, the discrete-time GD (DTGD) model and Newton iteration (NI) are also presented for solving such nonlinear time-varying equations. Numerical examples and results demonstrate the efficacy and superiority of the proposed DTZD models for solving nonlinear time-varying equations, as compared with the DTGD model and NI.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Ujevic, N.: A method for solving nonlinear equations. Appl. Math. Comput. 174, 1416–1426 (2006)

    Article  MathSciNet  MATH  Google Scholar 

  2. Sharma, J.R.: A composite third order Newton-steffensen method for solving nonlinear equations. Appl. Math. Comput. 169, 242–246 (2005)

    Article  MathSciNet  MATH  Google Scholar 

  3. Chun, C.: Construction of Newton-like iteration methods for solving nonlinear equations. Numer. Math. 104, 297–315 (2006)

    Article  MathSciNet  MATH  Google Scholar 

  4. Frontini, M.: Hermite interpolation and a new iterative method for the computation of the roots of non-linear equations. Calcolo 40, 109–119 (2003)

    MathSciNet  MATH  Google Scholar 

  5. Zhang, Y., Xiao, L., Ruan, G., Li, Z.: Continuous and discrete time Zhang dynamics for time-varying 4th root finding. Numer. Algor. 57, 35–51 (2011)

    Article  MathSciNet  MATH  Google Scholar 

  6. Zhang, Y., Leithead, W.E., Leith, D.J.: Time-series Gaussian process regression based on Toeplitz computation of O(N 2) operations and O(N)-level storage. In: Proceedings of the 44th IEEE Conference on Decision and Control, pp. 3711–3716 (2005)

  7. Mead, C.: Analog VLSI and Neural Systems. Addison-Wesley, Reading, MA (1989)

    Book  MATH  Google Scholar 

  8. Zhang, Y., Ma, W., Li, K., Yi, C.: Brief history and prospect of coprocessors. China Sci. Tech. Inf. 13, 115–117 (2008)

    Google Scholar 

  9. Zhang, Y., Xu, D.: Global dynamics for non-autonomous reaction-diffusion neural networks with time-varying delays. Theor. Comput. Sci. 403, 3–10 (2008)

    Article  Google Scholar 

  10. Lenze, B.: Linking discrete orthogonality with dilation and translation for incomplete sigma-pi neural networks of Hopfield-type. Discrete Appl. Math. 89, 169–180 (1998)

    Article  MathSciNet  MATH  Google Scholar 

  11. Wang, J.: A recurrent neural network for real-time matrix inversion. Appl. Math. Comput. 55, 89–100 (1993)

    Article  MathSciNet  MATH  Google Scholar 

  12. Ganesh, M., Mustapha, K.: A fully discrete H 1-Galerkin method with quadrature for nonlinear advection-diffusion-reaction equations. Numer. Algor. 43, 355–383 (2003)

    Article  MathSciNet  Google Scholar 

  13. Shi, Y.: A globalization procedure for solving nonlinear systems of equations. Numer. Algor. 12, 273–286 (2003)

    Article  Google Scholar 

  14. Mohamad, S., Gopalsamy, K.: Dynamics of a class of discrete-time neural networks and their continuous-time counterparts. Math. Comput. Simul. 53, 1–39 (2000)

    Article  MathSciNet  Google Scholar 

  15. Zhang, Y., Ma, W., Cai, B.: From Zhang neural network to Newton iteration for matrix inversion. IEEE Trans. Circuits Syst. 56, 1405–1415 (2009)

    Article  MathSciNet  Google Scholar 

  16. Zhang, Y., Yang, Y.: Simulation and comparison of Zhang neural network and gradient neural network solving for time-varying matrix square roots. In: Proceedings of the 2nd International Symposium on Intelligent Information Technology Application, pp. 966–970 (2008)

  17. Zhang, Y., Jiang, D., Wang, J.: A recurrent neural network for solving Sylvester equation with time-varying coefficients. IEEE Trans. Neural Netw. 13, 1053–1063 (2002)

    Article  Google Scholar 

  18. Zhang, Y., Li, Z.: Zhang neural network for online solution of time-varying convex quadratic program subject to time-varying linear-equality constraints. Phys. Lett. A 373, 1639–1643 (2009)

    Article  MATH  Google Scholar 

  19. Brezinski, C.: A classification of quasi-Newton methods. Numer. Algor. 33, 123–135 (2003)

    Article  MathSciNet  MATH  Google Scholar 

  20. Zhang, Y., Xu, P., Tan, N.: Solution of nonlinear equations by continuous-time and discrete-time Zhang dynamics and more importantly their links to Newton iteration. In: Proceedings of IEEE International Conference on Information, Communications and Signal Processing, pp. 1–5 (2009)

  21. Zhang, Y., Ge, S.: Design and analysis of a general recurrent neural network model for time-varying matrix inversion. IEEE Trans. Neural Netw. 16, 1477–1490 (2005)

    Article  Google Scholar 

  22. Zhang, Y.: A set of nonlinear equations and inequalities arising in robotics and its online solution via a primal neural network. Neurocomputing 70, 513–524 (2006)

    Article  Google Scholar 

  23. The MathWorks, Inc.: Simulink 7 Getting Started Guide. Natick, MA (2008)

  24. Guo, B., Wang, D., Shen, Y., Li, Z.: A Hopfield neural network approach for power optimization of real-time operating systems. Neural Comput. Appl. 17, 11–17 (2008)

    Article  Google Scholar 

  25. Wu, A., Tam, P.K.S.: A neural network methodology and strategy of quadratic optimization. Neural Comput. Appl. 8, 283–289 (1999)

    Article  Google Scholar 

  26. Zhang, Y., Chen, Z., Chen, K., Cai, B.: Zhang neural network without using time-derivative information for constant and time-varying matrix inversion. In: Proceedings of International Joint Conference on Neural Networks, pp. 142–146 (2008)

  27. Steriti, R.J., Fiddy, M.A.: Regularized image reconstruction using SVD and a neural network method for matrix inversion. IEEE Trans. Signal Process. 41, 3074–3077 (1993)

    Article  MATH  Google Scholar 

  28. Zhang, Y., Xu, P., Tan, N.: Further studies on Zhang neural-dynamics and gradient dynamics for online nonlinear equations Solving. In: Proceedings of the IEEE International Conference on Automation and Logistics, pp. 566–571 (2009)

  29. Zhang, Y., Yi, C., Guo, D., Zheng, J.: Comparison on Zhang neural dynamics and gradient-based neural dynamics for online solution of nonlinear time-varying equations. Neural Comput. Appl. 20, 1–7 (2010)

    Article  Google Scholar 

  30. Perez-IIzarbe, M.J.: Convergence analysis of a discrete-time recurrent neural network to perform quadratic real optimization with bound constraints. IEEE Trans. Neural Netw. 9, 1344–1351 (1998)

    Article  Google Scholar 

  31. David, F.G., Desmond, J.H.: Numerical Methods for Ordinary Differential Equations: Initial Value Problems. Springer, England (2010)

    Google Scholar 

  32. Mathews, J.H., Fink, K.D.: Numerical Methods Using MATLAB. Publishing House of Electronics Industry, Beijing (2005)

    Google Scholar 

  33. Zhang, Y., Guo, D., Xu, S., Li, H.: Verification and practice on first-order numerical differentiation formulas for unknown target functions. J. Gansu. Sci. 21, 13–18 (2009)

    Article  Google Scholar 

  34. Mitra, S.K.: Digital Signal Processing: A Computrer-Based Approach. Tsinghua University Press, Beijing (2006)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yunong Zhang.

Additional information

This work is supported by the National Natural Science Foundation of China (under grants 61075121 and 60935001) as well as the Specialized Research Fund for the Doctoral Program of Institutions of Higher Education of China (with project number 20100171110045).

Rights and permissions

Reprints and permissions

About this article

Cite this article

Zhang, Y., Li, Z., Guo, D. et al. Discrete-time ZD, GD and NI for solving nonlinear time-varying equations. Numer Algor 64, 721–740 (2013). https://doi.org/10.1007/s11075-012-9690-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11075-012-9690-7

Keywords

Navigation