Abstract
A special class of neural dynamics called Zhang dynamics (ZD), which is different from gradient dynamics (GD), has recently been proposed, generalized, and investigated for solving time-varying problems by following Zhang et al.’s design method. In view of potential digital hardware implemetation, discrete-time ZD (DTZD) models are proposed and investigated in this paper for solving nonlinear time-varying equations in the form of \(f(x,t)=0\). For comparative purposes, the discrete-time GD (DTGD) model and Newton iteration (NI) are also presented for solving such nonlinear time-varying equations. Numerical examples and results demonstrate the efficacy and superiority of the proposed DTZD models for solving nonlinear time-varying equations, as compared with the DTGD model and NI.
Similar content being viewed by others
References
Ujevic, N.: A method for solving nonlinear equations. Appl. Math. Comput. 174, 1416–1426 (2006)
Sharma, J.R.: A composite third order Newton-steffensen method for solving nonlinear equations. Appl. Math. Comput. 169, 242–246 (2005)
Chun, C.: Construction of Newton-like iteration methods for solving nonlinear equations. Numer. Math. 104, 297–315 (2006)
Frontini, M.: Hermite interpolation and a new iterative method for the computation of the roots of non-linear equations. Calcolo 40, 109–119 (2003)
Zhang, Y., Xiao, L., Ruan, G., Li, Z.: Continuous and discrete time Zhang dynamics for time-varying 4th root finding. Numer. Algor. 57, 35–51 (2011)
Zhang, Y., Leithead, W.E., Leith, D.J.: Time-series Gaussian process regression based on Toeplitz computation of O(N 2) operations and O(N)-level storage. In: Proceedings of the 44th IEEE Conference on Decision and Control, pp. 3711–3716 (2005)
Mead, C.: Analog VLSI and Neural Systems. Addison-Wesley, Reading, MA (1989)
Zhang, Y., Ma, W., Li, K., Yi, C.: Brief history and prospect of coprocessors. China Sci. Tech. Inf. 13, 115–117 (2008)
Zhang, Y., Xu, D.: Global dynamics for non-autonomous reaction-diffusion neural networks with time-varying delays. Theor. Comput. Sci. 403, 3–10 (2008)
Lenze, B.: Linking discrete orthogonality with dilation and translation for incomplete sigma-pi neural networks of Hopfield-type. Discrete Appl. Math. 89, 169–180 (1998)
Wang, J.: A recurrent neural network for real-time matrix inversion. Appl. Math. Comput. 55, 89–100 (1993)
Ganesh, M., Mustapha, K.: A fully discrete H 1-Galerkin method with quadrature for nonlinear advection-diffusion-reaction equations. Numer. Algor. 43, 355–383 (2003)
Shi, Y.: A globalization procedure for solving nonlinear systems of equations. Numer. Algor. 12, 273–286 (2003)
Mohamad, S., Gopalsamy, K.: Dynamics of a class of discrete-time neural networks and their continuous-time counterparts. Math. Comput. Simul. 53, 1–39 (2000)
Zhang, Y., Ma, W., Cai, B.: From Zhang neural network to Newton iteration for matrix inversion. IEEE Trans. Circuits Syst. 56, 1405–1415 (2009)
Zhang, Y., Yang, Y.: Simulation and comparison of Zhang neural network and gradient neural network solving for time-varying matrix square roots. In: Proceedings of the 2nd International Symposium on Intelligent Information Technology Application, pp. 966–970 (2008)
Zhang, Y., Jiang, D., Wang, J.: A recurrent neural network for solving Sylvester equation with time-varying coefficients. IEEE Trans. Neural Netw. 13, 1053–1063 (2002)
Zhang, Y., Li, Z.: Zhang neural network for online solution of time-varying convex quadratic program subject to time-varying linear-equality constraints. Phys. Lett. A 373, 1639–1643 (2009)
Brezinski, C.: A classification of quasi-Newton methods. Numer. Algor. 33, 123–135 (2003)
Zhang, Y., Xu, P., Tan, N.: Solution of nonlinear equations by continuous-time and discrete-time Zhang dynamics and more importantly their links to Newton iteration. In: Proceedings of IEEE International Conference on Information, Communications and Signal Processing, pp. 1–5 (2009)
Zhang, Y., Ge, S.: Design and analysis of a general recurrent neural network model for time-varying matrix inversion. IEEE Trans. Neural Netw. 16, 1477–1490 (2005)
Zhang, Y.: A set of nonlinear equations and inequalities arising in robotics and its online solution via a primal neural network. Neurocomputing 70, 513–524 (2006)
The MathWorks, Inc.: Simulink 7 Getting Started Guide. Natick, MA (2008)
Guo, B., Wang, D., Shen, Y., Li, Z.: A Hopfield neural network approach for power optimization of real-time operating systems. Neural Comput. Appl. 17, 11–17 (2008)
Wu, A., Tam, P.K.S.: A neural network methodology and strategy of quadratic optimization. Neural Comput. Appl. 8, 283–289 (1999)
Zhang, Y., Chen, Z., Chen, K., Cai, B.: Zhang neural network without using time-derivative information for constant and time-varying matrix inversion. In: Proceedings of International Joint Conference on Neural Networks, pp. 142–146 (2008)
Steriti, R.J., Fiddy, M.A.: Regularized image reconstruction using SVD and a neural network method for matrix inversion. IEEE Trans. Signal Process. 41, 3074–3077 (1993)
Zhang, Y., Xu, P., Tan, N.: Further studies on Zhang neural-dynamics and gradient dynamics for online nonlinear equations Solving. In: Proceedings of the IEEE International Conference on Automation and Logistics, pp. 566–571 (2009)
Zhang, Y., Yi, C., Guo, D., Zheng, J.: Comparison on Zhang neural dynamics and gradient-based neural dynamics for online solution of nonlinear time-varying equations. Neural Comput. Appl. 20, 1–7 (2010)
Perez-IIzarbe, M.J.: Convergence analysis of a discrete-time recurrent neural network to perform quadratic real optimization with bound constraints. IEEE Trans. Neural Netw. 9, 1344–1351 (1998)
David, F.G., Desmond, J.H.: Numerical Methods for Ordinary Differential Equations: Initial Value Problems. Springer, England (2010)
Mathews, J.H., Fink, K.D.: Numerical Methods Using MATLAB. Publishing House of Electronics Industry, Beijing (2005)
Zhang, Y., Guo, D., Xu, S., Li, H.: Verification and practice on first-order numerical differentiation formulas for unknown target functions. J. Gansu. Sci. 21, 13–18 (2009)
Mitra, S.K.: Digital Signal Processing: A Computrer-Based Approach. Tsinghua University Press, Beijing (2006)
Author information
Authors and Affiliations
Corresponding author
Additional information
This work is supported by the National Natural Science Foundation of China (under grants 61075121 and 60935001) as well as the Specialized Research Fund for the Doctoral Program of Institutions of Higher Education of China (with project number 20100171110045).
Rights and permissions
About this article
Cite this article
Zhang, Y., Li, Z., Guo, D. et al. Discrete-time ZD, GD and NI for solving nonlinear time-varying equations. Numer Algor 64, 721–740 (2013). https://doi.org/10.1007/s11075-012-9690-7
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11075-012-9690-7