Abstract
In the present article, delay and system of delay differential equations are treated using feed-forward artificial neural networks. We have solved multiple problems using neural network architectures with different depths. The neural networks are trained using the extreme learning machine algorithm for the satisfaction of delay differential equations and associated initial/boundary conditions. Further, numerical rates of convergence of the proposed algorithm are reported based on variation of error in the obtained solution for different number of training points. Emphasis is on analysing whether deeper network architectures trained with extreme learning machine algorithm can perform better than shallow network architectures for approximating the solutions of delay differential equations.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Ockendon JR, Tayler AB (1971) The dynamics of a current collection system for an electric locomotive. Proc R Soc Lond A 322:447–468
Ahmad I, Mukhtar A (2015) Stochastic approach for the solution of multi-pantograph differential equation arising in cell-growth model. Appl Math Comput 261:360–372
Doha EH, Bhrawy AH, Hafez RM (2017) Numerical algorithm for solving multi-pantograph delay equations on the half-line using Jacobi rational functions with convergence analysis. Acta Math Appl Sin Engl Ser 33(2):297–310
Xie L, Zhou C, Xu S (2018) A new computational approach for the solutions of generalized pantograph-delay differential equations. Comput Appl Math 37:1756–1783
Sedaghar S, Nemati S, Ordokhani Y (2019) Convergence analysis of spectral method for neutral multi-pantograph equations. Iran J Sci Technol Trans A Sci 43:2261–2268
Yang C (2018) Modified Chebyshev collocation method for pantograph-type differential equations. Appl Numer Math 134:132–144
Ezz-Eldien SS (2018) On solving systems of multi-pantograph equations via spectral tau method. Appl Math Comput 321:63–73
Jiang K, Huang Q, Xu X (2020) Discontinuous Galerkin methods for multi-pantograph delay differential equations. Adv Appl Math Mecha 12(1):189–211
Yang Y, Tohidi E (2019) Numerical solution of multi-Pantograph delay boundary value problems via an efficient approach with the convergence analysis. Comput Appl Math 38:127
Bhagat MSM (2020) Approximate analytical solution of the linear and nonlinear multi-pantograph delay differential equations. Phys Scr 95:055219
Adel W, Sabir Z (2020) Solving a new design of nonlinear second-order Lane–Emden pantograph delay differential model via Bernoulli collocation method. Eur Phys J Plus 135:427
Lagaris IE, Likas A, Fotiadis DI (1998) Artificial neural networks for solving ordinary and partial differential equations. IEEE Trans Neural Netw 9:987–1000
Aarts LP, Veer Pvd (2001) Neural network method for solving partial differential equations. Neural Process Lett 14:261–271
Alli H, Uçar A, Demir Y (2003) The solutions of vibration control problems using artificial neural networks. J Frankl Inst 340:307–325
Malek A, Beidokhti RS (2006) Numerical solution for high order differential equations using a hybrid neural network-optimization method. Appl Math Comput 183:260–271
Mall S, Chakraverty S (2016) Application of Legendre neural network for solving ordinary differential equations. Appl Soft Comput 43:347–356
Mall S, Chakraverty S (2017) Single layer Chebyshev neural network model for solving elliptic partial differential equations. Neural Process Lett 45:825–840
Shirvany Y, Hayati M, Moradian R (2009) Multilayer perceptron neural networks with novel unsupervised training method for numerical solution of the partial differential equations. Appl Soft Comput 9:20–29
Beidokhti RS, Malek A (2009) Solving initial-boundary value problems for systems of partial differential equations using neural networks and optimization techniques. J Frankl Inst 346:898–913
Ezadi S, Parandin N (2013) An application of neural networks to solve ordinary differential equations. Int J Math Model Comput 3:245–252
Raja MAZ, Khan JA, Siddiqui AM, Behloul D, Haroon T, Samar R (2015) Exactly satisfying initial conditions neural network models for numerical treatment of first Painlevé equation. Appl Soft Comput 26:244–256
Kumar M, Yadav N (2015) Numerical solution of Bratu’s problem using multilayer perceptron neural network method. Natl Acad Sci Lett 38(5):425–428
Tawfiq LNM, Hussein AAT (2013) Design feed forward neural network to solve singular boundary value problems. ISRN Appl Math 2013:1–7
Liu Z, yang Y, Cai Q (2019) Neural network as a function approximator and its application in solving differential equations. Appl Math Mech 40:237–248
Piscopo ML, Spannowsky M, Waite P (2019) Solving differential equations with neural networks: applications to the calculation of cosmological phase transitions. Phys Rev D 100:016002
Panghal S, Kumar M (2020) Optimization free neural network approach for solving ordinary and partial differential equations. Eng Comput. https://doi.org/10.1007/s00366-020-00985-1
Jiang K, Huang Q, Xu X (2020) Discontinuous Galerkin methods for multi-pantograph delay differential equations. Adv Appl Math Mech 12(1):189–211
Acknowledgements
We express our sincere thanks to editor in chief, editor and reviewers for their valuable suggestions to revise this manuscript.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Panghal, S., Kumar, M. Neural network method: delay and system of delay differential equations. Engineering with Computers 38 (Suppl 3), 2423–2432 (2022). https://doi.org/10.1007/s00366-021-01373-z
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00366-021-01373-z