Skip to main content
SpringerLink
Log in

A novel lagrange functional link neural network for solving variable-order fractional time-varying delay differential equations: a comparison with multilayer perceptron neural networks

  • Neural Networks
  • Published:
Soft Computing Aims and scope Submit manuscript

Abstract

This study introduces a novel functional link neural network and explores the associated theorems for a class of nonlinear differential equations with fractional variable-order and time-varying delays. Lagrange polynomials, known for their efficiency in solving fractional calculus problems, are utilized as the neuro-solutions within the neural network structure. For an efficient learning process in artificial neural networks, appropriate activation functions play a crucial role. To handle the fractional derivative of variable-order and time-varying delays, it is essential to select the right activation function. Hence, numerical simulations are conducted to determine the optimal activation function for these equations. The training of the neural network is done using a modified Newton–Raphson method instead of the traditional supervised learning methods. As a result, the proposed functional link neural network provides more accurate results compared to conventional neural networks like the multilayer perceptron.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

Data Availability

The manuscript is a theoretical study and there are no external data associated with it.

References

  • Akgül A, Inc M, Baleanu D (2017) On solutions of variable-order fractional differential equations. Int J Optim Control Theories & Appl(IJOCTA), vol. 7, https://doi.org/10.11121/ijocta.01.2017.00368

  • Alijani Z, Baleanu D, Shiri B, Wu G-C (2020) Spline collocation methods for systems of fuzzy fractional differential equations. Chaos, Solitons and Fractals, vol. 131. https://doi.org/10.1016/j.chaos.2019.109510

  • Al-Janabi S, Alkaim A (2020) A nifty collaborative analysis to predicting a novel tool (drflls) for missing values estimation. Soft Comput vol. 24. https://doi.org/10.1007/s00500-019-03972-x

  • Al-Janabi S, Alkaim A, Adil Z (2020) An innovative synthesis of deep learning techniques (DCapsNet & DCOM) for generation electrical renewable energy from wind energy. Methodol Appl, vol. 24 https://doi.org/10.1007/s00500-020-04905-9

  • Al-Janabi S, Mohammad M, Al-Sultan A (2020) A new method for prediction of air pollution based on intelligent computation. Soft Comput, vol. 24,. https://doi.org/10.1007/s00500-019-04495-1

  • Al-Janabi S, Salman AH (2021) Sensitive integration of multilevel optimization model in human activity recognition for smartphone and smartwatch applications. Big Data Mining and Anal, vol. 4 no. 2, 124–138. https://doi.org/10.26599/BDMA.2020.9020022

  • Amin R, Shah K, Asif M, Khan I (2021) A computational algorithm for the numerical solution of fractional order delay differential equations, vol. 402. https://doi.org/10.1016/j.amc.2020.125863

  • Bijiga LK, Ibrahim W (2021) Neural network method for solving time-fractional telegraph equation. Math Problem Eng, vol. 2021. https://doi.org/10.1155/2021/7167801

  • Boubaker O, Balas V, Benzaouia A, Mohamed C, Mahmoud M, Zhu Q (2017) Time-delay systems-modeling, analysis, estimation, control, and synchronization. Math Problem Eng, vol. 2017 https://doi.org/10.1155/2015/246351

  • Canuto C, Hussaini MY, Quarteroni A, Thomas A Jr, et al. (2012) Spectral methods in fluid dynamics, Springer Science & Business Media

  • Chen T, Chen H, Liu R-W (1995) Approximation capability in by multilayer feedforward networks and related problems. IEEE Trans Neural Netw 6:25–30. https://doi.org/10.1109/72.363453

    Article  Google Scholar 

  • Chen S, Liu F, Burrage K (2014) Numerical simulation of a new two-dimensional variableorder fractional percolation equation in non-homogeneous porous media. Comput Math Appl 68(12):2133–2141. https://doi.org/10.1016/j.camwa.2013.01.023

    Article  MathSciNet  MATH  Google Scholar 

  • Dabiri A, Moghaddam BP, Machado JAT (2018) Optimal variable-order fractional pid controllers for dynamical systems. J Comput Appl Math vol. 339, pp. 40–48. https://doi.org/10.1016/j.cam.2018.02.029

  • Dadkhah Ehsan, Shiri Babak, Ghaffarzadeh Hosein, Baleanu Dumitru (2020) Visco-elastic dampers in structural buildings and numerical solution with spline collocation methods. J Appl Math Comput 63:29–57. https://doi.org/10.1007/s12190-019-01307-5

    Article  MathSciNet  MATH  Google Scholar 

  • Deng Y, Léchappé V, Rouquet S, Moulay E, Plestan F (2020) Super-twisting algorithm-based time-varying delay estimation with external signal 67:10663–10671. https://doi.org/10.1109/TIE.2019.2960739

  • Diethelm K (2010) The analysis of fractional differential equations: an application-oriented exposition using differential operators of caputo type, Springer; 2010th edition, ISBN-13: 978-3642145735

  • Driver RD (1977) Ordinary and Delay Differential Equations, Springer New York, NY, ISBN: 978-1-4684-9467-9

  • G 1M. Phillips (2003) Interpolation and Approximation by Polynomials, Springer/Sci-Tech/Trade; 2003rd edition, ISBN-13 :978-0387002156

  • Gavrielides A, Pieroux D, Erneux T, Kovanis V (2000) Hopf bifurcation subject to a large delay in a laser system. J SIAM Appl Math 61:966–982

    Article  MathSciNet  MATH  Google Scholar 

  • Ghazali R, Hussain AJ, Al-Jumeily D, Lisboa P (2009) Time series prediction using dynamic ridge polynomial neural networks, In: 2009 second international conference on developments in Esystems Engineering, IEEE, pp. 354–363 https://doi.org/10.1109/DeSE.2009.35

  • Guo B-y, Shen J, Wang Z-q (2002) Chebyshev rational spectral and pseudospectral methods on a semi-infinite interval. Int J Num Methods In Engineering, vol. 53. https://doi.org/10.1002/nme.392

  • Haykin S (1998) Neural networks: a comprehensive foundation, Pearson, ISBN-13 :978-0132733502, 2nd edition

  • Jaaffar NT, Majid ZA, Senu N (2020) Numerical approach for solving delay differential equations with boundary conditions, Numerical Methods for Solving Differential Problems, vol. 8, no. 7. https://doi.org/10.3390/math8071073

  • Jocelyn Sabatier, Mohamed Aoun, Alain Oustaloup, Gilles Gregoire, Franck Ragot, Patrick Roy (2006) Fractional system identification for lead acid battery state of charge estimation. Signal Process 86(10):2645–2657. https://doi.org/10.1016/j.sigpro.2006.02.030

    Article  MATH  Google Scholar 

  • Kadhuim ZA, Al-Janabi S (2023) Codon-mrna prediction using deep optimal neurocomputing technique (dlstm-dsn-woa) and multivariate analysis. Results in Eng, vol. 17. https://doi.org/10.1016/j.rineng.2022.100847

  • Kheyrinataj F, Nazemi A (2019) Fractional power series neural network for solving delay fractional optimal control problems. Connect Sci 32:1–28. https://doi.org/10.1080/09540091.2019.1605498

    Article  MATH  Google Scholar 

  • Kheyrinataj F, Nazemi A (2020) Fractional chebyshev functional link neural network-optimization method for solving delay fractional optimal control problems with Atangana-Baleanu derivative. Opt Control Appl Methods, vol. 41, https://doi.org/10.1002/oca.2572

  • Khiabani ED, Dadkhah E, Katebi J, Ghaffarzadeh H (2020) Spline collocation methods for seismic analysis of multiple degree of freedom systems with viscoelastic dampers using fractional models. J Vib Control, vol. 26 https://doi.org/10.1177/1077546319898570

  • Kilbas JTAA, Srivastava HM (2006) Theory and applications of fractional differential equations, Elsevier Science; 1st edition, ISBN-13: 978-0444518323

  • Lee Tae H, Park JuH, Shengyuan Xu (2017) Relaxed conditions for stability of time-varying delay systems 75:11–15. https://doi.org/10.1016/j.automatica.2016.08.011

  • Lu Z, Wang C, Wang W (2018) Stability criteria of interval time-varying delay systems and their application 2018:1–8. https://doi.org/10.1155/2018/7025908

  • Moghaddam BP, Yaghoobi S, Machado JAT (2017) An Extended Predictor-Corrector Algorithm for Variable-Order Fractional Delay Differential Equations. J Comput Nonlinear Dynam, vol. 75, pp. 11–15 https://doi.org/10.1115/1.4032574

  • Mohammed GS, Al-Janabi S (2020) An innovative synthesis of optmization techniques (fdire-gsk) for generation electrical renewable energy from natural resources, vol. 16. https://doi.org/10.1016/j.rineng.2022.100637

  • Mohammed GS, Al-Janabi S (2022) An innovative synthesis of optmization techniques (FDIRE-GSK) for generation electrical renewable energy from natural resources. Results in Eng, vol. 16. https://doi.org/10.1016/j.rineng.2022.100637

  • Morgado ML, Ford N, Lima PM (2013) Analysis and numerical methods for fractional differential equations with delay, Journal of Computational and Applied Mathematics, vol. 252, pp. 159–168,. https://doi.org/10.1016/j.cam.2012.06.034

  • Muthukumar P, Priya BG (2015) Numerical solution of fractional delay differential equation by shifted jacobi polynomials. Int J Comput Math, vol. 94, pp. 1–28. https://doi.org/10.1080/00207160.2015.1114610

  • Pao Y-H (1989) Adaptive Pattern Recognition and Neural Networks, Addison-Wesley Longman Publishing Co., Inc., USA, ISBN-13: 978-0201125849

  • Patnaik S, Hollkamp J, Semperlotti F (2020) Applications of variable-order fractional operators: a review, Proceedings of the Royal Society A: Mathematical, Physical and Engineering Science, vol. 476. https://doi.org/10.1098/rspa.2019.0498

  • Patra JC, Chin WC, Meher PK, Chakraborty G (2008) Legendre-flann-based nonlinear channel equalization in wireless communication system, In: 2008 IEEE International Conference on Systems, Man and Cybernetics, pp. 1826–1831. https://doi.org/10.1109/ICSMC.2008.4811554

  • Peterson LE, Larin KV (2008) Hermite/laguerre neural networks for classification of artificial fingerprints from optical coherence tomography, In: 2008 Seventh International Conference on Machine Learning and Applications, pp. 637–643. https://doi.org/10.1109/ICMLA.2008.36

  • Podlubny I (1998) Fractional differential equations: an introduction to fractional derivatives, fractional differential equations, to methods of their solution and some of their applications, Academic Press; 1st edition

  • R JF, Torres I (2011) An exact solution of delay-differential equations in association models, Revista mexicana de fisica, vol. 57, pp. 117–124

  • Ramirez LES, Carlos, Coimbra FM (2011) On the variable order dynamics of the nonlinear wake caused by a sedimenting particle, Physica D: Nonlinear Phenomena, vol. 240, no. 13, pp. 1111–1118 https://doi.org/10.1016/j.physd.2011.04.001

  • Sheng H, Sun H, Coopmans C, Chen Y, Bohannan G (2011) A physical experimental study of variable-order fractional integrator and differentiator. Eur Phys J Special Topics 193:93–104. https://doi.org/10.1140/epjst/e2011-01384-4

    Article  Google Scholar 

  • Shiri Babak, Guo-Cheng Wu, Baleanu Dumitru (2021) Terminal value problems for the nonlinear systems of fractional differential equations. Appl Numer Math 170:162–178. https://doi.org/10.1016/j.apnum.2021.06.015

    Article  MathSciNet  MATH  Google Scholar 

  • Shiri B, Baleanu D (2019) System of fractional differential algebraic equations with applications. Chaos, Solitons Fractals, vol. 120, pp. 203–212 https://doi.org/10.1016/j.chaos2019.01.028

  • Sun H, Chen W, Wei H, Chen Y (2011) A comparative study of constant-order and variableorder fractional models in characterizing memory property of systems. Eur Phys J Special Topics 193:185–192. https://doi.org/10.1140/epjst/e2011-01390-6

    Article  Google Scholar 

  • Susanto H, Karjanto N (2009) Newtons method basin of attraction revisited. Appl Math Comput 215:1084–1090. https://doi.org/10.1016/j.amc.2009.06.041

    Article  MathSciNet  MATH  Google Scholar 

  • Syah R, Guerrero JWG, Poltarykhin AL, Suksatan W, Aravindhan S, Bokov DO, Abdelbasset WK, Al-Janabi i S, Alkaim i AF, Yu D (2022) Tumanov, Developed teamwork optimizer for model parameter estimation of the proton exchange membrane fuel cell. Energy Rep vol. 8, pp. 10776–10785. https://doi.org/10.1016/j.egyr.2022.08.177

  • Tavares D, Almeida R, Torres DFM (2015) Caputo derivatives of fractional variable order: Numerical approximations. Commun Nonlinear Sci Num Simulation, vol. 35. https://doi.org/10.1016/j.cnsns.2015.10.027

  • Thanh N, Phat V, Niamsup P (2020) New finite-time stability analysis of singular fractional differential equations with time-varying delay. Fract Calculus Appl Anal 23:504–519. https://doi.org/10.1515/fca-2020-0024

    Article  MathSciNet  MATH  Google Scholar 

  • Wang L, Ma Y, Meng Z (2014) Haar wavelet method for solving fractional partial differential equations numerically. Num Methods for Partial Differ Equa 227:66–76. https://doi.org/10.1016/j.amc.2013.11.004

    Article  MathSciNet  MATH  Google Scholar 

  • Wang H, Gu Y, yu Y (2019) Numerical solution of fractional-order time-varying delayed differential systems using lagrange interpolation. Nonlinear Dynam, vol. 95, pp. 809–822. https://doi.org/10.1007/s11071-018-4597-z

  • Wu L, Lam H-K, Zhao Y, Shu Z (2015) Time-delay systems and their applications in engineering 2014. Math Probl Eng 2015:1–3. https://doi.org/10.1155/2015/246351

    Article  Google Scholar 

  • Zou A-M, Kumar KD, Hou Z-G (2010) Quaternion-based adaptive output feedback attitude control of spacecraft using chebyshev neural networks, IEEE Transactions on Neural Networks, vol. 21, pp. 1457–1471. https://doi.org/10.1109/TNN.2010.2050333

  • Zúniga-Aguilar C, Coronel-Escamilla A, Gómez-Aguilar J, Alvarado V, Ugalde HR (2018) New numerical approximation for solving fractional delay differential equations of variable order using artificial neural networks, The European Physical Journal Plus, vol. 133. https://doi.org/10.1140/epjp/i2018-11917-0

  • Zúniga-Aguilar C, Gómez-Aguilar J, Jiménez RE, Ugalde HR (2019) A novel method to solve variable-order fractional delay differential equations based in lagrange interpolations, vol. 126, pp. 266–282. https://doi.org/10.1016/j.chaos.2019.06.009

Download references

Funding

The authors declare that no funds, grants, or other support were received during the preparation of this manuscript.

Author information

Authors and Affiliations

  1. Department of Mathematics, Rasht Branch, Islamic Azad University, Rasht, Iran

    Farahnaz Golpour Lasaki, Hamideh Ebrahimi & Mousa Ilie

Authors
  1. Farahnaz Golpour Lasaki
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hamideh Ebrahimi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mousa Ilie
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hamideh Ebrahimi.

Ethics declarations

Conflicts of interest

This article does not contain any studies with human participants or animals performed by any of the authors.

Ethical approval

The authors have no conflict of interest to declare.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lasaki, F.G., Ebrahimi, H. & Ilie, M. A novel lagrange functional link neural network for solving variable-order fractional time-varying delay differential equations: a comparison with multilayer perceptron neural networks. Soft Comput 27, 12595–12608 (2023). https://doi.org/10.1007/s00500-023-08494-1

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00500-023-08494-1

Keywords

Search

Navigation