Skip to main content
SpringerLink
Log in

Design of meta-heuristic computing paradigms for Hammerstein identification systems in electrically stimulated muscle models

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

In this study, a novel application of differential evolution (DE)-based computational heuristics is proposed for the identification of Hammerstein structures representing the electrically stimulated muscle (ESM) models as a part of rehabilitation interventions for the stock patient to prevent the post-spinal cord injury atrophy. The strength of approximation theory is incorporated for defining the fitness function for ESM system based on mean square deviation between actual and estimated responses. DE, genetic algorithms (GAs), particle swarm optimization (PSO), pattern search (PS), and simulated annealing (SA) are used as optimization mechanisms to identify the ESM models with input nonlinearities of sigmoidal, polynomial, and spline kernels for noiseless and noisy environments. Comparative studies based on detailed statistics establish the worth of DE-based heuristics over its counterparts GAs, PSO, PS, and SA in terms of accuracy, convergence, robustness, and efficiency for the identification of ESM models arising in rehabilitation of the stock patients.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

References

  1. Castro MJ, Apple DF Jr, Hillegass EA, Dudley GA (1999) Influence of complete spinal cord injury on skeletal muscle cross-sectional area within the first 6 months of injury. Eur J Appl Physiol 80(4):373–378

    Google Scholar 

  2. Vestergaard P, Krogh K, Rejnmark L, Mosekilde L (1998) Fracture rates and risk factors for fractures in patients with spinal cord injury. Spinal Cord 36(11):790

    Google Scholar 

  3. Mahoney ET, Bickel CS, Elder C, Black C, Slade JM, Apple D, Dudley GA (2005) Changes in skeletal muscle size and glucose tolerance with electrically stimulated resistance training in subjects with chronic spinal cord injury. Arch Phys Med Rehabil 86(7):1502–1504

    Google Scholar 

  4. Shields RK, Dudley-Javoroski S (2007) Musculoskeletal adaptations in chronic spinal cord injury: effects of long-term soleus electrical stimulation training. Neurorehabil Neural Repair 21(2):169–179

    Google Scholar 

  5. Howlett OA, Lannin NA, Ada L, McKinstry C (2015) Functional electrical stimulation improves activity after stroke: a systematic review with meta-analysis. Arch Phys Med Rehabil 96(5):934–943

    Google Scholar 

  6. Haeufle DFB, Günther M, Bayer A, Schmitt S (2014) Hill-type muscle model with serial damping and eccentric force–velocity relation. J Biomech 47(6):1531–1536

    Google Scholar 

  7. Law LF, Shields RK (2007) Mathematical models of human paralyzed muscle after long-term training. J Biomech 40(12):2587–2595

    Google Scholar 

  8. Ding J, Wexler AS, Binder-Macleod SA (2003) Mathematical models for fatigue minimization during functional electrical stimulation. J Electromyogr Kinesiol 13(6):575–588

    Google Scholar 

  9. Hunt KJ, Munih M, Donaldson NDN, Barr FM (1998) Investigation of the Hammerstein hypothesis in the modeling of electrically stimulated muscle. IEEE Trans Biomed Eng 45(8):998–1009

    Google Scholar 

  10. Bai EW, Cai Z, Dudley-Javorosk S, Shields RK (2009) Identification of a modified Wiener–Hammerstein system and its application in electrically stimulated paralyzed skeletal muscle modeling. Automatica 45(3):736–743

    MathSciNet  MATH  Google Scholar 

  11. Le F (2011) Identification of electrically stimulated muscle after stroke. Doctoral dissertation, University of Southampton

  12. Le F, Markovsky I, Freeman CT, Rogers E (2012) Recursive identification of Hammerstein systems with application to electrically stimulated muscle. Control Eng Pract 20(4):386–396

    Google Scholar 

  13. Mehmood A, Zameer A, Chaudhary NI, Raja MAZ (2019) Backtracking search heuristics for identification of electrical muscle stimulation models using Hammerstein structure. Appl Soft Comput 84:105705

    Google Scholar 

  14. Greblicki W, Pawlak M (2017) Hammerstein system identification with the nearest neighbor algorithm. IEEE Trans Inf Theory 63(8):4746–4757

    MathSciNet  MATH  Google Scholar 

  15. Castro-Garcia R, Agudelo OM, Suykens JA (2019) Impulse response constrained LS-SVM modelling for MIMO Hammerstein system identification. Int J Control 92(4):908–925

    MathSciNet  MATH  Google Scholar 

  16. Giordano G, Gros S, Sjöberg J (2018) An improved method for Wiener–Hammerstein system identification based on the Fractional Approach. Automatica 94:349–360

    MathSciNet  MATH  Google Scholar 

  17. Wang D (2016) Hierarchical parameter estimation for a class of MIMO Hammerstein systems based on the reframed models. Appl Math Lett 57:13–19

    MathSciNet  MATH  Google Scholar 

  18. Chen H, Ding F (2015) Hierarchical least squares identification for Hammerstein nonlinear controlled autoregressive systems. Circuits Syst Signal Process 34(1):61–75

    MathSciNet  MATH  Google Scholar 

  19. Mao Y, Ding F, Yang E (2017) Adaptive filtering-based multi-innovation gradient algorithm for input nonlinear systems with autoregressive noise. Int J Adapt Control Signal Process 31(10):1388–1400

    MathSciNet  MATH  Google Scholar 

  20. Mao Y, Ding F (2015) Multi-innovation stochastic gradient identification for Hammerstein controlled autoregressive systems based on the filtering technique. Nonlinear Dyn 79(3):1745–1755

    MATH  Google Scholar 

  21. Ding F, Wang F, Xu L, Hayat T, Alsaedi A (2016) Parameter estimation for pseudo-linear systems using the auxiliary model and the decomposition technique. IET Control Theory Appl 11(3):390–400

    MathSciNet  Google Scholar 

  22. Mao Y, Ding F (2016) A novel parameter separation based identification algorithm for Hammerstein systems. Appl Math Lett 60:21–27

    MathSciNet  MATH  Google Scholar 

  23. Chaudhary NI et al (2015) Design of fractional adaptive strategy for input nonlinear Box–Jenkins systems. Sig Process 116:141–151

    Google Scholar 

  24. Chaudhary NI et al (2015) Design of modified fractional adaptive strategies for Hammerstein nonlinear control autoregressive systems. Nonlinear Dyn 82(4):1811–1830

    Google Scholar 

  25. Cheng S, Wei Y, Sheng D, Chen Y, Wang Y (2018) Identification for Hammerstein nonlinear ARMAX systems based on multi-innovation fractional order stochastic gradient. Sig Process 142:1–10

    Google Scholar 

  26. Chaudhary NI et al (2015) Identification of Hammerstein nonlinear ARMAX systems using nonlinear adaptive algorithms. Nonlinear Dyn 79(2):1385–1397

    MathSciNet  MATH  Google Scholar 

  27. Aslam MS et al (2017) A sliding-window approximation-based fractional adaptive strategy for Hammerstein nonlinear ARMAX systems. Nonlinear Dyn 87(1):519–533

    MATH  Google Scholar 

  28. Chaudhary NI et al (2017) Modified Volterra LMS algorithm to fractional order for identification of Hammerstein non-linear system. IET Signal Proc 11(8):975–985

    Google Scholar 

  29. Djenouri Y, Belhadi A, Belkebir R (2018) Bees swarm optimization guided by data mining techniques for document information retrieval. Expert Syst Appl 94:126–136

    Google Scholar 

  30. Dhiman G, Kumar V (2018) Emperor penguin optimizer: a bio-inspired algorithm for engineering problems. Knowl Based Syst 159:20–50

    Google Scholar 

  31. Bose D, Biswas S, Vasilakos AV, Laha S (2014) Optimal filter design using an improved artificial bee colony algorithm. Inf Sci 281:443–461

    MathSciNet  Google Scholar 

  32. Abiyev RH, Tunay M (2015) Optimization of high-dimensional functions through hypercube evaluation. Comput Intell Neurosci 2015:17

    Google Scholar 

  33. Zhao W, Wang L, Zhang Z (2019) Atom search optimization and its application to solve a hydrogeologic parameter estimation problem. Knowl Based Syst 163:283–304

    Google Scholar 

  34. Chen X, Mei C, Xu B, Yu K, Huang X (2018) Quadratic interpolation based teaching-learning-based optimization for chemical dynamic system optimization. Knowl-Based Syst 145:250–263

    Google Scholar 

  35. Lodhi S et al (2019) Fractional neural network models for nonlinear Riccati systems. Neural Comput Appl 31(1):359–378

    Google Scholar 

  36. Kumar A, Kumar V (2018) Performance analysis of optimal hybrid novel interval type-2 fractional order fuzzy logic controllers for fractional order systems. Expert Syst Appl 93:435–455

    Google Scholar 

  37. Raja MAZ, Abbas S, Syam MI, Wazwaz AM (2018) Design of neuro-evolutionary model for solving nonlinear singularly perturbed boundary value problems. Appl Soft Comput 62:373–394

    Google Scholar 

  38. Raja MAZ (2014) Numerical treatment for boundary value problems of pantograph functional differential equation using computational intelligence algorithms. Appl Soft Comput 24:806–821

    Google Scholar 

  39. Umar M et al (2019) Intelligent computing for numerical treatment of nonlinear prey–predator models. Appl Soft Comput 80:506–524

    Google Scholar 

  40. Wang Y, Feng X, Lyu X, Li Z, Liu B (2016) Optimal targeting of nonlinear chaotic systems using a novel evolutionary computing strategy. Knowl-Based Syst 107:261–270

    Google Scholar 

  41. Chen K, Zhou F, Liu A (2018) Chaotic dynamic weight particle swarm optimization for numerical function optimization. Knowl-Based Syst 139:23–40

    Google Scholar 

  42. Ahmad I et al (2018) Neuro-evolutionary computing paradigm for Painlevé equation-II in nonlinear optics. Eur Phys J Plus 133(5):184

    Google Scholar 

  43. Raja MAZ, Shah Z, Manzar MA, Ahmad I, Awais M, Baleanu D (2018) A new stochastic computing paradigm for nonlinear Painlevé II systems in applications of random matrix theory. Eur Phys J Plus 133(7):254

    Google Scholar 

  44. Raja MAZ, Shah FH, Khan AA, Khan NA (2016) Design of bio-inspired computational intelligence technique for solving steady thin film flow of Johnson-Segalman fluid on vertical cylinder for drainage problems. J Taiwan Inst Chem Eng 60:59–75

    Google Scholar 

  45. Ahmad I et al (2019) Design of computational intelligent procedure for thermal analysis of porous fin model. Chin J Phys 59:641–655

    MathSciNet  Google Scholar 

  46. Mehmood A et al (2018) Parameter estimation for Hammerstein control autoregressive systems using differential evolution. SIViP 12(8):1603–1610

    Google Scholar 

  47. Raja MAZ, Shah AA, Mehmood A, Chaudhary NI, Aslam MS (2018) Bio-inspired computational heuristics for parameter estimation of nonlinear Hammerstein controlled autoregressive system. Neural Comput Appl 29(12):1455–1474

    Google Scholar 

  48. Khan WU et al (2018) Backtracking search integrated with sequential quadratic programing for nonlinear active noise control systems. Appl Soft Comput 73:666–683

    Google Scholar 

  49. Khan WU et al (2019) A novel application of fireworks heuristic paradigms for reliable treatment of nonlinear active noise control. Appl Acoust 146:246–260

    Google Scholar 

  50. Mehmood A et al (2019) Nature-inspired heuristic paradigms for parameter estimation of control autoregressive moving average systems. Neural Comput Appl 31(10):5819–5842

    Google Scholar 

  51. Ahmad I et al (2016) Bio-inspired computational heuristics to study Lane-Emden systems arising in astrophysics model. SpringerPlus 5(1):1866

    Google Scholar 

  52. Pathak M, Joshi P (2018) Application of a coupled approach for the solution of nonlinear singular initial value problems of Lane-Emden type. Astrophys Space Sci 363(9):191

    MathSciNet  Google Scholar 

  53. Raja MAZ, Zameer A, Khan AU, Wazwaz AM (2016) A new numerical approach to solve Thomas-Fermi model of an atom using bio-inspired heuristics integrated with sequential quadratic programming. SpringerPlus 5(1):1400

    Google Scholar 

  54. Sabir Z et al (2018) Neuro-heuristics for nonlinear singular Thomas-Fermi systems. Appl Soft Comput 65:152–169

    Google Scholar 

  55. Raja MAZ, Shah FH, Tariq M, Ahmad I (2018) Design of artificial neural network models optimized with sequential quadratic programming to study the dynamics of nonlinear Troesch’s problem arising in plasma physics. Neural Comput Appl 29(6):83–109

    Google Scholar 

  56. Majeed K et al (2017) A genetic algorithm optimized Morlet wavelet artificial neural network to study the dynamics of nonlinear Troesch’s system. Appl Soft Comput 56:420–435

    Google Scholar 

  57. Ahmad I et al (2017) Neural network methods to solve the Lane-Emden type equations arising in thermodynamic studies of the spherical gas cloud model. Neural Comput Appl 28(1):929–944

    Google Scholar 

  58. Raja MAZ, Niazi SA, Butt SA (2017) An intelligent computing technique to analyze the vibrational dynamics of rotating electrical machine. Neurocomputing 219:280–299

    Google Scholar 

  59. Vitayasak S, Pongcharoen P (2018) Performance improvement of Teaching-Learning-Based Optimisation for robust machine layout design. Expert Syst Appl 98:129–152

    Google Scholar 

  60. Mehmood A et al (2018) Design of neuro-computing paradigms for nonlinear nanofluidic systems of MHD Jeffery-Hamel flow. J Taiwan Inst Chem Eng 91:57–85

    Google Scholar 

  61. Raja MAZ, Ahmed T, Shah SM (2017) Intelligent computing strategy to analyze the dynamics of convective heat transfer in MHD slip flow over stretching surface involving carbon nanotubes. J Taiwan Inst Chem Eng 80:935–953

    Google Scholar 

  62. Mehmood A, Zameer A, Aslam MS, Raja MAZ (2019) Design of nature-inspired heuristic paradigm for systems in nonlinear electrical circuits. Neural Comput Appl. https://doi.org/10.1007/s00521-019-04197-7

    Article  Google Scholar 

  63. Raja MAZ, Mehmood A, Niazi SA, Shah SM (2018) Computational intelligence methodology for the analysis of RC circuit modelled with nonlinear differential order system. Neural Comput Appl 30(6):1905–1924

    Google Scholar 

  64. Li YZ, Jiang L, Wu QH, Wang P, Gooi HB, Li KC, Liu YQ, Lu P, Cao M, Imura J (2017) Wind-thermal power system dispatch using MLSAD model and GSOICLW algorithm. Knowl-Based Syst 116:94–101

    Google Scholar 

  65. Nuaekaew K, Artrit P, Pholdee N, Bureerat S (2017) Optimal reactive power dispatch problem using a two-archive multi-objective grey wolf optimizer. Expert Syst Appl 87:79–89

    Google Scholar 

  66. Mehmood A, Chaudhary NI, Zameer A et al (2019) Novel computing paradigms for parameter estimation in power signal models. Neural Comput Appl. https://doi.org/10.1007/s00521-019-04133-9

    Article  Google Scholar 

  67. Zameer A et al (2017) Intelligent and robust prediction of short term wind power using genetic programming based ensemble of neural networks. Energy Convers Manag 134:361–372

    Google Scholar 

  68. Kelly S, Ahmad K (2018) Estimating the impact of domain-specific news sentiment on financial assets. Knowl-Based Syst 150:116–126

    Google Scholar 

  69. Ara A et al (2018) Wavelets optimization method for evaluation of fractional partial differential equations: an application to financial modelling. Adv Differ Equ 2018(1):8

    MathSciNet  MATH  Google Scholar 

  70. Karhunen M (2019) Algorithmic sign prediction and covariate selection across eleven international stock markets. Expert Syst Appl 115:256–263

    Google Scholar 

  71. Cerqueti R, Ferraro G, Iovanella A (2018) A new measure for community structures through indirect social connections. Expert Syst Appl 114:196–209

    Google Scholar 

  72. Raja MAZ, Asma K, Aslam MS (2018) Bio-inspired computational heuristics to study models of hiv infection of CD4+ T-cell. Int J Biomath 11(02):1850019

    MathSciNet  MATH  Google Scholar 

  73. Raja MAZ, Shah FH, Alaidarous ES, Syam MI (2017) Design of bio-inspired heuristic technique integrated with interior-point algorithm to analyze the dynamics of heartbeat model. Appl Soft Comput 52:605–629

    Google Scholar 

  74. Storn R, Price K (1997) Differential evolution–a simple and efficient heuristic for global optimization over continuous spaces. J Global Optim 11(4):341–359

    MathSciNet  MATH  Google Scholar 

  75. Price K, Storn RM, Lampinen JA (2006) Differential evolution: a practical approach to global optimization. Springer, Berlin

    MATH  Google Scholar 

  76. Buba AT, Lee LS (2018) A differential evolution for simultaneous transit network design and frequency setting problem. Expert Syst Appl 106:277–289

    Google Scholar 

  77. Mlakar U, Fister I, Brest J, Potočnik B (2017) Multi-objective differential evolution for feature selection in facial expression recognition systems. Expert Syst Appl 89:129–137

    Google Scholar 

  78. Li H, Gong M, Wang C, Miao Q (2018) Self-paced stacked denoising autoencoders based on differential evolution for change detection. Appl Soft Comput 71:698–714

    Google Scholar 

  79. Sayah S (2018) Modified differential evolution approach for practical optimal reactive power dispatch of hybrid AC–DC power systems. Appl Soft Comput 73:591–606

    Google Scholar 

  80. Vali MH, Aghagolzadeh A, Baleghi Y (2018) Optimized watermarking technique using self-adaptive differential evolution based on redundant discrete wavelet transform and singular value decomposition. Expert Syst Appl 114:296–312

    Google Scholar 

  81. Hancer E, Xue B, Zhang M (2018) Differential evolution for filter feature selection based on information theory and feature ranking. Knowl-Based Syst 140:103–119

    Google Scholar 

  82. Holland JH (1992) Genetic algorithms. Scientific american 267(1):66–73

    Google Scholar 

  83. Davis L (1991) Handbook of genetic algorithms. Van Nostrand Reinhold, New York

    Google Scholar 

  84. Keshavarz H, Abadeh MS (2017) ALGA: adaptive lexicon learning using genetic algorithm for sentiment analysis of microblogs. Knowl-Based Syst 122:1–16

    Google Scholar 

  85. Raman MG, Somu N, Kirthivasan K, Liscano R, Sriram VS (2017) An efficient intrusion detection system based on hypergraph-Genetic algorithm for parameter optimization and feature selection in support vector machine. Knowl-Based Syst 134:1–12

    Google Scholar 

  86. Tseng HE, Chang CC, Lee SC, Huang YM (2018) A Block-based genetic algorithm for disassembly sequence planning. Expert Syst Appl 96:492–505

    Google Scholar 

  87. Owais M, Osman MK (2018) Complete hierarchical multi-objective genetic algorithm for transit network design problem. Expert Syst Appl 114:143–154

    Google Scholar 

  88. Jadhav S, He H, Jenkins K (2018) Information gain directed genetic algorithm wrapper feature selection for credit rating. Appl Soft Comput 69:541–553

    Google Scholar 

  89. Raja MAZ, Mehmood A, ur Rehman A, Khan A, Zameer A (2018) Bio-inspired computational heuristics for Sisko fluid flow and heat transfer models. Appl Soft Comput 71:622–648

    Google Scholar 

  90. Chouhdry ZR et al (2018) Design of reduced search space strategy based on integration of Nelder-Mead method and pattern search algorithm with application to economic load dispatch problem. Neural Comput Appl 30(12):3693–3705

    Google Scholar 

  91. Raja MAZ, Samar R (2014) Solution of the 2-dimensional Bratu problem using neural network, swarm intelligence and sequential quadratic programming. Neural Comput Appl 25(7–8):1723–1739

    Google Scholar 

  92. Raja MAZ, Khan JA, Qureshi IM (2010) A new stochastic approach for solution of Riccati differential equation of fractional order. Ann Math Artif Intell 60(3–4):229–250

    MathSciNet  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Electrical Engineering, Pakistan Institute of Engineering and Applied Sciences, Nilore, Islamabad, Pakistan

    Ammara Mehmood

  2. Department of Computer and Information Sciences, Pakistan Institute of Engineering and Applied Sciences, Nilore, Islamabad, Pakistan

    Aneela Zameer

  3. Department of Electrical Engineering, International Islamic University, Islamabad, Pakistan

    Naveed Ishtiaq Chaudhary

  4. Department of Engineering and IT, School of Biomedical Engineering, Centre for Health Technologies, University of Technology, Sydney, NSW, Australia

    Sai Ho Ling

  5. Department of Electrical and Computer Engineering, COMSATS University Islamabad, Attock Campus, Attock, Pakistan

    Muhammad Asif Zahoor Raja

Authors
  1. Ammara Mehmood
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Aneela Zameer
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Naveed Ishtiaq Chaudhary
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Sai Ho Ling
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Muhammad Asif Zahoor Raja
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Sai Ho Ling.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Mehmood, A., Zameer, A., Chaudhary, N.I. et al. Design of meta-heuristic computing paradigms for Hammerstein identification systems in electrically stimulated muscle models. Neural Comput & Applic 32, 12469–12497 (2020). https://doi.org/10.1007/s00521-020-04701-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-020-04701-4

Keywords

Search

Navigation