Advertisement

A New Iterative Least Squares Parameter Estimation Approach for Equation-error Autoregressive Systems

  • Lijuan Wan
  • Feng DingEmail author
  • Ximei LiuEmail author
  • Chunping Chen
Article
  • 6 Downloads

Abstract

This paper investigates the identification methods for controlled autoregressive systems with autoregressive noise (i.e., equation-error autoregressive systems) from given input and output data. By applying the iterative technique and the hierarchical identification principle, an iterative least squares identification algorithm is presented and a recursive generalized least squares algorithm is given for comparison. The basic idea is to replace the unknown noise terms in the information vector with their estimated residuals. The simulation test results show the effectiveness of these algorithms.

Keywords

Hierarchical principle iterative identification least squares parameter estimation 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Notes

References

  1. [1]
    L. Ljung, System Identification: Theory for the User, 2nd ed., Prentice-Hall, Englewood Cliffs, NJ, 1999.zbMATHGoogle Scholar
  2. [2]
    F. Ding, System Identification-New Theory and Methods, Science Press, Beijing, 2013.Google Scholar
  3. [3]
    J. Pan, X. Jiang, X. K. Wan, and W. Ding, “A filtering based multi-innovation extended stochastic gradient algorithm for multivariable control systems,” International Journal of Control Automation and Systems, vol. 15, no. 3, pp. 1189–1197, June 2017.CrossRefGoogle Scholar
  4. [4]
    L. Xu and F. Ding, “Parameter estimation for control systems based on impulse responses,” International Journal of Control Automation and Systems, vol. 15, no. 6, pp. 2471–2479, December 2017.CrossRefGoogle Scholar
  5. [5]
    J. J. Rubio, “Interpolation neural network model of a manufactured wind turbine,” Neural Computing and Applications, vol. 28, no. 8, pp. 2017–2028, August 2017.CrossRefGoogle Scholar
  6. [6]
    P. Gysel, J. Pimentel, M. Motamedi, and S. Ghiasi, “Ristretto: a framework for empirical study of resourceefficient inference in convolutional neural networks,” IEEE Transactions on Neural Networks and Learning Systems, vol. 29, no. 11, pp. 5784–5789, November 2018.CrossRefGoogle Scholar
  7. [7]
    J. J. Rubio, “Modified optimal control with a backpropagation network for robotic arms,” IET Control Theory and Applications, vol. 6, no. 14, pp. 2216–2225, September 2012.MathSciNetCrossRefGoogle Scholar
  8. [8]
    I. Mansouri, A. Gholampour, O. Kisi, and T. Ozbakkaloglu, “Evaluation of peak and residual conditions of actively confined concrete using neuro-fuzzy and neural computing techniques,” Neural Computing and Applications, vol. 29, no. 3, pp. 873–888, February 2018.CrossRefGoogle Scholar
  9. [9]
    J. J. Rubio, E. Lughofer, J. A. Meda-Campaña, L. A. Páramo, J. F. Novoa, and J. Pacheco, “Neural network updating via argument Kalman filter for modeling of Takagi-Sugeno fuzzy models,” Journal of Intelligent & Fuzzy Systems, vol. 35, no. 2, pp. 2585–2596, August 2018.CrossRefGoogle Scholar
  10. [10]
    Y. B. Gong, S. X. Yang, H. L. Ma, and M. Ge, “Fuzzy regression model based on geometric coordinate points distance and application to performance evaluation,” Journal of Intelligent & Fuzzy Systems, vol. 34, no. 1, pp. 395–404, January 2018.CrossRefGoogle Scholar
  11. [11]
    J. J. Rubio, “SOFMLS: online self-organizing fuzzy modified least square network,” IEEE Transactions on Fuzzy Systems, vol. 17, no. 6, pp. 1296–1309, December 2009.CrossRefGoogle Scholar
  12. [12]
    Y. P. Wang, L. C. Wang, D. H. Kong, and B. C. Yin, “Extrinsic least squares regression with closed-form solution on product grassmann manifold for video-based recognition,” Mathematical Problems in Engineering, vol. 2018, no. 1, pp. 1–7, March 2018.Google Scholar
  13. [13]
    F. Ding, F. F. Wang, L. Xu, T. Hayat, and A. Alsaedi, “Parameter estimation for pseudo-linear systems using the auxiliary model and the decomposition technique,” IET Control Theory and Applications, vol. 11, no. 3, pp. 390–400, February 2017.MathSciNetCrossRefGoogle Scholar
  14. [14]
    M. H. Li and X. M. Liu, “The least squares based iterative algorithms for parameter estimation of a bilinear system with autoregressive noise using the data filtering technique,” Signal Processing, vo. 147, pp. 23–34, June 2018.CrossRefGoogle Scholar
  15. [15]
    M. H. Li, X. M. Liu, and F. Ding, “The filtering-based maximum likelihood iterative estimation algorithms for a special class of nonlinear systems with autoregressive moving average noise using the hierarchical identification principle,” International Journal of Adaptive Control and Signal Processing, vol. 33, no. 7, pp. 1189–1211, July 2019.MathSciNetzbMATHCrossRefGoogle Scholar
  16. [16]
    D. Q. Wang, Z. Zhang, and J. Y. Yuan, “Maximum likelihood estimation method for dual-rate Hammerstein systems,” International Journal of Control Automation and Systems, vol. 15, no. 2, pp. 698–705, April 2017.CrossRefGoogle Scholar
  17. [17]
    L. Xu, “A proportional differential control method for a time-delay system using the Taylor expansion approximation,” Applied Mathematics and Computation, vol. 236, pp. 391–399, June 2017.MathSciNetzbMATHCrossRefGoogle Scholar
  18. [18]
    L. Xu, “Application of the Newton iteration algorithm to the parameter estimation for dynamical systems,” Journal of Computational and Applied Mathematics, vol. 288, pp. 33–43, November 2017.MathSciNetCrossRefGoogle Scholar
  19. [19]
    L. Xu, L. Chen, and W. L. Xiong, “Parameter estimation and controller design for dynamic systems from the step responses based on the Newton iteration,” Nonlinear Dynamics, vol. 79, no. 3, pp. 2155–2163, February 2017.MathSciNetCrossRefGoogle Scholar
  20. [20]
    L. Xu, “The damping iterative parameter identification method for dynamical systems based on the sine signal measurement,” Signal Processing, vol. 120, pp. 660–667, March 2017.CrossRefGoogle Scholar
  21. [21]
    L. Xu, F. Ding, and Q. M. Zhu, “Hierarchical Newton and least squares iterative estimation algorithm for dynamic systems by transfer functions based on the impulse responses,” International Journal of Systems Science, vol. 50, no. 1, pp. 141–151, January 2017.MathSciNetCrossRefGoogle Scholar
  22. [22]
    L., J. Liu, F. Ding, L. Xu, J. Pan, A. Alsaedi, and T. Hayat, “Maximum likelihood recursive identification for the multivariate equation-error autoregressive moving average systems using the data filtering,” IEEE Access, vol. 7, pp. 41154–41163, 2017.CrossRefGoogle Scholar
  23. [23]
    J. X. Ma and F. Ding, “Filtering-based multistage recursive identification algorithm for an input nonlinear outputerror autoregressive system by using key the term separation technique,” Circuits Systems and Signal Processing, vol. 36, no. 2, pp. 577–599, February 2017.zbMATHCrossRefGoogle Scholar
  24. [24]
    Y. J. Wang, F. Ding, and M. H. Wu, “Recursive parameter estimation algorithm for multivariate output-error systems,” Journal of the Franklin Institute, vol. 355, no. 12, pp. 5163–5181, August 2017.MathSciNetzbMATHCrossRefGoogle Scholar
  25. [25]
    H. Ma, J. Pan, L. Lv, G. Xu, F. Ding, A. Alsaedi, and T. Hayat, “Recursive algorithms for multivariable outputerror-like ARMA systems,” Mathematics, vol. 7, no. 6, Article Number: 558, June 2017.Google Scholar
  26. [26]
    L. J. Wan and F. Ding, “Decomposition-and gradientbased iterative identification algorithms for multivariable systems using the multi-innovation theory,” Circuits Systems and Signal Processing, vol. 38, no. 7, pp. 2971–2991, July 2017.CrossRefGoogle Scholar
  27. [27]
    L. J. Wan, X. M. Liu, F. Ding, and C. P. Chen, “Decomposition least-squares-based iterative identification algorithms for multivariable equation-error autoregressive moving average systems,” Mathematics, vol. 7, no. 7, Article Number: 609, July 2017.Google Scholar
  28. [28]
    Q. Liu, F. Ding, A. Alsaedi, and T. Hayat, “Recursive identification methods for multivariate output-error moving average systems using the auxiliary model,” International Journal of Control Automation and Systems, vol. 16, no. 3, pp. 1070–1079. March 2017.CrossRefGoogle Scholar
  29. [29]
    F. Ding, “Two-stage least squares based iterative estimation algorithm for CARARMA system modeling,” Applied Mathematical Modelling, vol. 37, no. 7, 4798–4808, April 2017.MathSciNetzbMATHCrossRefGoogle Scholar
  30. [30]
    L. Xu, W. L. Xiong, A. Alsaedi, and T. Hayat, “Hierarchical parameter estimation for the frequency response based on the dynamical window data,” International Journal of Control Automation and Systems, vol. 16, no. 4, pp. 1756–1764, August 2017.CrossRefGoogle Scholar
  31. [31]
    H. H. Yin, Z. F. Zhu, and F. Ding, “Model order determination using the Hankel matrix of impulse responses,” Applied Mathematics Letters, vol. 24, no. 5, pp. 797–802, May 2017.MathSciNetzbMATHCrossRefGoogle Scholar
  32. [32]
    Y. P. Pan, T. Sun, and H. Y. Yu, “On parameter convergence in least squares identification and adaptive control,” International Journal of Robust and Nonlinear Control vol. 29, no. 10, March 2017.Google Scholar
  33. [33]
    Y. P. Pan, X. Li, and H. Y. Yu, “Least-squares learning control with guaranteed parameter convergence,” Proc. of the 22nd International Conference on Automation and Computing (2016 ICAC), Colchester, UK, September 7-8, 2017.Google Scholar
  34. [34]
    F. Ding, X. G. Liu, and J. Chu, “Gradient-based and leastsquares-based iterative algorithms for Hammerstein systems using the hierarchical identification principle,” IET Control Theory and Applications, vol. 7, no. 2, pp. 176–184, January 2017.CrossRefGoogle Scholar
  35. [35]
    J. Ding, J. Z. Chen, J. X. Lin, and L. J. Wan, “Particle filtering based parameter estimation for systems with outputerror type model structures,” Journal of the Franklin Institute, vol. 356, no. 10, pp. 5521–5540, July 2017.zbMATHCrossRefGoogle Scholar
  36. [36]
    J. Ding, J. Z. Chen, J. X. Lin, and G. P. Jiang, “Particle filtering-based recursive identification for controlled auto-regressive systems with quantised output,” IET Control Theory and Applications, vol. 13, 2017.CrossRefGoogle Scholar
  37. [37]
    S. Y. Liu, F. Ding, L., Xu, and T. Hayat, “Hierarchical principle-based iterative parameter estimation algorithm for dual-frequency signals,” Circuits Systems and Signal Processing, vol. 38, no. 7, pp. 3251–3268, July 2017.CrossRefGoogle Scholar
  38. [38]
    X. Zhang, F. Ding, and E. F. Yang, “State estimation for bilinear systems through minimizing the covariance matrix of the state estimation errors,” International Journal of Adaptive Control and Signal Processing, vol. 33, no. 7, pp. 1157–1173, July 2017.MathSciNetzbMATHCrossRefGoogle Scholar
  39. [39]
    F. Ding, J. Pan, A. Alsaedi, and T. Hayat, “Gradient-based iterative parameter estimation algorithms for dynamical systems from observation data,” Mathematics, vol. 7, no. 5, Article Number: 428, May 2017.Google Scholar
  40. [40]
    F. Yang, Y.R. Sun, X. X. Li, and C. Y. Huang, “The quasiboundary value method for identifying the initial value of heat equation on a columnar symmetric domain,” Numerical Algorithms, vol. 82, no. 2, pp. 623–639, October 2017.zbMATHCrossRefGoogle Scholar
  41. [41]
    F. Yang, N. Wang, X. X. Li, and C. Y. Huang, “A quasiboundary regularization method for identifying the initial value of time-fractional diffusion equation on spherically symmetric domain,” Journal of Inverse and Ill-posed Problems, 2017. DOI: 2017.1515/jiip-2018-0050Google Scholar
  42. [42]
    F. Yang, Y. Zhang, and X. X. Li, “Landweber iterative method for identifying the initial value problem of the time-space fractional diffusion-wave equation,” Numerical Algorithms, 2017. DOI: 2017.1007/s11075-019-00734-6Google Scholar
  43. [43]
    B. Fu, C. X. Ouyang, C. S. Li, J. W. Wang, and E. Gul, “An improved mixed integer linear programming approach based on symmetry diminishing for unit commitment of hybrid power system,” Energies, vol. 12, no. 5, Article Number: 833, March 2017.Google Scholar
  44. [44]
    W. X. Shi, N. Liu, Y. M. Zhou, and X. A. Cao, “Effects of postannealing on the characteristics and reliability of polyfluorene organic light-emitting diodes,” IEEE Transactions on Electron Devices, vol. 66, no. 2, pp. 1057–1062, February 2017.CrossRefGoogle Scholar
  45. [45]
    N. Liu, S. Mei, D. Sun, W. Shi, J. Feng, Y. M. Zhou, F. Mei, J. Xu, Y. Jiang, and X. A. Cao, “Effects of charge transport materials on blue fluorescent organic light-emitting diodes with a host-dopant system,” Micromachines, vol. 10, no. 5, Article Number: 344, May 2017.Google Scholar
  46. [46]
    T. Z. Wu, X. Shi, L. Liao, C. J. Zhou, H. Zhou, and Y. H. Su, “A capacity configuration control strategy to alleviate power fluctuation of hybrid energy storage system based on improved particle swarm optimization,” Energies, vol. 12, no. 4, Article Number: 642, February 2017.Google Scholar
  47. [47]
    X. L. Zhao, Z. Y. Lin, B. Fu, L. He, and C. S. Li, “Research on the predictive optimal PID plus second order derivative method for AGC of power system with high penetration of photovoltaic and wind power,” Journal of Electrical Engineering & Technology, vol. 14, no. 3, pp. 1075–1086, May 2017.CrossRefGoogle Scholar
  48. [48]
    Z. Y. Sun, D. Zhang, Q. Meng, and C. C. Chen, “Feedback stabilization of time-delay nonlinear systems with continuous time-varying output function,” International Journal of Systems Science, vol. 50, no. 2, pp. 244–255, January 2017.CrossRefGoogle Scholar
  49. [49]
    Y. Cao, Z. Wang, F. Liu, P. Li, and G. Xie, “Bio-inspired speed curve optimization and sliding mode tracking control for subway trains,” IEEE Transactions on Vehicular Technology, vol. 68, no. 7, pp. 6331–6342, July 2017.CrossRefGoogle Scholar
  50. [50]
    Y. Cao, Y. K. Sun, G. Xie, and T. Wen, “Fault diagnosis of train plug door based on a hybrid criterion for IMFs selection and fractional wavelet package energy entropy,” IEEE Transactions on Vehicular Technology, vol. 68, no. 8, pp. 7544–7551, Aug. 2017.CrossRefGoogle Scholar
  51. [51]
    X. K. Wan, Y. Li, C. Xia, M. H. Wu, J. Liang, and N. Wang, “A T-wave alternans assessment method based on least squares curve fitting technique,” Measurement, vol. 86, pp. 93–100, May 2017.CrossRefGoogle Scholar
  52. [52]
    N. Zhao, “Joint optimization of cooperative spectrum sensing and resource allocation in multi-channel cognitive radio sensor networks,” Circuits Systems and Signal Processing, vol. 35, no. 7, pp. 2563–2583, July 2017.zbMATHCrossRefGoogle Scholar
  53. [53]
    X. L. Zhao, F. Liu, B. Fu, and F. Na, “Reliability analysis of hybrid multi-carrier energy systems based on entropybased Markov model,” Proceedings of the Institution of Mechanical Engineers Part O-Journal of Risk and Reliability, vol. 230, no. 6, pp. 561–569, December 2017.CrossRefGoogle Scholar
  54. [54]
    N. Zhao, Y. Chen, R. Liu, M. H. Wu, and W. Xiong, “Monitoring strategy for relay incentive mechanism in cooperative communication networks,” Computers & Electrical Engineering, vol. 60, pp. 14–29, May 2017.CrossRefGoogle Scholar
  55. [55]
    N. Zhao, M. H. Wu, and J. J. Chen, “Android-based mobile educational platform for speech signal processing,” International Journal of Electrical Engineering Education, vol. 54, no. 1, pp. 3–16, January 2017.CrossRefGoogle Scholar
  56. [56]
    J. Pan, W. Li, and H. P. Zhang, “Control algorithms of magnetic suspension systems based on the improved double exponential reaching law of sliding mode control,” International Journal of Control Automation and Systems, vol. 16, no. 6, pp. 2878–2887, December 2017.CrossRefGoogle Scholar
  57. [57]
    P. C. Gong, W. Q. Wang, and X. R. Wan, “Adaptive weight matrix design and parameter estimation via sparse modeling for MIMO radar,” Signal Processing, vol. 139, pp. 1–11, October 2017.CrossRefGoogle Scholar
  58. [58]
    P. C. Gong, W. Q. Wang, F. C. Li, and H. Cheung, “Sparsity-aware transmit beamspace design for FDAMIMO radar,” Signal Processing, vol. 144, pp. 99–103, March 2017.CrossRefGoogle Scholar
  59. [59]
    N. Zhao, Y. Liang, and Y. Pei, “Dynamic contract incentive mechanism for cooperative wireless networks,” IEEE Transactions on Vehicular Technology, vol. 67, no. 11, pp. 10970–10982, November 2017.CrossRefGoogle Scholar
  60. [60]
    X. L. Zhao, Z. Y. Lin, B. Fu, L. He, and F. Na, “Research on automatic generation control with wind power participation based on predictive optimal 2-degree-of-freedom PID strategy for multi-area interconnected power system,” Energies, vol. 11, no. 12, Article Number: 3325, December 2017.Google Scholar
  61. [61]
    W.Wei,W. C. Xue, and D. H. Li, “On disturbance rejection in magnetic levitation,” Control Engineering Practice, vol. 82, pp. 24–35, January 2017.Google Scholar
  62. [62]
    X. D. Liu, H. S. Yu, J. P. Yu, and L. Zhao, “Combined speed and current terminal sliding mode control with nonlinear disturbance observer for PMSM drive,” IEEE Access, vol. 6, pp. 29594–29601, 2017.CrossRefGoogle Scholar
  63. [63]
    X. D. Liu, H. S. Yu, J. P. Yu, and Y. Zhao, “A novel speed control method based on port-Controlled Hamiltonian and disturbance observer for PMSM drives,” IEEE Access, vol. 7, pp. 111115–111123, 2017.CrossRefGoogle Scholar
  64. [64]
    J. X. Ma, W. L. Xiong, J. Chen, and F. Ding, “Hierarchical identification for multivariate Hammerstein systems by using the modified Kalman filter,” IET Control Theory and Applications, vol. 11, no. 6, pp. 857–869, April 2017.MathSciNetCrossRefGoogle Scholar
  65. [65]
    P. Ma and F. Ding, “New gradient based identification methods for multivariate pseudo-linear systems using the multi-innovation and the data filtering,” Journal of the Franklin Institute, vol. 354, no. 3, pp. 1568–1583, February 2017.MathSciNetzbMATHCrossRefGoogle Scholar
  66. [66]
    F. Ding, F. F. Wang, L. Xu, and M. H. Wu, “Decomposition based least squares iterative identification algorithm for multivariate pseudo-linear ARMA systems using the data filtering,” Journal of the Franklin Institute, vol. 354, no. 3, pp. 1321–1339, February 2017.MathSciNetzbMATHCrossRefGoogle Scholar
  67. [67]
    H. Ma, J. Pan, F. Ding, L. Xu, and W. Ding, “Partiallycoupled least squares based iterative parameter estimation for multi-variable output-error-like autoregressive moving average systems,” IET Control Theory and Applications, vol. 13, 2017. DOI: 2017.1049/iet-cta.2017.0112Google Scholar
  68. [68]
    F. Ding, L. Lv, J. Pan, X. K. Wan, and X. B. Jin, “Two-stage gradient-based iterative estimation methods for controlled autoregressive systems using the measurement data,” International Journal of Control Automation and Systems, vol. 18, 2017. DOI: 2017.1007/s12555-019-0140-3Google Scholar

Copyright information

© ICROS, KIEE and Springer 2019

Authors and Affiliations

  1. 1.College of Automation and Electronic EngineeringQingdao University of Science and TechnologyQingdaoP. R. China
  2. 2.Qingdao University of Science and TechnologyQingdaoP. R. China

Personalised recommendations