A State-Space Backpropagation Algorithm for Nonlinear Estimation
- 42 Downloads
Abstract
The fact that the knowledge of system model enhances the performance of any estimation algorithm is well known. However, the existing state-space-based algorithms are either linear such as the Kalman Filter and the state-space least mean square algorithms or highly complex in computation such as the Unscented Kalman Filter and the particle filter algorithms. To remedy this situation, we propose a novel state-space version of the most prominent algorithm used with neural networks, namely the backpropagation algorithm by incorporating the knowledge of the state-space model. To stress that this algorithm has a state-space basis, we call it a “State-Space Backpropagation (SSBP)” algorithm. The developed algorithm is then applied and analyzed on various challenging nonlinear estimation problems including the estimation of Remaining Useful Life of a lithium-ion battery and the Phase Permanent Magnet Synchronous Motor. Simulation results show that the performance of the SSBP is comparable to the competitive algorithms but with very reduced computational complexity.
Keywords
State space Neural network Estimation Backpropagation PrognosticsNotes
Acknowledgements
Funding was provided by Deanship of Scientic Research, King Abdulaziz University.
References
- 1.F. Ahmadzadeh, J. Lundberg, Remaining useful life estimation. Int. J. Syst. Assur. Eng. Manag. 5(4), 461–474 (2014)CrossRefGoogle Scholar
- 2.A. Ahmed, U.M. Al-Saggaf, M. Moinuddin, State space least mean fourth algorithm for state estimation of synchronous motor. Asian J. Eng. Sci. Technol. 4(1), 9–12 (2014)Google Scholar
- 3.D. An, J.-H. Choi, N.H. Kim, Prognostics 101: a tutorial for particle filter-based prognostics algorithm using matlab. Reliab. Eng. Syst. Saf. 115, 161–169 (2013)CrossRefGoogle Scholar
- 4.I. Arasaratnam, S. Haykin, Cubature Kalman filters. IEEE Trans. Autom. Control 54(6), 1254–1269 (2009)MathSciNetCrossRefzbMATHGoogle Scholar
- 5.I. Arasaratnam, S. Haykin, R.J. Elliott, Discrete-time non-linear filtering algorithms using Gauss–Hermite quadrature. Proc. IEEE 95(5), 953–977 (2007)CrossRefGoogle Scholar
- 6.C. Chui, G. Chen, Kalman Filtering with Real-Time Applications. Springer Series in Information Sciences (Springer, Berlin, 2013). ISBN: 9783662025086Google Scholar
- 7.C.K. Chui, G. Chen et al., Kalman Filtering (Springer, Berlin, 2017)CrossRefzbMATHGoogle Scholar
- 8.M.J. Daigle, C.S. Kulkarni. Electrochemistry based battery modeling for prognostics, in Annual Conference of the Prognostics and Health Management Society (2013), pp. 249–261Google Scholar
- 9.S.J. Dodds. State estimation, in Feedback Control (Springer, 2015), pp. 561–624Google Scholar
- 10.A. Doucet, A.M. Johansen. A tutorial on particle filtering and smoothing: Fifteen years later, in Handbook of Nonlinear Filtering, vol. 12 (2009), pp. 656–704Google Scholar
- 11.B.P. Gibbs, Advanced Kalman Filtering, Least-Squares and Modeling: A Practical Handbook (Wiley, Hoboken, 2011)CrossRefGoogle Scholar
- 12.M.S. Grewal, A.P. Andrews, Kalman Filtering: Theory and Practice with MATLAB (Wiley, Hoboken, 2015)zbMATHGoogle Scholar
- 13.S. Haykin, Adaptive Filter. Theory Prentice-Hall Information and System Sciences Series (Prentice Hall, Upper Saddle River, 1996). ISBN: 9780133227604Google Scholar
- 14.S. Haykin, Neural Networks and Learning Machines. Neural Networks and Learning Machines v. 10 (Prentice Hall, Upper Saddle River, 2009). ISBN: 9780131471399Google Scholar
- 15.S.J. Julier, J.K. Uhlmann, Unscented filtering and nonlinear estimation. Proc. IEEE 92(3), 401–422 (2004)CrossRefGoogle Scholar
- 16.S.J. Julier, J.K. Uhlmann. New extension of the Kalman filter to nonlinear systems, in AeroSense’97. International Society for Optics and Photonics (1997), pp. 182–193Google Scholar
- 17.M. Moinuddin, U.M. Al-Saggaf, A. Ahmed, Family of state space least mean power of two-based algorithms. EURASIP J. Adv. Signal Process. 2015(39), 1–16 (2015)Google Scholar
- 18.F. Orderud. Comparison of Kalman filter estimation approaches for state space models with nonlinear measurements, in Proceedings of Scandinavian Conference on Simulation and Modeling (2005), pp. 1–8Google Scholar
- 19.B. Ristic, Particle Filters for Random Set Models, vol. 798 (Springer, Berlin, 2013)CrossRefzbMATHGoogle Scholar
- 20.Y. Shen et al., Event-based recursive filtering for a class of non-linear stochastic parameter systems over fading channels. Int. J. Gen. Syst. 47(5), 401–415 (2018)CrossRefGoogle Scholar
- 21.X.-S. Si et al., Remaining useful life estimation—a review on the statistical data driven approaches. Eur. J. Oper. Res. 213(1), 1–14 (2011)MathSciNetCrossRefGoogle Scholar
- 22.J.Z. Sikorska, M. Hodkiewicz, L. Ma, Prognostic modelling options for remaining useful life estimation by industry. Mech. Syst. Signal Process. 25(5), 1803–1836 (2011)CrossRefGoogle Scholar
- 23.H.A. Talebi et al., Neural Network-Based State Estimation of Nonlinear Systems: Application to Fault Detection and Isolation, vol. 395 (Springer, Berlin, 2009)Google Scholar
- 24.L. Tamas et al. State estimation based on Kalman filtering techniques in navigation, in Automation, Quality and Testing, Robotics, 2008. AQTR 2008. IEEE International Conference on. Vol. 2. (IEEE, 2008), pp. 147–152Google Scholar
- 25.E.A. Wan, R. Van Der Merwe. The unscented Kalman filter for nonlinear estimation, in Adaptive Systems for Signal Processing, Communications, and Control Symposium 2000. AS-SPCC. The IEEE 2000 (IEEE, 2000), pp. 153–158Google Scholar
- 26.D. Wang et al., An event-triggered approach to robust recursive filtering for stochastic discrete timevarying spatial-temporal systems. Signal Process. 145, 91–98 (2018)CrossRefGoogle Scholar
- 27.E. Zio. Monte Carlo simulation methods for reliability estimation and failure prognostics, in Complex Data Modeling and Computationally Intensive Statistical Methods. (Springer, 2010), pp. 151–164Google Scholar
- 28.E. Zio, G. Peloni, Particle filtering prognostic estimation of the remaining useful life of nonlinear components. Reliab. Eng. Syst. Saf. 96(3), 403–409 (2011)CrossRefGoogle Scholar