Abstract
The fact that the knowledge of system model enhances the performance of any estimation algorithm is well known. However, the existing state-space-based algorithms are either linear such as the Kalman Filter and the state-space least mean square algorithms or highly complex in computation such as the Unscented Kalman Filter and the particle filter algorithms. To remedy this situation, we propose a novel state-space version of the most prominent algorithm used with neural networks, namely the backpropagation algorithm by incorporating the knowledge of the state-space model. To stress that this algorithm has a state-space basis, we call it a “State-Space Backpropagation (SSBP)” algorithm. The developed algorithm is then applied and analyzed on various challenging nonlinear estimation problems including the estimation of Remaining Useful Life of a lithium-ion battery and the Phase Permanent Magnet Synchronous Motor. Simulation results show that the performance of the SSBP is comparable to the competitive algorithms but with very reduced computational complexity.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
F. Ahmadzadeh, J. Lundberg, Remaining useful life estimation. Int. J. Syst. Assur. Eng. Manag. 5(4), 461–474 (2014)
A. Ahmed, U.M. Al-Saggaf, M. Moinuddin, State space least mean fourth algorithm for state estimation of synchronous motor. Asian J. Eng. Sci. Technol. 4(1), 9–12 (2014)
D. An, J.-H. Choi, N.H. Kim, Prognostics 101: a tutorial for particle filter-based prognostics algorithm using matlab. Reliab. Eng. Syst. Saf. 115, 161–169 (2013)
I. Arasaratnam, S. Haykin, Cubature Kalman filters. IEEE Trans. Autom. Control 54(6), 1254–1269 (2009)
I. Arasaratnam, S. Haykin, R.J. Elliott, Discrete-time non-linear filtering algorithms using Gauss–Hermite quadrature. Proc. IEEE 95(5), 953–977 (2007)
C. Chui, G. Chen, Kalman Filtering with Real-Time Applications. Springer Series in Information Sciences (Springer, Berlin, 2013). ISBN: 9783662025086
C.K. Chui, G. Chen et al., Kalman Filtering (Springer, Berlin, 2017)
M.J. Daigle, C.S. Kulkarni. Electrochemistry based battery modeling for prognostics, in Annual Conference of the Prognostics and Health Management Society (2013), pp. 249–261
S.J. Dodds. State estimation, in Feedback Control (Springer, 2015), pp. 561–624
A. Doucet, A.M. Johansen. A tutorial on particle filtering and smoothing: Fifteen years later, in Handbook of Nonlinear Filtering, vol. 12 (2009), pp. 656–704
B.P. Gibbs, Advanced Kalman Filtering, Least-Squares and Modeling: A Practical Handbook (Wiley, Hoboken, 2011)
M.S. Grewal, A.P. Andrews, Kalman Filtering: Theory and Practice with MATLAB (Wiley, Hoboken, 2015)
S. Haykin, Adaptive Filter. Theory Prentice-Hall Information and System Sciences Series (Prentice Hall, Upper Saddle River, 1996). ISBN: 9780133227604
S. Haykin, Neural Networks and Learning Machines. Neural Networks and Learning Machines v. 10 (Prentice Hall, Upper Saddle River, 2009). ISBN: 9780131471399
S.J. Julier, J.K. Uhlmann, Unscented filtering and nonlinear estimation. Proc. IEEE 92(3), 401–422 (2004)
S.J. Julier, J.K. Uhlmann. New extension of the Kalman filter to nonlinear systems, in AeroSense’97. International Society for Optics and Photonics (1997), pp. 182–193
M. Moinuddin, U.M. Al-Saggaf, A. Ahmed, Family of state space least mean power of two-based algorithms. EURASIP J. Adv. Signal Process. 2015(39), 1–16 (2015)
F. Orderud. Comparison of Kalman filter estimation approaches for state space models with nonlinear measurements, in Proceedings of Scandinavian Conference on Simulation and Modeling (2005), pp. 1–8
B. Ristic, Particle Filters for Random Set Models, vol. 798 (Springer, Berlin, 2013)
Y. Shen et al., Event-based recursive filtering for a class of non-linear stochastic parameter systems over fading channels. Int. J. Gen. Syst. 47(5), 401–415 (2018)
X.-S. Si et al., Remaining useful life estimation—a review on the statistical data driven approaches. Eur. J. Oper. Res. 213(1), 1–14 (2011)
J.Z. Sikorska, M. Hodkiewicz, L. Ma, Prognostic modelling options for remaining useful life estimation by industry. Mech. Syst. Signal Process. 25(5), 1803–1836 (2011)
H.A. Talebi et al., Neural Network-Based State Estimation of Nonlinear Systems: Application to Fault Detection and Isolation, vol. 395 (Springer, Berlin, 2009)
L. Tamas et al. State estimation based on Kalman filtering techniques in navigation, in Automation, Quality and Testing, Robotics, 2008. AQTR 2008. IEEE International Conference on. Vol. 2. (IEEE, 2008), pp. 147–152
E.A. Wan, R. Van Der Merwe. The unscented Kalman filter for nonlinear estimation, in Adaptive Systems for Signal Processing, Communications, and Control Symposium 2000. AS-SPCC. The IEEE 2000 (IEEE, 2000), pp. 153–158
D. Wang et al., An event-triggered approach to robust recursive filtering for stochastic discrete timevarying spatial-temporal systems. Signal Process. 145, 91–98 (2018)
E. Zio. Monte Carlo simulation methods for reliability estimation and failure prognostics, in Complex Data Modeling and Computationally Intensive Statistical Methods. (Springer, 2010), pp. 151–164
E. Zio, G. Peloni, Particle filtering prognostic estimation of the remaining useful life of nonlinear components. Reliab. Eng. Syst. Saf. 96(3), 403–409 (2011)
Acknowledgements
Funding was provided by Deanship of Scientic Research, King Abdulaziz University.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Bjaili, H.A., Moinuddin, M. & Rushdi, A.M. A State-Space Backpropagation Algorithm for Nonlinear Estimation. Circuits Syst Signal Process 38, 3682–3696 (2019). https://doi.org/10.1007/s00034-019-01031-2
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00034-019-01031-2