Abstract
This paper presents a novel approach to Lyapunov stability theory-based adaptive filter (LAF) design. The proposed design is based on the minimization of the Euclidean norm of the difference weight vector under negative definiteness constraint defined over a novel linear Lyapunov function. The proposed fixed step size LAF (FSS-LAF) algorithm is first obtained by using the method of Lagrangian multipliers. The FSS-LAF satisfying asymptotic stability in the sense of Lyapunov provides a significant performance gain in the presence of a measurement noise. The stability of the FSS-LAF algorithm is also statistically analyzed in this study. Moreover, gradient variable step size (VSS) algorithms are adapted to the FSS-LAF algorithm to further enhance the performance for the first time in this paper. These VSS algorithms are Benveniste (BVSS), Mathews and Farhang–Ang (FVSS) algorithms. Simulation results on system identification problems show that the bounds of step size for the FSS-LAF algorithm are verified, and especially, the BVSS-LAF and FVSS-LAF algorithms provide a better trade-off between steady-state mean square deviation error and convergence rate than other proposed algorithms.
Similar content being viewed by others
References
Haykin, S.: Adaptive Filter Theory. Prentice-Hall, Englewood Cliffs (1996)
Seng, K.P., Man, Z., Wu, H.R.: Lyapunov-theory-based radial basis function networks for adaptive filtering. IEEE Trans. Circuits Syst. I Fundam. Theory Appl. 49(8), 1215–1220 (2002)
Sakrani, S., Sayadi, M. and Fnaiech, F.: A new 2D adaptive nonlinear filter based on the Lyapunov stability theory. In: Proceedings of 3rd International Symposium on Image and Signal Processing and Analysis, vol. 2, pp. 1102–1105 (2003)
Phooi, S.K., Ang, L.M.: Adaptive RBF neural network training algorithm for nonlinear and nonstationary signal. In: Proceedings of International Conference on Computational Intelligence and Security, vol. 1, pp. 433–436 (2006)
Zhao, H., Zhang, J.: Filtered-X Lyapunov algorithm for nonlinear active noise control using second-order Volterra filter. In: Proceedings of 11th IEEE International Conference on Communication Technology, pp. 497–500 (2008)
Caiyun, W.: Active noise control based on adaptive bilinear F-L algorithm. In: Proceedings of International Conference on Computer Distributed Control and Intelligent Environmental Monitoring (CDCIEM), pp. 89–92 (2012)
Mengüç, E.C., Acır, N.: A novel adaptive filter algorithm for tracking of chaotic time series. In: Proceedings of IEEE 19th Conference on Signal Processing and Communications Applications (SIU), pp. 490–493 (2011)
Mengüç, E.C., Acır, N.: A novel adaptive filter design using Lyapunov stability theory. Turk. J. Electr. Eng. Comput. Sci. 23(8), 719–728 (2015)
Mengüç, E.C., Acır, N.: Lyapunov stability theory based adaptive filter algorithm for noisy measurements. In: Proceedings of 15th International Conference on Computer Modelling and Simulation (UKSim), pp. 451–454 (2013)
Benveniste, A., Metivier, M., Priouret, P.: Adaptive Algorithms and Stochastic Approximation. Springer, Berlin (1990)
Mathews, V.J., Xie, Z.: A stochastic gradient adaptive filter with gradient adaptive step size. IEEE Trans. Signal Process. 41(6), 2075–2087 (1993)
Ang, W.-P., Farhang-Boroujeny, B.: A new class of gradient adaptive step-size LMS algorithms. IEEE Trans. Signal Process. 49(4), 805–810 (2001)
Mandic, D.P., Goh, V.S.L.: Complex Valued Nonlinear Adaptive Filters: Noncircularity, Widely Linear and Neural Models. Wiley, New York (2009)
Hayes, M.: Statistical Digital Signal Processing and Modelling. Wiley, New York (1999)
Hwang, J.-K., Li, Y.-P.: Variable step-size LMS algorithm with a gradient-based weighted average. IEEE Signal Process. Lett. 16(126), 1043–1046 (2009)
Aliyu, M.L., Alkassim, M.A., Salman, M.S.: A p-norm variable step-size LMS algorithm for sparse system identification. Signal Video Image Process. 9(7), 1559–1565 (2016)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Mengüç, E.C., Acır, N. A generalized Lyapunov stability theory-based adaptive FIR filter algorithm with variable step sizes. SIViP 11, 1567–1575 (2017). https://doi.org/10.1007/s11760-017-1121-8
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11760-017-1121-8