Skip to main content
SpringerLink
Log in

Novel error variance estimation rule for nonparametric VSS-NLMS algorithm

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

This paper presents a robust error variance estimation rule for the nonparametric variable step-size normalized least mean square (NPVSS-NLMS) algorithm. The proposed variance estimation rule accurately estimates the variance of the error signal. This is achieved by the variable exponential windowing parameter depending on the standard deviations of the sequential error signals. The accurate estimation of the error signal variance in the NPVSS-NLMS algorithm considerably improves the performance of the adaptive filter when compared to the classical NPVSS-NLMS algorithm. Moreover, the convergence and steady-state performances of the NPVSS-NLMS based on the proposed rule are analyzed in this study. The performance of the proposed algorithm is evaluated on system identification and acoustic echo canceling experiments and compared with that the classical NPVSS-NLMS algorithm. As a result, simulations show that the proposed algorithm with the help of the novel robust error variance estimation rule not only yields a dramatically reduced steady-state error but also achieves a faster convergence rate as compared with the classical counterparts. Furthermore, the theoretical results of the variable exponential windowing parameter used in the proposed rule are in very good agreement with its simulation results.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. Widrow, B., Stearns, S.D.: Adaptive Signal Processing. Prentice-Hall, Englewood Cliffs (1985)

    MATH  Google Scholar 

  2. Haykin, S.: Adaptive Filter Theory, 4th edn. Prentice-Hall, Upper Saddle River (2002)

    MATH  Google Scholar 

  3. Benesty, J., Huang, Y. (eds.): Adaptive Signal Processing-Applications to Real-World Problems. Springer, Berlin (2003)

    MATH  Google Scholar 

  4. Huang, Y., Benesty, J., Chen, J.: Acoustic MIMO Signal Processing. Springer, Boston (2006)

    Book  Google Scholar 

  5. Harris, R.W., Chabries, D.M., Bishop, F.A.: A variable step (VS) adaptive filter algorithm. IEEE Trans. Acoust. Speech Signal Process. ASSP–34, 309–316 (1986)

    Article  Google Scholar 

  6. Kwong, R.H., Johnston, E.W.: A variable step size LMS algorithm. IEEE Trans. Signal Process. 40(7), 1633–1642 (1992)

    Article  Google Scholar 

  7. Benveniste, A., Metivier, M., Priouret, P.: Adaptive algorithms and stochastic approximation. Springer, New York (1990)

    Book  Google Scholar 

  8. Mathews, V.J., Xie, Z.: A stochastic gradient adaptive filter with gradient adaptive step size. IEEE Trans. Signal Process. 41(6), 2075–2087 (1993)

    Article  Google Scholar 

  9. Ang, W.-P., Farhang-Boroujeny, B.: A new class of gradient adaptive step-size LMS algorithms. IEEE Trans. Signal Process. 49(4), 805–810 (2001)

    Article  Google Scholar 

  10. Evans, J.B., Xue, P., Liu, B.: Analysis and implementation of variable step size adaptive algorithms. IEEE Trans. Signal Process. 41(8), 2517–2535 (1993)

    Article  Google Scholar 

  11. Aboulnasr, T., Mayyas, K.: A robust variable step-size LMS-type algorithm: analysis and simulations. IEEE Trans. Signal Process. 45(3), 631–639 (1997)

    Article  Google Scholar 

  12. Pazaitis, D.I., Constantinides, A.G.: A novel kurtosis driven variable step-size adaptive algorithm. IEEE Trans. Signal Process. 47(3), 864–872 (1999)

    Article  Google Scholar 

  13. Hwang, J.-K., Li, Y.-P.: A gradient-based variable step-size scheme for kurtosis of estimated error. IEEE Signal Process. Lett. 17(4), 331–334 (2010)

    Article  Google Scholar 

  14. Shin, H.-C., Sayed, A.H., Song, W.-J.: Variable step-size NLMS and affine projection algorithms. IEEE Signal Process. Lett. 11(2), 132–135 (2004)

    Article  Google Scholar 

  15. Benesty, J., Rey, H., Rey Vega, L., Tressens, S.: A nonparametric VSS NLMS algorithm. IEEE Signal Process. Lett. 13(10), 581–584 (2006)

    Article  Google Scholar 

  16. Paleologu, C., Ciochina, S., Benesty, J.: Variable step-size NLMS algorithm for under-modeling acoustic echo cancellation. IEEE Signal Process. Lett. 15(1), 5–8 (2008)

    Article  Google Scholar 

  17. Paleologu, C., Benesty, J., Ciochina, S.: A variable step-size affine projection algorithm designed for acoustic echo cancellation. IEEE Trans. Audio Speech Lang. Process. 16(8), 1466–1478 (2008)

    Article  Google Scholar 

  18. Yin, W., Saadat Mehr, A.: A variable regularization method for affine projection algorithm. IEEE Trans. Circuits Syst. II Exp. Briefs 57(6), 476–480 (2010)

    Article  Google Scholar 

  19. Paleologu, C., Benesty, J., Grant, S. L., Osterwise, C.: Variable step-size NLMS algorithms designed for echo cancellation. In: Proceedings of the Asilomar, pp. 633–637 (2009)

  20. Jian-Chang, L., Xia, Y., Hong-Ru, L.: A nonparametric variable step-size NLMS algorithm for transversal filters. Appl. Math. Comput. 217(17), 7365–7371 (2011)

    MathSciNet  MATH  Google Scholar 

  21. Huang, H.C., Lee, J.: A new variable step-size NLMS algorithm and its performance analysis. IEEE Trans. Signal Process. 60(4), 2055–2060 (2012)

    Article  MathSciNet  Google Scholar 

  22. Paleologu, C., Ciochina, S., Benesty, J., Grant, S.L.: An overview on optimized NLMS algorithms for acoustic echo cancellation. EURASIP J. Adv. Signal Process. 2015(97), 1–19 (2015)

    Google Scholar 

  23. Pauline, S.H., Samiappan, D., Kumar, R., Anand, A., Kar, A.: Variable tap-length non-parametric variable step-size NLMS adaptive filtering algorithm for acoustic echo cancellation. Appl. Acoust. 159, 1–9 (2020)

    Article  Google Scholar 

  24. Han, H., Zhang, S., Liang, H.: Non-parametric variable step-size diffusion LMS algorithm over adaptive networks. Electron. Lett. 53(12), 768770 (2017)

    Google Scholar 

  25. Guan, S., Li, Z.: Nonparametric variable step-size LMAT algorithm. Circuits Syst. Signal Process. 36(3), 13221339 (2017)

    Article  Google Scholar 

  26. Hansler, E., Schmidt, G.: Acoustic echo and noise control—a practical approach. Wiley, Hoboken (2004)

    Book  Google Scholar 

  27. Jeng-Kuang, H., Yuan-Ping, L.: Variable step-size LMS algorithm with a gradient-based weighted average. IEEE Signal Process. Lett. 16(12), 1043–1046 (2009)

    Article  Google Scholar 

  28. Jahromi, M.N.S., Salman, M.S., Hocanin, A., Kukrer, O.: Mean-square deviation analysis of the zero-attracting variable step-size LMS algorithm. Signal Image Video Process. 11(3), 533540 (2017)

    Article  Google Scholar 

  29. Benesty, J., Gaensler, T., Morgan, D.R., Sondhi, M.M., Gay, S.L.: Advances in network and acoustic echo cancellation. Springer, Berlin (2001)

    Book  Google Scholar 

  30. Ni, J., Li, F.: A variable step-size matrix normalized subband adaptive filter. IEEE Trans. Audio Speech Lang. Process. 18(6), 1290–1299 (2010)

    Article  Google Scholar 

  31. Benesty, J., Paleologu, C., Ciochina, S.: On reqularization in adaptive filtering. IEEE Trans. Audio Speech Lang. Process. 19(6), 1734–1742 (2011)

    Article  Google Scholar 

  32. Paleologu, C., Benesty, J., Ciochina, S.: Study of the general kalman filter for echo cancellation. IEEE Trans. Audio Speech Lang. Process. 21(8), 1539–1549 (2013)

    Article  Google Scholar 

  33. Gil-Cacho, J.M., Waterschoot, T., Moonen, M., Jensen, S.H.: A frequency-domain adaptive filter (FDAF) prediction error method (PEM) framework for double-talk-robust acoustic echo cancellation. IEEE Trans. Audio Speech Lang. Process. 22(12), 2074–2086 (2014)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Electrical and Electronics Engineering Department, Nigde Ömer Halisdemir University, 51245, Nigde, Turkey

    Engin Cemal Mengüç

Authors
  1. Engin Cemal Mengüç
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Engin Cemal Mengüç.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Mengüç, E.C. Novel error variance estimation rule for nonparametric VSS-NLMS algorithm. SIViP 14, 1421–1429 (2020). https://doi.org/10.1007/s11760-020-01691-7

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-020-01691-7

Keywords

Search

Navigation