Skip to main content
Log in

Steady-State Tracking Analysis of Adaptive Filter With Maximum Correntropy Criterion

  • Short Paper
  • Published:
Circuits, Systems, and Signal Processing Aims and scope Submit manuscript

Abstract

This letter studies the tracking performance of a stochastic gradient-based adaptive algorithm, namely the maximum correntropy criterion algorithm, where a random walk is used to model the non-stationarity. In our analysis, we use the energy conservation argument to derive expressions for the steady-state excess mean square error (EMSE). We consider two different cases for measurement of noise distribution including the Gaussian noise and general non-Gaussian noise. For the Gaussian case, we derive a fixed-point equation that can be solved numerically to find steady-state EMSE value. For the general non-Gaussian case, we derive an approximate closed-form expression for EMSE. For both cases, unlike the stationary environment, the EMSE curves are not increasing functions of step size parameter. We use this observation to find the optimum step size learning parameter for general non-Gaussian case. The validity of the theoretical results are justified via simulation results.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2

Similar content being viewed by others

Notes

  1. We use the Taylor expansion of \(f(e_n)\) as \(f(e_n) = f(v_n)+ f'(v_n)e_{a,n} +\frac{1}{2}f''(v_n)e_{a,n}^2+o(e_{a,n}^2)\).

References

  1. W. Bazzi, A. Rastegarnia, A. Khalili, A robust diffusion adaptive network based on the maximum correntropy criterion, in Computer Communication and Networks (ICCCN), 2015 24th International Conference on, pp. 1–4 (2015)

  2. B. Chen, J. Wang, H. Zhao, N. Zheng, J. Principe, Convergence of a fixed-point algorithm under maximum correntropy criterion. Signal Process. Lett. IEEE 22(10), 1723–1727 (2015)

  3. B. Chen, L. Xing, J. Liang, N. Zheng, J. Principe, Steady-state mean-square error analysis for adaptive filtering under the maximum correntropy criterion. Signal Process. Lett. IEEE 21(7), 880–884 (2014)

    Article  Google Scholar 

  4. B. Chen, J. Wang, H. Zhao, N. Zheng, J. Principe, Convergence of a fixed-point algorithm under maximum correntropy criterion. Signal Process. Lett. IEEE 22(10), 1723–1727 (2015)

    Article  Google Scholar 

  5. D. Erdogmus, Information theoretic learning: Renyi’s entropy and its applications to adaptive system training. Ph.D. dissertation, University of Florida (2002)

  6. D. Erdogmus, J.C. Principe, Generalized information potential criterion for adaptive system training. IEEE Trans. Neural Netw. 13(5), 1035–1044 (2002)

    Article  Google Scholar 

  7. S. Han, A family of minimum Renyi’s error entropy algorithm for information processing. Ph.D. dissertation, University of Florida (2007)

  8. S. Haykin, Adaptive Filter Theory, 3rd edn. (Prentice-Hall, Upper Saddle River, NJ, 1996)

    MATH  Google Scholar 

  9. A. Khalili, A. Rastegarnia, S. Sanei, Robust frequency estimation in three-phase power systems using correntropy-based adaptive filter. Sci. Meas. Technol. IET 9(8), 928–935 (2015)

    Article  Google Scholar 

  10. W. Liu, P.P. Pokharel, J.C. Principe, Correntropy: properties, and applications in non-gaussian signal processing. IEEE Trans. Signal Process. 55(11), 5286–5298 (2007)

    Article  MathSciNet  Google Scholar 

  11. R. Price, A useful theorem for nonlinear devices having gaussian inputs. Inf. Theory, IRE Trans. 4(2), 69–72 (1958)

  12. J.C. Principe, Information Theoretic Learning: Renyi’s Entropy and Kernel Perspectives (Springer, Berlin, 2010)

    Book  MATH  Google Scholar 

  13. L. Shi, Y. Lin, Convex combination of adaptive filters under the maximum correntropy criterion in impulsive interference. Signal Process. Lett. IEEE 21(11), 1385–1388 (2014)

    Article  Google Scholar 

  14. A. Singh, J. Principe, Using correntropy as a cost function in linear adaptive filters, in Neural Networks, 2009. IJCNN 2009. International Joint Conference on, pp. 2950–2955 (2009)

  15. R. Wang, B. Chen, N. Zheng, J. Principe, A variable step-size adaptive algorithm under maximum correntropy criterion, in Neural Networks (IJCNN), 2015 International Joint Conference on, pp. 1–5 (2015)

  16. B. Widrow, M. Hoff, Adaptive switching circuits. IRE WESCON Conv. Rec. 4, 96–104 (1960)

    Google Scholar 

  17. S. Zhao, B. Chen, J.C. Principe, Kernel adaptive filtering with maximum correntropy criterion, in International Joint Conference on Neural Networks (IJCNN), pp. 2012–2017 (2011)

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Azam Khalili.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Khalili, A., Rastegarnia, A., Islam, M.K. et al. Steady-State Tracking Analysis of Adaptive Filter With Maximum Correntropy Criterion. Circuits Syst Signal Process 36, 1725–1734 (2017). https://doi.org/10.1007/s00034-016-0373-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00034-016-0373-9

Keywords

Navigation