Abstract
This letter studies the tracking performance of a stochastic gradient-based adaptive algorithm, namely the maximum correntropy criterion algorithm, where a random walk is used to model the non-stationarity. In our analysis, we use the energy conservation argument to derive expressions for the steady-state excess mean square error (EMSE). We consider two different cases for measurement of noise distribution including the Gaussian noise and general non-Gaussian noise. For the Gaussian case, we derive a fixed-point equation that can be solved numerically to find steady-state EMSE value. For the general non-Gaussian case, we derive an approximate closed-form expression for EMSE. For both cases, unlike the stationary environment, the EMSE curves are not increasing functions of step size parameter. We use this observation to find the optimum step size learning parameter for general non-Gaussian case. The validity of the theoretical results are justified via simulation results.
Similar content being viewed by others
Notes
We use the Taylor expansion of \(f(e_n)\) as \(f(e_n) = f(v_n)+ f'(v_n)e_{a,n} +\frac{1}{2}f''(v_n)e_{a,n}^2+o(e_{a,n}^2)\).
References
W. Bazzi, A. Rastegarnia, A. Khalili, A robust diffusion adaptive network based on the maximum correntropy criterion, in Computer Communication and Networks (ICCCN), 2015 24th International Conference on, pp. 1–4 (2015)
B. Chen, J. Wang, H. Zhao, N. Zheng, J. Principe, Convergence of a fixed-point algorithm under maximum correntropy criterion. Signal Process. Lett. IEEE 22(10), 1723–1727 (2015)
B. Chen, L. Xing, J. Liang, N. Zheng, J. Principe, Steady-state mean-square error analysis for adaptive filtering under the maximum correntropy criterion. Signal Process. Lett. IEEE 21(7), 880–884 (2014)
B. Chen, J. Wang, H. Zhao, N. Zheng, J. Principe, Convergence of a fixed-point algorithm under maximum correntropy criterion. Signal Process. Lett. IEEE 22(10), 1723–1727 (2015)
D. Erdogmus, Information theoretic learning: Renyi’s entropy and its applications to adaptive system training. Ph.D. dissertation, University of Florida (2002)
D. Erdogmus, J.C. Principe, Generalized information potential criterion for adaptive system training. IEEE Trans. Neural Netw. 13(5), 1035–1044 (2002)
S. Han, A family of minimum Renyi’s error entropy algorithm for information processing. Ph.D. dissertation, University of Florida (2007)
S. Haykin, Adaptive Filter Theory, 3rd edn. (Prentice-Hall, Upper Saddle River, NJ, 1996)
A. Khalili, A. Rastegarnia, S. Sanei, Robust frequency estimation in three-phase power systems using correntropy-based adaptive filter. Sci. Meas. Technol. IET 9(8), 928–935 (2015)
W. Liu, P.P. Pokharel, J.C. Principe, Correntropy: properties, and applications in non-gaussian signal processing. IEEE Trans. Signal Process. 55(11), 5286–5298 (2007)
R. Price, A useful theorem for nonlinear devices having gaussian inputs. Inf. Theory, IRE Trans. 4(2), 69–72 (1958)
J.C. Principe, Information Theoretic Learning: Renyi’s Entropy and Kernel Perspectives (Springer, Berlin, 2010)
L. Shi, Y. Lin, Convex combination of adaptive filters under the maximum correntropy criterion in impulsive interference. Signal Process. Lett. IEEE 21(11), 1385–1388 (2014)
A. Singh, J. Principe, Using correntropy as a cost function in linear adaptive filters, in Neural Networks, 2009. IJCNN 2009. International Joint Conference on, pp. 2950–2955 (2009)
R. Wang, B. Chen, N. Zheng, J. Principe, A variable step-size adaptive algorithm under maximum correntropy criterion, in Neural Networks (IJCNN), 2015 International Joint Conference on, pp. 1–5 (2015)
B. Widrow, M. Hoff, Adaptive switching circuits. IRE WESCON Conv. Rec. 4, 96–104 (1960)
S. Zhao, B. Chen, J.C. Principe, Kernel adaptive filtering with maximum correntropy criterion, in International Joint Conference on Neural Networks (IJCNN), pp. 2012–2017 (2011)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Khalili, A., Rastegarnia, A., Islam, M.K. et al. Steady-State Tracking Analysis of Adaptive Filter With Maximum Correntropy Criterion. Circuits Syst Signal Process 36, 1725–1734 (2017). https://doi.org/10.1007/s00034-016-0373-9
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00034-016-0373-9