Abstract
This paper focuses on the problem of adaptive blind source separation (BSS). First, a recursive least-squares (RLS) whitening algorithm is proposed. By combining it with a natural gradient-based RLS algorithm for nonlinear principle component analysis (PCA), and using reasonable approximations, a novel RLS algorithm which can achieve BSS without additional pre-whitening of the observed mixtures is obtained. Analyses of the equilibrium points show that both of the RLS whitening algorithm and the natural gradient-based RLS algorithm for BSS have the desired convergence properties. It is also proved that the combined new RLS algorithm for BSS is equivariant and has the property of keeping the separating matrix from becoming singular. Finally, the effectiveness of the proposed algorithm is verified by extensive simulation results.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Girolami, M., Self-organising Neural Networks: Independent Component Analysis and Blind Source Separation, London: Springer-Verlag, 1999.
Jiao, L. C., Ma, H. B., Liu, F., Multiuser detector and independent component analysis: progress and prospective, Progress in Natural Science, 2002, 12(4): 365–371.
Cardoso, J. F., Blind beamforming for non-Gaussian signals, IEE Proceedings-F, 1993, 140(6): 362–370.
Hyvarinen, A., Fast and robust fixed-point algorithms for independent component analysis, IEEE Trans. Neural Networks, 1999, 10(3): 626–634.
Feng, D. Z., Bao, Z., Zhang, X. D., Multistage decomposition algorithm for blind source separation, Progress in Natural Science, 2002, 12(3): 324–328.
Amari, S., Cichocki, A., Yang, H. H., A new learning algorithm for blind signal separation, Advances in Neural Information Processing Systems, Cambridge: MIT Press, 1996, 8: 757–763
Yang, H. H., Amari, S., Adaptive online learning algorithms for blind separation: maximum entropy and minimum mutual information, Neural Computation, 1997, 9(5): 1457–1482
Zhang, X. D., Zhu, X. L., Bao, Z., Grading learning for blind source separation, Science in China, Ser. E, 2002, 32(5): 693–703.
Cardoso, J. F., Laheld, B., Equivariant adaptive source separation, IEEE Trans. Signal Processing, 1996, 44(12): 3017–3030.
Pajunen, P., Karhunen, J., Least-squares methods for blind source separation based on nonlinear PCA, Int. J. of Neural Systems, 1998, 8(12): 601–612.
Karhunen, J., Pajunen, P., Oja, E., The nonlinear PCA criterion in blind source separation: relations with other approaches, Neurocomputing, 1998, 22(1): 5–20.
Haykin, S., Adaptive Filter Theory, 3rd ed., New York: Prentice Hall, 1996.
Eleftheriou, E., Falconer, D., Tracking properties and steady-state performance of RLS adaptive filter algorithm, IEEE Trans. ASSP, 1986, 34(5): 1097–1109.
Poor, H., Wang, X. D., Code-aided interference suppression for DS-CDMA communications, Part II: parallel blind adaptive implementations, IEEE Trans. Comm., 1997, 45(9): 1112–1122.
Zhang, X. D., Linear Algebra in Signal Processing (in Chinese), Beijing: Science Press, 1997.
Douglas, S. C., Self-stabilized gradient algorithms for blind source separation with orthogonality constraints, IEEE Trans. Neural Networks, 2000, 11(6): 1490–1497.
Amari, S., Natural gradient learning for over- and under-complete bases in ICA, Neural Computation, 1999, 11(8): 1875–1883.
Zhu, X. L., Zhang, X. D., Adaptive RLS algorithm for blind source separation using a natural gradient, IEEE Signal Processing Letters, 2002, 9(12): 432–435.
Yang, H. H., Serial updating rule for blind separation derived from the method of scoring, IEEE Trans. Signal Processing, 1999, 47(8): 2279–2285.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Zhu, X., Zhang, X. & Ye, J. Natural gradient-based recursive least-squares algorithm for adaptive blind source separation. Sci China Ser F 47, 55–65 (2004). https://doi.org/10.1360/02yf0242
Received:
Issue Date:
DOI: https://doi.org/10.1360/02yf0242