Neural Processing Letters

, Volume 12, Issue 1, pp 91–98 | Cite as

On-line Algorithm for Blind Signal Extraction of Arbitrarily Distributed, but Temporally Correlated Sources Using Second Order Statistics

  • Andrzej Cichocki
  • Ruck Thawonmas


Most of the algorithms for blind separation/extraction and independent component analysis (ICA) can not separate mixtures of sources with extremely low kurtosis or colored Gaussian sources. Moreover, to separate mixtures of super- and sub-Gaussian signals, it is necessary to use adaptive (time-variable) or switching nonlinearities which are controlled via computationally intensive measures, such as estimation of the sign of kurtosis of extracted signals. In this paper, we develop a very simple neural network model and an efficient on-line adaptive algorithm that sequentially extract temporally correlated sources with arbitrary distributions, including colored Gaussian sources and sources with extremely low values (or even zero) of kurtosis. The validity and performance of the algorithm have been confirmed by extensive computer simulation experiments.

adaptive learning algorithms blind signal processing neural networks 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Amari, S.: ICA of temporally correlated signals-learning algorithm, Proceedings ICA' 99: International workshop on blind signal separation and independent component analysis, Aussois, France, pp. 13-18, 1999.Google Scholar
  2. 2.
    Amari, S. and Cichocki, A.: Adaptive blind signal processing-neural network approaches, Proceedings of the IEEE, 86(10) (1998), 2026-2048.Google Scholar
  3. 3.
    Belouchrani, A., Meraim, K. A. and Cardoso, J.-F.: A blind source separation technique using second order statistics, IEEE Transaction on Signal Processing, 45 (1997), 434-444.Google Scholar
  4. 4.
    Cichocki, A. and Unbehauen, R.: Robust neural networks with on-line learning for blind identification and blind separation of sources, IEEE Transaction on Circuits and Systems, 43(11) (1996), 894-906.Google Scholar
  5. 5.
    Delfosse, N. and Loubaton, P.: Adaptive blind separation of independent sources: A deflation approach, Signal Processing, 45 (1995), 59-83.Google Scholar
  6. 6.
    Douglas, S.C. and Kung, S.-Y.: KuicNet algorithm for blind deconvolution, Proceedings of the 1998 IEEE Workshop on Neural Networks for Signal Processing, IEEE Press, New York, pp. 3-12, 1998.Google Scholar
  7. 7.
    Hyvärinen, A. and Oja, E.: A fast fixed-point algorithm for independent component analysis, Neural Computation, 9(7) (1997), 1483-1492.Google Scholar
  8. 8.
    Jutten, C. and Herault, J.: Blind separation of sources, Part I: An adaptive algorithm based on neuromimetic architecture, Signal Processing, 24 (1991), 1-20.Google Scholar
  9. 9.
    Malouche, Z. and Macchi, O.: Adaptive unsupervised extraction of one component of a linear mixture with a single neuron, IEEE Transactions Neural Networks, 9(1) (1998), 123-138.Google Scholar
  10. 10.
    Matsuoka, K. Ohya, M. and Kawamoto, M.: A neural net for blind separation of nonstationary signals, Neural Networks, 8(3) (1995), 411-419.Google Scholar
  11. 11.
    Molgedey, L. and Schuster, H. G.: Separation of a mixture of independent signals using time delayed correlations, Phys. Rev. Lett. 72(23) (1994), 3634-3637.Google Scholar
  12. 12.
    Pearlmutter, B. A. and Parra, L. C.: Maximum Likelihood blind source separation: A context-sensitive generalization of ICA, Proc. NIPS 96, MIT Press, 9 (1997), 613-619.Google Scholar
  13. 13.
    Pham, D. T. and Garat, P.: Blind separation of mixtures of independent sources through a quasi-maximum likelihood approach, IEEE Transactions on Signal Processing, 45(7) (1997), 1712-1725.Google Scholar
  14. 14.
    Prieto, A., Puntonet, C. G. and Prieto, B.: A neural learning algorithm for blind separation of sources based on geometric properties, Signal Processing, 64(13), (1998), 315-331.Google Scholar
  15. 15.
    Puntonet, C. G. and Prieto, A.: Neural network approach for blind separation of sources based on geometric properties, Neurocomputing, 18(1-3) (1998), 141-164.Google Scholar
  16. 16.
    Tong, L., Soon, V. C., Liu, R. and Huang, Y.: AMUSE: a new blind identification algorithm, Proceedings ISCAS, New Orleans, LA, 1990.Google Scholar
  17. 17.
    Thawonmas, R., Cichocki, A. and Amari, S.: A cascade neural network for blind signal extraction without spurious equilibria, IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences, E81-A(9) (1998), 1833-1846.Google Scholar
  18. 18.
    Tugnait, J. K.: Blind spatio-temporal equalization and impulse response estimation for MIMO channels using a Godard cost function, IEEE Transactions on Signal Processing, 45 (1997), 268-271.Google Scholar

Copyright information

© Kluwer Academic Publishers 2000

Authors and Affiliations

  • Andrzej Cichocki
    • 1
    • 2
  • Ruck Thawonmas
    • 3
  1. 1.Laboratory for Open Information SystemsBrain Science Institute, RIKENSaitamaJapan
  2. 2.Warsaw University of TechnologyWarsawPoland
  3. 3.Department of Information Systems EngineeringKochi University of TechnologyKochiJapan

Personalised recommendations