The Independence Assumption: Dependent Component Analysis
Redundancy reduction as a form of neural coding has been a topic of great research interest since the early sixties. A number of strategies have been proposed, but the one which is attracting most attention recently assumes that this coding is carried out so that the output signals are as independent as possible. In this work, we go one step further and propose an algorithm to separate non-orthogonal signals (i.e., dependent signals) based on the minimization of the output mutual spectral overlap. Indeed, separating independent sources turns to be a special case of this strategy. Moreover, we show that this principle can also be used to separate spectrally overlapping signals by exploiting their higher-order cyclostationary properties. We also suggest a numerically-efficient algorithm which searches for the learning step size in a way that avoids divergence.
KeywordsIndependent Component Analysis Independent Component Analysis Blind Source Separation Blind Signal Independent Component Analysis Algorithm
Unable to display preview. Download preview PDF.
- 1.S. Amari, A. Cichocki, H. H. Yang. A new learning algorithm for blind signal separation. In D. S. Touretzky, M. C. Mozer and M. E. Hasselmo, editors, Advances in Neural Information Processing Systems, 8, MIT Press, Cambridge, MA, 1996.Google Scholar
- 3.Y. Baram and Z. Roth. Density shaping by neural networks with application to classification, estimation and forecasting. CIS report no. 9420. Center for Intelligent Systems, Technion, Israel, 1994.Google Scholar
- 4.H. B. Barlow, Possible principles underlying the transformations of sensory messages. In W. Rosenblith editor Sensory Communication, pp. 217–234. MIT Press, Cambridge, MA, 1961.Google Scholar
- 8.J-F. Cardoso and B. Hvam Laheld. Equivariant adaptive source separation. IEEE Trans, on Signal Process, 3017–3030, 1996.Google Scholar
- 12.W. Gardner (editor). Cyclostationarity in communications and signal processign. IEEE Press, 1994.Google Scholar
- 14.C. Jutten and J. Hárault. Independent component analysis versus PCA. Proc. EUSIPCO, pp. 643–646, 1988.Google Scholar
- 17.D. Nuzillard and J-M. Nuzillard. Blind source separation applied to non-orthogonal signals. Proc. ICA ‘99, 25–30, 1999.Google Scholar
- 18.J.A. Simpson, and E.S.C Weiner. The Oxford English Dictionary, 2nd edn. Clarendon Press, Oxford, 1989.Google Scholar
- 19.A. Papoulis. Probability, random variables, and stochastic processes. McGraw-Hill, 1991.Google Scholar