Distributional Convergence of Subspace Estimates in FastICA: A Bootstrap Study
Independent component analysis (ICA) is possibly the most widespread approach to solve the blind source separation (BSS) problem. Many different algorithms have been proposed, together with an extensive body of work on the theoretical foundations and limits of the methods.
One practical concern about the use of ICA with real-world data is the reliability of its estimates. Variations of the estimates may stem from the inherent stochastic nature of the algorithm, or deviations from the theoretical assumptions. To overcome this problem, some approaches use bootstrapped estimates. The bootstrapping also allows identification of subspaces, since multiple separated components can share a common pattern of variation, when they belong to the same subspace. This is a desired ability, since real-world data often violates the strict independence assumption.
Based on empirical process theory, it can be shown that FastICA and bootstrapped FastICA are consistent and asymptotically normal. In the context of subspace analysis, the normal convergence is not satisfied. This paper shows such limitation, and how to circumvent it, when one can estimate the canonical directions within the subspace.
KeywordsIndependent Component Analysis Asymptotic Normality Normality Test Independent Component Analysis Blind Source Separation
Unable to display preview. Download preview PDF.
- 1.Hyvärinen, A., Karhunen, J., Oja, E.: Independent component analysis: algorithms and applications. Wiley Interscience (2001)Google Scholar
- 3.Cichocki, A., Amari, S.: Adaptive Blind Signal and Image Processing: Learning Algorithms and Applications. Wiley (2003)Google Scholar
- 10.Huettel, S.A., Song, A.W., McCarthy, G.: Functional Magnetic Resonance Imaging, 1st edn. Sinauer Associates, Sunderland (2004)Google Scholar
- 13.Reyhani, N., Ylipaavalniemi, J., Vigário, R., Oja, E.: Consistency and asymptotic normality of fastica and bootstrap fastica. Signal Processing (2011) (submitted)Google Scholar
- 15.Henze, N., Zirkler, B.: A class of invariant consistent tests for multivariate normality. Commun. Statist.-Theor. Meth. 19(10) (1990)Google Scholar
- 16.Anderson, T.: An Introduction to Multivariate Statistical Analysis. Wiley Interscience (2003)Google Scholar