Advertisement

Independent Subspace Analysis Is Unique, Given Irreducibility

Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4666)

Abstract

Independent Subspace Analysis (ISA) is a generalization of ICA. It tries to find a basis in which a given random vector can be decomposed into groups of mutually independent random vectors. Since the first introduction of ISA, various algorithms to solve this problem have been introduced, however a general proof of the uniqueness of ISA decompositions remained an open question. In this contribution we address this question and sketch a proof for the separability of ISA. The key condition for separability is to require the subspaces to be not further decomposable (irreducible). Based on a decomposition into irreducible components, we formulate a general model for ISA without restrictions on the group sizes. The validity of the uniqueness result is illustrated on a toy example. Moreover, an extension of ISA to subspace extraction is introduced and its indeterminacies are discussed.

Keywords

Random Vector Independent Component Irreducible Component Independent Component Analysis Invertible Matrix 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Blanchard, G., Kawanabe, M., Sugiyama, M., Spokoiny, V., Müller, K.R.: In search of non-gaussian components of a high-dimensional distribution. Journal of Machine Learning Research 7, 247–282 (2006)Google Scholar
  2. 2.
    Cardoso, J.F.: Multidimensional independent component analysis. In: Proc. of ICASSP 1998, Seattle (1998)Google Scholar
  3. 3.
    Comon, P.: Independent component analysis - a new concept? Signal Processing 36, 287–314 (1994)zbMATHCrossRefGoogle Scholar
  4. 4.
    Theis, F.J.: A new concept for separability problems in blind source separation. Neural Computation 16, 1827–1850 (2004)zbMATHCrossRefGoogle Scholar
  5. 5.
    Theis, F.J.: Towards a general independent subspace analysis. In: Proc. NIPS 2006 (2007)Google Scholar
  6. 6.
    Theis, F.J., Kawanabe, M.: Uniqueness of non-gaussian subspace analysis. In: Rosca, J., Erdogmus, D., Príncipe, J.C., Haykin, S. (eds.) ICA 2006. LNCS, vol. 3889, pp. 917–925. Springer, Heidelberg (2006)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2007

Authors and Affiliations

  1. 1.Max Planck Institute for Dynamics and Self-Organization, 37073 GöttingenGermany

Personalised recommendations