Kernel-Based Nonlinear Independent Component Analysis
We propose the kernel-based nonlinear independent component analysis (ICA) method, which consists of two separate steps. First, we map the data to a high-dimensional feature space and perform dimension reduction to extract the effective subspace, which was achieved by kernel principal component analysis (PCA) and can be considered as a pre-processing step. Second, we need to adjust a linear transformation in this subspace to make the outputs as statistically independent as possible. In this way, nonlinear ICA, a complex nonlinear problem, is decomposed into two relatively standard procedures. Moreover, to overcome the ill-posedness in nonlinear ICA solutions, we utilize the minimal nonlinear distortion (MND) principle for regularization, in addition to the smoothness regularizer. The MND principle states that we would prefer the nonlinear ICA solution with the mixing system of minimal nonlinear distortion, since in practice the nonlinearity in the data generation procedure is usually not very strong.
KeywordsIndependent Component Analysis Independent Component Analysis Kernel Principal Component Analysis Kernel Trick Independent Component Analysis Algorithm
Unable to display preview. Download preview PDF.
- 2.Amari, S., Cichocki, A., Yang, H.H.: A new learning algorithm for blind signal separation. In: Advances in Neural Information Processing Systems (1996)Google Scholar
- 4.Cardoso, J.F., Souloumiac, A.: Blind beamforming for non-Gaussian signals. IEE Proceeding-F 140(6), 362–370 (1993)Google Scholar
- 9.Jutten, C., Karhunen, J.: Advances in nonlinear blind source separation. In: Proc. ICA 2003, pp. 245–256 (2003) Invited paper in the special session on nonlinear ICA and BSSGoogle Scholar
- 12.Zhang, K., Chan, L.: Nonlinear independent component analysis with minimum nonlinear distortion. In: ICML 2007, Corvallis, OR, US, pp. 1127–1134 (2007)Google Scholar
- 13.Ziehe, A., Müller, K.R.: TDSEP − an efficient algorithm for blind separation using time structure. In: Proc. ICANN98, Skövde, Sweden, pp. 675–680 (1998)Google Scholar