Abstract
Nonlinear source separation can be performed by inferring the state of a nonlinear state-space model. We study and improve the inference algorithm in the variational Bayesian blind source separation model introduced by Valpola and Karhunen in 2002. As comparison methods we use extensions of the Kalman filter that are widely used inference methods in tracking and control theory. The results in stability, speed, and accuracy favour our method especially in difficult inference problems.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Valpola, H., Karhunen, J.: An unsupervised ensemble learning method for nonlinear dynamic state-space models. Neural Computation 14(11), 2647–2692 (2002)
Cichocki, A., Zhang, L., Choi, S., Amari, S.-I.: Nonlinear dynamic independent component analysis using state-space and neural network models. In: Proc. of the 1st Int. Workshop on Independent Component Analysis and Signal Separation (ICA 1999), Aussois, France, January 11-15, pp. 99–104 (1999)
Anderson, B., Moore, J.: Optimal Filtering. Prentice-Hall, Englewood Cliffs (1979)
Koivunen, V., Enescu, M., Oja, E.: Adaptive algorithm for blind separation from noisy time-varying mixtures. Neural Computation 13, 2339–2357 (2001)
Julier, S., Uhlmann, J.: A new extension of the Kalman filter to nonlinear systems. In: Int. Symp. Aerospace/Defense Sensing, Simul. and Controls (1997)
Wan, E.A., van der Merwe, R.: The unscented Kalman filter. In: Haykin, S. (ed.) Kalman Filtering and Neural Networks, pp. 221–280. Wiley, New York (2001)
Honkela, A., Valpola, H.: Unsupervised variational Bayesian learning of nonlinear models. In: Saul, L., Weiss, Y., Bottou, L. (eds.) Advances in Neural Information Processing Systems 17, pp. 593–600. MIT Press, Cambridge (2005)
Psiaki, M.: Backward-smoothing extended Kalman filter. Journal of Guidance, Control, and Dynamics 28 (September–October 2005)
Doucet, A., de Freitas, N., Gordon, N.J.: Sequential Monte Carlo Methods in Practice. Springer, Heidelberg (2001)
Everson, R., Roberts, S.: Particle filters for non-stationary ICA. In: Girolami, M. (ed.) Advances in Independent Component Analysis, pp. 23–41. Springer, Heidelberg (2000)
Fletcher, R., Reeves, C.M.: Function minimization by conjugate gradients. The Computer Journal 7, 149–154 (1964)
Raiko, T., Tornio, M.: Learning nonlinear state-space models for control. In: Proc. Int. Joint Conf. on Neural Networks (IJCNN 2005), Montreal, Canada, pp. 815–820 (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Raiko, T., Tornio, M., Honkela, A., Karhunen, J. (2006). State Inference in Variational Bayesian Nonlinear State-Space Models. In: Rosca, J., Erdogmus, D., PrÃncipe, J.C., Haykin, S. (eds) Independent Component Analysis and Blind Signal Separation. ICA 2006. Lecture Notes in Computer Science, vol 3889. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11679363_28
Download citation
DOI: https://doi.org/10.1007/11679363_28
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-32630-4
Online ISBN: 978-3-540-32631-1
eBook Packages: Computer ScienceComputer Science (R0)