Abstract
In this paper, a parametric mixture density model is employed to be the source prior in blind source separation (BSS). A strict lower bound on the source prior is derived by using a variational method, which naturally enables the intractable posterior to be represented as a gaussian form. An expectation-maximization (EM) algorithm in closed form is therefore derived for estimating the mixing matrix and inferring the sources. Simulation results show that the proposed variational expectation-maximization algorithm can perform blind separation of not only speech source of more sources than mixtures, but also binary source of more sources than mixtures.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Attias H (1999). Independent factor analysis. Neural Comput 11(4): 803–851
Bell AJ, Sejnowski TJ (1995). An information-maximization approach to blind separation and blind deconvolution. Neural Comput 7(6): 1129–1159
Belouchrani A, Cardoso J-F (1995) Maximum likelihood source separation by the expectation-maximization technique: deterministic and stochastic implementation. In Proc NOLTA, pp 49–53
Dempster AP, Laird NM, Rubin DB (1977). Maximum likelihood from incomplete data via the EM algorithm(with discussion). J Roy Stat Soc B 39(1): 1–38
Girolami M (2001). A variational method for learning sparse and overcomplete representations. Neural Comput 13(11): 2517–2532
Højen-Sørensen PAdFR, Winther O, Hansen LK (2002). Mean-field approaches to independent component analysis. Neural Comput 14(4): 889–918
Hyvärinen A, Karhunen J, Oja E (2001). Independent component analysis. John Wiley & Sons, New York
Hyvärinen A, Oja E (2000). Independent component analysis: algorithms and applications. Neural Networks 13(4–5): 411–430
Jaakkola TS (1997) Variation methods for inference and estimation in graphical models. Unpublished doctoral dissertation, MIT
Lee TW, Girolami M, Sejnowski TJ (1999). Independent component analysis using an extended infomax algorithm for mixed subgaussian and supergaussian sources. Neural Comput 11(2): 417–441
Lee TW, Lewicki MS, Girolami M, Sejnowski TJ (1999). Blind source separation of more sources than mixtures using overcomplete representations. IEEE Signal Process Lett 6(4): 87–90
Lewicki MS, Sejnowski TJ (2000). Learning overcomplete representations. Neural Comput 12(2): 337–365
Liebermeister W (2002). Linear modes of gene expression determined by independent component analysis. Bioinformatics 18(1): 51–60
McKeown MJ, Makeig S, Brown GG, Jung TP, Kindermann SS, Bell AJ and Sejnowski TJ (1998). Analysis of fMRI data by blind separation into independent spatial components. Human Brain Mapp 6(3): 160–188
Moulines E, Cardoso J, Gassiat E (1997). Maximum likelihood for blind separation and deconvolution of noisy signals using mixture models. Proc ICASSP 5: 3617–3620
Pearlmutter B, Parra L (1996) A context sensitive generalization of ICA. International Conference on Neural Information Processing, pp 151–157
Roberts S, Everson R (2001). Independent component analysis: principles and practice. Cambridge University Press, Cambridge
Zhong MJ, Tang HW, Tang YY (2004). Expectation-maximization approaches to independent component analysis. Neurocomputing 61: 503–512
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Zhong, M., Du, J. A parametric density model for blind source separation. Neural Process Lett 25, 199–207 (2007). https://doi.org/10.1007/s11063-007-9038-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11063-007-9038-9