Abstract
Mixture models are widely used for clustering or discrimination problems. Estimating the parameters of such models can be viewed as an incomplete data problem and has thus often been handled by the Expectation-Maximization (EM) algorithm. It has been shown that this method can integrate additional information such as the label of some observations. In this paper we propose a generalization of this approach which can take into account partial information about the observation labels. An example illustrates the relevance of the proposed method for mixture density estimation.
Chapter PDF
References
DEMPSTER, A.P., LAIRD, N.M. and RUBIN, D.B. (1977): Maximum Likelihood from Incomplete Data via the EM Algorithm, Journal of the Royal Statistical Society, B, 39, 1–38.
GANESALINGAM, S. and MCLACHLAN, G.J. (1978): The Efficiency of Linear Discriminant Function Based on Unclassified Initial Samples, Biometrika, 65, 658–662.
JORDAN, M.I. and JACOBS, R.A. (1994): Hierarchical Mixtures of Experts and the EM Algorithm, Neural Computation, 6, 181–214.
MCLACHLAN, G.J. and BASFORD, K.E. (1989): Misture Models. Inference and Applications to Clustering. Marcel Dekker, New York.
MCLACHLAN, G. and KRISHNAN, T. (1997): The EM Algorithm and Extensions. Wiley, New York.
O’NEIL, T.J. (1978): Normal Discrimination with Unclassified Observations, Journal of the American Statistical Association, 73, 821–826.
TITTERINGTON, D.M., SMITH, A.F. and MAKOV, U.E. (1985): Statistical Analysis of Finite Mixture Distributions. Wiley, New York.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2000 Springer-Verlag Berlin · Heidelberg
About this paper
Cite this paper
Ambroise, C., Govaert, G. (2000). EM Algorithm for Partially Known Labels. In: Kiers, H.A.L., Rasson, JP., Groenen, P.J.F., Schader, M. (eds) Data Analysis, Classification, and Related Methods. Studies in Classification, Data Analysis, and Knowledge Organization. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-59789-3_26
Download citation
DOI: https://doi.org/10.1007/978-3-642-59789-3_26
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-67521-1
Online ISBN: 978-3-642-59789-3
eBook Packages: Springer Book Archive