Summary
Given a random sample from a mixture density, the objectives is to estimate the mixing distribution by maximum likelihood. Certain properties of this estimator are identified. The estimator is characterized by a family of inequalities which correspond to the usual parametric likelihood equations. If the atomic densities underlying the mixture are of exponential type, it is demonstrated that the estimator matches the first sample moment to the first theoretical moment evaluated at the estimator. However, the sample variance is related to the theoretical variance by an inequality. Following this structural analysis, several algorithms for the estimator are discussed. The paper concludes with an example and a discussion of the difficulties of an asymptotic distribution theory.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Barndorff-Neilson, O. (1965). Identifiability of mixtures of exponential families. Journal of Mathematical Analysis and Applications, 12, 115–121.
Barndorff-Neilson, O. (1978). Information and Exponential Families in Statistical Theory. Wiley, New York.
Dempster, A.P., Laird, N.M., Rubin, D.B. (1977). Maximum likelihood for incomplete data via the EM algorithm. Journal of the Royal Statistical Society, B, 39, 1–38.
Kiefer, J., Wolfowitz, J. (1956). Consistency of the maximum likelihood estimator in the presence of infinitely many nuisance parameters. Annals of Mathematical Statistics, 27, 887–906.
Laird, N. (1978). Nonparametric maximum likelihood estimation of a mixing distribution. Journal of the American Statistical Association, 73, 805–811.
Lindsay, B.G. (1980). The geometry of mixture likelihoods. Pennsylvania State University, Department of Statistics Technical Reports and Preprints, 36.
Simar, L. (1976). Maximum likelihood estimation of a compound Poisson process. Annals of Statistics, 4, 1200–1209.
Teicher, H. (1973). Identifiability of mixtures. Annals of Mathematical Statistics, 32, 244–248.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1981 D. Reidel Publishing Company
About this chapter
Cite this chapter
Lindsay, B.G. (1981). Properties of the Maximum Likelihood Estimator of a Mixing Distribution. In: Taillie, C., Patil, G.P., Baldessari, B.A. (eds) Statistical Distributions in Scientific Work. NATO Advanced study Institutes Series, vol 79. Springer, Dordrecht. https://doi.org/10.1007/978-94-009-8552-0_8
Download citation
DOI: https://doi.org/10.1007/978-94-009-8552-0_8
Publisher Name: Springer, Dordrecht
Print ISBN: 978-94-009-8554-4
Online ISBN: 978-94-009-8552-0
eBook Packages: Springer Book Archive