Sankhya A

, Volume 78, Issue 1, pp 133–153 | Cite as

Comparing Two Mixing Densities in Nonparametric Mixture Models



In this paper we consider two nonparametric mixtures of quadratic natural exponential families with unknown mixing densities. We propose a statistic to test the equality of these mixing densities when the two natural exponential families are known. The test is based on moment characterizations of the distributions. The number of moments is retained automatically by a data driven technique. Some examples and simulations of implementation of the procedure are provided.

Keywords and phrases

Akaike’s rule Natural exponential families Nonparametric mixture Quadratic variance function Schwarz’s rule Smooth test 

AMS (2000) subject classification

Primary 62G10 Secondary 62G07 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Abramowitz, M. and Stegun, I. (1965). Handbook of Mathematical Functions. Dover Publications.Google Scholar
  2. Akaike, H. (1974). A new look at the statistical model identification. IEEE Trans. Autom. Control 19, 6, 716–723.MathSciNetCrossRefMATHGoogle Scholar
  3. Albers, W., Kallenberg, W. and Martini, F. (2001). Data driven rank tests for classes of tail alternatives. J. Am. Stat. Assoc. 96, 685–696.MathSciNetCrossRefMATHGoogle Scholar
  4. Asmussen, S. and Albrecher, H. 2010 Ruin Probabilities. Advanced Series on Statistical Science Applied Probability. World Scientific.Google Scholar
  5. Bangert, M., Hennig, P. and Oelfke, U. (2010) Using an infinite von mises-fisher mixture model to cluster treatment beam directions in external radiation therapy. In: International Conference on Machine Learning and Applications.Google Scholar
  6. Barndorff-Nielsen, O. (1978). Information and Exponential Families in Statistical Theory. Wiley, Chichester.MATHGoogle Scholar
  7. Carleman, T. (1926). Les fonctions quasi analytiques. Collection de Monographies sur la Théorie des Fonctions, Gauthier-Villars, Paris.MATHGoogle Scholar
  8. Carroll, R., Ruppert, D., Stefanski, L. and Crainiceanu, C. (2010). Measurement Error in Nonlinear Models: A Modern Perspective, Second Edition. Taylor & Francis.Google Scholar
  9. Chee, C.-S. and Wang, Y. (2013). Minimum quadratic distance density estimation using nonparametric mixtures. Comput. Stat. Data Anal. 57, 1, 1–16.MathSciNetCrossRefGoogle Scholar
  10. D’Agostino, R. B. and Stephens, M. A. (1986). Goodness-Of-Fit Techniques. Marcel Dekker, New York.MATHGoogle Scholar
  11. Denuit, M. (1997). A new distribution of poisson-type for the number of claims. ASTIN Bulletin 27, 229–242.CrossRefGoogle Scholar
  12. Doukhan, P., Pommeret, D. and Reboul, L. (2015). Data driven smooth test of comparison for dependent sequences. J. Multivar. Anal. 139, 147–165.MathSciNetCrossRefMATHGoogle Scholar
  13. Dubey, A., Hwang, S., Rangel, C., Rasmussen, C., Ghahramani, Z. and Wild, D. L. (2004). Clustering protein sequence and structure space with infinite gaussian mixture models. World Scientific, 399–410.Google Scholar
  14. Fan, J. (1996). Test of significance based on wavelet thresholding and Neyman’s truncation. J. Am. Stat. Assoc. 91, 674–688.CrossRefMATHGoogle Scholar
  15. Ghattas, B., Pommeret, D., Reboul, L. and Yao, A. (2011). Data driven smooth test for paired populations. Journal of Statistical Planning and Inference 141, 1, 262–275.MathSciNetCrossRefMATHGoogle Scholar
  16. Ghosh, A. (2001). Testing equality of two densities using Neyman’s smooth test. Tech. rep., Department of Economics, University of Illinois.Google Scholar
  17. Griffin, J. E. (2010). Default priors for density estimation with mixture models. Bayesian Analysis 5, 1, 45–64.MathSciNetCrossRefMATHGoogle Scholar
  18. Groeneboom, P. 1984 Estimating a Monotone Density. Report MS / Centrum voor Wiskunde en Informatica, Department of Mathematical Statistics. Stichting Math. Centrum.Google Scholar
  19. Hart, J. (1997). Nonparametric Smoothing and Lack-of-Fit Tests. Springer, New York.CrossRefMATHGoogle Scholar
  20. Inglot, T., Jurlewicz, T. and Ledwina, T. (1990). On neyman-type smooth tests of fit. Statistics 21, 549–568.MathSciNetCrossRefMATHGoogle Scholar
  21. Inglot, T., Kallenberg, W. and Ledwina, T. (1997). Data-driven smooth tests for composite hypotheses. Ann. Stat. 25, 1222–1250.MathSciNetCrossRefMATHGoogle Scholar
  22. Inglot, T. and Ledwina, T. (2006). Towards data driven selection of a penalty function for data driven neyman test. Linear Algebra Appl. 417, 124–133.MathSciNetCrossRefMATHGoogle Scholar
  23. Janic-Wróblewska, J. and Ledwina, T. (2000). Data driven rank test for two-sample problem. Scand. J. Stat. 27, 281–297.MathSciNetCrossRefMATHGoogle Scholar
  24. Kallenberg, W. and Ledwina, T. (1995). On data-driven Neyman’s tests. Probab. Math. Stat. 15, 409–426.MathSciNetMATHGoogle Scholar
  25. Kallenberg, W. and Ledwina, T. (1995a). Consistency and Monte Carlo simulation of a data driven version of smooth goodness-of-fit tests. Ann. Stat. 23, 1594–1608.Google Scholar
  26. Ledwina, T. (1994). Data-driven version of Neyman’s smooth test of fit. J. Am. Stat. Assoc. 89, 1000–1005.MathSciNetCrossRefMATHGoogle Scholar
  27. Lindsay, B. G. (1989). Moment matrices: Applications in mixtures. Ann. Stat. 17, 2, 722–740.MathSciNetCrossRefMATHGoogle Scholar
  28. Morris, C. (1982). Natural exponential families with quadratic variance functions. Ann. Stat. 10, 65–80.MathSciNetCrossRefMATHGoogle Scholar
  29. Munk, Axel S.J.-P.V.J.G.G. (2011). Neyman smooth goodness-of-fit tests for the marginal distribution of dependent data. Ann. Inst. Statist. Math. 63, 5, 939–959.MathSciNetCrossRefMATHGoogle Scholar
  30. Neyman, J. (1937). Smooth test for goodness of fit. Skandinavisk Aktuarietidskrift 20, 149–199.MATHGoogle Scholar
  31. Pommeret, D. (2005). Distance of a mixture from its parent distribution. Sankhyā 67, 4, 699–714.MathSciNetMATHGoogle Scholar
  32. Rayner, J. and Best, D. (1989). Smooth Tests of Goodness of Fit. Oxford University Press, New York.MATHGoogle Scholar
  33. Rayner, J. and Best, D. (2001). A Contingency Table Approach to Nonparametric Testing. Chapman and Hall/CRC.Google Scholar
  34. Schwarz, G. (1978). Estimating the dimension of a model. Ann. Stat. 6.2, 461–464.MathSciNetCrossRefMATHGoogle Scholar
  35. van and de Geer, S. (2003). Asymptotic theory for maximum likelihood in nonparametric mixture models. Comput. Stat. Data Anal. 41, 453–464.MathSciNetCrossRefMATHGoogle Scholar
  36. Wang, J. (2007). A linearization procedure and a vdm/ecm algorithm for penalized and constrained nonparametric maximum likelihood estimation for mixture models. Comput. Stat. Data Anal. 51, 2946–2957.MathSciNetCrossRefMATHGoogle Scholar
  37. Wang, X.-F. and Wang, B. (2011). Deconvolution estimation in measurement error models: The r package decon. J. Stat. Softw. 39, 10, 1–24.CrossRefGoogle Scholar
  38. Wylupek, G. (2010). Data driven k sample test. Technometrics 52, 107–123.MathSciNetCrossRefGoogle Scholar

Copyright information

© Indian Statistical Institute 2015

Authors and Affiliations

  1. 1.Institut de Mathématiques de MarseilleAix Marseille UniversitéMarseille Cedex 9France

Personalised recommendations