Skip to main content
Log in

Clustering dynamics in a class of normalised generalised gamma dependent priors

  • Published:
Annals of the Institute of Statistical Mathematics Aims and scope Submit manuscript

Abstract

Normalised generalised gamma processes are random probability measures that induce nonparametric prior distributions widely used in Bayesian statistics, particularly for mixture modelling. We construct a class of dependent normalised generalised gamma priors induced by a stationary population model of Moran type, which exploits a generalised Pólya urn scheme associated with the prior. We study the asymptotic scaling for the dynamics of the number of clusters in the sample, which in turn provides a dynamic measure of diversity in the underlying population. The limit is formalised to be a positive non-stationary diffusion process which falls outside well-known families, with unbounded drift and an entrance boundary at the origin. We also introduce a new class of stationary positive diffusions, whose invariant measures are explicit and have power law tails, which approximate weakly the scaling limit.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  • Arbel, J., Favaro, S., Nipoti, B., Teh, Y.W. (2016). Bayesian nonparametric inference for discovery probabilities: credible intervals and large sample asymptotics. Statistica Sinica (in press).

  • Blackwell, D. (1973). Discreteness of Ferguson selections. The Annals of Statistics, 2, 356–358.

    Article  MathSciNet  MATH  Google Scholar 

  • Brix, A. (1999). Generalized gamma measures and shot-noise Cox processes. Advances in Applied Probability, 31, 929–953.

    Article  MathSciNet  MATH  Google Scholar 

  • Charalambides, C. A. (2005). Combinatorial methods in discrete distributions. Hoboken, NJ: Wiley.

  • Costantini, C., De Blasi, P., Ethier, S. N., Ruggiero, M., Spanò, D. (2016). Wright–Fisher construction of the two-parameter Poisson–Dirichlet diffusion. arXiv:1601.06064.

  • De Blasi, P., Favaro, S., Lijoi, A., Mena, R. H., Prünster, I., Ruggiero, M. (2015). Are Gibbs-type priors the most natural generalization of the Dirichlet process? IEEE Transactions Pattern Analysis and Machine Intelligence, 37, 212–229.

  • Etheridge, A. M. (2009). Some mathematical models from population genetics. École d’été de Probabilités de Saint-Flour XXXIX. Lecture Notes in Math. 2012. Berlin, Heidelberg: Springer.

  • Ethier, S. N., Kurtz, T. G. (1986). Markov processes: characterization and convergence. New York: Wiley.

  • Feng, S. (2010). The Poisson–Dirichlet distribution and related topics. Heidelberg: Springer.

  • Ferguson, T. S. (1973). A Bayesian analysis of some nonparametric problems. The Annals of Statistics, 1, 209–230.

    Article  MathSciNet  MATH  Google Scholar 

  • Gnedin, A., Pitman, J. (2006). Exchangeable Gibbs partitions and Stirling triangles. Journal of Mathematical Sciences, 138, 5674–5685.

  • Griffin, J. E., Kolossiatis, M., Steel, M. F. J. (2013). Comparing distributions by using dependent normalized random-measure mixtures. Journal of the Royal Statistical Society. Series B, 75, 499–529.

  • Griffin, J. E., Leisen, F. (2016). Compound random measures and their use in Bayesian nonparametrics . Journal of the Royal Statistical Society. Series B (in press).

  • Hjort, N. L., Holmes, C. C., Müller, P., Walker, S. G. (Eds.). (2003). Bayesian nonparametrics. Cambridge: Cambridge University Press.

  • Karlin, S., Taylor, H. M. (1981). A second course in stochastic processes. New York: Academic Press.

  • Korwar, R. M., Hollander, M. (1973). Contribution to the theory of Dirichlet processes. The Annals of Probability, 1, 705–711.

  • Lijoi, A., Prünster, I. (2010). Models beyond the Dirichlet process. In N. L. Hjort, C. C. Holmes, P. Müller, S. G.Walker (Eds.), Bayesian nonparametrics (pp.  80–136). Cambridge: Cambridge University Press.

  • Lijoi, A., Mena, R. H., Prünster, I. (2005). Hierarchical mixture modeling with normalized inverse-gaussian priors. Journal of the American Statistical Association, 472, 1278–1291.

  • Lijoi, A., Mena, R. H., Prünster, I. (2007). Controlling the reinforcement in Bayesian non-parametric mixture models. Journal of the Royal Statistical Society. Series B, 69, 715–740.

  • Lijoi, A., Prünster, I., Walker, S. G. (2008). Investigating nonparametric priors with Gibbs structure. Statistica Sinica, 18, 1653–1668.

  • Lijoi, A., Nipoti, B., Prünster, I. (2014). Bayesian inference with dependent normalized completely random measures. Bernoulli, 20, 1260–1291.

  • Lo, A. Y. (1984). On a class of Bayesian nonparametric estimates: I. Density estimates. The Annals of Statistics, 12, 351–357.

    Article  MathSciNet  MATH  Google Scholar 

  • MacEachern, S. N. (1999). Dependent nonparametric processes. In ASA Proceedings of the Section on Bayesian Statistical Science. Alexandria, VA: American Statistical Association.

  • MacEachern, S.N. (2000). Dependent Dirichlet processes. Technical Report, Department of Statistics, Ohio State University, Columbus.

  • Mena, R. H., Ruggiero, M. (2016). Dynamic density estimation with diffusive Dirichlet mixtures. Bernoulli, 22, 901–926.

  • Mena, R. H., Ruggiero, M., Walker, S. G. (2011). Geometric stick-breaking processes for continuous-time Bayesian nonparametric modelling. Journal of Statistical Planning and Inference, 141, 3217–3230.

  • Papaspiliopoulos, O., Ruggiero, M., Spanò, D. (2016). Conjugacy properties of time-evolving Dirichlet and gamma random measures. Electronic Journal of Statistics (to appear).

  • Petrov, L. (2009). Two-parameter family of diffusion processes in the Kingman simplex. Functional Analysis and its Applications, 43, 279–296.

    Article  MathSciNet  MATH  Google Scholar 

  • Pitman, J. (1995). Exchangeable and partially exchangeable random partitions. Probability Theory and Related Fields, 102, 145–158.

    Article  MathSciNet  MATH  Google Scholar 

  • Pitman, J. (1996). Some developments of the Blackwell-MacQueen urn scheme. In T. S. Ferguson, L. S. Shapley, J. B. MacQueen (Eds.), Statistics, Probability and Game Theory. Institute of Mathematical Statistics Lecture Notes-Monograph Series, 30. Hayward, CA: Institute of Mathematical Statistics.

  • Pitman, J. (2006). Combinatorial Stochastic Processes. Lecture Notes in Mathematics, 1875. Berlin: Springer.

  • Pitman, J., Yor, M. (1997). The two-parameter Poisson–Dirichlet distribution derived from a stable subordinator. The Annals of Probability, 25, 855–900.

  • Ruggiero, M. (2014). Species dynamics in the two-parameter Poisson–Dirichlet diffusion model. Journal of Applied Probability, 51, 174–190.

    Article  MathSciNet  MATH  Google Scholar 

  • Ruggiero, M., Walker, S. G. (2009a). Bayesian nonparametric construction of the Fleming–Viot process with fertility selection. Statistica Sinica, 19, 707–720.

  • Ruggiero, M., Walker, S. G. (2009b). Countable representation for infinite-dimensional diffusions derived from the two-parameter Poisson–Dirichlet process. Electronic Communications in Probability, 14, 501–517.

  • Ruggiero, M., Walker, S. G., Favaro, S. (2013). Alpha-diversity processes and normalized inverse-Gaussian diffusions. The Annals of Applied Probability, 23, 386–425.

  • Smith, A. F. M., Roberts, G. O. (1993). Bayesian computation via the Gibbs sampler and related Markov chain Monte Carlo methods. Journal of the Royal Statistical Society. Series B, 55, 3–23.

Download references

Acknowledgments

The authors are grateful to two anonymous referees for helpful comments and to Pierpaolo De Blasi and Bertrand Lods for useful suggestions. This work was conducted while the second author was affiliated to the University of Torino and Collegio Carlo Alberto, Italy.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Matteo Ruggiero.

Additional information

The first author is supported by the European Research Council (ERC) through StG “N-BNP” 306406.

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ruggiero, M., Sordello, M. Clustering dynamics in a class of normalised generalised gamma dependent priors. Ann Inst Stat Math 70, 83–98 (2018). https://doi.org/10.1007/s10463-016-0583-8

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10463-016-0583-8

Keywords

Navigation