Skip to main content
SpringerLink
Log in

Random partitioning over a sparse contingency table

  • Published:
Annals of the Institute of Statistical Mathematics Aims and scope Submit manuscript

Abstract

The present article investigates a class of random partitioning distributions of a positive integer. This class is called the limiting conditional compound poisson (LCCP) distribution and characterized by the law of small numbers. Accordingly the LCCP distribution explains the limiting behavior of counts on a sparse contingency table by the frequencies of frequencies. The LCCP distribution is constructed via some combinations of conditioning and limiting, and this view reveals that the LCCP distribution is a subclass of several known classes that depend on a Bell polynomial. It follows that the limiting behavior of a Bell polynomial provides new asymptotics for a sparse contingency table. Also the Neyman Type A distribution and the Thomas distribution are revisited as the basis of the sparsity.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Arratia R., Barbour A.D., Tavarè S. (2003) Logarithmic combinatorial structures: A probabilistic approach. European Mathematical Society, Zürich

    Book  MATH  Google Scholar 

  • Borel E. (1942) Sur l’emploi du théorème de Bernoulli pour faciliter le calcul d’un infinité de coefficients. Application au problème de l’attente à un guichet. Comptes Rendus, Académie des Sciences, Paris, Series A 214: 452–456

    MathSciNet  Google Scholar 

  • Breiman L. (1992) Probability. SIAM, Philadelphia

    Book  MATH  Google Scholar 

  • Bunge J., Fitzpatrick M. (1993) Estimating the number of species: A review. Journal of the American Statistical Association 88: 364–373

    Article  Google Scholar 

  • Charalambides Ch.A. (2002) Enumerative combinatorics. Chapman and Hall/CRC, Florida

    MATH  Google Scholar 

  • Charalambides Ch.A. (2007) Distributions of random partitions and their applications. Methodology and Computing in Applied Probability 9: 163–193

    Article  MathSciNet  MATH  Google Scholar 

  • Comtet L. (1974) Advanced combinatorics. D. Reidel Publishing Company, Boston

    Book  MATH  Google Scholar 

  • Ewens W.J. (1972) The sampling theory of selectively neutral alleles. Theoretical Population Biology 3: 87–112

    Article  MathSciNet  Google Scholar 

  • Fienberg S.E., Holland P.W. (1973) Simultaneous estimation of multinomial cell probabilities. Journal of the American Statistical Association 68: 683–691

    Article  MathSciNet  MATH  Google Scholar 

  • Good I.J. (1953) The population frequencies of species and the estimation of population parameters. Biometrika 40: 237–264

    MathSciNet  MATH  Google Scholar 

  • Hoshino N. (2005a) Engen’s extended negative binomial model revisited. Annals of the Institute of Statistical Mathematics 57: 369–387

    Article  MathSciNet  MATH  Google Scholar 

  • Hoshino, N. (2005b). On a limiting quasi-multinomial distribution. Discussion Paper CIRJE-F-361. Tokyo: Faculty of Economics, University of Tokyo

  • Hoshino N. (2006) A discrete multivariate distribution resulting from the law of small numbers. Journal of Applied Probability 43: 852–866

    Article  MathSciNet  MATH  Google Scholar 

  • Hoshino N. (2009) The quasi-multinomial distribution as a tool for disclosure risk assessment. Journal of Official Statistics 25: 269–291

    Google Scholar 

  • Johnson N.L., Kotz S., Kemp A.W. (1993) Univariate discrete distributions (2nd ed.). Wiley, New York

    Google Scholar 

  • Karlin S. (1967) Central limit theorems for certain infinite urn schemes. Journal of Mathematics and Mechanics 17: 373–401

    MathSciNet  MATH  Google Scholar 

  • Kerov S. (1995) Coherent random allocations and the Ewens–Pitman formula. PDMI Preprint. Steklov Math Institute, St. Petersburg

    Google Scholar 

  • Kingman J.F. (1978) Random partitions in population genetics. Proceedings of the Royal Society of London, A 361: 1–20

    Article  MathSciNet  MATH  Google Scholar 

  • Kolchin V.F. (1971) A problem on allocations of particles into boxes, and the cycles of random permutations. Teoriya Veroyatnostei i ee Primeneniya 16: 67–82

    Google Scholar 

  • Koopman B.O. (1950) Necessary and sufficient conditions for Poisson’s distribution. Proceedings of the American Mathematical Society 1: 813–823

    MathSciNet  MATH  Google Scholar 

  • Lehmann E.L. (1991) Theory of point estimation. Wadsworth, California

    Google Scholar 

  • Meyer R.M. (1973) A Poisson-type limit theorem for mixing sequences of dependent ‘rare’ events. Annals of Probability 1: 480–483

    Article  MATH  Google Scholar 

  • Nandi S.B., Dutta S.K. (1988) Some developments in the generalized Bell distribution. Sankhyā, B 50: 362–375

    MathSciNet  MATH  Google Scholar 

  • Pitman J. (1999) Coalescent random forests. Journal of Combinatorial Theory, A 85: 165–193

    Article  MathSciNet  MATH  Google Scholar 

  • Pitman, J. (2006). Combinatorial stochastic processes. Lecture notes in mathematics (Vol. 1875). New York: Springer

  • Riordan J. (1968) Combinatorial identities. Wiley, New York

    MATH  Google Scholar 

  • Sibuya M. (1993) A random clustering process. Annals of the Institute of Statistical Mathematics 45: 459–465

    Article  MathSciNet  MATH  Google Scholar 

  • Steutel F.W., van Harn K. (2004) Infinite divisibility of probability distributions on the real line. Marcel Dekker, New York

    MATH  Google Scholar 

  • Thomas M. (1949) A generalization of Poisson’s binomial limit for use in ecology. Biometrika 36: 18–25

    MathSciNet  Google Scholar 

  • Uppuluri V.R., Carpenter J.R. (1969) Numbers generated by the function exp(1−e x). The Fibonacci Quarterly 7: 437–448

    MathSciNet  MATH  Google Scholar 

  • Vershik A.M. (1996) Statistical mechanics of combinatorial partitions, and their limit shapes. Functional Analysis and its Applications 30: 90–105

    Article  MathSciNet  MATH  Google Scholar 

  • Wang Y.H. (1993) On the number of successes in independent trials. Statistica Sinica 3: 295–312

    MathSciNet  MATH  Google Scholar 

  • Wang Y.H., Ji S. (1993) Derivations of the compound Poisson distribution and process. Statistics and Probability Letters 18: 1–7

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Economics, Kanazawa University, Kakuma-machi, Kanazawa-shi, Ishikawa, 920-1192, Japan

    Nobuaki Hoshino

Authors
  1. Nobuaki Hoshino
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Nobuaki Hoshino.

About this article

Cite this article

Hoshino, N. Random partitioning over a sparse contingency table. Ann Inst Stat Math 64, 457–474 (2012). https://doi.org/10.1007/s10463-011-0327-8

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10463-011-0327-8

Keywords

Search

Navigation