Skip to main content
Log in

Waiting time distributions of runs in higher order Markov chains

  • Distribution
  • Published:
Annals of the Institute of Statistical Mathematics Aims and scope Submit manuscript

Abstract

We consider a {0,1}-valuedm-th order stationary Markov chain. We study the occurrences of runs where two 1’s are separated byat most/exactly/at least k 0’s under the overlapping enumeration scheme wherek≥0 and occurrences of scans (at leastk 1 successes in a window of length at mostk, 1≤k 1k) under both non-overlapping and overlapping enumeration schemes. We derive the generating function of first two types of runs. Under the conditions, (1) strong tendency towards success and (2) strong tendency towards reversing the state, we establish the convergence of waiting times of ther-th occurrence of runs and scans to Poisson type distributions. We establish the central limit theorem and law of the iterated logarithm for the number of runs and scans up to timen.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Aki, S. (1985). Discrete distributions of orderk on a binary sequence,Annals of the Institute of Statistical Mathematics,37, 205–224.

    Article  MathSciNet  Google Scholar 

  • Aki, S. (1992). Waiting time problems for a sequence of discrete random variables,Annals of the Institute of Statistical Mathematics,44, 363–378.

    Article  MathSciNet  Google Scholar 

  • Aki, S. and Hirano, K. (1995). Joint distributions of numbers of success-runs and failures until the firstk consecutive successes,Annals of the Institute of Statistical Mathematics,47, 225–235.

    Article  MathSciNet  Google Scholar 

  • Aki, S., Balakrishnan, N. and Mohanty, S. G. (1996). Sooner or later waiting time problems and failure runs in higher order Markov dependent trials.Annals of the Institute of Statistical Mathematics,48, 773–787.

    Article  MathSciNet  Google Scholar 

  • Balakrishnan, N. and Koutras, M. V. (2002).Runs and Scans with Applications, Wiley, New York.

    MATH  Google Scholar 

  • Balasubramanian, K., Viveros, R. and Balakrishnan, N. (1993). Sooner or later waiting time problem for Markovian Bernoulli trials,Statistics & Probability Letters,18, 153–161.

    Article  MathSciNet  Google Scholar 

  • Bhattacharya, R. N. and Waymire, E. C. (1990)Stochastic Processes with Applications, Wiley, New York.

    Google Scholar 

  • Billingsley, P. (1986).Probability and Measure, 2nd ed., Wiley, New York.

    MATH  Google Scholar 

  • Boutsikas, M. V. and Koutras, M. V. (2001). Compound Poisson approximation for sums of dependent random variables,Probability and Statistical Models with Applications (eds. Ch. A. Charalambides, M. V. Koutras and N. Balakrishnan), 63–86, Chapman and Hall, Florida.

    Google Scholar 

  • Chadjiconstantinidis, S. and Koutras, M. V. (2001). Distributions of the numbers of failures and successes in a waiting time problem.Annals of the Institute of Statistical Mathematics,53, 576–598.

    Article  MathSciNet  Google Scholar 

  • Chadjiconstantinidis, S., Antzoulakos, D. L. and Koutras, M. V. (2000). Joint distributions of successes, failures and patterns in enumeration problems,Advances in Applied Probability,32, 866–884.

    Article  MathSciNet  Google Scholar 

  • Chen, J. and Glaz, J. (1999). Approximation for the distribution and the moments of discrete scan statistics,Scan Statistics and Applications (eds. J. Glaz and N. Balakrishnan), 27–66, Birkhauser, Boston.

    Google Scholar 

  • Chung, K. L. (1974).A Course in Probability Theory, 2nd ed., Academic Press, London.

    MATH  Google Scholar 

  • Ebneshahrashoob, M. and Sobel, M. (1990). Sooner or later waiting time problems for Bernoulli trials: Frequency and run quotas,Statistics & Probability Letters,9, 5–11.

    Article  MathSciNet  Google Scholar 

  • Feller, W. (1968).An Introduction to Probability Theory & Its Applications, 3rd ed., Vol. I, Wiley, New York.

    MATH  Google Scholar 

  • Fu, J. C. and Koutras, M. V. (1994). Distribution theory of runs: a Markov chain approach,Journal of American Statistical Association,89, 1050–1058.

    Article  MathSciNet  Google Scholar 

  • Glaz, J. and Balakrishnan, N. (eds.) (1999).Scan Statistics and Applications, Birkhauser, Boston.

    MATH  Google Scholar 

  • Glaz, J., Naus, J. and Wallenstein, S. (2001)Scan Statistics, Springer, New York.

    MATH  Google Scholar 

  • Hirano, K. (1986). Some properties of the distributions of orderk, Fibonacci Numbers and Their Applications (eds. A. N. Philippou and A. F. Horadam), 43–53, Reidel, Dordrecht.

    Google Scholar 

  • Hirano, K. and Aki, S. (1993). On number of occurrences of success runs of specified length in a two-state Markov chain,Statistica Sinica,3, 311–320.

    MathSciNet  Google Scholar 

  • Koutras, M. V. (1996). On a waiting time distribution in a sequence of Bernoulli trials.Annals of the Institute of Statistical Mathematics,48, 789–806.

    Article  MathSciNet  Google Scholar 

  • Koutras, M. V. and Alexandrou, V. A. (1995). Runs, scans and urn model distributions: A unified Markov chain approach,Annals of the Institute of Statistical Mathematics,47, 743–766.

    Article  MathSciNet  Google Scholar 

  • Ling, K. D. (1988). On binomial distributions of orderk, Statistics & Probability Letters,6, 247–250.

    Article  MathSciNet  Google Scholar 

  • Philipp, W. (1971).Mixing Sequence of Random Variables and Probabilistic Number Theory, Memoirs of the American Mathematical Society, A.M.S., Providence.

    Google Scholar 

  • Philippou, A. N. (1986). Distributions and Fibonacci polynomials of orderk, longest runs, and reliability of consecutive-k-out-of-n:F system,Fibonacci Numbers and Their Applications (eds. A. N. Philippou and A. F. Horadam), 203–227, Reidel, Dordrecht.

    Google Scholar 

  • Philippou, A. N. and Makri, F. S. (1986). Successes, runs and longest runs.Statistics & Probability Letters,4, 101–105.

    Article  MathSciNet  Google Scholar 

  • Sarkar, A. and Anuradha (2002). Asymptotic results for generalized runs in higher order Markov Chains (preprint).

  • Uchida, M. (1998). On number of occurrences of success runs of specified length in a higher-order two-state Markov chain,Annals of the Institute of Statistical Mathematics,50, 587–601.

    Article  MathSciNet  Google Scholar 

  • Uchida, M. and Aki, S. (1995). Sooner or later waiting time problems in a two-state Markov chain,Annals of the Institute of Statistical Mathematics,47, 363–378.

    MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

About this article

Cite this article

Sarkar, A., Sen, K. & Anuradha Waiting time distributions of runs in higher order Markov chains. Ann Inst Stat Math 56, 317–349 (2004). https://doi.org/10.1007/BF02530548

Download citation

  • Received:

  • Revised:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF02530548

Key words and phrases

Navigation