Abstract
We consider a {0,1}-valuedm-th order stationary Markov chain. We study the occurrences of runs where two 1’s are separated byat most/exactly/at least k 0’s under the overlapping enumeration scheme wherek≥0 and occurrences of scans (at leastk 1 successes in a window of length at mostk, 1≤k 1≤k) under both non-overlapping and overlapping enumeration schemes. We derive the generating function of first two types of runs. Under the conditions, (1) strong tendency towards success and (2) strong tendency towards reversing the state, we establish the convergence of waiting times of ther-th occurrence of runs and scans to Poisson type distributions. We establish the central limit theorem and law of the iterated logarithm for the number of runs and scans up to timen.
Similar content being viewed by others
References
Aki, S. (1985). Discrete distributions of orderk on a binary sequence,Annals of the Institute of Statistical Mathematics,37, 205–224.
Aki, S. (1992). Waiting time problems for a sequence of discrete random variables,Annals of the Institute of Statistical Mathematics,44, 363–378.
Aki, S. and Hirano, K. (1995). Joint distributions of numbers of success-runs and failures until the firstk consecutive successes,Annals of the Institute of Statistical Mathematics,47, 225–235.
Aki, S., Balakrishnan, N. and Mohanty, S. G. (1996). Sooner or later waiting time problems and failure runs in higher order Markov dependent trials.Annals of the Institute of Statistical Mathematics,48, 773–787.
Balakrishnan, N. and Koutras, M. V. (2002).Runs and Scans with Applications, Wiley, New York.
Balasubramanian, K., Viveros, R. and Balakrishnan, N. (1993). Sooner or later waiting time problem for Markovian Bernoulli trials,Statistics & Probability Letters,18, 153–161.
Bhattacharya, R. N. and Waymire, E. C. (1990)Stochastic Processes with Applications, Wiley, New York.
Billingsley, P. (1986).Probability and Measure, 2nd ed., Wiley, New York.
Boutsikas, M. V. and Koutras, M. V. (2001). Compound Poisson approximation for sums of dependent random variables,Probability and Statistical Models with Applications (eds. Ch. A. Charalambides, M. V. Koutras and N. Balakrishnan), 63–86, Chapman and Hall, Florida.
Chadjiconstantinidis, S. and Koutras, M. V. (2001). Distributions of the numbers of failures and successes in a waiting time problem.Annals of the Institute of Statistical Mathematics,53, 576–598.
Chadjiconstantinidis, S., Antzoulakos, D. L. and Koutras, M. V. (2000). Joint distributions of successes, failures and patterns in enumeration problems,Advances in Applied Probability,32, 866–884.
Chen, J. and Glaz, J. (1999). Approximation for the distribution and the moments of discrete scan statistics,Scan Statistics and Applications (eds. J. Glaz and N. Balakrishnan), 27–66, Birkhauser, Boston.
Chung, K. L. (1974).A Course in Probability Theory, 2nd ed., Academic Press, London.
Ebneshahrashoob, M. and Sobel, M. (1990). Sooner or later waiting time problems for Bernoulli trials: Frequency and run quotas,Statistics & Probability Letters,9, 5–11.
Feller, W. (1968).An Introduction to Probability Theory & Its Applications, 3rd ed., Vol. I, Wiley, New York.
Fu, J. C. and Koutras, M. V. (1994). Distribution theory of runs: a Markov chain approach,Journal of American Statistical Association,89, 1050–1058.
Glaz, J. and Balakrishnan, N. (eds.) (1999).Scan Statistics and Applications, Birkhauser, Boston.
Glaz, J., Naus, J. and Wallenstein, S. (2001)Scan Statistics, Springer, New York.
Hirano, K. (1986). Some properties of the distributions of orderk, Fibonacci Numbers and Their Applications (eds. A. N. Philippou and A. F. Horadam), 43–53, Reidel, Dordrecht.
Hirano, K. and Aki, S. (1993). On number of occurrences of success runs of specified length in a two-state Markov chain,Statistica Sinica,3, 311–320.
Koutras, M. V. (1996). On a waiting time distribution in a sequence of Bernoulli trials.Annals of the Institute of Statistical Mathematics,48, 789–806.
Koutras, M. V. and Alexandrou, V. A. (1995). Runs, scans and urn model distributions: A unified Markov chain approach,Annals of the Institute of Statistical Mathematics,47, 743–766.
Ling, K. D. (1988). On binomial distributions of orderk, Statistics & Probability Letters,6, 247–250.
Philipp, W. (1971).Mixing Sequence of Random Variables and Probabilistic Number Theory, Memoirs of the American Mathematical Society, A.M.S., Providence.
Philippou, A. N. (1986). Distributions and Fibonacci polynomials of orderk, longest runs, and reliability of consecutive-k-out-of-n:F system,Fibonacci Numbers and Their Applications (eds. A. N. Philippou and A. F. Horadam), 203–227, Reidel, Dordrecht.
Philippou, A. N. and Makri, F. S. (1986). Successes, runs and longest runs.Statistics & Probability Letters,4, 101–105.
Sarkar, A. and Anuradha (2002). Asymptotic results for generalized runs in higher order Markov Chains (preprint).
Uchida, M. (1998). On number of occurrences of success runs of specified length in a higher-order two-state Markov chain,Annals of the Institute of Statistical Mathematics,50, 587–601.
Uchida, M. and Aki, S. (1995). Sooner or later waiting time problems in a two-state Markov chain,Annals of the Institute of Statistical Mathematics,47, 363–378.
Author information
Authors and Affiliations
About this article
Cite this article
Sarkar, A., Sen, K. & Anuradha Waiting time distributions of runs in higher order Markov chains. Ann Inst Stat Math 56, 317–349 (2004). https://doi.org/10.1007/BF02530548
Received:
Revised:
Issue Date:
DOI: https://doi.org/10.1007/BF02530548