Abstract
We prove a representation theorem for {Xt} (t denotes time), an rth order categorical Markov chain. We prove that the conditional probability P(Xt|X t − 1, …, Xt−r) can be written as a linear combination of the monomials of past process responses X t − 1, …, Xt−r. Simulations show that the “partial likelihood estimation” and the representation together give us satisfactory results. We also check the performance of “BIC” criterion for selecting optimal models and find that to be quite satisfactory. An advantage of this model over existing models is its capacity to admit covariates as linear terms by extension. For example, we can add some seasonal processes to get a non-stationary chain for daily precipitation values.
Similar content being viewed by others
References
Anderson, T.W., Goodman, L.A., 1957. Statistical inference about Markov chains. Annals of Mathematical Statistics, 28, 89–110.
Besag, J., 1974. Spatial interactions and the statistical analysis of lattice systems. Journal of the Royal Statistical Society, Series B, 36(2), 192–236.
Breiman, L., 1992. Probability. SIAM.
Cressie, N., Subash, L., 1992. New models for Markov random fields. Journal of Applied Probability, 29, 877–884.
Hosseini, R., 2009. Statistical Models for Agroclimate Risk Analysis. PhD thesis, Department of Statistics, UBC.
Hosseini, R., Zidek, J., Le, N., 2010a. Model selection for the binary dichotomized temperature processes. Technical Report TR #257, Department of Statistics, UBC.
Hosseini, R., Zidek, J., Le., N., 2010b. Selecting a binary Markov model for a precipitation process. Technical Report TR #256, Department of Statistics, UBC.
Kedem, B., Fokianos, K., 2002. Regression Models for Time Series Analysis. Wiley Series in Probability and Statistics.
Öksendal, B., 2003. Stochastic Differential Equations: An Introduction with Applications. Springer.
Wong, W., 1986. Theory of partial likelihood. The Annals of Statistics, 14, 88–123.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Hosseini, R., Le, N. & Zidek, J. A Characterization of Categorical Markov Chains. J Stat Theory Pract 5, 261–284 (2011). https://doi.org/10.1080/15598608.2011.10412028
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1080/15598608.2011.10412028