Abstract
The ε-Markov process is a general model of stochastic processes which includes nonlinear time series models, diffusion processes with jumps, and many point processes. With a view to applications to the higher-order statistical inference, we will consider a functional of the ε-Markov process admitting a stochastic expansion. Arbitrary order asymptotic expansion of the distribution will be presented under a strong mixing condition. Applying these results, the third order asymptotic expansion of theM-estimator for a general stochastic process will be derived. The Malliavin calculus plays an essential role in this article. We illustrate how to make the Malliavin operator in several concrete examples. We will also show that the thirdorder expansion formula (Sakamoto and Yoshida (1998, ISM Cooperative Research Report, No. 107, 53–60; 1999, unpublished)) of the maximum likelihood estimator for a diffusion process can be obtained as an example of our result.
Similar content being viewed by others
References
Akahira, M. and Takeuchi, K. (1981). Asymptotic efficiency of statistical estimators, concepts and higher order asymptotic efficiency,Lecture Notes in Statistics,7, Springer, New York.
Barnodoroff-Nielsen, O. E. and Cox, D. R. (1994).Inference and Asymptotics, Chapman & Hall, London.
Bhattacharya, R. N. and Ghosh, J. K. (1978). On the validity of the formal Edgeworth expansion,Annals of Statistics,6, 434–451.
Bhattacharya, R. N. and Rao, R. R. (1986).Normal Approximation and Asymptotic Expansions, Krieger, Melbourne, Florida.
Bichteler, K., Gravereaux, J. B. and Jacod, J. (1987).Malliavin Calculus for Processes with Jumps, Gordon and Breach Science Publisher, New York.
Dermoune, A. and Kutoyants, Y. A. (1995). Expansion of distribution function of maximum likelihood estimate for misspecified diffusion type observations,Stochastics and Stochastic Reports,52, 121–145.
Ghosh, J. K. (1994).Higher Order Asymptotics, Institute of Mathematical Statistics, California.
Götze, F. and Hipp, C. (1983). Asymptotic expansions for sums of weakly dependent random vectors,Zeitschrift für Wahrscheinlichkeitstheorie und Verwandte Gebiete,64, 211–239.
Götze, F. and Hipp, C. (1994). Asymptotic distribution of statistics in time series,Annals of Statistics,22, 211–239.
Ikeda, N. and Watanabe, S. (1989).Stochastic Differential Equations and Diffusion Processes, 2nd ed., North-Holland/Kodansha, Tokyo.
Kusuoka, S. and Yoshida, N. (2000). Malliavin calculus, geometric mixing, and expansion of diffusion functionals,Probability Theory and Related Fields,116, 457–484.
Kutoyants, Yu. A. (2004).Statistical Inference for Ergodic Diffusion Processes, Springer, New York.
Lahiri, S. N. (1993). Reflnements in the asymptotic expansions for the sums of weakly dependent random vectors,Annals of Probability,21, 791–799.
Mykland, P. A. (1992). Asymptotic expansions and bootstrapping distributions for dependent variables, a martingale approach,Annals of Statistics,20 (2), 623–654.
Mykland, P. A. (1993). Asymptotic expansions for martingales,Annals of Probability,21, 800–818.
Mykland, P. A. (1995). Martingale expansions and second order inference,Annals of Statistics,23, 707–731.
Pfanzagl, J. (1982). Contributions to a general asymptotic statistical theory,Lecture Notes in Statistics,13, Springer, New York.
Pfanzagl, J. (1985). Asymptotic expansions for general statistical models,Lecture Notes in Statistics,31, Springer, Berlin.
Roberts, G. O. and Tweedie, R. L. (1996). Exponential convergence of Langevin distributions and their discrete approximations,Bernoulli,2 (4), 341–363.
Sakamoto, Y. (1998). Higher order asymptotic expansions for functionals of mixing processes, ISM Cooperative Research Report, No. 111.
Sakamoto, Y. and Yoshida, N. (1996). Expansion of perturbed random variables based on generalized Wiener functionals,Journal of Multivariate Analysis,59(1), 34–59.
Sakamoto, Y. and Yoshida, N. (1998a). Asymptotic expansions ofM-estimator over Wiener space,Statistical Inference for Stochastic Processes,1, 85–103.
Sakamoto, Y. and Yoshida, N. (1998b). Third order asymptotic expansion for diffusion process, in “Theory of Statistical Analysis and Its Applications”, ISM Cooperative Research Report, No. 107, 53–60.
Sakamoto, Y. and Yoshida, N. (1999). Higher order asymptotic expansion for a functional of a mixing process with applications to diffusion processes (unpublished).
Sakamoto, Y. and Yoshida, N. (2000). Asymptotic expansions of the cluster process (in preparation).
Sakamoto, Y. and Yoshida, N. (2003). Asymptotic expansion under degeneracy,Journal of the Japan Statistical Society,33 (2), 145–156.
Stroock, D. W. (1994).Probability Theory, an Analytic View, Cambridge University Press, Cambridge.
Taniguchi, M. (1991). Higher order asymptotic theory for time series analysis,Lecture Notes in Statistics,68, Springer, Berlin.
Taniguchi, M. and Watanabe, Y. (1994). Statistical analysis of curved probability densities,Journal of Multivariate Analysis,48, 228–248.
Uchida, M. and Yoshida, N. (1999). Asymptotic expansion and information criteria (submitted).
Uchida, M. and Yoshida, N. (2001). Information criteria in model selection for mixing processes,Statistical Inference for Stochastic Processes,4, 73–98.
Uchida, M. and Yoshida, N. (2004). Information criteria for small difusions via the theory of Malliavin-Watanabe,Statistical Inference for Stochastic Processes,7, 35–67.
Yoshida, N. (1992a). Asymptotic expansions for small diffusions via the theory of Malliavin-Watanabe,Probability Theory and Related Fields,92, 275–311.
Yoshida, N. (1992b). Asymptotic expansion for statistics related to small diffusions,Journal of the Japan Statistical Society,22 (2), 139–159.
Yoshida, N. (1993). Asymptotic expansion of Bayes estimators for small diffusions,Probability Theory and Related Fields,95, 429–450.
Yoshida, N. (1996a). Asymptotic expansion for martingales with jumps and Malliavin calculus, Research Memo., No. 601, The Institute of Statistical Mathematics, Tokyo.
Yoshida, N. (1996b). Asymptotic expansions for perturbed systems on Wiener space: Maximum likelihood estimators,Journal of Multivariate Analysis,57, 1–36.
Yoshida, N. (1997). Malliavin calculus and asymptotic expansion for martingales,Probability Theory and Related Fields,109, 301–342.
Yoshida, N. (1999). Asymptotic expansion for martingales with jumps (preprint).
Yoshida, N. (2001). Partial mixing and conditional Edgeworth expansion for diffusions with jumps,Probability Theory and Related Fields (to appear).
Author information
Authors and Affiliations
About this article
Cite this article
Sakamoto, Y., Yoshida, N. Asymptotic expansion formulas for functionals of ε-Markov processes with a mixing property. Ann Inst Stat Math 56, 545–597 (2004). https://doi.org/10.1007/BF02530541
Received:
Revised:
Issue Date:
DOI: https://doi.org/10.1007/BF02530541