Abstract
In this paper, we consider the model selection problem for discretely observed ergodic multi-dimensional diffusion processes. In order to evaluate the statistical models, Akaike’s information criterion (AIC) is a useful tool. Since AIC is constructed by the maximum log likelihood and the dimension of the parameter space, it may look easy to get AIC even for discretely observed diffusion processes. However, there is a serious problem that a transition density of a diffusion process does not generally have an explicit form. Instead of the exact log-likelihood, we use a contrast function based on a locally Gaussian approximation of the transition density and we propose the contrast-based information criterion.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Adams, R. A., Fournier, J. J. F. (2003). Sobolev spaces (2nd ed.). In Pure and Applied Mathematics (Vol. 140). Amsterdam: Elsevier/Academic Press.
Aït-Sahalia Y. (2008) Closed-form likelihood expansions for multivariate diffusions. The Annals of Statistics 36: 906–937
Akaike H. (1973) Information theory and an extension of the maximum likelihood principle. In: Petrov B.N., Csaki F.(eds) 2nd international symposium in information theory. Budapest, Akademiai Kaido, pp 267–281
Akaike, H. (1974). A new look at the statistical model identification. IEEE transactions on automatic control, AC-19, pp. 716–723.
Beskos A., Papaspiliopoulos O., Roberts G.O., Fearnhead P. (2006) Exact and computationally efficient likelihood-based estimation for discretely observed diffusion processes (with discussions). Journal of the Royal Statistical Society, Series B, Statistical Methodology 68: 333–382
Burman P., Nolan D. (1995) A general Akaike-type criterion for model selection in robust regression. Biometrika 82: 877–886
Burnham K.P., Anderson D.R. (2002) Model selection and multimodel Inference (2nd ed.). Springer, New York
Florens-Zmirou D. (1989) Approximate discrete time schemes for statistics of diffusion processes. Statistics 20: 547–557
Genon-Catalot V., Jacod J. (1993) On the estimation of the diffusion coefficient for multidimensional diffusion processes. Annales de l’Institut Henri Poincaré, Probabilités et Statistiques 29: 119–151
Gobet E. (2001) Local asymptotic mixed normality property for elliptic diffusion: a Malliavin calculus approach. Bernoulli 7: 899–912
Gobet E. (2002) LAN property for ergodic diffusions with discrete observations. Annales de l’Institut Henri Poincaré, Probabilités et Statistiques 38: 711–737
Hall P. (1990) Akaike’s information criterion and Kullback–Leibler loss for histogram density estimation. Probability Theory and Related Fields 85: 449–467
Hurvich C.M., Simonoff J.S., Tsai C. (1998) Smoothing parameter selection in nonparametric regression using an improved Akaike information criterion. Journal of the Royal Statistical Society, Series B, Statistical Methodology 60: 271–293
Inagaki N., Ogata Y. (1975) The weak convergence of likelihood ratio random fields and its applications. Annals of the Institute of Statistical Mathematics 27: 391–419
Jacod J. (2006) Parametric inference for discretely observed non-ergodic diffusions. Bernoulli 12: 383–401
Kessler M. (1997) Estimation of an ergodic diffusion from discrete observations. Scandinavian Journal of Statistics 24: 211–229
Kloeden P.E., Platen E. (1992) Numerical solution of stochastic differential equations. Springer, New York
Konishi S., Kitagawa G. (1996) Generalised information criteria in model selection. Biometrika 83: 875–890
Konishi S., Kitagawa G. (2008) Information criteria and statistical modeling. Springer, New York
Kunita, H. (1984). Stochastic differential equations and stochastic flows of diffeomorphisms. Ecole d’eté de probabilités de Saint-Flour, XII—1982, Lecture Notes in Mathematics (Vol. 1097) (pp. 143–303). Berlin: Springer.
Kutoyants Y.A. (2004) Statistical inference for ergodic diffusion processes. Springer, London
Malliavin P. (1997) Stochastic analysis. Springer, Berlin
Nualart D. (2006) The Malliavin calculus and related topics (2nd ed.). Springer, Berlin
Pardoux E., Veretennikov A.Y. (2001) On the Poisson equation and diffusion approximation 1. The Annals of Probability 29: 1061–1085
Prakasa Rao B.L.S. (1983) Asymptotic theory for nonlinear least squares estimator for diffusion processes. Mathematische Operationsforschung und Statistik Series Statistics 14: 195–209
Prakasa Rao, B. L. S. (1988). Statistical inference from sampled data for stochastic processes. Contemporary Mathematics (Vol. 80, pp. 249–284). Providence, RI: American Mathematical Society.
Sakamoto Y., Yoshida N. (2004) Asymptotic expansion formulas for functionals of ε-Markov processes with a mixing property. Annals of the Institute of Statistical Mathematics 56: 545–597
Sei T., Komaki F. (2007) Bayesian prediction and model selection for locally asymptotically mixed normal models. Journal of Statistical Planning and Inference 137: 2523–2534
Shibata R. (1976) Selection of the order of an autoregressive model by Akaike’s information criterion. Biometrika 63: 117–126
Takeuchi K. (1976) Distribution of information statistics and criteria for adequacy of models. Mathematical Sciences 153: 12–18 (in Japanese)
Uchida M., Yoshida N. (2001) Information criteria in model selection for mixing processes. Statistical Inference for Stochastic Processes 4: 73–98
Uchida M., Yoshida N. (2004) Information criteria for small diffusions via the theory of Malliavin–Watanabe. Statistical Inference for Stochastic Processes 7: 35–67
Uchida M., Yoshida N. (2006) Asymptotic expansion and information criteria. SUT Journal of Mathematics 42: 31–58
Yoshida N. (1992a) Asymptotic expansion of maximum likelihood estimators for small diffusions via the theory of Malliavin-Watanabe. Probability Theory and Related Fields 92: 275–311
Yoshida N. (1992b) Estimation for diffusion processes from discrete observation. Journal of Multivariate Analysis 41: 220–242
Yoshida N. (1997) Malliavin calculus and asymptotic expansion for martingales. Probability Theory and Related Fields 109: 301–342
Yoshida N. (2004) Partial mixing and Edgeworth expansion. Probability Theory and Related Fields 129: 559–624
Yoshida, N. (2005). Polynomial type large deviation inequalities and quasi-likelihood analysis for stochastic differential equations (to appear in Annals of the Institute of Statistical Mathematics).
Author information
Authors and Affiliations
Corresponding author
About this article
Cite this article
Uchida, M. Contrast-based information criterion for ergodic diffusion processes from discrete observations. Ann Inst Stat Math 62, 161–187 (2010). https://doi.org/10.1007/s10463-009-0245-1
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10463-009-0245-1