Kernel Methods for Detecting the Direction of Time Series
We propose two kernel based methods for detecting the time direction in empirical time series. First we apply a Support Vector Machine on the finite-dimensional distributions of the time series (classification method) by embedding these distributions into a Reproducing Kernel Hilbert Space. For the ARMA method we fit the observed data with an autoregressive moving average process and test whether the regression residuals are statistically independent of the past values. Whenever the dependence in one direction is significantly weaker than in the other we infer the former to be the true one. Both approaches were able to detect the direction of the true generating model for simulated data sets. We also applied our tests to a large number of real world time series. The ARMA method made a decision for a significant fraction of them, in which it was mostly correct, while the classification method did not perform as well, but still exceeded chance level.
KeywordsClassification Support vector machines Time series
Unable to display preview. Download preview PDF.
- Brockwell, P. J., & Davis, R. A. (1991). Time series: Theory and methods (2nd ed.). Berlin: Springer.Google Scholar
- Eichler, M., & Didelez, V. (2007). Causal reasoning in graphical time series models. In Proceedings of the 23nd Annual Conference on Uncertainty in Artifical Intelligence (pp. 109–116).Google Scholar
- Gretton, A., Borgwardt, K., Rasch, M., Schölkopf, B., & Smola, A. (2007). A kernel method for the two-sample-problem. In Advances in Neural Information Processing Systems (Vol. 19, pp. 513–520). Cambridge, MA: MIT Press.Google Scholar
- Gretton, A., Bousquet, O., Smola, A., & Schölkopf, B. (2005). Measuring statistical dependence with Hilbert–Schmidt norms. In Algorithmic Learning Theory: 16th International Conference (pp. 63–78). Berlin: Springer.Google Scholar
- Hein, M., & Bousquet, O. (2005). Hilbertian metrics and positive definite kernels on probability measures. In Proceedings of AISTATS.Google Scholar
- Kankainen, A. (1995). Consistent testing of total independence based on the empirical characteristic function. Ph.D. Thesis, University of Jyväskylä.Google Scholar
- Pearl, J. (2002). Causality. Cambridge: Cambridge University Press.Google Scholar
- Peters, J. (2008). Asymmetries of time series under inverting their direction. Diploma Thesis.Google Scholar
- Reichenbach, H. (1956). The direction of time. Berkeley: University of California Press.Google Scholar
- Shimizu, S., Hoyer, P. O., Hyvärinen, A., & Kerminen, A. (2006). A linear non-gaussian acyclic model for causal discovery. Journal of Machine Learning Research, 7, 2003–2030.Google Scholar
- Smola, A. J., Gretton, A., Song, L., & Schölkopf, B. (2007). A Hilbert space embedding for distributions. In Algorithmic Learning Theory: 18th International Conference (pp. 13–31). Berlin: Springer.Google Scholar
- Sriperumbudur, B., Gretton, A., Fukumizu, K., Lanckriet, G., & Schölkopf, B. (2008). Injective hilbert space embeddings of probability measures. In COLT, 2008.Google Scholar