State Space Models

Part of the Springer Texts in Statistics book series (STS)


A very general model that subsumes a whole class of special cases of interest in much the same way that linear regression does is the state-space model or the dynamic linear model, which was introduced in Kalman [112] and Kalman and Bucy [113]. The model arose in the space tracking setting, where the state equation defines the motion equations for the position or state of a spacecraft with location x t and the data y t reflect information that can be observed from a tracking device such as velocity and azimuth.


  1. [5]
    Anderson BDO, Moore JB (1979) Optimal filtering. Prentice-Hall, Englewood CliffszbMATHGoogle Scholar
  2. [7]
    Anderson TW (1984) An introduction to multivariate statistical analysis, 2nd edn. Wiley, New YorkzbMATHGoogle Scholar
  3. [8]
    Ansley CF, Newbold P (1980) Finite sample properties of estimators for autoregressive moving average processes. J Econ 13:159–183CrossRefzbMATHGoogle Scholar
  4. [9]
    Ansley CF, Kohn R (1982) A geometrical derivation of the fixed interval smoothing algorithm. Biometrika 69:486–487MathSciNetCrossRefzbMATHGoogle Scholar
  5. [12]
    Bar-Shalom Y (1978) Tracking methods in a multi-target environment. IEEE Trans Automat Contr AC-23:618–626CrossRefzbMATHGoogle Scholar
  6. [13]
    Bar-Shalom Y, Tse E (1975) Tracking in a cluttered environment with probabilistic data association. Automatica 11:4451–4460CrossRefzbMATHGoogle Scholar
  7. [14]
    Baum LE, Petrie T, Soules G, Weiss N (1970) A maximization technique occurring in the statistical analysis of probabilistic functions of Markov chains. Ann Math Stat 41:164–171MathSciNetCrossRefzbMATHGoogle Scholar
  8. [24]
    Blight BJN (1974) Recursive solutions for the estimation of a stochastic parameter. J Am Stat Assoc 69:477–481MathSciNetCrossRefzbMATHGoogle Scholar
  9. [37]
    Cappé O, Moulines E, Rydén T (2009) Inference in hidden Markov models. Springer, New YorkzbMATHGoogle Scholar
  10. [38]
    Caines PE (1988) Linear stochastic systems. Wiley, New YorkzbMATHGoogle Scholar
  11. [39]
    Carter CK, Kohn R (1994) On Gibbs sampling for state space models. Biometrika 81:541–553MathSciNetCrossRefzbMATHGoogle Scholar
  12. [48]
    Danielson J (1994) Stochastic volatility in asset prices: Estimation with simulated maximum likelihood. J Econometrics 61:375–400CrossRefzbMATHGoogle Scholar
  13. [50]
    Dent W, Min A-S (1978) A Monte Carlo study of autoregressive-integrated-moving average processes. J Econ 7:23–55CrossRefzbMATHGoogle Scholar
  14. [51]
    Dempster AP, Laird NM, Rubin DB (1977) Maximum likelihood from incomplete data via the EM algorithm. J R Stat Soc B 39:1–38MathSciNetzbMATHGoogle Scholar
  15. [53]
    Douc R, Moulines E, Stoffer DS (2014) Nonlinear time series: theory, methods, and applications with R examples. CRC Press, Boca RatonzbMATHGoogle Scholar
  16. [55]
    Durbin J, Koopman SJ (2001) Time series analysis by state space methods. Oxford University Press, OxfordzbMATHGoogle Scholar
  17. [60]
    Eubank RL (1999) Nonparametric regression and spline smoothing, vol 157. Chapman & Hall, New YorkzbMATHGoogle Scholar
  18. [64]
    Frühwirth-Schnatter S (1994) Data augmentation and dynamic linear models. J Time Ser Anal 15:183–202MathSciNetCrossRefzbMATHGoogle Scholar
  19. [67]
    Gelfand AE, Smith AFM (1990) Sampling-based approaches to calculating marginal densities. J Am Stat Assoc 85:398–409MathSciNetCrossRefzbMATHGoogle Scholar
  20. [68]
    Geman S, Geman D (1984) Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images. IEEE Trans Pattern Anal Machine Intell 6:721–741CrossRefzbMATHGoogle Scholar
  21. [69]
    Gerlach R, Carter C, Kohn R (2000) Efficient Bayesian inference for dynamic mixture models. J Am Stat Assoc 95:819–828MathSciNetCrossRefzbMATHGoogle Scholar
  22. [74]
    Goldfeld SM, Quandt RE (1973) A Markov model for switching regressions. J Econ 1:3–16CrossRefzbMATHGoogle Scholar
  23. [76]
    Gordon K, Smith AFM (1988) Modeling and monitoring discontinuous changes in time series. In: Bayesian analysis of time series and dynamic models, pp 359–392Google Scholar
  24. [77]
    Gordon K, Smith AFM (1990) Modeling and monitoring biomedical time series. J Am Stat Assoc 85:328–337Google Scholar
  25. [81]
    Green PJ, Silverman BW (1993) Nonparametric regression and generalized linear models: a roughness penalty approach, vol 58. Chapman & Hall, New YorkzbMATHGoogle Scholar
  26. [84]
    Gupta NK, Mehra RK (1974) Computational aspects of maximum likelihood estimation and reduction in sensitivity function calculations. IEEE Trans Automat Contr AC-19:774–783MathSciNetCrossRefzbMATHGoogle Scholar
  27. [85]
    Hamilton JD (1989) A new approach to the economic analysis of nonstationary time series and the business cycle. Econometrica 57:357–384MathSciNetCrossRefzbMATHGoogle Scholar
  28. [88]
    Hannan EJ, Deistler M (1988) The statistical theory of linear systems. Wiley, New YorkzbMATHGoogle Scholar
  29. [90]
    Harrison PJ, Stevens CF (1976) Bayesian forecasting (with discussion). J R Stat Soc B 38:205–247zbMATHGoogle Scholar
  30. [91]
    Harvey AC, Todd PHJ (1983) Forecasting economic time series with structural and Box-Jenkins models: A case study. J Bus Econ Stat 1:299–307Google Scholar
  31. [92]
    Harvey AC, Pierse RG (1984) Estimating missing observations in economic time series. J Am Stat Assoc 79:125–131CrossRefGoogle Scholar
  32. [93]
    Harvey AC (1991) Forecasting, structural time series models and the Kalman filter. Cambridge University Press, CambridgeGoogle Scholar
  33. [96]
    Hastings WK (1970) Monte Carlo sampling methods using Markov chains and their applications. Biometrika 57:97–109MathSciNetCrossRefzbMATHGoogle Scholar
  34. [104]
    Jacquier E, Polson NG, Rossi PE (1994) Bayesian analysis of stochastic volatility models. J Bus. Econ Stat 12:371–417zbMATHGoogle Scholar
  35. [105]
    Jazwinski AH (1970) Stochastic processes and filtering theory. Academic Press, New YorkzbMATHGoogle Scholar
  36. [107]
    Jones RH (1980) Maximum likelihood fitting of ARMA models to time series with missing observations. Technometrics 22:389–395MathSciNetCrossRefzbMATHGoogle Scholar
  37. [108]
    Jones RH (1984) Fitting multivariate models to unequally spaced data. In: Parzen E (ed) Time series analysis of irregularly observed data, pp 158–188. Lecture notes in statistics, 25. Springer, New YorkGoogle Scholar
  38. [110]
    Juang BH, Rabiner LR (1985) Mixture autoregressive hidden Markov models for speech signals. IEEE Trans Acoust Speech Signal Process ASSP-33:1404–1413CrossRefGoogle Scholar
  39. [112]
    Kalman RE (1960) A new approach to linear filtering and prediction problems. Trans ASME J Basic Eng 82:35–45CrossRefGoogle Scholar
  40. [113]
    Kalman RE, Bucy RS (1961) New results in filtering and prediction theory. Trans ASME J Basic Eng 83:95–108MathSciNetCrossRefGoogle Scholar
  41. [118]
    Kim S, Shephard N, Chib S (1998) Stochastic volatility: likelihood inference and comparison with ARCH models. Rev Econ Stud 65:361–393CrossRefzbMATHGoogle Scholar
  42. [119]
    Kitagawa G, Gersch W (1984) A smoothness priors modeling of time series with trend and seasonality. J Am Stat Assoc 79:378–389Google Scholar
  43. [125]
    Lam PS (1990) The Hamilton model with a general autoregressive component: Estimation and comparison with other models of economic time series. J Monetary Econ 26:409–432CrossRefGoogle Scholar
  44. [128]
    Lindgren G (1978) Markov regime models for mixed distributions and switching regressions. Scand J Stat 5:81–91MathSciNetzbMATHGoogle Scholar
  45. [135]
    McCulloch RE, Tsay RS (1993) Bayesian inference and prediction for mean and variance shifts in autoregressive time series. J Am Stat Assoc 88:968–978CrossRefzbMATHGoogle Scholar
  46. [139]
    Meinhold RJ, Singpurwalla ND (1983) Understanding the Kalman filter. Am Stat 37:123–127Google Scholar
  47. [140]
    Meng XL, Rubin DB (1991) Using EM to obtain asymptotic variance–covariance matrices: The SEM algorithm. J Am Stat Assoc 86:899–909CrossRefGoogle Scholar
  48. [141]
    Metropolis N, Rosenbluth AW, Rosenbluth MN, Teller AH, Teller E (1953) Equations of state calculations by fast computing machines. J Chem Phys 21:1087–1091CrossRefGoogle Scholar
  49. [142]
    Mickens RE (1990) Difference equations: theory and applicatons, 2nd edn. Springer, New YorkGoogle Scholar
  50. [143]
    Newbold P, Bos T (1985) Stochastic parameter regression models. Sage, Beverly HillsCrossRefGoogle Scholar
  51. [146]
    Palma W, Chan NH (1997) Estimation and forecasting of long-memory time series with missing values. J Forecast 16:395–410CrossRefGoogle Scholar
  52. [151]
    Peña D, Guttman I (1988) A Bayesian approach to robustifying the Kalman filter. In: Spall JC (ed) Bayesian analysis of time series and dynamic linear models, pp 227–254. Marcel Dekker, New YorkGoogle Scholar
  53. [153]
    Petris G, Petrone S, Campagnoli P (2009) Dynamic linear models with R. Springer, New YorkCrossRefzbMATHGoogle Scholar
  54. [156]
    Press WH, Teukolsky SA, Vetterling WT, Flannery BP (1993) Numerical recipes in C: the art of scientific computing, 2nd edn. Cambridge University Press, CambridgezbMATHGoogle Scholar
  55. [160]
    Quandt RE (1972) A new approach to estimating switching regressions. J Am Stat Assoc 67:306–310CrossRefzbMATHGoogle Scholar
  56. [161]
    Rabiner LR, Juang BH (1986) An introduction to hidden Markov models. IEEE Acoust. Speech Signal Process ASSP-34:4–16Google Scholar
  57. [164]
    Remillard B (2011) Validity of the parametric bootstrap for goodness-of-fit testing in dynamic models. Available at SSRN 1966476Google Scholar
  58. [171]
    Sandmann G, Koopman SJ (1998) Estimation of stochastic volatility models via Monte Carlo maximum likelihood. J Econometrics 87:271–301MathSciNetCrossRefzbMATHGoogle Scholar
  59. [176]
    Schweppe FC (1965) Evaluation of likelihood functions for Gaussian signals. IEEE Trans Inform Theory IT-4:294–305MathSciNetzbMATHGoogle Scholar
  60. [177]
    Shephard N (1996) Statistical aspects of ARCH and stochastic volatility. In: Cox DR, Hinkley DV, Barndorff-Nielson OE (eds) Time series models in econometrics, finance and other fields, pp 1–100. Chapman and Hall, LondonGoogle Scholar
  61. [181]
    Shumway RH, Stoffer DS (1982) An approach to time series smoothing and forecasting using the EM algorithm. J Time Ser Anal 3:253–264CrossRefzbMATHGoogle Scholar
  62. [183]
    Shumway RH (1988) Applied statistical time series analysis. Prentice-Hall, Englewood CliffsGoogle Scholar
  63. [184]
    Shumway RH, Stoffer DS (1991) Dynamic linear models with switching. J Am Stat Assoc 86:763–769 (Correction: V87 p. 913)Google Scholar
  64. [188]
    Smith AFM, West M (1983) Monitoring renal transplants: An application of the multiprocess Kalman filter. Biometrics 39:867–878CrossRefzbMATHGoogle Scholar
  65. [190]
    Stoffer DS (1982) Estimation of parameters in a linear dynamic system with missing observations. Ph.D. Dissertation. Univ. California, DavisGoogle Scholar
  66. [192]
    Stoffer DS, Wall KD (1991) Bootstrapping state space models: Gaussian maximum likelihood estimation and the Kalman filter. J Am Stat Assoc 86:1024–1033MathSciNetCrossRefzbMATHGoogle Scholar
  67. [195]
    Stoffer DS, Wall KD (2004) Resampling in state space models. In: Harvey A, Koopman SJ, Shephard N (eds) State space and unobserved component models theory and applications, Chapter 9, pp 227–258. Cambridge University Press, CambridgeGoogle Scholar
  68. [198]
    Tanner M, Wong WH (1987) The calculation of posterior distributions by data augmentation (with discussion). J Am Stat Assoc 82:528–554CrossRefzbMATHGoogle Scholar
  69. [199]
    Taylor SJ (1982) Financial returns modelled by the product of two stochastic processes – A study of daily sugar prices, 1961–79. In: Anderson OD (ed) Time series analysis: theory and practice, Vol 1, pp 203–226. Elsevier/North-Holland, New YorkGoogle Scholar
  70. [206]
    Wahba G (1990) Spline models for observational data, vol 59. Society for Industrial Mathematics, PhiladelphiaCrossRefzbMATHGoogle Scholar
  71. [212]
    Wu CF (1983) On the convergence properties of the EM algorithm. Ann Stat 11:95–103MathSciNetCrossRefzbMATHGoogle Scholar
  72. [214]
    Zucchini W, MacDonald IL (2009) Hidden Markov models for time series: An introduction using R. CRC Press, Boca RatonCrossRefzbMATHGoogle Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  1. 1.Department of StatisticsUniversity of California, DavisDavisUSA
  2. 2.Department of StatisticsUniversity of PittsburghPittsburghUSA

Personalised recommendations