A second-order iterated smoothing algorithm
- 372 Downloads
Simulation-based inference for partially observed stochastic dynamic models is currently receiving much attention due to the fact that direct computation of the likelihood is not possible in many practical situations. Iterated filtering methodologies enable maximization of the likelihood function using simulation-based sequential Monte Carlo filters. Doucet et al. (2013) developed an approximation for the first and second derivatives of the log likelihood via simulation-based sequential Monte Carlo smoothing and proved that the approximation has some attractive theoretical properties. We investigated an iterated smoothing algorithm carrying out likelihood maximization using these derivative approximations. Further, we developed a new iterated smoothing algorithm, using a modification of these derivative estimates, for which we establish both theoretical results and effective practical performance. On benchmark computational challenges, this method beat the first-order iterated filtering algorithm. The method’s performance was comparable to a recently developed iterated filtering algorithm based on an iterated Bayes map. Our iterated smoothing algorithm and its theoretical justification provide new directions for future developments in simulation-based inference for latent variable models such as partially observed Markov process models.
KeywordsIterated smoothing Sequential Monte Carlo State space model Hidden Markov model Parameter estimation
This research was funded in part by National Science Foundation Grant DMS-1308919 and National Institutes of Health Grants 1-U54-GM111274 and 1-U01-GM110712.
- Blackwood, J.C., Streicker, D.G., Altizer, S., Rohani, P.: Resolving the roles of immunity, pathogenesis, and immigration for rabies persistence in vampire bats. Proc. Natl. Acad. Sci. USA 110, 2083720842 (2013b)Google Scholar
- Douc, R., Cappé, O., Moulines, E.: Comparison of resampling schemes for particle filtering. In: Proceedings of the 4th International Symposium on Image and Signal Processing and Analysis, 2005, pp 64–69. IEEE, New York (2005)Google Scholar
- Doucet, A., Jacob, P. E., and Rubenthaler, S.: Derivative-free estimation of the score vector and observed information matrix with application to state-space models (version 2). arXiv:1304.5768v2 (2013)
- Kloeden, P.E., Platen, E.: Numerical Soluion of Stochastic Differential Equations, 3rd edn. Springer, New York (1999)Google Scholar
- Macdonald, G.: The Epidemiology and Control of Malaria. Oxford University Press, Oxford (1957)Google Scholar
- Nemeth, C., Fearnhead, P., Mihaylova, L.: Particle approximations of the score and observed information matrix for parameter estimation in state space models with linear computational cost. arXiv:1306.0735 (2013)
- Nguyen, D. (2015). Iterated smoothing r package, is2. https://r-forge.r-project.org/projects/is2
- Ross, R.: The Prevention of Malaria. Dutton, Boston (1910)Google Scholar
- Shrestha, S., King, A.A., Rohani, P.: Statistical inference for multi-pathogen systems. PLoS Comput. Biol. 7(8), e1002135 (2011)Google Scholar
- Toni, T., Welch, D., Strelkowa, N., Ipsen, A., Stumpf, M.P.: Approximate Bayesian computation scheme for parameter inference and model selection in dynamical systems. J. R. Soc. Interface 6, 187–202 (2009)Google Scholar