Statistics and Computing

, Volume 25, Issue 2, pp 487–496 | Cite as

Path storage in the particle filter

  • Pierre E. Jacob
  • Lawrence M. Murray
  • Sylvain Rubenthaler


This article considers the problem of storing the paths generated by a particle filter and more generally by a sequential Monte Carlo algorithm. It provides a theoretical result bounding the expected memory cost by T+CNlogN where T is the time horizon, N is the number of particles and C is a constant, as well as an efficient algorithm to realise this. The theoretical result and the algorithm are illustrated with numerical experiments.


Sequential Monte Carlo Particle filter Memory cost Parallel computation 


  1. Andrieu, C., Doucet, A., Holenstein, R.: Particle Markov chain Monte Carlo (with discussion). J. R. Stat. Soc., Ser. B 72(4), 357–385 (2010) MathSciNetGoogle Scholar
  2. Cappé, O., Moulines, E., Rydén, T.: Inference in Hidden Markov Models. Springer, New York (2005) MATHGoogle Scholar
  3. Carpenter, J., Clifford, P., Fearnhead, P.: Improved particle filter for nonlinear problems. IEE Proc. Radar Sonar Navig. 146(1), 2–7 (1999) CrossRefGoogle Scholar
  4. Chopin, N., Singh, S.S.: On the particle Gibbs sampler (2013). ArXiv e-prints 1304.1887
  5. Chopin, N., Jacob, P., Papaspiliopoulos, O.: SMC2: an efficient algorithm for sequential analysis of state space models. J. R. Stat. Soc., Ser. B, Stat. Methodol. 75(3), 397–426 (2013) CrossRefMathSciNetGoogle Scholar
  6. Del Moral, P.: Feynman-Kac Formulae. Springer, Berlin (2004) CrossRefMATHGoogle Scholar
  7. Del Moral, P., Doucet, A.: On a class of genealogical and interacting metropolis models. Sémin. Probab. XXXVII, 415–446 (2003) Google Scholar
  8. Del Moral, P., Miclo, L., Patras, F., Rubenthaler, S.: The convergence to equilibrium of neutral genetic models. Stoch. Anal. Appl. 28(1), 123–143 (2009) CrossRefGoogle Scholar
  9. Douc, R., Moulines, E., Olsson, J.: Long-term stability of sequential Monte Carlo methods under verifiable conditions. Ann. Appl. Probab. (2012, to appear). ArXiv e-prints 1203.6898
  10. Doucet, A., Johansen, A.: A tutorial on particle filtering and smoothing: fifteen years later. In: Handbook of Nonlinear Filtering. Oxford University Press, Oxford (2011) Google Scholar
  11. Doucet, A., de Freitas, N., Gordon, N.: Sequential Monte Carlo Methods in Practice. Springer, New York (2001) CrossRefMATHGoogle Scholar
  12. Gordon, N., Salmond, J., Smith, A.: A novel approach to non-linear/non-Gaussian Bayesian state estimation. IEEE Proc. Radar Signal Process. 140, 107–113 (1993) CrossRefGoogle Scholar
  13. van Handel, R.: Uniform time average consistency of Monte Carlo particle filters. Stoch. Process. Appl. 119(11), 3835–3861 (2009) CrossRefMATHGoogle Scholar
  14. Jones, E.M., Parslow, J., Murray, L.M.: A Bayesian approach to state and parameter estimation in a phytoplankton-zooplankton model. Aust. Meteorol. Oceanogr. J. 59, 7–16 (2010) Google Scholar
  15. Kitagawa, G.: A self-organizing state-space model. J. Am. Stat. Assoc. 93, 1203–1215 (1998) Google Scholar
  16. Lee, A., Yau, C., Giles, M.B., Doucet, A., Holmes, C.C.: On the utility of graphics cards to perform massively parallel simulation of advanced Monte Carlo methods. J. Comput. Graph. Stat. 19, 769–789 (2010) CrossRefGoogle Scholar
  17. Lindsten, F., Jordan, M., Schön, T.: Ancestor sampling for particle Gibbs (2012). ArXiv e-prints 1210.6911
  18. Liu, J., Chen, R.: Sequential Monte Carlo methods for dynamic systems. J. Am. Stat. Assoc. 93, 1032–1044 (1998) CrossRefMATHGoogle Scholar
  19. Möhle, M.: The time back to the most recent common ancestor in exchangeable population models. Adv. Appl. Probab. 36, 78–97 (2004) CrossRefMATHGoogle Scholar
  20. Murray, L.M.: Bayesian state-space modelling on high-performance hardware using LibBi (2013). ArXiv e-prints 1306.3277
  21. Murray, L.M., Jones, E.M., Parslow, J.: On collapsed state-space models and the particle marginal Metropolis-Hastings sampler (2012). ArXiv e-prints 1202.6159
  22. Murray, L.M., Lee, A., Jacob, P.E.: Rethinking resampling in the particle filter on graphics processing units (2013). ArXiv e-prints 1301.4019
  23. Poyiadjis, G., Doucet, A., Singh, S.: Particle approximations of the score and observed information matrix in state space models with application to parameter estimation. Biometrika 98(1), 65–80 (2011) CrossRefMATHMathSciNetGoogle Scholar
  24. Sengupta, S., Harris, M., Garland, M.: Efficient parallel scan algorithms for GPUs. Tech. Rep. NVR-2008-003, NVIDIA (2008) Google Scholar
  25. Wang, J., Jasra, A., De Iorio, M.: Computational methods for a class of network models. J. Comput. Biol. (2014) Google Scholar
  26. Whiteley, N.: Stability properties of some particle filters. Ann. Appl. Probab. (2011, to appear). ArXiv e-prints 1109.6779

Copyright information

© Springer Science+Business Media New York 2013

Authors and Affiliations

  • Pierre E. Jacob
    • 1
  • Lawrence M. Murray
    • 2
  • Sylvain Rubenthaler
    • 3
  1. 1.Department of Statistics & Applied Probability, Faculty of ScienceNational University of SingaporeSingaporeSingapore
  2. 2.CSIRO Mathematics, Informatics & StatisticsWembleyAustralia
  3. 3.Univ. Nice Sophia AntipolisNiceFrance

Personalised recommendations