On parallel implementation of sequential Monte Carlo methods: the island particle model
- 672 Downloads
The approximation of the Feynman-Kac semigroups by systems of interacting particles is a very active research field, with applications in many different areas. In this paper, we study the parallelization of such approximations. The total population of particles is divided into sub-populations, referred to as islands. The particles within each island follow the usual selection/mutation dynamics. We show that the evolution of each island is also driven by a Feynman-Kac semigroup, whose transition and potential can be explicitly related to ones of the original problem. Therefore, the same genetic type approximation of the Feynman-Kac semi-group may be used at the island level; each island might undergo selection/mutation algorithm. We investigate the impact of the population size within each island and the number of islands, and study different type of interactions. We find conditions under which introducing interactions between islands is beneficial. The theoretical results are supported by some Monte Carlo experiments.
KeywordsParticle approximation of Feynman-Kac flow Island models Parallel implementation
This work is supported by the Agence Nationale de la Recherche through the 2009-2012 project Big MC. The work of Christelle Vergé is financially supported by CNES (Centre National d’Etudes Spatiales) and Onera, The French Aerospace Lab.
- Arnaud, E., Le Gland, F.: SMC with Adaptive Resampling: Large Sample Asymptotics, pp. 481–484 (2009) Google Scholar
- Cappé, O., Moulines, E.: On the use of particle filtering for maximum likelihood parameter estimation. In: European Signal Processing Conference (EUSIPCO), Antalya, Turkey (2005) Google Scholar
- Casarin, R., Grassi, S., Ravazzolo, F., Van Dijk, H.K.: Parallel sequential Monte Carlo for efficient density combination: the deco Matlab toolboox. Tinbergen Institute Discussion Paper, 055/III (2013) Google Scholar
- Del Moral, P., Hu, P., Wu, L.: On the concentration properties of interacting particle processes. Found. Trends Mach. Learn. 3(3–4), 225–289 (2012b) Google Scholar
- Durham, G., Geweke, J.: Massively parallel sequential Monte Carlo for Bayesian inference. Manuscript, URL http://www.censoc.uts.edu.au/pdfs/geweke_papers/gp_working_9.pdf (2011)