Abstract
Recent work demonstrates that coupling Bayesian computational statistics methods with dynamic models can facilitate analysis and understanding of complex systems associated with diverse time series, those involving social and behavioral dynamics. Particle Markov Chain Monte Carlo (PMCMC) is a particularly powerful class of Bayesian methods combining aspects of batch Markov Chain Monte Carlo (MCMC) and the sequential Monte Carlo method of Particle Filtering (PF). PMCMC can flexibly combine theory-capturing dynamic models with diverse empirical data streams. PMCMC has demonstrated great potential for broad applicability across social and behavioral domains. While PMCMC offers high analytic power, such power imposes a high computational burden. In this work, we investigated the effectiveness of using Graphical Processing Units (GPUs) in reducing run times. Specifically, we designed and implemented a GPU-enabled parallel PMCMC version with compartmental simulation models. Evaluating this work’s impact with a realistic PMCMC health application showed that GPU-based acceleration achieves up to \(160\times \) speedup compared to a corresponding sequential CPU-based version. Use of the GPU accelerated PMCMC algorithm with dynamic models offers researchers a powerful toolset to greatly accelerate learning and secure additional insight from the high-velocity data increasingly prevalent within social and behavioral spheres.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
Sask. Weekly Influenza Surveillance Reports: https://tinyurl.com/SKFluReports.
References
Andrieu, C., Doucet, A., Holenstein, R.: Particle Markov chain Monte Carlo methods. J. R. Stat. Soc. B 72(3), 269–342 (2010)
Brockwell, A.E.: Parallel Markov Chain Monte Carlo simulation by pre-fetching. J. Comput. Graph. Stat. 15(1), 246–261 (2006)
Endo, A., van Leeuwen, E., Baguelin, M.: Introduction to particle Markov-chain Monte Carlo for disease dynamics modellers. Epidemics 29, 100363 (2019)
Epstein, J.M., Parker, J., Cummings, D., Hammond, R.A.: Coupled contagion dynamics of fear and disease: mathematical and computational explorations. PLoS ONE 3(12) (2008)
Golightly, A., Wilkinson, D.J.: Bayesian parameter inference for stochastic biochemical network models using particle Markov chain Monte Carlo. Interface Focus 1(6), 807–820 (2011)
Henriksen, S., Wills, A., Schön, T.B., Ninness, B.: Parallel implementation of particle MCMC methods on a GPU. In: 16th IFAC Symposium on System Identification, vol. 45, pp. 1143–1148 (2012)
Kattwinkel, M., Reichert, P.: Bayesian parameter inference for individual-based models using a Particle Markov Chain Monte Carlo method. Environ. Model. Softw. 87, 110–119 (2017)
Lee, A., Yau, C., Giles, M.B., Doucet, A., Holmes, C.C.: On the utility of graphics cards to perform massively parallel simulation of advanced Monte Carlo methods (2010)
Li, X., et al.: Illuminating the Hidden Elements and Future Evolution of Opioid Abuse Using Dynamic Modeling. Big Data and Particle Markov Chain Monte Carlo, SBP-BRiMS (2018)
Lovell, D., Malmaud, J., Adams, R.P., Mansinghka, V.K.: ClusterCluster: Parallel Markov Chain Monte Carlo for Dirichlet Process Mixtures, April 2013
Mingas, G., Bottolo, L., Bouganis, C.S.: Particle MCMC algorithms and architectures for accelerating inference in state-space models. Int. J. Approx. Reasoning 83, 413–433 (2017)
Mingas, G., Bouganis, C.S.: Population-based MCMC on multi-core CPUs, GPUs and FPGAs. IEEE Trans. Comput. 65(4), 1283–1296 (2016)
Nevat, I., Peters, G.W., Yuan, J.: Channel tracking in relay systems via particle MCMC. In: IEEE Vehicular Technology Conference (2011)
Quiroz, M., Kohn, R., Villani, M., Tran, M.N.: Speeding up MCMC by efficient data subsampling. J. Am. Stat. Assoc. 114(526), 831–843 (2019)
Safarishahrbijari, A., Osgood, N.D.: Social media surveillance for outbreak projection via transmission models: longitudinal observational study. JMIR Public Health Surveill. 5(2), e11615 (2019)
Wang, S., Huang, G.H., Baetz, B.W., Ancell, B.C.: Towards robust quantification and reduction of uncertainty in hydrologic predictions: integration of particle Markov chain Monte Carlo and factorial polynomial chaos expansion. J. Hydrol. 548, 484–497 (2017)
Acknowledgements
The authors gratefully acknowledge Dr. Juxin Liu’s methodological guidance on PMCMC. NDO further expresses his gratitude to SYK for inspiring and making sustainable delivery of this work. This research was enabled in part by NSERC support and Compute Canada computing resources (www.computecanada.ca).
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Duan, L., Osgood, N. (2021). GPU Accelerated PMCMC Algorithm with System Dynamics Modelling. In: Thomson, R., Hussain, M.N., Dancy, C., Pyke, A. (eds) Social, Cultural, and Behavioral Modeling. SBP-BRiMS 2021. Lecture Notes in Computer Science(), vol 12720. Springer, Cham. https://doi.org/10.1007/978-3-030-80387-2_10
Download citation
DOI: https://doi.org/10.1007/978-3-030-80387-2_10
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-80386-5
Online ISBN: 978-3-030-80387-2
eBook Packages: Computer ScienceComputer Science (R0)