Skip to main content

GPU Accelerated PMCMC Algorithm with System Dynamics Modelling

  • Conference paper
  • First Online:
Social, Cultural, and Behavioral Modeling (SBP-BRiMS 2021)

Abstract

Recent work demonstrates that coupling Bayesian computational statistics methods with dynamic models can facilitate analysis and understanding of complex systems associated with diverse time series, those involving social and behavioral dynamics. Particle Markov Chain Monte Carlo (PMCMC) is a particularly powerful class of Bayesian methods combining aspects of batch Markov Chain Monte Carlo (MCMC) and the sequential Monte Carlo method of Particle Filtering (PF). PMCMC can flexibly combine theory-capturing dynamic models with diverse empirical data streams. PMCMC has demonstrated great potential for broad applicability across social and behavioral domains. While PMCMC offers high analytic power, such power imposes a high computational burden. In this work, we investigated the effectiveness of using Graphical Processing Units (GPUs) in reducing run times. Specifically, we designed and implemented a GPU-enabled parallel PMCMC version with compartmental simulation models. Evaluating this work’s impact with a realistic PMCMC health application showed that GPU-based acceleration achieves up to \(160\times \) speedup compared to a corresponding sequential CPU-based version. Use of the GPU accelerated PMCMC algorithm with dynamic models offers researchers a powerful toolset to greatly accelerate learning and secure additional insight from the high-velocity data increasingly prevalent within social and behavioral spheres.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Sask. Weekly Influenza Surveillance Reports: https://tinyurl.com/SKFluReports.

References

  1. Andrieu, C., Doucet, A., Holenstein, R.: Particle Markov chain Monte Carlo methods. J. R. Stat. Soc. B 72(3), 269–342 (2010)

    Article  MathSciNet  Google Scholar 

  2. Brockwell, A.E.: Parallel Markov Chain Monte Carlo simulation by pre-fetching. J. Comput. Graph. Stat. 15(1), 246–261 (2006)

    Article  MathSciNet  Google Scholar 

  3. Endo, A., van Leeuwen, E., Baguelin, M.: Introduction to particle Markov-chain Monte Carlo for disease dynamics modellers. Epidemics 29, 100363 (2019)

    Google Scholar 

  4. Epstein, J.M., Parker, J., Cummings, D., Hammond, R.A.: Coupled contagion dynamics of fear and disease: mathematical and computational explorations. PLoS ONE 3(12) (2008)

    Google Scholar 

  5. Golightly, A., Wilkinson, D.J.: Bayesian parameter inference for stochastic biochemical network models using particle Markov chain Monte Carlo. Interface Focus 1(6), 807–820 (2011)

    Article  Google Scholar 

  6. Henriksen, S., Wills, A., Schön, T.B., Ninness, B.: Parallel implementation of particle MCMC methods on a GPU. In: 16th IFAC Symposium on System Identification, vol. 45, pp. 1143–1148 (2012)

    Google Scholar 

  7. Kattwinkel, M., Reichert, P.: Bayesian parameter inference for individual-based models using a Particle Markov Chain Monte Carlo method. Environ. Model. Softw. 87, 110–119 (2017)

    Article  Google Scholar 

  8. Lee, A., Yau, C., Giles, M.B., Doucet, A., Holmes, C.C.: On the utility of graphics cards to perform massively parallel simulation of advanced Monte Carlo methods (2010)

    Google Scholar 

  9. Li, X., et al.: Illuminating the Hidden Elements and Future Evolution of Opioid Abuse Using Dynamic Modeling. Big Data and Particle Markov Chain Monte Carlo, SBP-BRiMS (2018)

    Google Scholar 

  10. Lovell, D., Malmaud, J., Adams, R.P., Mansinghka, V.K.: ClusterCluster: Parallel Markov Chain Monte Carlo for Dirichlet Process Mixtures, April 2013

    Google Scholar 

  11. Mingas, G., Bottolo, L., Bouganis, C.S.: Particle MCMC algorithms and architectures for accelerating inference in state-space models. Int. J. Approx. Reasoning 83, 413–433 (2017)

    Article  MathSciNet  Google Scholar 

  12. Mingas, G., Bouganis, C.S.: Population-based MCMC on multi-core CPUs, GPUs and FPGAs. IEEE Trans. Comput. 65(4), 1283–1296 (2016)

    Article  MathSciNet  Google Scholar 

  13. Nevat, I., Peters, G.W., Yuan, J.: Channel tracking in relay systems via particle MCMC. In: IEEE Vehicular Technology Conference (2011)

    Google Scholar 

  14. Quiroz, M., Kohn, R., Villani, M., Tran, M.N.: Speeding up MCMC by efficient data subsampling. J. Am. Stat. Assoc. 114(526), 831–843 (2019)

    Article  MathSciNet  Google Scholar 

  15. Safarishahrbijari, A., Osgood, N.D.: Social media surveillance for outbreak projection via transmission models: longitudinal observational study. JMIR Public Health Surveill. 5(2), e11615 (2019)

    Google Scholar 

  16. Wang, S., Huang, G.H., Baetz, B.W., Ancell, B.C.: Towards robust quantification and reduction of uncertainty in hydrologic predictions: integration of particle Markov chain Monte Carlo and factorial polynomial chaos expansion. J. Hydrol. 548, 484–497 (2017)

    Article  Google Scholar 

Download references

Acknowledgements

The authors gratefully acknowledge Dr. Juxin Liu’s methodological guidance on PMCMC. NDO further expresses his gratitude to SYK for inspiring and making sustainable delivery of this work. This research was enabled in part by NSERC support and Compute Canada computing resources (www.computecanada.ca).

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to Lujie Duan or Nathaniel Osgood .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Duan, L., Osgood, N. (2021). GPU Accelerated PMCMC Algorithm with System Dynamics Modelling. In: Thomson, R., Hussain, M.N., Dancy, C., Pyke, A. (eds) Social, Cultural, and Behavioral Modeling. SBP-BRiMS 2021. Lecture Notes in Computer Science(), vol 12720. Springer, Cham. https://doi.org/10.1007/978-3-030-80387-2_10

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-80387-2_10

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-80386-5

  • Online ISBN: 978-3-030-80387-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics