Skip to main content

Seven Problems with Massive Simulation Models for Policy Decision-Making

  • Conference paper
  • First Online:
The Science and Art of Simulation I

Abstract

Policymakers increasingly draw on scientific methods, including simulation modeling, to justify their decisions. For these purposes, scientist and policymakers face an extensive choice of modeling strategies. This paper distinguishes two types of strategies: Massive Simulation Models (MSMs) and Abstract Simulation Models (ASMs), and discusses how to justify strategy choice with reference to the core characteristics of the respective strategies. In particular, I argue that MSMs might have more severe problems than ASMs in determining the accuracy of the model; that MSMs might have more severe problems than ASMs in dealing with inevitable uncertainty; and that MSMs might have more severe problems than ASMs with misinterpretation and misapplication due to their format. While this in no way excludes the prospect that some MSMs provide good justifications for policy decisions, my arguments caution against a general preference for MSM over ASMs for policy decision purposes.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    “We view the social networks created by TRANSIMS as a single instance of a stochastic process defined in an enormous space of possibilities” (Eubank et al. 2004, Supplement, 3).

  2. 2.

    This issue further compounds the problem of particular model targets when policy targets are more abstract, discussed in Sect. 4.1. A close fit to the particular model target—even without the problem of overfitting—might not improve the model’s usefulness for questions about the abstract policy target.

References

  • Burke, Donald S., Joshua M. Epstein, Derek A. Cummings, Jon I. Parker, Kenneth C. Cline, Ramesh M. Singa, and Shubah Chakravarty. 2006. Individual-Based Computational Modeling Of Smallpox Epidemic Control Strategies. Academic Emergency Medicine 13 (11): 1142–1149.

    Article  Google Scholar 

  • Dawid, Herbert, and Giorgio Fagiolo. 2008. Editorial. Agent-based models for economic policy design: Introduction to the special issue. Journal of Economic Behaviour & Organization 67 (2): 351–354.

    Article  Google Scholar 

  • Epstein, Joshua M. 1999. Agent-based computational models and generative social science. Complexity 4 (5): 41–57.

    Article  MathSciNet  Google Scholar 

  • Eubank, Stephen, Hasan Guclu, V. S. Anil Kumar, Madhav V. Marathe, Aravind Srinivasan, Zoltán Toroczkai, and Nan Wang. 2004. Modelling Disease Outbreaks In Realistic Urban Social Networks. Nature 429 (6988): 180–184. See supplement at http://www.nature.com/nature/journal/v429/n6988/extref/nature02541-s1.htm. Accessed 15 March 2016.

  • Farmer, J. Doyne, and Duncan Foley. 2009. The Economy Needs Agent-Based Modelling. Nature 460 (7256): 685–686.

    Article  Google Scholar 

  • Gigerenzer, Gerd, and Henry Brighton. 2009. Homo Heuristicus: Why Biased Minds Make Better Inferences. Topics in Cognitive Science 1 (1): 107–143.

    Article  Google Scholar 

  • Grüne-Yanoff, Till. 2011. Agent-Based Models as Policy Decision Tools: The Case of Smallpox Vaccination. Simulation and Gaming: An Interdisciplinary Journal 42 (2): 219–236.

    Google Scholar 

  • Hartmann, Stephan. 1996. The World as a Process: Simulations in the Natural and Social Sciences. In Modelling and Simulation in the Social Sciences from the Philosophy of Science Point of View, ed. Rainer Hegselmann, Ulrich Mueller, and Klaus Troitzsch, 77–100. Dordrecht: Kluwer.

    Chapter  Google Scholar 

  • Hine, Dame Deirdre. 2010. The 2009 Influenza Pandemic: An independent review of the UK response to the 2009 influenza pandemic. Available at https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/61252/the2009influenzapandemic-review.pdf. Accessed 02 May 2016.

  • Humphreys, Paul. 2004. Extending Ourselves: Computational Science, Empiricism, and Scientific Method. New York: Oxford University Press.

    Book  Google Scholar 

  • Kaplan, Edward H., David L. Craft, and Lawrence M. Wein. 2002. Emergency response to a smallpox attack: The case for mass vaccination. Proceedings of the National Academy of Sciences 99 (16): 10935–10940.

    Article  Google Scholar 

  • Lenhard, Johannes, and Eric Winsberg. 2010. Holism, entrenchment, and the future of climate model pluralism. Studies in History and Philosophy of Science Part B: Studies in History and Philosophy of Modern Physics 41 (3): 253–262.

    Article  Google Scholar 

  • Myung, In Jae. 2000. The importance of complexity in model selection. Journal of Mathematical Psychology 44 (1): 190–204.

    Article  MATH  Google Scholar 

  • Parker, Wendy S., and James S. Risbey. 2015. False Precision, Surprise and Improved Uncertainty Assessment. Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences 373 (2055): 20140453.

    Google Scholar 

  • Schelling, Thomas. 1971. Dynamic models of segregation. Journal of Mathematical Sociology 1: 143–186.

    Article  MATH  Google Scholar 

  • Zucchini, Walter. 2000. An introduction to model selection. Journal of Mathematical Psychology 44 (1): 41–61.

    Article  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Till Grüne-Yanoff .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Grüne-Yanoff, T. (2017). Seven Problems with Massive Simulation Models for Policy Decision-Making. In: Resch, M., Kaminski, A., Gehring, P. (eds) The Science and Art of Simulation I . Springer, Cham. https://doi.org/10.1007/978-3-319-55762-5_7

Download citation

Publish with us

Policies and ethics