Skip to main content

Model Testing

  • Chapter
  • First Online:
System Dynamics Modeling with R

Part of the book series: Lecture Notes in Social Networks ((LNSN))

Abstract

This chapter provides an overview of model testing in system dynamics, and presents practical methods—using the R framework—that can be used to develop automated model tests. An important challenge in system dynamics is to build client confidence in models. While there is no single test that serves to validate a system dynamics model, confidence in a model gradually accumulates as the model passes more tests. Testing should not be designed to prove that a model is right, as all models are simplified representations of the world. However, models can be useful, and performing a wide range of tests on models can uncover errors. The chapter shows how R can be used to support automated testing of system dynamics models, and also how the concept of the atomic behavior pattern can support behavior tests.

Model testing should be designed to uncover errors so that you and your clients can understand the model’s limitations, improve it, and ultimately use the best available model to assist in important decisions.

John D. Sterman, Business Dynamics (2000, p. 846).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 89.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 119.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 119.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Balci O (1994) Validation, verification and testing techniques throughout the life cycle of a simulation study. Annals of OR 53

    Google Scholar 

  • Barlas Y (1989) Multiple tests for validation of system dynamics type of simulation models. Eur J Oper Res 42(1):59–87

    Article  MATH  Google Scholar 

  • Barlas Y (1996) Formal aspects of model validity and validation in system dynamics. Syst Dyn Rev 12(3):183–210

    Article  Google Scholar 

  • Cowpertwait PS, Metcalfe AV (2009) Introductory time series with R. Springer Science & Business Media

    Google Scholar 

  • Ford, D. N. (1999). A behavioral approach to feedback loop dominance analysis. System Dynamics Review, 15(1), 3.

    Google Scholar 

  • Forrester JW, Senge PM (1980) Tests for building confidence in system dynamics models. In: Legasto AA, Forrester JW, Lyneis JM (eds) system dynamics. North-Holland, Amsterdam

    Google Scholar 

  • König T, Jünemann K, Burger M (2015) RUnit-a unit test framework for R. Downloaded from https://cran.r-project.org/web/packages/RUnit/vignettes/RUnit.pdf. August 2015

  • Lo Giudice D (2013) Why agile development races ahead of traditional testing. Computer Weekly, 16–18. ISSN: 0010-4787

    Google Scholar 

  • Peterson DW, Eberlein RL (1994) Reality check: a bridge between systems thinking and system dynamics. Syst Dyn Rev 10(2–3):159–174

    Article  Google Scholar 

  • Sterman JD (2000) Business dynamics: systems thinking and modeling for a complex world. Irwin/McGraw-Hill, Boston

    Google Scholar 

  • Sterman JD (2002) All models are wrong: reflections on becoming a systems scientist. Syst Dyn Rev 18(4):501–531

    Article  Google Scholar 

  • Sücüllü C, Yücel G (2014) Behavior analysis and testing software (BATS). In: Proceedings of the 32nd international conference of the system dynamics society. Delft, The Netherlands

    Google Scholar 

  • Van Vliet H (2008) Software engineering: principles and practice. Wiley, UK

    Google Scholar 

  • Viboud C, Boëlle PY, Carrat F, Valleron AJ, Flahault A (2003) Prediction of the spread of influenza epidemics by the method of analogues. Am J Epidemiol 158(10):996–1006

    Article  Google Scholar 

  • Yücel G, Barlas B (2015) Pattern recognition for model testing, calibration, and behavior analysis. In: Rahmandad H, Oliva R, Osgood N (eds) Analytical methods for dynamic modelers. MIT Press, Cambridge

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jim Duggan .

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Duggan, J. (2016). Model Testing. In: System Dynamics Modeling with R. Lecture Notes in Social Networks. Springer, Cham. https://doi.org/10.1007/978-3-319-34043-2_6

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-34043-2_6

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-34041-8

  • Online ISBN: 978-3-319-34043-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics