A Bayesian Approach to the Validation of Agent-Based Models

  • Kevin B. Korb
  • Nicholas Geard
  • Alan Dorin
Part of the Intelligent Systems Reference Library book series (ISRL, volume 44)


The rapid expansion of agent-based simulation modeling has left the theory of model validation behind its practice. Much of the literature emphasizes the use of empirical data for both calibrating and validating agent-based models. But a great deal of the practical effort in developing models goes into making sense of expert opinions about a modeling domain. Here we present a unifying view which incorporates both expert opinion and data in validating models, drawing upon Bayesian philosophy of science. We illustrate this in reference to a demographic model.


Bayesian Network Expert Opinion Bayesian Approach Epistemological Virtue Severe Test 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Auchincloss, A.H., Diez Roux, A.V.: A new tool for epidemiology: The usefulness of dynamic-agent models in understanding place effects on health. American Journal of Epidemiology (1), 1–8 (2008)Google Scholar
  2. Australian Bureau of Statistics, Births, Australia, 2009, cat. no. 3301.0 (2010a) (viewed August 18, 2011)Google Scholar
  3. Australian Bureau of Statistics, Life Tables, Australia, 2007–2009, cat. no. 3302.0.55.001 (2010b) (viewed August 18, 2011)Google Scholar
  4. Barro, R.J.: Education as a determinant of economic growth. In: Lazear, E.P. (ed.) Education in the Twenty-First Century, pp. 9–24. The Hoover Institution, Palo Alto (2002)Google Scholar
  5. de Vaus, D.: Diversity and change in Australian families: Statistical profiles. Australian Institute of Family Studies, Melbourne (2004)Google Scholar
  6. Edmonds, B., Moss, S.: From KISS to KIDS – An ’Anti-simplistic’ Modelling Approach. In: Davidsson, P., Logan, B., Takadama, K. (eds.) MABS 2004. LNCS (LNAI), vol. 3415, pp. 130–144. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  7. Feyerabend, P.: Against Method. Verso (1975)Google Scholar
  8. Franklin, A.: The Neglect of Experiment. Cambridge University (1986)Google Scholar
  9. Friedman, N., Koller, D.: Being Bayesian about network structure: A Bayesian approach to structure discovery in Bayesian networks. Machine Learning 50, 95–125 (2003)zbMATHCrossRefGoogle Scholar
  10. Glass, K., McCaw, J., McVernon, J.: Incorporating population dynamics into household models of infectious disease transmission. Epidemics 3, 152–158 (2011)CrossRefGoogle Scholar
  11. Glimcher, P.W.: Decisions, Uncertainty, and the Brain: The Science of Neuroeconomics. MIT Press (2004)Google Scholar
  12. Good, I.J.: Good Thinking: The Foundations of Probability and its Applications. University of Minnesota (1983)Google Scholar
  13. Grimm, V., Railsback, S.: Individual-based Modeling and Ecology. Princeton University Press, Princeton (2005)zbMATHGoogle Scholar
  14. Grimm, V., Revilla, E., Berger, U., Jeltsch, F., Mooij, W.M., Railsback, S.F., Thulke, H., Weiner, J., Wiegand, T., DeAngelis, D.L.: Pattern-oriented modeling of agent-based complex systems: Lessons from ecology. Science 310, 987–991 (2005)CrossRefGoogle Scholar
  15. Howson, C., Urbach, P.: Scientific Reasoning: The Bayesian Approach, 2nd edn. Open Court (1993)Google Scholar
  16. Kaldor, N.: Capital Accumulation and Economic Growth. Macmillan (1961)Google Scholar
  17. Klein, E.E., Herskovitz, P.J.: Philosophical foundations of computer simulation validation. Simulation & Gaming 36, 303–329 (2005)CrossRefGoogle Scholar
  18. Kleindorfer, G.B., O’Neill, L., Ganeshan, R.: Validation in simulation: Various positions in the philosophy of science. Management Science, 1087–1099 (1998)Google Scholar
  19. Korb, K.B.: A Pragmatic Bayesian Platform for Automating Scientific Induction. Ph. D. thesis, Indiana University (1992)Google Scholar
  20. Korb, K.B.: Bayesian informal logic and fallacy. Informal Logic 24 (2004)Google Scholar
  21. Korb, K.B., Nicholson, A.: Bayesian Artificial Intelligence, 2nd edn. CRC Press, Boca Raton (2010)Google Scholar
  22. Kuhn, T.: The Structure of Scientific Revolutions. University of Chicago, Chicago (1962)Google Scholar
  23. Lakatos, I.: Criticism and the Growth of Knowledge. Cambridge University (1970)Google Scholar
  24. Mascaro, S., Korb, K.B., Nicholson, A.E., Woodberry, O.: Evolving Ethics: The New Science of Good and Evil. Imprint Academic (2010)Google Scholar
  25. McLaughlin, B., Bennett, K.: Supervenience. In: Zalta, E.N. (ed.) The Stanford Encyclopedia of Philosophy (Winter 2011 )Google Scholar
  26. Pearl, J.: Probabilistic Reasoning in Intelligent Systems. Morgan Kaufmann (1988)Google Scholar
  27. Pitchforth, J., Mengersen, K.: A proposed validation framework for expert elicited Bayesian networks. Decision Support Systems and Electronic Commerce (submitted, 2012)Google Scholar
  28. Popper, K.: The Logic of Scientific Discovery. Translation of Logik der Forschung. Basic Books, New York (1934)Google Scholar
  29. Reichenbach, H.: The the pragmatic justification of induction. In: Feigl, H., Sellars, W. (eds.) Readings in Philosophical Analysis, pp. 305–327. Appleton-Century-Crofts, New York (1949)Google Scholar
  30. Sargent, R.G.: Verification and validation of simulation models. In: Proceedings of the 2010 Winter Simulation Conference (WSC), pp. 166–183 (2010)Google Scholar
  31. Tesfatsion, L., Judd, K.L. (eds.): Handbook of Computational Economics, Volume II: Agent-Based Computational Economics. Elsevier, Amsterdam (2006)Google Scholar
  32. Viboud, C., Boëlle, P.Y., Cauchemez, S., Lavenu, A., Valleron, A.J., Flahault, A., Carrat, F.: Risk factors of influenza transmission in households. British Journal of General Practice 54, 684–689 (2004)Google Scholar
  33. Wallace, C.S.: Statistical and Inductive Inference by Minimum Message Length. Springer (2005)Google Scholar
  34. Wilkins, R., Warren, D., Hahn, M., Houng, B.: Families, Incomes and Jobs, Volume 6: A Statistical Report on Waves 1 to 8 of the Household, Income and Labour Dynamics in Australia Survey. Melbourne Institute of Applied Economic and Social Research, Melbourne (2011)Google Scholar
  35. Windrum, P., Fagiolo, G., Moneta, A.: Empirical validation of agent-based models: Alternatives and prospects. Journal of Artificial Societies and Social Simulation 10 (2007)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Kevin B. Korb
    • 1
  • Nicholas Geard
    • 2
  • Alan Dorin
    • 1
  1. 1.Monash UniversityMelbourneAustralia
  2. 2.University of MelbourneMelbourneAustralia

Personalised recommendations