Abstract
The rapid expansion of agent-based simulation modeling has left the theory of model validation behind its practice. Much of the literature emphasizes the use of empirical data for both calibrating and validating agent-based models. But a great deal of the practical effort in developing models goes into making sense of expert opinions about a modeling domain. Here we present a unifying view which incorporates both expert opinion and data in validating models, drawing upon Bayesian philosophy of science. We illustrate this in reference to a demographic model.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Auchincloss, A.H., Diez Roux, A.V.: A new tool for epidemiology: The usefulness of dynamic-agent models in understanding place effects on health. American Journal of Epidemiology (1), 1–8 (2008)
Australian Bureau of Statistics, Births, Australia, 2009, cat. no. 3301.0 (2010a) (viewed August 18, 2011)
Australian Bureau of Statistics, Life Tables, Australia, 2007–2009, cat. no. 3302.0.55.001 (2010b) (viewed August 18, 2011)
Barro, R.J.: Education as a determinant of economic growth. In: Lazear, E.P. (ed.) Education in the Twenty-First Century, pp. 9–24. The Hoover Institution, Palo Alto (2002)
de Vaus, D.: Diversity and change in Australian families: Statistical profiles. Australian Institute of Family Studies, Melbourne (2004)
Edmonds, B., Moss, S.: From KISS to KIDS – An ’Anti-simplistic’ Modelling Approach. In: Davidsson, P., Logan, B., Takadama, K. (eds.) MABS 2004. LNCS (LNAI), vol. 3415, pp. 130–144. Springer, Heidelberg (2005)
Feyerabend, P.: Against Method. Verso (1975)
Franklin, A.: The Neglect of Experiment. Cambridge University (1986)
Friedman, N., Koller, D.: Being Bayesian about network structure: A Bayesian approach to structure discovery in Bayesian networks. Machine Learning 50, 95–125 (2003)
Glass, K., McCaw, J., McVernon, J.: Incorporating population dynamics into household models of infectious disease transmission. Epidemics 3, 152–158 (2011)
Glimcher, P.W.: Decisions, Uncertainty, and the Brain: The Science of Neuroeconomics. MIT Press (2004)
Good, I.J.: Good Thinking: The Foundations of Probability and its Applications. University of Minnesota (1983)
Grimm, V., Railsback, S.: Individual-based Modeling and Ecology. Princeton University Press, Princeton (2005)
Grimm, V., Revilla, E., Berger, U., Jeltsch, F., Mooij, W.M., Railsback, S.F., Thulke, H., Weiner, J., Wiegand, T., DeAngelis, D.L.: Pattern-oriented modeling of agent-based complex systems: Lessons from ecology. Science 310, 987–991 (2005)
Howson, C., Urbach, P.: Scientific Reasoning: The Bayesian Approach, 2nd edn. Open Court (1993)
Kaldor, N.: Capital Accumulation and Economic Growth. Macmillan (1961)
Klein, E.E., Herskovitz, P.J.: Philosophical foundations of computer simulation validation. Simulation & Gaming 36, 303–329 (2005)
Kleindorfer, G.B., O’Neill, L., Ganeshan, R.: Validation in simulation: Various positions in the philosophy of science. Management Science, 1087–1099 (1998)
Korb, K.B.: A Pragmatic Bayesian Platform for Automating Scientific Induction. Ph. D. thesis, Indiana University (1992)
Korb, K.B.: Bayesian informal logic and fallacy. Informal Logic 24 (2004)
Korb, K.B., Nicholson, A.: Bayesian Artificial Intelligence, 2nd edn. CRC Press, Boca Raton (2010)
Kuhn, T.: The Structure of Scientific Revolutions. University of Chicago, Chicago (1962)
Lakatos, I.: Criticism and the Growth of Knowledge. Cambridge University (1970)
Mascaro, S., Korb, K.B., Nicholson, A.E., Woodberry, O.: Evolving Ethics: The New Science of Good and Evil. Imprint Academic (2010)
McLaughlin, B., Bennett, K.: Supervenience. In: Zalta, E.N. (ed.) The Stanford Encyclopedia of Philosophy (Winter 2011 )
Pearl, J.: Probabilistic Reasoning in Intelligent Systems. Morgan Kaufmann (1988)
Pitchforth, J., Mengersen, K.: A proposed validation framework for expert elicited Bayesian networks. Decision Support Systems and Electronic Commerce (submitted, 2012)
Popper, K.: The Logic of Scientific Discovery. Translation of Logik der Forschung. Basic Books, New York (1934)
Reichenbach, H.: The the pragmatic justification of induction. In: Feigl, H., Sellars, W. (eds.) Readings in Philosophical Analysis, pp. 305–327. Appleton-Century-Crofts, New York (1949)
Sargent, R.G.: Verification and validation of simulation models. In: Proceedings of the 2010 Winter Simulation Conference (WSC), pp. 166–183 (2010)
Tesfatsion, L., Judd, K.L. (eds.): Handbook of Computational Economics, Volume II: Agent-Based Computational Economics. Elsevier, Amsterdam (2006)
Viboud, C., Boëlle, P.Y., Cauchemez, S., Lavenu, A., Valleron, A.J., Flahault, A., Carrat, F.: Risk factors of influenza transmission in households. British Journal of General Practice 54, 684–689 (2004)
Wallace, C.S.: Statistical and Inductive Inference by Minimum Message Length. Springer (2005)
Wilkins, R., Warren, D., Hahn, M., Houng, B.: Families, Incomes and Jobs, Volume 6: A Statistical Report on Waves 1 to 8 of the Household, Income and Labour Dynamics in Australia Survey. Melbourne Institute of Applied Economic and Social Research, Melbourne (2011)
Windrum, P., Fagiolo, G., Moneta, A.: Empirical validation of agent-based models: Alternatives and prospects. Journal of Artificial Societies and Social Simulation 10 (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Korb, K.B., Geard, N., Dorin, A. (2013). A Bayesian Approach to the Validation of Agent-Based Models. In: Tolk, A. (eds) Ontology, Epistemology, and Teleology for Modeling and Simulation. Intelligent Systems Reference Library, vol 44. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-31140-6_14
Download citation
DOI: https://doi.org/10.1007/978-3-642-31140-6_14
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-31139-0
Online ISBN: 978-3-642-31140-6
eBook Packages: EngineeringEngineering (R0)