Many cases of strategic interaction between agents involve a continuous set of choices. It is natural to model these problems as continuous space games. Consequently, the population of agents playing the game will be represented with a density function defined over the continuous set of strategy choices. Simulating evolutionary dynamics on continuous strategy spaces is a challenging problem. The classic approach of discretizing the strategy space is ineffective for multidimensional strategy spaces. We present a principled approach to simulation of adaptive dynamics in continuous space games using sequential Monte Carlo methods. Sequential Monte Carlo methods use a set of weighted random samples, also named particles to represent density functions over multidimensional spaces. Sequential Monte Carlo methods provide computationally efficient ways of computing the evolution of probability density functions. We employ resampling and smoothing steps to prevent particle degeneration problem associated with particle estimates. The resulting algorithm can be interpreted as an agent based simulation with elements of natural selection, regression to mean and mutation. We illustrate the performance of the proposed simulation technique using two examples: continuous version of the repeated prisoner dilemma game and evolution of bidding functions in first-price closed-bid auctions.
This is a preview of subscription content, log in to check access.
Buy single article
Instant access to the full article PDF.
Price includes VAT for USA
Subscribe to journal
Immediate online access to all issues from 2019. Subscription will auto renew annually.
This is the net price. Taxes to be calculated in checkout.
Axelrod RD (1984) The evolution of cooperation. Basic Books, New York
Benaim M, Weibull J (2003) Deterministic approximation of stochastic evolution in games. Econometrica 71:873–903
Bomze I (1990) Dynamical aspects of evolutionary stability. Monatshefte Math 110:189–206
Boylan RT (1992) Laws of large numbers for dynamical systems with randomly matched agents. J Econ Theory 57:473–504
Byde A (2003) Applying evolutionary game theory to auction mechanism design. In: Proceedings of the IEEE international converence on E-commerce
Carpenter JP (2002) Evolutionary models of bargaining: comparing agent-based computational and analytical approaches to understanding convention evolution. Comput Econ 19:25–49
Corradi V, Sarin R (2000) Continuous approximation of stochastic evolutionary game dynamics. J Econ Theory 94:163–191
Dawid H (1999) Adaptive learning with genetic algorithms, analytical results and applications to economic models. Springer, Berlin Heidelberg New York
Doucet A, Freitas N, Gordon N (eds) (2001) Sequential Monte Carlo methods in practice. Springer, Berlin Heidelberg New York
Friedman D, Yellin J (1997) Evolving landscapes for population games. Draft Manuscript University of California, Sant Cruz
Fudenberg D, Levine DK (1998) The theory of learning in games. MIT Press, Cambridge
Gordon NJ, Salmond DJ, Smith AFM (1993) Novel approach to nonlinear/non-gaussian bayesian state estimation. IEE Proceedings-F 140, 2
Killingback T, Doebeli M (2002) The continuous prisoner’s dilemma and the evolution of cooperation through reciprocal altruism with variable investment. Am Nat 160:4
Killingback T, Doebeli M, Knowlton N (1999) Variable investment, the continuous prisoner’s dilemma, and the origin of cooperation. In: Proceedings of the Royal Society of London B 263
Klemperer P (2002) Auctions: theory and practice. Princeton University Press, Englewood Cliffs
Liu J, West M (2001) Combined parameter and state estimation in simulation-based filtering. In: Doucet A, Freitas N, Gordon N (eds). Sequential Monte Carlo methods in practice. Springer, Berlin Heidelberg New York
Oechssler J, Riedel F (2001) Evolutionary dynamics on infinite strategy spaces. Econ Theory 17:1
Riechmann T (2001) Genetic algorithm learning and evolutionary games. J Econ Dyn Control 25:1019–1037
Schenk-Hoppe, KR (2000) The evolution of walrasian behavior in oligopolies. J Math Econ 33:35–55
Vega-Redondo F (1996) Evolution, games and economic behaviour. Oxford University Press, New York
Vega-Redondo F (1997) The evolution of walrasian behavior. Econometrica 65:2
Wahl LM, Nowak MA (1999) The continuous prisoner’s dilemma: I. linear reactive strategies. J Theor Biol 200:323–338
About this article
Cite this article
Yazar, J. Evolving densities in continuous strategy games through particle simulations. J Econ Interac Coord 1, 171–187 (2006). https://doi.org/10.1007/s11403-006-0014-7
- Stochastic and dynamic games
- Evolutionary games
- Agent based simulations
- Monte Carlo methods
- Computational techniques