# Replicator Dynamics of Symmetric Ultimatum Game

## Abstract

We construct a symmetric version of the ultimatum mini game and analyze the stability of its equilibria in the replicator dynamics. We show that the mere symmetry does not lead to a unique social norm consistent with the observed experimental results. Moreover, the average offer in the population has to be lower than 50 % in order to have one of the equilibria consistent with the experimental data.

### Keywords

Symmetric ultimatum game Social norm Replicator dynamics## 1 Introduction

Ultimatum game is the simplest bargaining game. Its goal is to divide a unit of a certain good between two players. The first player offers a fraction *δ*∈[0,1] of the good to the second player. The second player can either accept the offer or reject it. In the first case, the second player receives the payoff *δ* and the first player 1−*δ*, while in the second case both players receive nothing. The first player is referred to as “proposer” and the second player as “responder”.

It is not difficult to see that in the ultimatum game any offer *δ* can be supported by a Nash equilibrium. Suppose a proposer offers a share *δ*>0 and a responder accepts any offer not lower than *δ*. Any such pair constitutes a Nash equilibrium and consequently there is a continuum of Nash equilibria in this game. However, if a proposer deviates from this equilibrium and offers any positive share *δ*′<*δ*, the best-reply strategy of a responder is to accept it. This shows that any such equilibrium is not subgame perfect. In fact, if the good is infinitely divisible there is the unique subgame-perfect equilibrium in which a proposer offers *δ*=0 and a responder accepts any offer.^{1}

Bargaining games were extensively tested in experiments. It seems that the first experiment involving the ultimatum game was conducted in [5]. The average observed offer was between 31 % and 35 % and so it was nowhere near the subgame-perfect equilibrium. This experiment was replicated in [6] and in a larger design in [2, 3, 7, 14]. A detailed discussion of these and other results is beyond the scope of this paper, a detailed survey can be found in [11].

(…) we suggest that initial play reflects decision rules that have evolved in real-life bargaining situations that are superficially similar to the Ultimatum Game. These bargaining games generally feature more symmetric allocations of bargaining power than the Ultimatum Game, yielding initial play in Ultimatum Game experiments that need not be close to the subgame-perfect equilibrium.

Here we construct a symmetric model of the ultimatum bargaining game and use replicator dynamics to test whether the symmetry of the roles leads to any significant changes as compared to the original model in [4].

The paper is organized as follows. In Sect. 2.1, the basic model is introduced. In Sect. 2.2, the unperturbed version of replicator dynamics is analyzed while the perturbed version is addressed in Sect. 2.3. We discuss our results in Sect. 3 and conclude in Sect. 4.

## 2 Model

We adopt the standard evolutionary setting and construct a model with a single population of players randomly matched to play the mini ultimatum game. Since the mini ultimatum game is an asymmetric one, the roles in the game, i.e. proposer and responder, are assigned at random. Consequently, the position of all players ex-ante is exactly the same. We assume, though, the conditioning of behavior on the assigned role, that is, a strategy is a plan describing a behavior in both roles. We are interested in studying the evolution of a distribution of pure strategies (describing behavior in both roles).

### 2.1 Strategies and Payoffs

*α*,

*β*), where

*α*∈[0,1] is an offer of a player in the role of the proposer and

*β*∈[0,1] is an acceptance level, that is, a player in the role of the responder accepts only offers not lower than

*β*. For simplicity we narrow down the possible offers to just three,

*α*,∈{0,

*δ*,1}, where 0<

*δ*<1. We also assume that acceptance levels cannot be larger than offers, that is,

*β*≤

*α*. Consequently, we are left with six possible strategies:

### 2.2 Unperturbed Replicator Dynamics

*x*

_{1},…,

*x*

_{6}, respectively. The vector of fractions is denoted by \(\mathbf {x}\in \triangle \), where △ is a simplex,

*R*. For this matrix we consider the standard replicator dynamics of the form

^{2}Namely, let \(\xi(\mathbf {x}^{0},t)\) be the solution of (1) with the initial condition \(\mathbf {x}^{0} \in \mathrm {int}(\triangle )\), then

*δ*,0). The replicator dynamics for variables

*x*

_{ i },

*i*=1,2,3 takes the following form:

### Proposition 1

(Equilibria)

*The set* *E* *of equilibria of dynamics* (2) *consists of four components*, *E*=*E* _{1}∪*E* _{2}∪*E* _{3}∪*E* _{4}, *where* *E* _{1}={(1,0,0)}, \(E_{2} = \{ \mathbf {x}\in \triangle : x_{2} = \delta\}\), \(E_{3} = \{ \mathbf {x}\in \triangle : x_{1} = 0, x_{2} < \delta\}\), *and* \(E_{4} = \{\mathbf {x}\in \triangle : x_{1} = 0, x_{2} > \delta\}\).

### Proposition 2

(Trajectories)

*Let* \(\mathbf {x}^{0} \in \triangle \) *be an initial condition*. *The trajectory* \(\{\mathbf {x}\in \triangle : \mathbf {x}=\xi(\mathbf {x}^{0},t)\), *t*≥0} *of *(2) *is contained in the straight line passing through points* \(\mathbf {x}^{0}\) *and* (1,0,0).

### Proposition 3

(Stability)

*Equilibrium* (1,0,0) *is locally asymptotically stable*. *Each equilibrium in* *E* _{4} *is Lyapunov stable*. *Each equilibrium in* *E* _{2}∪*E* _{3} *is unstable*.

### 2.3 Perturbed Replicator Dynamics

*ϵ*and with a small probability

*ϵ*strategies are chosen randomly, that is, each one with the probability 1/3. The random choice of strategies introduces the term

*ϵ*(1/3−

*x*

_{ i }) into the replicator dynamics and we obtain the following perturbed version of the dynamics (2):

*x*

_{2}=

*x*

_{3}is invariant under the flow (4). Moreover,

*x*

_{2}=

*x*

_{3}at any equilibrium. Hence we may have at most three equilibria of (4).

### Proposition 4

(Equilibria)

*Let*

*ϵ*>0

*be small enough*.

*If*

*δ*≥1/2,

*then dynamics*(4)

*has only one equilibrium*\(\hat{\mathbf {x}}^{1} \in \triangle \).

*If*

*δ*<1/2,

*then dynamics*(4)

*has three equilibria*: \(\hat{\mathbf {x}}^{1}\), \(\hat{\mathbf {x}}^{2}\), \(\hat{\mathbf {x}}^{3} \in \triangle \).

*In the limit*

*ϵ*↓0

*we have*

### Proof

*δ*we have two cases. For

*δ*<1/2, cf. Fig. 2(a), there are three different roots of

*f*

_{2}(

*x*

_{2},0)=0, namely \(\hat {x}_{2}^{1}=0\), \(\hat{x}_{2}^{2}=\delta\) and \(\hat{x}_{2}^{3}=1/2\). All these roots give rise to stationary points of the flow (4) that are contained in △. It is easy to see that for any small enough

*ϵ*>0 all these stationary points still remain in the simplex, hence there are three equilibria for the perturbed flow \(\mathbf {f}(\mathbf {x}, \epsilon )\). It is clear that as

*ϵ*↓0 we have the desired convergence.

For *δ*≥1/2 and *ϵ*>0, cf. Figure 2(b), there is only a single root \(\hat{x}_{2}^{1}(\epsilon )\) of *f* _{2}(*x* _{2},*ϵ*)=0 that gives rise to a stationary point of \(\mathbf {f}(\mathbf {x}, \epsilon )\) that is contained in a simplex △. Also here, it is clear that as *ϵ*↓0 we have the desired convergence. □

As we have already mentioned, a line *x* _{2}=*x* _{3} is invariant under the perturbed dynamics. This plays a crucial role in the following proposition.

### Proposition 5

(Global Convergence)

*Let* \(\mathbf {x}\in \triangle \) *be any initial condition and let* \(\xi(\mathbf {x}, t)\) *be the solution *(4). *Then* \(\xi(\mathbf {x}, t)\) *converges to one of the equilibria* \(\hat{x}^{i}\).

### Proof

System (4) is a planar system and so by the Poincaré–Bendixson theorem we know that \(\xi(\mathbf {x}, t)\) converges either to a stationary point or a limit cycle. Therefore, in order to prove the proposition it is enough to show that there cannot be any limit cycles.

Suppose that \(\xi( \mathbf {x}, t)\) converges to a limit cycle defining a region *γ* that is invariant under \(\mathbf {f}(\mathbf {x},\epsilon )\). It is well known^{3} that there must be a stationary point \(\hat{x}\) of \(\mathbf {f}(\mathbf {x}, \epsilon )\) such that \(\hat{x} \in \mathrm {int}(\gamma)\). But then a limit cycle has to cross the invariant line *x* _{2}=*x* _{3} which cannot happen. □

To complete the analysis of the perturbed system we focus on local phase portraits around equilibria of (4).

### Proposition 6

(Local Phase Portraits)

*Let* *δ*<1/2 *and* *ϵ*>0 *be small enough*. *Equilibria* \(\hat{\mathbf {x}}^{1}\) *and* \(\hat{\mathbf {x}}^{3}\) *are asymptotically stable and equilibrium* \(\hat{\mathbf {x}}^{2}\) *is a saddle*.

### Proof

*λ*

_{1}<0 leads to

*λ*

_{2}we get

*f*

_{2}(

*x*

_{2},

*ϵ*) shows, cf. Fig. 2, that

*λ*

_{2}is negative at both \(\hat{\mathbf {x}}^{1}\) and \(\hat{\mathbf {x}}^{3}\) and positive at \(\hat{\mathbf {x}}^{2}\). □

The case of *δ*≥1/2 is trivial. The proof of Proposition 6 works for the only equilibrium \(\hat{\mathbf {x}}^{1}\) in the case of *δ*≥1/2 as well. We could also argue differently. We know by Proposition 5 that any trajectory converges to one of the equilibria and all of them are on a line *x* _{2}=*x* _{3}. Therefore, trajectories come arbitrarily close to this line and by the continuity of (4) their behavior is qualitatively identical to the behavior of (4) on that line.

## 3 Discussion

The asymmetric noisy model introduced in [4] predicts two stable equilibria. The first one is close to the subgame-perfect equilibrium of the ultimatum game while the other one is substantially different supporting the average offer of around 20 %. It was speculated there that at the initial phases of an experiment, the observed behavior is driven by a social norm that happened to be triggered by the framing of the ultimatum game. This social norm is formed in superficially similar real-life bargaining problems where players are in a symmetric situation. In other words, the initial conditions of the replicator dynamics are likely to belong to the basin of attraction of the non-perfect equilibrium because the triggered behavior is formed in a (more) symmetric model.

In order to check this possibility, we constructed a symmetric model of the ultimatum game with proposer and responder roles assigned at random hence the situation of players is completely symmetric. So, how does our symmetric model compare? In the unperturbed case, the behavior of the model is simple. In fact, we can justify a population using a modal offer *δ* through a stable (but not asymptotically stable) equilibrium. However, we are not satisfied with such an explanation for two reasons. Firstly, we would like to have an asymptotically stable equilibrium supporting the observed behavior, and secondly, in the ultra-long run one would expect some kind of a noise in the system. This leads us as in [4] to consider a perturbed version of the replicator dynamics.

Behavior of the perturbed replicator dynamics is to a certain extent similar to the behavior of perturbed dynamics in the original ultimatum bargaining mini game. For *δ*<1/2 there are three equilibria. Two asymptotically stable equilibria are connected through an unstable manifold of the saddle point. Equilibrium \(\hat{\mathbf {x}}^{1}\) is the perturbed subgame-perfect Nash equilibrium and cannot be used to explain the behavior observed in experiments. There is, however, the second asymptotically stable equilibrium \(\hat {\mathbf {x}}^{3}\), at which most of the population uses the social norm offer *δ*. This equilibrium can explain to a certain extent the behavior of subjects playing the bargaining game in a lab.

Although, we can use the equilibrium \(\hat{\mathbf {x}}^{3}\), there are some problems with this explanation. Firstly, the experimental results on bargaining games vary wildly and in the context of this work the only common observation is that the average offer is lower than 1/2. Thus to calibrate our model for various data we would have to use different noise levels *ϵ*. This is a minor problem since we can always argue that in a lab only a very small sample is observed and this can vary even though there is a common noise level.^{4}

There is a more serious problem with the use of the equilibrium \(\hat {\mathbf {x}}^{3}\) as the explanation of the observed behavior. Although this equilibrium is asymptotically stable, it is not globally asymptotically stable. If an initial population state belongs to the basin of attraction of \(\hat{\mathbf {x}}^{3}\) and there are only small uncorrelated jumps, then in the ultra-long time, the population state should be near the equilibrium \(\hat{\mathbf {x}}^{3}\). However, if there are large perturbations or a series of correlated small perturbations, the population state may very well happen to be in the basin of attraction of the subgame-perfect Nash equilibrium \(\hat{\mathbf {x}}^{1}\). If the perturbations were persistent, then we could observe a system jumping between equilibria which is reminiscent of [15].

One way of estimating how likely it is for a population state to be in a given basin is to look at the basins area. For precise calculations we would need to have formulas for the stable manifold of the saddle point \(\hat{\mathbf {x}}^{2}\) and these are notoriously difficult to get. However, for *δ*=1/3, the segment *x* _{2}=*δ* is the stable separatrix of the saddle point \(\hat{\mathbf {x}}^{2}\) and consequently the ratio of the area of the basin of attraction of \(\hat{\mathbf {x}}^{3}\) to the whole simplex is 4/9. Numerical calculations suggest that for *δ*<1/3 this separatrix is to the left of the segment *x* _{2}=*δ* and for *δ*>1/3 it is to the right of this segment. As *δ*↓0, the area of the basin of attraction of the subgame-perfect equilibrium \(\hat{\mathbf {x}}^{1}\) decreases to 0, but at the same time the difference between offers of the egoistic strategy and the medium strategies decreases as well. If the plausibility of a given equilibrium is measured by the size of its basin of attraction, then there is a trade off between the plausibility of \(\hat{\mathbf {x}}^{3}\) and how different medium strategies are from the egoistic one.

*μ*>0, i.e.

*α*,

*β*∈{

*μ*,

*δ*,1}, where 0<

*μ*<

*δ*<1. The introduction of the minimal offer

*μ*does not change the first step in our analysis, the last three strategies vanish in the long run and so we can consider the 3×3 game with the first three pure strategies.

*E*′ is a union of four components \(E' = E_{1}' \cup E_{2}' \cup E_{3}' \cup E_{4}'\), where \(E_{i}'= E_{i}\) for

*i*=1,3,4 with identical stability properties. The only difference occurs with respect to the component

*E*

_{2}which is reduced to just a single point \(E_{2}'=(1-\delta, \delta, 0)\) and is unstable. This phase portrait is extremely similar to the Fig. 2 in [4], p 76. In this case, an introduction of symmetry does not lead to any substantial change regardless of the value of the minimal offer

*μ*.

The next step is the analysis of the perturbed dynamics. Figure 3(b) depicts the phase portrait of the perturbed dynamics with the positive minimal offer *μ*>0. Qualitatively the situation is exactly the same as the one with a noise and *μ*=0 depicted in Fig. 1(b). There are three equilibria. The first one \(\tilde{\mathbf {x}}^{1}\) is close to the first pure strategy corresponding to the subgame perfect equilibrium of the original game and is asymptotically stable. The third one \(\tilde{\mathbf {x}}^{3}\) is also asymptotically stable equilibrium and corresponds to the \(\hat{\mathbf {x}}^{3}\) equilibrium of the dynamics (4). There is an unstable equilibrium (saddle) \(\tilde{\mathbf {x}}^{2}\) corresponding to the \(\hat{\mathbf {x}}^{2}\) equilibrium of the dynamics (4). Also in this case the introduction of the positive minimal offer *μ*>0 does not change anything qualitatively.

Introduction of the minimal positive offer *μ*>0 neither influences results qualitatively nor gives an additional insight. On the other hand, the assumption that *μ*=0 simplifies immensely calculations and this is the main reason why we decided to analyze in detail this version of the game.

Now we ask ourselves: is there anything that we can conclude from the replicator dynamics of the symmetric ultimatum mini game? The only good news is that if we would like to have any chance to explain the experimental data, we have to have *δ*<1/2, a result that goes quite well with the collected data. However, the symmetry does not lead to the creation of the social norm, triggered by the framing of the ultimatum game during experiments, different from the subgame-perfect equilibrium of the ultimatum game. Regardless of the symmetry, there are still two asymptotically stable equilibria and one of them is arbitrarily close to the subgame-perfect equilibrium of the ultimatum game. Consequently, the symmetry argument cannot be used to justify the appropriate initial conditions in the replicator dynamics for the asymmetric ultimatum mini game.

## 4 Conclusions

We proposed an extended symmetric version of the ultimatum mini game introduced in [4]. We analyzed the global behavior of the model in both unperturbed and perturbed cases. The main insight from the analysis presented in this paper is that the mere symmetry cannot be solely responsible for a creation of the social norm supporting an equilibrium that is not subgame perfect. The main problem of the model introduced in [4] is still unsolved. It seems to us that to fully explain results of experiments one has to construct dynamics with a unique globally asymptotically stable equilibrium consistent with the observed experimental data. Also, it seems to us that any dynamics based on imitation, like the replicator dynamics, is not a suitable model of learning in the context of bargaining situations. Construction of a model based on different learning procedures with a unique globally asymptotically stable equilibrium is left for a future research.

## Footnotes

- 1.
If there is a grid with a size

*g*, then there is another subgame-perfect equilibrium at which*δ*=*g*and the offer is accepted. - 2.Consider
*η*∈(0,1). For any \(\mathbf {x}\) such that*x*_{1}+*x*_{2}+*x*_{3}=*η*we have$$\begin{aligned}\frac{d}{dt}(x_4 +x_5 + x_6) &= \dot{x}_4 +\dot{x}_5 + \dot{x}_6\\&= \frac{1}{2} (x_1+x_2+x_3-1 )\bigl(x_1^2+ (x_2+2 x_3 )x_1+ (x_2+x_3 ){}^2 \bigr)\\&\leq\frac{1}{2} ( \eta- 1 ) \frac{3}{4} \eta^2<0.\end{aligned}$$ - 3.
The interior of a limit cycle is an invariant region that is homeomorphic to a disc an thus has the Euler characteristic 1. It follows by the Poincaré–Hopf index theorem or the Lefschetz fixed-point theorem, cf. [13], that there must be a stationary point. Alternatively, it can be proved by an iterated use of the Poincaré–Bendixson theorem and a fact that a polynomial vector field can have only a finite number of limit cycles or by a direct use of the result from [9, 10].

- 4.
However interesting, such a discussion is far beyond the scope of this note and so we only hint in this direction herein. Many models assume some kind of a noise of behavior of players but we are not aware of any systematic study of errors people make, whether these errors have a uniform distribution of alternatives or if all people are similar as far as a distribution of errors is concerned.

## Notes

### Acknowledgement

J. Miękisz would like to thank Polish Ministry of Science and Higher Education for a financial support under the grant N201 023 31/2069.

### Open Access

This article is distributed under the terms of the Creative Commons Attribution License which permits any use, distribution, and reproduction in any medium, provided the original author(s) and the source are credited.

### References

- 1.Binmore K, Shaked A, Sutton J (1985) Testing noncooperative bargaining theory: a preliminary study. Am Econ Rev 75:1178–1180 Google Scholar
- 2.Bolton GE (1991) A comparative model of bargaining: theory and evidence. Am Econ Rev 81:1096–1136 Google Scholar
- 3.Forsythe R, Horowitz JL, Savin NE, Sefton M (1994) Fairness in simple bargaining experiments. Games Econ Behav 6:347–369 MATHCrossRefGoogle Scholar
- 4.Gale J, Binmore KG, Samuelson L (1995) Learning to be imperfect: the ultimatum game. Games Econ Behav 8:56–90 MathSciNetMATHCrossRefGoogle Scholar
- 5.Guth W, Schmittberger R, Schwarze B (1982) An experimental analysis of ultimatum bargaining. J Econ Behav Organ 3:367–388 CrossRefGoogle Scholar
- 6.Kahneman D, Knetsch JL, Thaler RH (1986) Fairness and the assumptions of economics. J Bus 59:S285–S300 CrossRefGoogle Scholar
- 7.Ochs J, Roth AE (1989) An experimental study of sequential bargaining. Am Econ Rev 79:355–384 Google Scholar
- 8.Prasnikar V, Roth AE (1992) Perception of fairness and consideration of strategy in bargaining: experimental data from sequential games. Q J Econ 107:865–888 MATHCrossRefGoogle Scholar
- 9.Richeson D, Wiseman J (2002) A fixed point theorem for bounded dynamical systems. Ill J Math 46:491–495 MathSciNetMATHGoogle Scholar
- 10.Richeson D, Wiseman J (2004) Addendum to “A fixed point theorem for bounded dynamical systems”. Ill J Math 48:1079–1080 MathSciNetGoogle Scholar
- 11.Roth AE (1995) Bargaining experiments. In: Kagel J, Roth AE (eds) Handbook of experimental economics. Princeton University Press, Princeton Google Scholar
- 12.Roth AE, Erev I (1995) Learning in extensive-form games: Experimental data and simple dynamic models in the intermediate term. Games Econ Behav 8:164–212 MathSciNetMATHCrossRefGoogle Scholar
- 13.Spanier EH (1966) Algebraic topology. McGraw-Hill, New York MATHGoogle Scholar
- 14.Weg E, Rapaport A, Felsenthal DS (1990) Two-person bargaining behavior in fixed discounting factors games with infinite horizon. Games Econ Behav 2:76–95 MATHCrossRefGoogle Scholar
- 15.Young HP (1993) An evolutionary model of bargaining. J Econ Theory 59:145–168 MATHCrossRefGoogle Scholar