Abstract
Before engaging in a group venture agents may require commitments from other members in the group, and based on the level of acceptance (participation) they can then decide whether it is worthwhile joining the group effort. Here, we show in the context of public goods games and using stochastic evolutionary game theory modelling, which implies imitation and mutation dynamics, that arranging prior commitments while imposing a minimal participation when interacting in groups induces agents to behave cooperatively. Our analytical and numerical results show that if the cost of arranging the commitment is sufficiently small compared to the cost of cooperation, commitment arranging behavior is frequent, leading to a high level of cooperation in the population. Moreover, an optimal participation level emerges depending both on the dilemma at stake and on the cost of arranging the commitment. Namely, the harsher the common good dilemma is, and the costlier it becomes to arrange the commitment, the more participants should explicitly commit to the agreement to ensure the success of the joint venture. Furthermore, considering that commitment deals may last for more than one encounter, we show that commitment proposers can be lenient in case of short-term agreements, yet should be strict in case of long-term interactions.
Similar content being viewed by others
Notes
For example, the Kyoto Protocol to the United Nations Framework Convention on Climate Change required ratification by at least 55 parties prior to its entry into force in February 2005. Similarly, the Montreal Protocol on Substances that Deplete the Ozone Layer required at least 11 countries to ratify it before it entered into force in 1989. While many treaties require only a subset of affected parties to ratify for entry into force, some require all parties to join. For example, the Convention for the Protection of the Marine Environment of the North-East Atlantic required accession of all negotiating parties [4].
This imitation process is equivalent to the selection in the birth–death process described above.
See Traulsen and Hauert [65] for some alternative approaches to modelling social dynamics in finite population settings.
It is known that \( 0.577215 < H_n - \log n \le 1\) [36]. Using these inequalities we provide, in Appendix, some further simplifications of the analytical formulas that include \(H_N\) which are presented throughout this results section.
“Delayed-return systems in all their variety (for almost all human societies are of this type) have basic implications for social relationships and social groupings: they depend for their effective operation on a set of ordered, differentiated, jurally-defined relationships through which crucial goods and services are transmitted. They imply binding commitments and dependencies between people” Quoted from [73].
References
Airiau, S., Sen, S., & Villatoro, D. (2014). Emergence of conventions through social learning. Autonomous Agents and Multi-Agent Systems, 28(5), 779–804.
Alvard, M. S., & Nolin, D. A. (2002). Rousseau’s whale hunt? Current Anthropology, 43(4), 533–559.
Axelrod, R., & Hamilton, W. (1981). The evolution of cooperation. Science, 211, 1390–1396.
Barrett, S. (2003). Environment and statecraft: The strategy of environmental treaty-making. Oxford: Oxford University Press.
Bloembergen, D., Tuyls, K., Hennes, D., & Kaisers, M. (2015). Evolutionary dynamics of multi-agent learning: A survey. Journal of Artificial Intelligence Research, 53, 659–697.
Castelfranchi, C., & Falcone, R. (1998). Principles of trust for MAS: Cognitive anatomy, social importance, and quantification. In Proceedings of IEEE international conference on multi agent systems (pp. 72–79).
Castelfranchi, C., & Falcone, R. (2010). Trust theory: A socio-cognitive and computational model. Wiley series in agent technology. Chichester: Wiley.
Chen, X., Sasaki, T., Brännström, Å., & Dieckmann, U. (2015). First carrot, then stick: How the adaptive hybridization of incentives promotes cooperation. Journal of The Royal Society Interface, 12(102), 20140935.
Chen, X.-P., & Komorita, S. S. (1994). The effects of communication and commitment in a public goods social dilemma. Organizational Behavior and Human Decision Processes, 60(3), 367–386.
Cherry, T. L., & McEvoy, D. M. (2013). Enforcing compliance with environmental agreements in the absence of strong institutions: An experimental analysis. Environmental and Resource Economics, 54(1), 63–77.
Duong, M. H., & Han, T. A. (2015). On the expected number of equilibria in a multi-player multi-strategy evolutionary game. Dynamic Games and Applications. doi:10.1007/s13235-015-0148-0.
Duong, M. H., & Han, T. A. (2016). Analysis of the expected density of internal equilibria in random evolutionary multi-player multi-strategy games. Journal of Mathematical Biology. doi:10.1007/s00285-016-1010-8.
Fehr, E., & Gächter, S. (2000). Cooperation and punishment in public goods experiments. American Economic Review, 90(4), 980–994.
Fudenberg, D., & Imhof, L. A. (2005). Imitation processes with small mutations. Journal of Economic Theory, 131, 251–262.
Gokhale, C. S., & Traulsen, A. (2010). Evolutionary games in the multiverse. Proceedings of the National Academy of Sciences of the United States of America, 107(12), 5500–5504.
Han, T. A. (2016). Emergence of social punishment and cooperationthrough prior commitments. In Proceedings of the conference of the American Association of Artificial Intelligence (AAAI’2016) (pp. 2494–2500), Phoenix, AZ.
Han, T. A., & Lenaerts, T. (2016). A synergy of costly punishmentand commitment in cooperation dilemmas. Adaptive Behavior. doi:10.1177/1059712316653451.
Han, T. A., Lenaerts, T., Santos, F. C., & Pereira, L. M. (2015a). Emergence of cooperation via intention recognition, commitment and apology—A research summary. AI Communications, 28(4), 709–715.
Han, T. A., Moniz Pereira, L., & Lenaerts, T. (2015b). Avoiding or restricting defectors in public goods games? Journal of the Royal Society Interface, 12(103), 20141203.
Han, T. A., Pereira, L. M., & Santos, F. C. (2011). The role of intention recognition in the evolution of cooperative behavior. In T. Walsh (Ed.), Proceedings of the 22nd international joint conference on Artificial intelligence (IJCAI’2011) (pp. 1684–1689). Menlo Park: AAAI.
Han, T. A., Pereira, L. M., & Santos, F. C. (2012a). Corpus-based intention recognition in cooperation dilemmas. Artificial Life Journal, 18(4), 365–383.
Han, T. A., Pereira, L. M., & Santos, F. C. (2012b). The emergence of commitments and cooperation. In Proceedings of the 11th international conference on autonomous agents and multiagent systems (AAMAS’2012) (pp. 559–566). New York: ACM.
Han, T. A., Pereira, L. M., Santos, F. C., & Lenaerts, T. (2013a). Good agreements make good friends. Scientific Reports, 3(2695). doi:10.1038/srep02695.
Han, T. A., Pereira, L. M., Santos, F. C., & Lenaerts, T. (2013b). Why is it so hard to say sorry: The evolution of apology with commitments in the iterated prisoner’s dilemma. In Proceedings of the 23nd international joint conference on Artificial intelligence (IJCAI’2013). Menlo Park: AAAI Press.
Han, T. A., Santos, F. C., Lenaerts, T., & Pereira, L. M. (2015c). Synergy between intention recognition and commitments in cooperation dilemmas. Scientific Reports, 5(9312). doi:10.1038/srep09312.
Han, T. A., Traulsen, A., & Gokhale, C. S. (2012c). On equilibrium properties of evolutionary multiplayer games with random payoff matrices. Theoretical Population Biology, 81(4), 264–272.
Hardin, G. (1968). The tragedy of the commons. Science, 162, 1243–1248.
Harrenstein, P., Brandt, F., & Fischer, F. (2007). Commitment and extortion. In Proceedings of the 6th international joint conference on Autonomous agents and MultiAgent systems (AAMAS ’07). New York: ACM.
Hasan, M. R., & Raja, A. (2013). Emergence of cooperation using commitments and complex network dynamics. In 2013 IEEE/WIC/ACM international joint conferences on web intelligence (WI) and intelligent agent technologies (IAT) (Vol. 2, pp. 345–352). Los Alamitos, CA: IEEE.
Hauert, C., Monte, S. D., Hofbauer, J., & Sigmund, K. (2002). Volunteering as red queen mechanism for cooperation in public goods games. Science, 296(5570), 1129. doi:10.1126/science.1070582.
Hauert, C., Traulsen, A., Brandt, H., Nowak, M. A., & Sigmund, K. (2007). Via freedom to coercion: The emergence of costly punishment. Science, 316, 1905–1907.
Hofbauer, J., & Sigmund, K. (1998). Evolutionary games and population dynamics. Cambridge: Cambridge University Press.
Hofmann, L.-M., Chakraborty, N., & Sycara, K. (2011). The evolution of cooperation in self-interested agent societies: A critical study. In The 10th international conference on autonomous agents and multiagent systems (AAMAS ’11) (pp. 685–692).
Imhof, L. A., Fudenberg, D., & Nowak, M. A. (2005). Evolutionary cycles of cooperation and defection. Proceedings of the National Academy of Sciences of the United States of America, 102, 10797–10800.
Karlin, S., & Taylor, H. E. (1975). A first course in stochastic processes. New York: Academic Press.
Knuth, D. E. (2011). The art of computer programming, Vol. 4A: Combinatorial algorithms, Part 1. Hong Kong: Pearson Education India.
Lerat, J.-S., Han, T. A., & Lenaerts, T. (2013). Evolution of common-pool resources and social welfare in structured populations. In Proceedings of the twenty-third international joint conference on artificial intelligence (pp. 2848–2854). Palo Alto, CA: AAAI Press.
Maier-Rigaud, F. P., Martinsson, P., & Staffiero, G. (2010). Ostracism and the provision of a public good: Experimental evidence. Journal of Economic Behavior & Organization, 73(3), 387–395.
Nesse, R. M. (2001). Evolution and the capacity for commitment. Russell Sage Foundation series on trust. New York: Russell Sage.
Nowak, M. A. (2006a). Evolutionary dynamics: Exploring the equations of life. Cambridge, MA: Harvard University Press.
Nowak, M. A. (2006b). Five rules for the evolution of cooperation. Science, 314(5805), 1560. doi:10.1126/science.1133755.
Nowak, M. A., Sasaki, A., Taylor, C., & Fudenberg, D. (2004). Emergence of cooperation and evolutionary stability in finite populations. Nature, 428, 646–650.
Ostrom, E. (1990). Governing the commons: The evolution of institutions for collective action. Cambridge: Cambridge University Press.
Perc, M., Gómez-Gardeñes, J., Szolnoki, A., Floría, L. M., & Moreno, Y. (2013). Evolutionary dynamics of group interactions on structured populations: A review. Journal of The Royal Society Interface, 10(80), 20120997.
Rand, D. G., Tarnita, C. E., Ohtsuki, H., & Nowak, M. A. (2013). Evolution of fairness in the one-shot anonymous ultimatum game. Proceedings of the National Academy of Sciences of the United States of America, 110, 2581–2586.
Ranjbar-Sahraei, B., Bou Ammar, H., Bloembergen, D., Tuyls, K., & Weiss, G. (2014). Evolution of cooperation in arbitrary complex networks. In Proceedings of the 2014 international conference on autonomous agents and multi-agent systems (pp. 677–684). Hakodate: International Foundation for Autonomous Agents and Multiagent Systems.
Ray, D. (2007). A game-theoretic perspective on coalition formation. Oxford: Oxford University Press.
Rendell, L., Boyd, R., Cownden, D., Enquist, M., Eriksson, K., Feldman, M. W., et al. (2010). Why copy others? Insights from the social learning strategies tournament. Science, 328(5975), 208–213.
Santos, F. C., Santos, M. D., & Pacheco, J. M. (2008). Social diversity promotes the emergence of cooperation in public goods games. Nature, 454, 214–216.
Sasaki, T., Okada, I., Uchida, S., & Chen, X. (2015). Commitment to cooperation and peer punishment: Its evolution. Games, 6(4), 574–587.
Schelling, T. C. (1990). The strategy of conflict. London: Oxford University Press.
Shehory, O., & Kraus, S. (1998). Methods for task allocation via agent coalition formation. Artificial Intelligence, 101(1), 165–200.
Shehory, O. M., Sycara, K., & Jha, S. (1998). Multi-agent coordination through coalition formation. In Intelligent agents IV agent theories, architectures, and languages (pp. 143–154). New York: Springer.
Sigmund, K. (2010). The calculus of selfishness. Princeton, NJ: Princeton University Press.
Sigmund, K., Hauert, C., & Nowak, M. (2001). Reward and punishment. Proceedings of the National Academy of Sciences of the United States of America, 98(19), 10757–10762.
Sigmund, K., Silva, H. D., Traulsen, A., & Hauert, C. (2010). Social learning promotes institutions for governing the commons. Nature, 466, 7308.
Stander, P. E. (1992). Cooperative hunting in lions: The role of the individual. Behavioral Ecology and Sociobiology, 29(6), 445–454.
Sterelny, K. (2012). The evolved apprentice. Cambridge, MA: MIT.
Sugawara, T. (2011). Emergence and stability of social conventions in conflict situations. In IJCAI (pp. 371–378).
Szolnoki, A., & Perc, M. (2010). Impact of critical mass on the evolution of cooperation in spatial public goods games. Physical Review E, 81(5), 057101.
Szolnoki, A., & Perc, M. (2012). Evolutionary advantages of adaptive rewarding. New Journal of Physics, 14(9), 093016.
Szolnoki, A., & Perc, M. (2013). Correlation of positive and negative reciprocity fails to confer an evolutionary advantage: Phase transitions to elementary strategies. Physical Review X, 3(4), 041021.
Tomasello, M. (2014). Natural history of human thinking. Cambridge, MA: Harvard University Press.
Tomasello, M., Carpenter, M., Call, J., Behne, T., & Moll, H. (2005). Understanding and sharing intentions: The origins of cultural cognition. Behavioral and Brain Sciences, 28(05), 675–691.
Traulsen, A., & Hauert, C. (2009). Stochastic evolutionary game dynamics. Reviews of Nonlinear Dynamics and Complexity, 2, 25–61.
Traulsen, A., Hauert, C., De Silva, H., Nowak, M. A., & Sigmund, K. (2009). Exploration dynamics in evolutionary games. Proceedings of the National Academy of Sciences of the United States of America, 106(3), 709–712.
Traulsen, A., & Nowak, M. A. (2006). Evolution of cooperation by multilevel selection. Proceedings of the National Academy of Sciences of the United States of America, 103(29), 10952–10955.
Traulsen, A., Nowak, M. A., & Pacheco, J. M. (2006). Stochastic dynamics of invasion and fixation. Physical Review E, 74, 11909.
Tuyls, K., & Parsons, S. (2007). What evolutionary game theory tells us about multiagent learning. Artificial Intelligence, 171(7), 406–416.
Van Segbroeck, S., Pacheco, J. M., Lenaerts, T., & Santos, F. C. (2012). Emergence of fairness in repeated group interactions. Physical Review Letters, 108(15), 158104.
West, S., Griffin, A., & Gardner, A. (2007). Evolutionary explanations for cooperation. Current Biology, 17, R661–R672.
Winikoff, M. (2007). Implementing commitment-based interactions. In Proceedings of the 6th international joint conference on Autonomous agents and multiagent systems (AAMAS ’07) (pp. 868–875). New York: ACM.
Woodburn, J. (1982). Egalitarian societies. Man, New Series, 17(3), 431–451.
Wooldridge, M., & Jennings, N. R. (1999). The cooperative problem-solving process. Journal of Logic and Computation, 9(4), 403–417.
Zisis, I., Guida, S. D., Han, T. A., Kirchsteiger, G., & Lenaerts, T. (2015). Generosity motivated by acceptance—Evolutionary analysis of an anticipation games. Scientific Reports, 5(18076). doi:10.1038/srep18076.
Acknowledgments
TAH acknowledges the support of the Teesside university URF funding (URF-11200174). TL acknowledges the support of Fondation de la Recherche Scientifique—FNRS through the grant FRFC No. 2.4614.12 and the Fonds voor Wetenschappelijk Onderzoek—FWO. through the Grant No. G.0391.13N. LMP acknowledges the support from FCT/MEC NOVA LINCS PEst UID/CEC/04516/2013.
Author information
Authors and Affiliations
Corresponding author
Appendices
Appendix 1: Some simplifications of the obtained analytical results
Here, using the well-known inequalities [36]
where \(\gamma = 0.577215\), we provide some simplifications of the conditions obtained in the main text. First of all, regarding the conditions for risk-dominance of \( COMP_F \) against D, FREE and FAKE:
They can be simplified to
Appendix 2: Risk-dominance conditions when \(N \rightarrow \infty \)
Note that the risk-dominance condition described in Sect. 3 is valid for the large population size limit (\(Z \rightarrow \infty \)). We now analyze these conditions for \(N \rightarrow \infty \). We assume that the multiplication factor r is a function of N, i.e. r(N).
From (12), if \(\log N\) grows much faster than r(N) (or using little-o notation, \(r(N) = o(\log N))\), i.e. if
then the right-hand side of the first inequality in (12) becomes 0. It implies that when \(N \rightarrow \infty \) the cost of arranging the commitment must be infinitely small so that COMP can be risk-dominant against defective strategies (namely, in this case, the FREE strategy). Hence, provided that arranging commitment is costly (\(\epsilon > 0\)), it must hold that \(r(N) \ne o(\log N)\), or, using the big omega notation,
In this case, we have
Hence, the necessary condition for this inequality to hold is that \(r(N) = \varOmega (\log N)\) and \(\epsilon \) grows at most as fast as \(\frac{r(N)}{\log N}\).
Consider now the second risk-dominance inequality
If \(\epsilon \) is a constant, clearly the right hand side becomes 0 as \(N \rightarrow \infty \), i.e. \(\delta \) can be indefinitely small while still ensuring the condition is satisfied (i.e. COMP is risk-dominant against FAKE). Let’s assume that \(\epsilon \) is a function of N. Then, the same conclusion applies if
Otherwise, i.e. if \(\epsilon (N) = \varOmega (N)\), then the inequality can be rewritten as
That is, roughly, \(\delta \) needs to grow at least as fast as \(\frac{\epsilon (N)}{N}\) when \(N \rightarrow \infty \) to guarantee risk-dominance of COMP against FAKE. We also observe that the contribution cost c does not play a role in determining the lower boundary of \(\delta \).
In short, as the group size \(N \rightarrow \infty \), the risk-dominance conditions are defined in (14) and (16). For these to hold, it is necessary that
-
1.
The multiplication factor r(N) satisfies that \(r(N) = \varOmega (\log N)\), i.e.
$$\begin{aligned} \lim _{N \rightarrow \infty } \frac{r(N)}{\log N} > 0 \end{aligned}$$ -
2.
The cost of arranging commitment \(\epsilon (N)\) grows at most as fast as \(\frac{r(N)}{\log N}\) as \(N \rightarrow \infty \)
-
3.
The compensation cost, \(\delta (N)\) grows at least as fast as \(\frac{\epsilon (N)}{N}\) when \(N \rightarrow \infty \)
Appendix 3: Results for varying group sizes
In Fig. 7, we plot the total frequency of commitment strategies for varying \(\epsilon \) and \(\delta \), and for increasing group sizes. The results show that the observations seen in the main text are robust for varying group sizes N as well as compensation cost \(\delta \). Furthermore, \(\epsilon \) is the essential parameter because as soon as \(\delta \) reaches a certain threshold, increasing it does not lead to notable improvement.
Rights and permissions
About this article
Cite this article
Han, T.A., Pereira, L.M. & Lenaerts, T. Evolution of commitment and level of participation in public goods games. Auton Agent Multi-Agent Syst 31, 561–583 (2017). https://doi.org/10.1007/s10458-016-9338-4
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10458-016-9338-4