Handbook of Dynamic Game Theory pp 595-632 | Cite as
Cooperative Differential Games with Transferable Payoffs
Abstract
In many instances, players find it individually and collectively rational to sign a long-term cooperative agreement. A major concern in such a setting is how to ensure that each player will abide by her commitment as time goes by. This will occur if each player still finds it individually rational at any intermediate instant of time to continue to implement her cooperative control rather than switch to a noncooperative control. If this condition is satisfied for all players, then we say that the agreement is time consistent. This chapter deals with the design of schemes that guarantee time consistency in deterministic differential games with transferable payoffs.
Keywords
Cooperative differential games Time consistency Strong time consistency Imputation distribution procedure Shapley value CoreReferences
- Angelova V, Bruttel LV, Güth W, Kamecke U (2013) Can subgame perfect equilibrium threats foster cooperation? An experimental test of finite-horizon folk theorems. Econ Inq 51: 1345–1356Google Scholar
- Baranova EM, Petrosjan LA (2006) Cooperative stochasyic games in stationary strategies. Game Theory Appl XI:1–7Google Scholar
- Başar T (1983) Performance bounds for hierarchical systems under partial dynamic information. J Optim Theory Appl 39:67–87Google Scholar
- Başar T (1984) Affine incentive schemes for stochastic systems with dynamic information. SIAM J Control Optim 22(2):199–210Google Scholar
- Başar T (1985) Dynamic games and incentives. In: Bagchi A, Jongen HT (eds) Systems and optimization. Lecture notes in control and information sciences, vol 66. Springer, Berlin/ New York, pp 1–13Google Scholar
- Başar T (1989) Stochastic incentive problems with partial dynamic information and multiple levels of hierarchy. Eur J Polit Econ V:203–217. (Special issue on “Economic Design”)Google Scholar
- Başar T, Olsder GJ (1980) Team-optimal closed-loop Stackelberg strategies in hierarchical control problems. Automatica 16(4):409–414Google Scholar
- Başar T, Olsder GJ (1995) Dynamic noncooperative game theory. Academic Press, New YorkGoogle Scholar
- Bauso D, Basar T (2016) Strategic thinking under social influence: scalability, stability and robustness of allocations. Eur J Control 32:1–15. https://doi.org/10.1016/j.ejcon.2016.04.006i
- Bayens E, Bitar Y, Khargonekar PP, Poolla K (2013) Coalitional aggregation of wind power. IEEE Trans Power Syst 28(4):3774–3784Google Scholar
- Benoit JP, Krishna V (1985) Finitely repeated games. Econometrica 53(4):905–922Google Scholar
- Boukas EK, Haurie A, Michel P (1990) An optimal control problem with a random stopping time. J Optim Theory Appl 64(3):471–480Google Scholar
- Breton M, Sokri A, Zaccour G (2008) Incentive equilibrium in an overlapping-generations environmental game. Eur J Oper Res 185:687–699Google Scholar
- Buratto A, Zaccour G (2009) Coordination of advertising strategies in a fashion licensing contract. J Optim Theory Appl 142:31–53Google Scholar
- Cansever DH, Başar T (1985) Optimum/near optimum incentive policies for stochastic decision problems involving parametric uncertainty. Automatica 21(5):575–584Google Scholar
- Chander P, Tulkens H (1997) The core of an economy with multilateral environmental externalities. Int J Game Theory 26:379–401Google Scholar
- Chang FR (2004) Stochastic optimization in continuous time. Cambridge University Press, CambridgeGoogle Scholar
- Chiarella C, Kemp MC, Long NV, Okuguchi K (1984) On the economics of international fisheries. Int Econ Rev 25:85–92Google Scholar
- De Frutos J, Martín-Herrán G (2015) Does flexibility facilitate sustainability of cooperation over time? A case study from environmental economics. J Optim Theory Appl 165:657–677Google Scholar
- De Giovanni P, Reddy PV, Zaccour G (2016) Incentive strategies for an optimal recovery program in a closed-loop supply chain. Eur J Oper Res 249:605–617Google Scholar
- Dockner EJ, Jorgensen S, Van Long N, Sorger G (2000) Differential games in economics and management science. Cambridge University Press, CambridgeGoogle Scholar
- Dutta PK (1995) A folk theorem for stochastic games. J Econ Theory 66:1–32Google Scholar
- Ehtamo H, Hämäläinen RP (1986) On affine incentives for dynamic decision problems. In: Basar T (ed) Dynamic games and applications in economics. Springer, Berlin, pp 47–63Google Scholar
- Ehtamo H, Hämäläinen RP (1989) Incentive strategies and equilibria for dynamic games with delayed information. J Optim Theory Appl 63:355–370Google Scholar
- Ehtamo H, Hämäläinen RP (1993) A cooperative incentive equilibrium for a resource management problem. J Econ Dyn Control 17:659–678Google Scholar
- Engwerda J (2005) Linear-quadratic dynamic optimization and differential games. Wiley, New YorkGoogle Scholar
- Eswaran M, Lewis T (1986) Collusive behaviour in finite repeated games with bonding. Econ Lett 20:213–216Google Scholar
- Flesch J, Kuipers J, Mashiah-Yaakovi A, Shmaya E, Shoenmakers G, Solan E, Vrieze K (2014) Nonexistene of subgame-perfect-equilibrium in perfect information games with infinite horizon. Int J Game Theory 43:945–951Google Scholar
- Flesch J, Predtetchinski A (2015) On refinements of subgame perfect ε-equilibrium. Int J Game Theory. https://doi.org/10.1007/s00182-015-0468-8
- Friedman JW (1986) Game theory with applications to economics. Oxford University Press, OxfordGoogle Scholar
- Gao L, Jakubowski A, Klompstra MB, Olsder GJ (1989) Time-dependent cooperation in games. In: Başar TS, Bernhard P (eds) Differential games and applications. Springer, BerlinGoogle Scholar
- Gillies DB (1953) Some theorems on N-person games. Ph.D. Thesis, Princeton UniversityGoogle Scholar
- Gromov D, Gromova E (2014) Differential games with random duration: a hybrid systems formulation. Contrib Game Theory Manag 7:104–119Google Scholar
- Gromov D, Gromova E (2016) On a class of hybrid differential games. Dyn Games Appl. https://doi.org/10.1007/s13235-016-0185-3
- Gromova EV, Lopez-Barrientos JD (2015) A differential game model for the extraction of non-renewable resources with random initial times. Contrib Game Theory Manag 8:58–63Google Scholar
- Haurie A (1976) A note on nonzero-sum differential games with bargaining solution. J Optim Theory Appl 18:31–39Google Scholar
- Haurie A (2005) A multigenerational game model to analyze sustainable development. Ann Oper Res 137(1):369–386Google Scholar
- Haurie A, Krawczyk JB, Roche M (1994) Monitoring cooperative equilibria in a stochastic differential game. J Optim Theory Appl 81:79–95Google Scholar
- Haurie A, Krawczyk JB, Zaccour G (2012) Games and dynamic games. Scientific World, SingaporeGoogle Scholar
- Haurie A, Pohjola M (1987) Efficient equilibria in a differential game of capitalism. J Econ Dyn Control 11:65–78Google Scholar
- Haurie A, Tolwinski B (1985) Definition and properties of cooperative equilibria in a two-player game of infinite duration. J Optim Theory Appl 46(4):525–534Google Scholar
- Haurie A, Zaccour G (1986) A differential game model of power exchange between interconnected utilities. In: Proceedings of the 25th IEEE conference on decision and control, Athens, pp 262–266Google Scholar
- Haurie A, Zaccour G (1991) A game programming approach to efficient management of interconnected power networks. In: Hämäläinen RP, Ehtamo H (eds) Differential games – developments in modelling and computation. Springer, BerlinGoogle Scholar
- Jørgensen S, Martín-Herrán G, Zaccour G (2003) Agreeability and time-consistency in linear-state differential games. J Optim Theory Appl 119:49–63Google Scholar
- Jørgensen S, Martín-Herrán G, Zaccour G (2005) Sustainability of cooperation overtime in linear-quadratic differential game. Int Game Theory Rev 7:395–406Google Scholar
- Jørgensen S, Zaccour G (2001) Time consistent side payments in a dynamic game of downstream pollution. J Econ Dyn Control 25:1973–1987Google Scholar
- Jørgensen S, Zaccour G (2002a) Time consistency in cooperative differential game. In: Zaccour G (ed) Decision and control in management science: in honor of professor Alain Haurie. Kluwer, Boston, pp 349–366Google Scholar
- Jørgensen S, Zaccour G (2002b) Channel coordination over time: incentive equilibria and credibility. J Econ Dyn Control 27:801–822Google Scholar
- Kaitala V, Pohjola M (1990) Economic development and agreeable redistribution in capitalism: efficient game equilibria in a two-class neoclassical growth model. Int Econ Rev 31:421–437Google Scholar
- Kaitala V, Pohjola M (1995) Sustainable international agreements on greenhouse warming: a game theory study. Ann Int Soc Dyn Games 2:67–87Google Scholar
- Kostyunin S, Palestini A, Shevkoplyas E (2014) On a nonrenewable resource extraction game played by asymmetric firms. J Optim Theory Appl 163(2):660–673Google Scholar
- Kostyunin SY, Shevkoplyas EV (2011) On the simplification of the integral payoff in differential games with random duration. Vestnik St Petersburg Univ Ser 10(4):47–56Google Scholar
- Kozlovskaya NV, Petrosyan LA, Zenkevich NA (2010) Coalitional solution of a game-theoretic emission reduction model. Int Game Theory Rev 12(3):275–286Google Scholar
- Lehrer E, Scarsini M (2013) On the core of dynamic cooperative games. Dyn Games Appl 3: 359–373Google Scholar
- Mailath GJ, Postlewaite A, Samuelson L (2005) Contemporaneous perfect epsilon-equilibria. Games Econ Behav 53:126–140Google Scholar
- Marín-Solano J, Shevkoplyas EV (2011) Non-constant discounting and differential games with random time horizon. Automatica 47(12):2626–2638Google Scholar
- Martín-Herrán G, Rincón-Zapatero JP (2005) Efficient Markov perfect Nash equilibria: theory and application to dynamic fishery games. J Econ Dyn Control 29:1073–1096Google Scholar
- Martín-Herrán G, Taboubi S, Zaccour G (2005) A time-consistent open-loop Stackelberg equilibrium of shelf-space allocation. Automatica 41:971–982Google Scholar
- Martín-Herrán G, Zaccour G (2005) Credibility of incentive equilibrium strategies in linear-state differential games. J Optim Theory Appl 126:1–23Google Scholar
- Martín-Herrán G, Zaccour G (2009) Credible linear-incentive equilibrium strategies in linear-quadratic differential games. Advances in dynamic games and their applications. Ann Int Soci Dyn Games 10:1–31Google Scholar
- Opathella C, Venkatesh B (2013) Managing uncertainty of wind energy with wind generators cooperative. IEEE Trans Power Syst 28(3):2918–2928Google Scholar
- Ordeshook PC (1986) Game theory and political theory. Cambridge University Press, Cambridge, UKGoogle Scholar
- Osborne MJ, Rubinstein A (1994) A course in game theory. MIT Press, Cambridge, MAGoogle Scholar
- Parilina E (2014) Strategic stability of one-point optimality principles in cooperative stochastic games. Math Game Theory Appl 6(1):56–72 (in Russian)Google Scholar
- Parilina EM (2015) Stable cooperation in stochastic games. Autom Remote Control 76(6): 1111–1122Google Scholar
- Parilina E, Zaccour G (2015a) Approximated cooperative equilibria for games played over event trees. Oper Res Lett 43:507–513Google Scholar
- Parilina E, Zaccour G (2015b) Node-consistent core for games played over event trees. Automatica 55:304–311Google Scholar
- Petrosyan LA (1977) Stability of solutions of differential games with many participants. Vestnik Leningrad State Univ Ser 1 4(19):46–52Google Scholar
- Petrosyan LA (1993) Strongly time-consistent differential optimality principles. Vestnik St Petersburg Univ Ser 1 4:35–40Google Scholar
- Petrosyan LA (1995) Characteristic function of cooperative differential games. Vestnik St Petersburg Univ Ser 1 1:48–52Google Scholar
- Petrosyan LA, Baranova EM, Shevkoplyas EV (2004) Multistage cooperative games with random duration, mathematical control theory, differential games. Trudy Inst Mat i Mekh UrO RAN 10(2):116–130 (in Russian)Google Scholar
- Petrosjan L, Danilov NN (1979) Stability of solutions in nonzero sum differential games with transferable payoffs. J Leningrad Univ N1:52–59 (in Russian)Google Scholar
- Petrosjan L, Danilov NN (1982) Cooperative differential games and their applications. Tomsk University Press, TomskGoogle Scholar
- Petrosjan L, Danilov NN (1986) Classification of dynamically stable solutions in cooperative differential games. Isvestia of high school 7:24–35 (in Russian)Google Scholar
- Petrosyan LA, Gromova EV (2014) Two-level cooperation in coalitional differential games. Trudy Inst Mat i Mekh UrO RAN 20(3):193–203Google Scholar
- Petrosjan LA, Mamkina SI (2006) Dynamic games with coalitional structures. Int Game Theory Rev 8(2):295–307Google Scholar
- Petrosjan LA, Murzov NV (1966) Game-theoretic problems of mechanics. Litovsk Mat Sb 6:423–433 (in Russian)Google Scholar
- Petrosyan LA, Shevkoplyas EV (2000) Cooperative differential games with random duration Vestnik Sankt-Peterburgskogo Universiteta. Ser 1. Matematika Mekhanika Astronomiya 4: 18–23Google Scholar
- Petrosyan LA, Shevkoplyas EV (2003) Cooperative solutions for games with random duration. Game theory and applications, vol IX. Nova Science Publishers, New York, pp 125–139Google Scholar
- Petrosjan L, Zaccour G (2003) Time-consistent Shapley value of pollution cost reduction. J Econ Dyn Control 27:381–398Google Scholar
- Petrosjan L, Zenkevich NA (1996) Game theory. World Scientific, SingaporeGoogle Scholar
- Radner R (1980) Collusive behavior in noncooperative epsilon-equilibria of oligopolies with long but finite lives. J Econ Theory 22:136–154Google Scholar
- Reddy PV, Shevkoplyas E, Zaccour G (2013) Time-consistent Shapley value for games played over event trees. Automatica 49(6):1521–1527Google Scholar
- Reddy PV, Zaccour G (2016) A friendly computable characteristic function. Math Soc Sci 82: 18–25Google Scholar
- Rincón-Zapatero JP, Martín-Herrán G, Martinez J (2000) Identification of efficient Subgame-perfect Nash equilibria in a class of differential games. J Optim Theory Appl 104:235–242Google Scholar
- Saad W, Han Z, Debbah M, Hjorungnes A, Başar T (2009) Coalitional game theory for communication networks [A tutorial]. IEEE Signal Process Mag Spec Issue Game Theory 26(5):77–97Google Scholar
- Saad W, Han Z, Zheng R, Hjorungnes A, Başar T, Poor HV (2012) Coalitional games in partition form for joint spectrum sensing and access in cognitive radio networks. IEEE J Sel Top Sign Process 6(2):195–209Google Scholar
- Shevkoplyas EV (2009) The Hamilton-Jacobi-Bellman equation for differential games with random duration. Upravlenie bolshimi systemami 26.1, M.:IPU RAN, pp 385–408 (in Russian)Google Scholar
- Shevkoplyas EV (2011) The Shapley value in cooperative differential games with random duration. In: Breton M, Szajowski K (eds) Advances in dynamic games. Ann Int Soci Dyn Games 11(part4):359–373Google Scholar
- Tolwinski B, Haurie A, Leitmann G (1986) Cooperative equilibria in differential games. J Math Anal Appl 119:182–202Google Scholar
- Von Neumann J, Morgenstern O (1944) Theory of games and economic behavior. Princeton University Press, PrincetonGoogle Scholar
- Wrzaczek S, Shevkoplyas E, Kostyunin S (2014) A differential game of pollution control with overlapping generations. Int Game Theory Rev 16(3):1450005–1450019Google Scholar
- Yeung DWK, Petrosjan L (2001) Proportional time-consistent solutions in differential games. In: Proceedings of international conference on logic, game theory and applications, St. Petersburg, pp 254–256Google Scholar
- Yeung DWK, Petrosjan L (2004) Subgame consistent cooperative solutions in stochastic differential games. J Optim Theory Appl 120:651–666MathSciNetCrossRefzbMATHGoogle Scholar
- Yeung DWK, Petrosjan L (2005a) Cooperative stochastic differential games. Springer, New YorkGoogle Scholar
- Yeung DWK, Petrosjan L (2005b) Consistent solution of a cooperative stochastic differential game with nontransferable payoffs. J Optim Theory Appl 124:701–724MathSciNetCrossRefzbMATHGoogle Scholar
- Yeung DWK, Petrosjan L (2006) Dynamically stable corporate joint ventures. Automatica 42: 365–370MathSciNetCrossRefzbMATHGoogle Scholar
- Yeung DWK, Petrosjan L, Yeung PM (2007) Subgame consistent solutions for a class of cooperative stochastic differential games with nontransferable payoffs. Ann Int Soc Dyn Games 9:153–170MathSciNetCrossRefzbMATHGoogle Scholar
- Yeung DWK (2006) An irrational-behavior-proof condition in cooperative differential games. Int Game Theory Rev 8(4):739–744MathSciNetCrossRefzbMATHGoogle Scholar
- Yeung DWK, Petrosyan LA (2012) Subgame consistent economic optimization. Birkhauser, New YorkCrossRefzbMATHGoogle Scholar
- Zaccour G (2003) Computation of characteristic function values for linear-state differential games. J Optim Theory Appl 117(1):183–194MathSciNetCrossRefzbMATHGoogle Scholar
- Zaccour G (2008) Time consistency in cooperative differential games: a tutorial. INFOR 46(1): 81–92MathSciNetGoogle Scholar
- Zhang B, Johari R, Rajagopal R (2015) Competition and coalition formation of renewable power producers. IEEE Trans Power Syst 30(3):1624–1632CrossRefGoogle Scholar
- Zheng YP, Başar T, Cruz JB (1982) Incentive Stackelberg strategies for deterministic multi-stage decision processes. IEEE Trans Syst Man Cybern SMC-14(1):10–20CrossRefGoogle Scholar