Abstract
This paper is concerned with linear quadratic optimal control problems for mean-field backward stochastic differential equations (MF-BSDEs, for short) with deterministic coefficients. The optimality system, which is a linear mean-field forward–backward stochastic differential equation with constraint, is obtained by a variational method. By decoupling the optimality system, two coupled Riccati equations and an MF-BSDE are derived. It turns out that the coupled two Riccati equations are uniquely solvable. Then a complete and explicit representation is obtained for the optimal control.
Similar content being viewed by others
References
Ait Rami, M., Moore, J.B., Zhou, X.Y.: Indefinite stochastic linear quadratic control and generalized differential Riccati equation. SIAM J. Control Optim. 40, 1296–1311 (2001)
Andersson, D., Djehiche, B.: A maximum principle for SDEs of mean-field type. Appl. Math. Optim. 63, 341–356 (2011)
Bensoussan, A., Sung, K.C.J., Yam, S.C.P.: Linear-quadratic time-inconsistent mean field games. Dyn. Games Appl. 3, 537–552 (2013)
Bensoussan, A., Sung, K.C.J., Yam, S.C.P., Yung, S.P.: Linear-quadratic mean field games. J. Optim. Theory Appl. 169, 496–529 (2016)
Borkar, V.S., Kumar, K.S.: McKean–Vlasov limit in portfolio optimization. Stoch. Anal. Appl. 28, 884–906 (2010)
Buckdahn, R., Djehiche, B., Li, J., Peng, S.: Mean-field backward stochastic differential equations: a limit approach. Ann. Probab. 37, 1524–1565 (2009)
Buckdahn, R., Li, J., Peng, S.: Mean-field backward stochastic differential equations and related partial differential equations. Stoch. Process. Appl. 119, 3133–3154 (2009)
Buckdahn, R., Djehiche, B., Li, J.: A general stochastic maximum principle for SDEs of mean-field type. Appl. Math. Optim. 64, 197–216 (2011)
Carmona, R., Delarue, F.: Forward–backward stochastic differential equations and controlled McKean–Vlasov dynamics. Ann. Probab. 43, 2647–2700 (2015)
Carmona, R., Delarue, F.: Probabilistic theory of mean field games with applications I: mean field FBSDEs, control, and games. Springer, Berlin (2017)
Carmona, R., Delarue, F., Lachapelle, A.: Control of McKean–Vlasov dynamics versus mean field games. Math. Financ. Econ. 7, 131–166 (2013)
Chan, T.: Dynamics of the McKean–Vlasov equation. Ann. Probab. 22, 431–441 (1994)
Chen, S., Li, X., Zhou, X.Y.: Stochastic linear quadratic regulators with indefinite control weight costs. SIAM J. Control Optim. 36, 1685–1702 (1998)
Crisan, D., Xiong, J.: Approximate McKean–Vlasov representations for a class of SPDEs. Stochastics 82, 53–68 (2010)
Dawson, D.A.: Critical dynamics and fluctuations for a mean-field model of cooperative behavior. J. Stat. Phys. 31, 29–85 (1983)
Graber, P.J.: Linear quadratic mean field type control and mean field games with common noise, with application to production of an exhaustible resource. Appl. Math. Optim. 74, 459–486 (2016)
Huang, M., Malhamé, R.P., Caines, P.E.: Large population stochastic dynamic games: closed-loop McKean–Vlasov systems and the Nash certainty equivalence principle. Commun. Inf. Syst. 6, 221–252 (2006)
Huang, M., Caines, P.E., Malhamé, R.P.: Large-population cost-coupled LQG problems with nonuniform agents: individual-mass behavior and decentralized \(\varepsilon \)-Nash equilibria. IEEE Trans. Autom. Control 52, 1560–1571 (2007)
Huang, M., Caines, P.E., Malhamé, R.P.: Social optima in mean field LQG control: centralized and decentralized strategies. IEEE Trans. Autom. Control 57, 1736–1751 (2012)
Huang, J., Li, X., Yong, J.: A linear-quadratic optimal control problem for mean-field stochastic differential equations in infinite horizon. Math. Control Relat. Fields 5, 97–139 (2015)
Kac, M.: Foundations of kinetic theory. In: Proceedings of the 3rd Berkeley Symposium on Mathematical Statistics and Probability, vol. 3, pp. 171–197 (1956)
Lasry, J.-M., Lions, P.-L.: Mean field games. Jpn. J. Math. 2, 229–260 (2007)
Li, X., Sun, J., Yong, J.: Mean-field stochastic linear quadratic optimal control problems: closed-loop solvability. Probab. Uncertain. Quant. Risk 1, 2 (2016). https://doi.org/10.1186/s41546-016-0002-3
Lim, A.E.B., Zhou, X.Y.: Linear-quadratic control of backward stochastic differential equations. SIAM J. Control Optim. 40, 450–474 (2001)
Ma, J., Yong, J.: Forward–backward stochastic differential equations and their applications. Lecture Notes in Mathematics, vol. 1702. Springer, New York (1999)
Ma, J., Protter, P., Yong, J.: Solving forward–backward stochastic differential equations explicitly: a four-step scheme. Probab. Theory Relat. Fields 98, 339–359 (1994)
McKean, H.P.: A class of Markov processes associated with nonlinear parabolic equations. Proc. Natl. Acad. Sci. USA 56, 1907–1911 (1966)
Meyer-Brandis, T., Oksendal, B., Zhou, X.Y.: A mean-field stochastic maximum principle via Malliavin calculus. Stochastics 84, 643–666 (2012)
Pham, H.: Linear quadratic optimal control of conditional McKean–Vlasov equation with random coefficients and applications. Probab. Uncertain. Quant. Risk 1, 7 (2016)
Sun, J.: Mean-field stochastic linear quadratic optimal control problems: open-loop solvabilities. ESIAM: COCV. 23, 1099–1127 (2017)
Sun, J., Yong, J.: Linear quadratic stochastic differential games: open-loop and closed-loop saddle points. SIAM J. Control Optim. 52, 4082–4121 (2014)
Sun, J., Li, X., Yong, J.: Open-loop and closed-loop solvabilities for stochastic linear quadratic optimal control problems. SIAM J. Control Optim. 54, 2274–2308 (2016)
Tang, S.: General linear quadratic optimal stochastic control problems with random coefficients: linear stochastic Hamilton systems and backward stochastic Riccati equations. SIAM J. Control Optim. 42, 53–75 (2003)
Wonham, W.M.: On a matrix Riccati equation of stochastic control. SIAM J. Control 6, 681–697 (1968)
Yong, J.: Linear-quadratic optimal control problems for mean-field stochastic differential equations. SIAM J. Control Optim. 51, 2809–2838 (2013)
Yong, J.: Linear-quadratic optimal control problems for mean-field stochastic differential equations—time-consistent solutions. Trans. AMS 51(4), 2809–2838 (2015)
Yong, J., Zhou, X.Y.: Stochastic controls: hamiltonian systems and HJB equations. Springer, New York (1999)
Acknowledgements
Xun Li was partially supported by Hong Kong RGC under Grants 15209614, 15224215 and 15255416. Jingrui Sun was partially supported by the National Natural Science Foundation of China (11401556) and the Fundamental Research Funds for the Central Universities (WK 2040000012). Jie Xiong acknowledges the financial support from FDCT 025/2016/A1. The authors would like to thank the anonymous referees for their suggestive comments, which lead to an improvement of the paper.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Li, X., Sun, J. & Xiong, J. Linear Quadratic Optimal Control Problems for Mean-Field Backward Stochastic Differential Equations. Appl Math Optim 80, 223–250 (2019). https://doi.org/10.1007/s00245-017-9464-7
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00245-017-9464-7
Keywords
- Linear quadratic optimal control
- Mean-field backward stochastic differential equation
- Riccati equation
- Optimality system
- Decoupling