Abstract
The paper studies partially observed optimal control problems of general McKean–Vlasov differential equations, in which the coefficients depend on the state of the solution process as well as of its law and the control variable. By applying Girsanov’s theorem with a standard variational technique, we establish a stochastic maximum principle on the assumption that the control domain is convex. As an application, partially observed linear-quadratic control problem is discussed.
Similar content being viewed by others
References
Bensoussan, A.: Maximum principle and dynamic programming approaches of the optimal control of partially observed diffusions. Stoch. Int. J. Probab. Stoch. Process. 9(3), 169–222 (1983)
Boyce, W.E., DiPrima, R.C.: Elementary Differential Equations and Bondary Value Problems, 7th edn. Wiley, Hoboken (2001)
Buckdahn, R., Li, J., Ma, J.: A stochastic maximum principle for general mean-field systems. Appl. Math. Optim. 74(3), 507–534 (2016)
Carmona, R., Delarue, F.: Forward–backward stochastic differential equations and controlled McKean–Vlasov dynamics. Ann. Probab. 43(5), 2647–2700 (2015)
Cardaliaguet, P.: Notes on Mean Field Games (from P.-L. Lions’ lectures at Collège de France). https://www.ceremade.dauphine.fr/~cardalia/ (2013)
Djehiche, B., Tembine, H.: Risk-Sensitive Mean-Field Type Control Under Partial Observation. Stochastics of Environmental and Financial Economics, pp. 243–263. Springer, Cham (2016)
Fleming, W.H.: Optimal control of partially observable diffusions. SIAM J. Control 6(2), 194–214 (1968)
Hafayed, M., Boukaf, S., Shi, Y., Meherrem, S.: A McKean–Vlasov optimal mixed regular-singular control problem for nonlinear stochastic systems with Poisson jump processes. Neurocomputing 182, 133–144 (2016)
Hafayed, M., Meherrem, S., Eren, Ş., Guçoglu, D.H.: On optimal singular control problem for general Mckean–Vlasov differential equations: necessary and sufficient optimality conditions. Optim. Control Appl. Methods 39(3), 1202–1219 (2018)
Kac, M.: Foundations of Kinetic Theory, pp. 171–197. University of California Press, California (1956)
Liptser, R.S., Shiryayev, A.N.: Statistics of Random Process. Springer, New York (1977)
McKean, J.R.H.: A class of Markov processes associated with nonlinear parabolic equations. Proc. Natl. Acad. Sci. USA. 56(6), 1907 (1966)
Meherrem, S., Hafayed, M.: Maximum principle for optimal control of McKean–Vlasov FBSDEs with Lévy process via the differentiability with respect to probability law. Optim. Control Appl. Methods 40(3), 499–516 (2019)
Shi, J., Wu, Z.: Maximum principle for partially-observed optimal control of fully-coupled forward–backward stochastic systems. J. Optim. Theory Appl. 145(3), 543–578 (2010)
Tang, M., Meng, Q.X.: Maximum principle for partial observed zero-sum stochastic differential game of mean-field SDEs. IEEE, pp. 1868–1875 (2017)
Wang, G., Wu, Z.: General maximum principles for partially observed risk-sensitive optimal control problems and applications to finance. J. Optim. Theory Appl. 141(3), 677–700 (2009)
Wang, H., Wu, Z.: Partially observed time-inconsistency recursive optimization problem and application. J. Optim. Theory Appl. 161(2), 664–687 (2014)
Wang, G., Wu, Z., Zhang, C.: Maximum principles for partially observed mean-field stochastic systems with application to financial engineering. IEEE, pp. 5357–5362 (2014)
Wu, Z.: A maximum principle for partially observed optimal control of forward–backward stochastic control systems. Sci. China Inf. Sci. 53(11), 2205–2214 (2010)
Wu, Z., Zhuang, Y.: Partially observed time-inconsistent stochastic linear-quadratic control with random jumps. Optim. Control Appl. Methods 39(1), 230–247 (2018)
Zhou, X.Y.: On the necessary conditions of optimal controls for stochastic partial differential equations. SIAM J. Control Optim. 31(6), 1462–1478 (1993)
Acknowledgements
The authors would like to thank the editor and anonymous referees for their constructive corrections and valuable suggestions that improved the manuscript considerably. The first author was supported by Algerian PRFU project Grant C00L03UN070120190003. The second and third authors were supported by Algerian PRFU project Grant C00L03UN070120180003.
Author information
Authors and Affiliations
Corresponding author
Additional information
Communicated by Sohrab Effati.
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Lakhdari, I.E., Miloudi, H. & Hafayed, M. Stochastic Maximum Principle for Partially Observed Optimal Control Problems of General McKean–Vlasov Differential Equations. Bull. Iran. Math. Soc. 47, 1021–1043 (2021). https://doi.org/10.1007/s41980-020-00426-1
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s41980-020-00426-1
Keywords
- Stochastic maximum principle
- Partially observed optimal control
- McKean–Vlasov differential equations
- Probability measure
- Derivative with respect to measures