Advertisement

Introduction

  • Guangchen Wang
  • Zhen Wu
  • Jie Xiong
Chapter
Part of the SpringerBriefs in Mathematics book series (BRIEFSMATH)

Abstract

Stochastic optimal control with incomplete information is composed of filtering and control. The filtering part is related to two stochastic processes: signal and observation. The signal process is what we want to estimate based on the observation which provides the information we can use. Kalman–Bucy filtering is the most successful result in linear filtering theory, which was obtained by Kalman and Bucy [38]. Nonlinear filtering is much more difficult to study. There have been two essentially different approaches so far. One is based on the innovation process, an observable Brownian motion, with the martingale representation theorem. This theory achieved its culmination with the celebrated paper of Fujisaki et al. [25]. See also Liptser and Shiryayev [49] and Kallianpur [36] for a systematic account of this approach. Another approach was introduced by Duncan [18], Mortensen [56], and Zakai [112] independently, who derived a linear stochastic partial differential equation (SPDE) satisfied by the unnormalized conditional density function of the signal. This SPDE is called the Duncan–Mortensen–Zakai equation, or, simply, Zakai’s equation. Unlike the Kalman–Bucy filtering, nonlinear filtering results in infinite-dimensional stochastic processes, whose analytical solutions are rarely available in general. Much effort has been devoted to finding finite-dimensional filters and numerical schemes. See, e.g., Benes̆ [5], Wonham [98], Xiong [104], and Bain and Crisan [2] for the development of this aspect.

References

  1. 2.
    Bain, A., Crisan, D.: Fundamentals of Stochastic Filtering. Springer, New York (2009)CrossRefGoogle Scholar
  2. 5.
    Benes̆, V.E.: Exact finite dimensional filters for certain diffusions with nonlinear drift. Stochastics 5, 65–92 (1985)Google Scholar
  3. 6.
    Bensoussan, A.: Stochastic Control of Partially Observable Systems. Cambridge University Press, Cambridge (1992)CrossRefGoogle Scholar
  4. 12.
    Boswijk, H., Hommes, C., Manzan, S.: Behavioral heterogeneity in stock prices. J. Econ. Dyn. Control 31, 1938–1970 (2007)MathSciNetCrossRefGoogle Scholar
  5. 15.
    Davis, M.H.A.: The separation principle in stochastic control via Girsanov solutions. SIAM J. Control Optim. 14, 176–188 (1976)MathSciNetCrossRefGoogle Scholar
  6. 18.
    Duncan, T.: Doctoral Dissertation. Dept. of Electrical Engineering, Stanford University (1967)Google Scholar
  7. 23.
    Föllmer, H., Schied, A.: Convex measures of risk and trading constraints. Finance Stoch. 6, 429–447 (2002)MathSciNetCrossRefGoogle Scholar
  8. 24.
    Frittelli, M., Rosazza-Gianin, E.: Putting order in risk measures J. Bank. Finance 26, 1473–1486 (2002)CrossRefGoogle Scholar
  9. 25.
    Fujisaki, M., Kallianpur, G., Kunita, H.: Stochastic differential equations for the nonlinear filtering problem. Osaka J. Math. 9, 19–40 (1972)MathSciNetzbMATHGoogle Scholar
  10. 26.
    Hu, M.: Stochastic global maximum principle for optimization with recursive utilities. Probab. Uncertain. Quant. Risk 2, 1–20 (2017)MathSciNetCrossRefGoogle Scholar
  11. 27.
    Hu, Y., Øksendal, B.: Partial information linear quadratic control for jump diffusions. SIAM J. Control Optim. 47, 1744–1761 (2008)MathSciNetCrossRefGoogle Scholar
  12. 28.
    Hu, Y., Peng, S.: Solution of forward-backward stochastic differential equations. Probab. Theory Rel. Fields 103, 273–283 (1995)MathSciNetCrossRefGoogle Scholar
  13. 29.
    Huang, J., Shi, J.: Maximum principle for optimal control of fully coupled forward-backward stochastic differential delayed equations. ESAIM Control Optim. Calc. Var. 18, 1073–1096 (2012)MathSciNetCrossRefGoogle Scholar
  14. 31.
    Huang, J., Wang, G., Xiong, J.: A maximum principle for partial information backward stochastic control problems with applications. SIAM J. Control Optim. 48, 2106–2117 (2009)MathSciNetCrossRefGoogle Scholar
  15. 32.
    Ji, S., Wei, Q.: A maximum principle for fully coupled forward-backward stochastic control systems with terminal state constraints. J. Math. Anal. Appl. 407, 200–210 (2013)MathSciNetCrossRefGoogle Scholar
  16. 33.
    Joseph, D.P., Tou, T.J.: On linear control theory. Trans. Am. Inst. Electr. Eng. Part II Appl. Ind. 80, 193–196 (1961)Google Scholar
  17. 36.
    Kallianpur, G.: Stochastic Filtering Theory. Springer, New York (1980)CrossRefGoogle Scholar
  18. 38.
    Kalman, R.E., Bucy, R.S.: New results in linear filtering and prediction theory. Trans. ASME Ser. D (J. Basic Eng. ASME) 83, 95–108 (1961)MathSciNetCrossRefGoogle Scholar
  19. 39.
    Kalman, R.E., Koepcke, R.W.: Optimal synthesis of linear sampling control systems using generalized performance indexes. Trans. ASME 80, 1820–1826 (1958)Google Scholar
  20. 43.
    Lakner, P.: Optimal trading strategy for an investor: the case of partial information. Stoch. Proc. Appl. 76, 77–97 (1998)MathSciNetCrossRefGoogle Scholar
  21. 45.
    Li, X., Tang, S.: General necessary conditions for partially observed optimal stochastic controls. J. Appl. Prob. 32, 1118–1137 (1995)MathSciNetCrossRefGoogle Scholar
  22. 46.
    Li, J., Wei, Q.: Optimal control problems of fully coupled FBSDEs and viscosity solutions of Hamilton-Jacobi-Bellman equations. SIAM J. Control Optim. 52, 1622–1662 (2014)MathSciNetCrossRefGoogle Scholar
  23. 48.
    Lim, A.E.B., Zhou, X.: Linear-quadratic control of backward stochastic differential equations. SIAM J. Control Optim. 40, 450–474 (2001)MathSciNetCrossRefGoogle Scholar
  24. 49.
    Liptser, R.S., Shiryayev, A.N.: Statistics of Random Processes. Springer, New York (1977)CrossRefGoogle Scholar
  25. 51.
    Ma, J., Wu, Z., Zhang, D., Zhang, J.: On well-posedness of forward-backward SDEs–a unified approach. Ann. Appl. Probab. 25, 2168–2214 (2015)MathSciNetCrossRefGoogle Scholar
  26. 52.
    Ma, J., Yong, J.: Forward-Backward Stochastic Differential Equations and Their Applications. Lecture Notes in Mathematics, vol. 1702. Springer, New York (1999)Google Scholar
  27. 54.
    Meng, Q.: Maximum principle for optimal control problem of fully coupled forward-backward stochastic systems with partial information. Sci. China Ser. A Math. 52, 1579–1588 (2009)MathSciNetCrossRefGoogle Scholar
  28. 55.
    Menaldi, J.L.: The separation principle for impulse control problems. Proc. Am. Math. Soc. 82, 439–445 (1981)MathSciNetCrossRefGoogle Scholar
  29. 56.
    Mortensen, R.E.: Doctoral Dissertation. Dept. of Electrical Engineering. University of California at Berkeley (1966)Google Scholar
  30. 57.
    Nagai, H., Peng, S.: Risk-sensitive dynamic portfolio optimization with partial information on infinite time horizon. Ann. Appl. Probab. 12, 173–195 (2002)MathSciNetCrossRefGoogle Scholar
  31. 59.
    Norberg, R.: Ruin problems with assets and liabilities of diffusion type. Stoch. Proc. Appl. 81, 255–269 (1999)MathSciNetCrossRefGoogle Scholar
  32. 61.
    Økesandal, B., Sulem, A.: Maximum principle for optimal control of stochastic differential equations with applications. SIAM J. Control Optim. 48, 2945–2976 (2010)CrossRefGoogle Scholar
  33. 66.
    Peng, S.: A general stochastic maximum principle for optimal control problems. SIAM J. Control Optim. 28, 966–979 (1990)MathSciNetCrossRefGoogle Scholar
  34. 67.
    Peng, S.: Backward stochastic differential equations and applications to optimal control. Appl. Math. Optim. 27, 125–144 (1993)MathSciNetCrossRefGoogle Scholar
  35. 68.
    Peng, S., Wu, Z.: Fully coupled forward-backward stochastic differential equations and applications to optimal control. SIAM J. Control Optim. 37, 825–843 (1999)MathSciNetCrossRefGoogle Scholar
  36. 69.
    Pham, H.: Continuous-Time Stochastic Control and Optimization with Financial Applications. Stochastic Modelling and Applied Probability, vol. 61. Springer, Berlin (2009)CrossRefGoogle Scholar
  37. 71.
    Rosazza-Gianin, E.: Risk measures via g-expectations. Insur. Math. Econ. 39, 19–34 (2006)MathSciNetCrossRefGoogle Scholar
  38. 72.
    Shen, B., Wang, Z., Shu, H.: Nonlinear Stochastic Systems with Incomplete Information. Filtering and Control. Springer, London (2013)CrossRefGoogle Scholar
  39. 75.
    Shi, J., Wu, Z.: The maximum principle for fully coupled forward-backward stochastic control system. Acta Automat. Sinica 32, 161–169 (2006)MathSciNetGoogle Scholar
  40. 76.
    Simon, H.A.: Dynamic programming under uncertainty with a quadratic criterion function. Econometrica 24, 74–81 (1956)MathSciNetCrossRefGoogle Scholar
  41. 78.
    Tang, S.: The maximum principle for partially observed optimal control of stochastic differential equations. SIAM J. Control Optim. 36, 1596–1617 (1998)MathSciNetCrossRefGoogle Scholar
  42. 80.
    Touzi, N.: Stochastic Control Problems, Viscosity Solutions and Application to Finance. Scuola Normale Superiore di Pisa, Quaderni (2004)Google Scholar
  43. 84.
    Wang, G., Wu, Z.: Kalman-Bucy filtering equations of forward and backward stochastic systems and applications to recursive optimal control problems. J. Math. Anal. Appl. 342, 1280–1296 (2008)MathSciNetCrossRefGoogle Scholar
  44. 85.
    Wang, G., Wu, Z.: The maximum principles for stochastic recursive optimal control problems under partial information. IEEE Trans. Automat. Control 54, 1230–1242 (2009)MathSciNetCrossRefGoogle Scholar
  45. 86.
    Wang, G., Wu, Z.: General maximum principles for partially observed risk-sensitive optimal control problems and applications to finance. J. Optim. Theory Appl. 141, 677–700 (2009)CrossRefGoogle Scholar
  46. 87.
    Wang, G., Wu, Z.: Mean-variance hedging and forward-backward stochastic differential filtering equations. Abstr. Appl. Anal. 2011, Art. ID 310910, 20 pp. (2011)Google Scholar
  47. 88.
    Wang, G., Wu, Z., Xiong, J.: Maximum principles for forward-backward stochastic control systems with correlated state and observation noises. SIAM J. Control Optim. 51, 491–524 (2013)MathSciNetCrossRefGoogle Scholar
  48. 89.
    Wang, G., Wu, Z., Xiong, J.: A linear-quadratic optimal control problem of forward-backward stochastic differential equations with partial information. IEEE Trans. Automat. Control 60, 2904–2916 (2015)MathSciNetCrossRefGoogle Scholar
  49. 90.
    Wang, G., Xiao, H.: Arrow sufficient conditions for optimality of fully coupled forward-backward stochastic differential equations with applications to finance. J. Optim. Theory Appl. 165, 639–656 (2015)MathSciNetCrossRefGoogle Scholar
  50. 91.
    Wang, G., Xiao, H., Xing, G.: An optimal control problem for mean-field forward-backward stochastic differential equation with noisy. Automatica J. IFAC 86, 104–109 (2017)MathSciNetCrossRefGoogle Scholar
  51. 94.
    Wang, G., Yu, Z.: A partial information non-zero sum differential game of backward stochastic differential equations with applications. Automat. J. IFAC 48, 342–352 (2012)MathSciNetCrossRefGoogle Scholar
  52. 95.
    Wang, G., Zhang, C., Zhang, W.: Stochastic maximum principle for mean-field type optimal control with partial information. IEEE Trans. Automat. Control 59, 522–528 (2014)MathSciNetCrossRefGoogle Scholar
  53. 96.
    Wonham, W.M.: On the separation theorem of stochastic control. SIAM J. Control 6, 312–326 (1968)MathSciNetCrossRefGoogle Scholar
  54. 98.
    Wonham, W.M.: Some applications of stochastic differential equations to optimal nonlinear filtering. SIAM J. Control 2, 347–369 (1965) (1965)MathSciNetCrossRefGoogle Scholar
  55. 99.
    Wu, Z.: Maximum principle for optimal control problem of fully coupled forward-backward stochastic systems. Syst. Sci. Math. Sci. 11, 249–259 (1998)MathSciNetzbMATHGoogle Scholar
  56. 100.
    Wu, Z.: A maximum principle for partially observed optimal control of forward-backward stochastic control systems. Sci. China Ser. F Inf. Sci. 53, 1–10 (2010)MathSciNetGoogle Scholar
  57. 101.
    Wu, Z.: A general maximum principle for optimal control of forward-backward stochastic systems. Automat. J. IFAC 49, 1473–1480 (2013)MathSciNetCrossRefGoogle Scholar
  58. 103.
    Xiao, H.: The maximum principle for partially observed optimal control of forward-backward stochastic systems with random jumps. J. Syst. Sci. Complex 24, 1083–1099 (2011)MathSciNetCrossRefGoogle Scholar
  59. 104.
    Xiong, J.: An Introduction to Stochastic Filtering Theory. Oxford University Press, London (2008)zbMATHGoogle Scholar
  60. 107.
    Yong, J.: Optimality variational principle for controlled forward-backward stochastic differential equations with mixed initial-terminal conditions. SIAM J. Control Optim. 48, 4119–4156 (2010)MathSciNetCrossRefGoogle Scholar
  61. 109.
    Yong, J., Zhou, X.: Stochastic Controls: Hamiltonian Systems and HJB Equations. Springer, New York (1999)CrossRefGoogle Scholar
  62. 112.
    Zakai, M.: On the optimal filtering of diffusion processes. Z. Wahrsch. Geb. 11, 230–243 (1969)MathSciNetCrossRefGoogle Scholar
  63. 114.
    Zhang, Q.: Controlled partially observed diffusions with correlated noise. Appl. Math. Optim. 22, 265–285 (1990)MathSciNetCrossRefGoogle Scholar

Copyright information

© The Author(s), under exclusive licence to Springer International Publishing AG, part of Springer Nature  2018

Authors and Affiliations

  • Guangchen Wang
    • 1
  • Zhen Wu
    • 2
  • Jie Xiong
    • 3
  1. 1.School of Control Science and EngineeringShandong UniversityJinanChina
  2. 2.School of MathematicsShandong UniversityJinanChina
  3. 3.Department of MathematicsSouthern University of Science and TechnologyShenzhenChina

Personalised recommendations