Abstract
We consider an optimal consumption/investment problem under partial information. By using a known reduction scheme, the problem can be transformed to a standard stochastic control problem. The related Hamilton–Jacobi–Bellman (HJB) equation is, after suitable transformation, a second-order linear degenerate elliptic equation. Although the problem is somewhat simple and classical, and the method of solution is well known, it is not obvious that the related HJB equation has a unique classical solution. Here, we prove the existence, uniqueness, and boundary regularity of the solution to the HJB equation. The main components of the proof are the construction of an appropriate weak solution and the verification of the Hörmander condition. Using the classical solution, we also prove the verification theorem for the original optimal consumption/investment problem.
Similar content being viewed by others
References
Bain, A., Crisan, D.: Fundamentals of Stochastic Filtering. Springer, New York (2009)
Björk, T., Davies, M.H.A., Landén, C.: Optimal investment under partial information. Math. Methods Oper. Res. 71, 371–399 (2010)
Elliott, R.J., Aggoun, L., Moore, J.B.: Hidden Markov Models: Estimation and Control. Springer, New York (2008)
Erdmann, K., Wildon, M.J.: Introduction to Lie Algebras. Springer, New York (2006)
Fujimoto, K., Nagai, H., Runggaldier, W.J.: Expected power-utility maximization under incomplete information and with Cox-process observations. Appl. Math. Optim. 67(1), 33–72 (2013)
Gilbarg, D., Trudinger, N.S.: Elliptic Partial Differential Equations of Second Order. Springer, Berlin (2001)
Hata, H., Sheu, S.J.: On the Hamilton–Jacobi–Bellman equation for an optimal consumption problem: I. Existence of solution. SIAM J. Control Optim. 50(4), 2373–2400 (2012)
Hata, H., Sheu, S.J.: On the Hamilton–Jacobi–Bellman equation for an optimal consumption problem: II. Verification theorem. SIAM J. Control Optim. 50(4), 2401–2430 (2012)
Hörmander, L.: Hypoelliptic second order differential equations. Acta Math. 119(1), 147–171 (1967)
Ikeda, N., Watanabe, S.: Stochastic Differential Equations and Diffusion Processes, 2nd edn. North-Holland/Kodansha, Amsterdam (1989)
Kumano-go, H.: Pseudo-Differential Operators. The MIT Press, Cambridge (1982)
Lieb, E.H., Loss, M.: Analysis, 2nd edn. AMS, Providence (2001)
Liu, J.: Portfolio selection in stochastic environments. Rev. Financ. Stud. 20, 1–39 (2007)
Nagai, H., Runggaldier, W.J.: PDE approach to utility maximization for market models with hidden Markov factors. In: Dalang, R.C., et al. (eds.) “Progress in Probability” Seminar on Stochastic Analysis, Random Fields and Applications, pp. 493–506. Birkhauser, Switzerland (2008)
Norris, J.R.: Markov Chains. Cambridge University Press, Cambridge (1997)
Oleinik, O., Radkevic, E.V.: Second-Order Equations with Non-Negative Characteristic Form. AMS, New York (1973)
Putschögl, W., Sass, S.: Optimal consumption and investment under partial information. Decis. Econ. Financ. 31, 137–170 (2008)
Tamura, T., Watanabe, Y.: Risk-sensitive portfolio optimization problems for hidden Markov factors on infinite time horizon. Asymptot. Anal. 75(3), 169–209 (2011)
Tamura, T., Watanabe, Y.: Hypoellipticity and ergodicity of the Wonham filter as a diffusion process. Appl. Math. Optim. 64(1), 13–36 (2011)
Taksar, M., Zeng, X.: Optimal terminal wealth under partial information: both the drift and the volatility driven by a discrete-time Markov chain. SIAM J. Control Optim. 46(4), 1461–1482 (2007)
Author information
Authors and Affiliations
Corresponding author
A Proof of Lemma 1
A Proof of Lemma 1
Proof
Step 1. Let \(\xi _i(t):=\mathbf {1}_{\{\xi (t)=\mathbf {e}_i\}}\) and
Then, the process \(z(t) = (z_1(t),\ldots ,z_d(t))\) satisfies the following equation.
We only outline the proof of (58). For technical details, see [3, Sects. 8.2–8.3] and [1, Chap. 3]. The dynamics of \(\xi (t)\) is given by
where \(M(t)=(M_1(t),\ldots ,M_d(t))\) is an \(\mathcal {F}_t\)-martingale of pure jump type taking values in \(\{\mathbf {e}_1,\ldots ,\mathbf {e}_d\}\). Recalling (4) and using Itô’ s formula, we obtain
We apply \(\bar{E}[\cdot |\mathcal {Y}_t]\) to both sides:
Combining these, we obtain (58).
Step 2. Next, we claim that
Indeed, if we compute \(d(\bar{H}(t)x_i(t))\) by using Itô’s formula, we see that \(\tilde{q}_i(t):= \bar{H}(t)x_i(t)\) also satisfies (58). A similar computation is seen in the proof of Proposition 2.1 in [18].
Step 3. From (5), (57), (59), and that \(\sum _{i=1}^d x_i(t) = 1\), we deduce
In a similar way, we obtain \(E[(V^{h,c}(t))^\gamma ] = v_0^\gamma \bar{E}[\bar{H}(t)]\). \(\square \)
About this article
Cite this article
Watanabe, Y. Study of a degenerate elliptic equation in an optimal consumption problem under partial information. Japan J. Indust. Appl. Math. 32, 157–185 (2015). https://doi.org/10.1007/s13160-015-0170-z
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s13160-015-0170-z
Keywords
- Optimal consumption problem
- Stochastic control
- Hidden Markov models
- Filtering equation
- HJB equation
- Degenerate elliptic equation