Abstract
A one-dimensional monotone follower control problem with a nonconvex Lagrangian is considered. The control problem consists in tracking a standard Wiener process by an adapted nondecreasing process starting at 0. The verification theorem for the problem is presented. The optimal control and the value function are explicitly defined. For some values of parameters of the problem, it is shown that the value function belongs to C 2. An interesting feature of the optimally controlled state process is that for some initial states it has jumps at times other than the inital time.
Similar content being viewed by others
References
L. H. R. Alvarez, “A class of solvable singular stochastic control problems,” Stoch. Stoch. Rep., 67, 83–122 (1999).
J. A. Bather and H. Chernoff, “Sequential decisions in the control of a spaceship,” In: Proc. Fifth Berkeley Symp. Math. Stat. Probab., 3 (1966), pp. 181–207.
V. E. Benes, L. A. Shepp, and H. S. Witsenhausen, “Some solvable stochastic control problems,” Stoch. Stoch. Rep., 4, 39–83 (1980).
W. H. Fleming and H. M. Soner, Controlled Markov Processes and Viscosity Solutions, Springer Verlag (1992).
I. Karatzas and S. E. Shreve, Brownian Motion and Stochastic Calculus, Springer Verlag (1987).
I. Karatzas and S. E. Shreve, “Connections between optimal stopping and singular stochastic control, Part I: Monotone follower problems,” SIAM J. Control Optim., 22, No. 6, 856–877 (1984).
D. Ocone and A. Weerasinghe, “Degenerate variance control of a scalar Ito process,” SIAM J. Control Optim., 39, No. 1, 1–24 (2000).
Author information
Authors and Affiliations
Additional information
Translated from Sovremennaya Matematika i Ee Prilozheniya (Contemporary Mathematics and Its Applications), Vol. 61, Optimal Control, 2008.
Rights and permissions
About this article
Cite this article
Luttamaguzi, J. Towards an example of a nonconvex monotone follower control problem. J Math Sci 161, 235–249 (2009). https://doi.org/10.1007/s10958-009-9549-1
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10958-009-9549-1