Abstract
We consider the discounted and ergodic optimal control problems related to a one-dimensional storage process. The existence and uniqueness of the corresponding Bellman equation and the regularity of the optimal value is established. Using the Bellman equation an optimal feedback control is constructed. Finally we show that under this optimal control the origin is reachable.
Similar content being viewed by others
References
Arrow KJ Optimal pricing, use and exploration of uncertain natural resource stocks. Presented at the Conference in National Resource Pricing, Trail Lake, Wyoming, August 1977
Bensoussan B, V Borkar (in press) Ergodic control problem for one-dimensional diffusions with near-monotone cost. Systems and Control Letters
Cinlar E (1975) A local time for a storage process. Annals of Probability 3:930–950
Cinlar E, M Pinsky (1971) A stochastic integral in storage theory. Z. Wahrscheinlichkeitstheorie and Verw. Gregiete, 17:227–240
Deshmukh SD, SR Pliska (1980) Optimal consumption and exploration of nonrenewable resources under uncertainty. Econometrica 48:177–200
Fleming W, R Rishel (1970) Deterministic and stochastic optimal control. Springer-Verlag, New York, Berlin, Heidelberg
Liao YC (1982) On optimal control of a Brownian motion. LCDS Report No. 82-17, Brown University, Providence
Pliska SR (1978) On a functional differential equation that arises in a Markov control problem. Journal of Differential Equations 28:390–405
Author information
Authors and Affiliations
Additional information
Communicated by W. Fleming
This work was supported by the National Science Foundation under Grant No. MCS 8121940.
Rights and permissions
About this article
Cite this article
Soner, H.M. Optimal control of a one-dimensional storage process. Appl Math Optim 13, 175–191 (1985). https://doi.org/10.1007/BF01442206
Accepted:
Issue Date:
DOI: https://doi.org/10.1007/BF01442206