Abstract
A pathwise optimality criterion is proposed for stochastic control problems in order toreduce the risk connected with the fluctuations of the cost around its expected value. Thisapproach may be of relevance also in economic applications, where risky situations appearparticularly dangerous. Some examples of applications are examined, in particular for thelinear quadratic Gaussian model.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
B.D.O. Anderson and J.B. Moore, Linear Optimal Control, Prentice-Hall, New York, 1971.
M. Aoki, Optimization of Stochastic Systems. Topics in Discrete-Time Dynamics, 2nd ed., Economic Theory, Econometrics, and Mathematical Economics, Academic Press, Boston, MA, 1989.
A.V. Asriev and V.I. Rotar, On asymptotic optimality in probability and almost surely in dynamic control, Stochastics and Stochastics Reports 33(1990)1-16.
T.A. Belkina, Yu.M. Kabanov and E.L. Presman, Stochastic linear-quadratic regulator. Optimality almost sure and in probability, Preprint.
R.M. Cox, Stationary and discounted control of diffusion processes, Ph.D. Thesis, Columbia University, 1984.
R.M. Cox and I. Karatzas, Stationary control of Brownian motion in several dimensions, Advances in Applied Probability 17(1985)531-561.
G.B. Di Masi and Yu.M. Kabanov, On sensitive probabilistic criteria in the linear regulator problem with the infinite horizon, in: Stochastic Processes and Optimal Control, ed. A.A. Novikov, TVP, Moscow, 1994.
W.H. Fleming and W.M. McEneaney, Risk-sensitive control on an infinite time horizon, SIAM J. Control and Optimization 33(1995)1881-1915.
W.H. Fleming and R.W. Rishel, Deterministic and Stochastic Optimal Control, Springer, New York, 1975.
W.H. Fleming and H.M. Soner, Controlled Markov Processes and Viscosity Solutions, Springer, New York, 1993.
D. Gale, On optimal development in a multi-sector economy, Rev. Econ. Stud. 34(1967)1-19.
A. Leizarovitz, On almost sure optimization for stochastic control systems, Stochastics 23(1988)85-107.
A. Leizarowitz, Optimal control for diffusions in R d. A min-max max-min formula for the minimal cost growth rate, J. Mathematical Analysis and Applications 149(1990)180-209.
N.Ya. Petrakov and V.I. Rotar, Factor of the Uncertainty and the Control of Economical Systems, Nauka, Moscow, 1985.
E.L. Presman, Optimality almost sure and in probability for stochastic linear-quadratic regulator, Theory of Probability and its Applications 42(1997).
E. Presman, V. Rotar and M. Taksar, Optimality in probability and almost surely. The general scheme and a linear regulator problem, Stochastics and Stochastics Reports 43(1993)127-137.
P. Protter, Stochastic Integration and Differential Equations, Springer, Berlin, 1990.
M. Robin, Long-term average cost control problems for continuous time Markov processes: A survey, Acta Applicandae Mathematicae 1(1983)281-299.
V.I. Rotar, Some remarks about asymptotical optimality, in: Investigation of Stochastic Problems of Controlling of Economical Processes, CEMI AN USSR, Moscow, 1986, pp. 93-116.
J.K. Sengupta and P. Fanchon, Control Theory Methods in Economics, Kluwer Academic, 1997.
R. Tarres, Asymptotic evolution of a stochastic control problem, SIAM J. Control and Optimization 23(1985)614-631.
C.C. Von Weizsäcker, Existence of optimal programs of accumulation for an infinite time horizon, Rev. Econ. Stud. 32(1965)85-164.
W.M. Wonham, Optimal stationary control of a linear system with state-dependent noise, SIAM J. Control 5(1967)486-500.
Rights and permissions
About this article
Cite this article
Dai Pra, P., Di Masi, G. & Trivellato, B. Almost sure optimality and optimality in probabilityfor stochastic control problems over aninfinite time horizon. Annals of Operations Research 88, 161–171 (1999). https://doi.org/10.1023/A:1018974112132
Issue Date:
DOI: https://doi.org/10.1023/A:1018974112132