Abstract
This paper is concerned with Markov diffusion processes which obey stochastic differential equations depending on a small parameterε. The parameter enters as a coefficient in the noise term of the stochastic differential equation. The Ventcel-Freidlin estimates give asymptotic formulas (asε→0) for such quantities as the probability of exit from a regionD through a given portionN of the boundary ∂D, the mean exit time, and the probability of exit by a given timeT. A new method to obtain such estimates is given, using ideas from stochastic control theory.
Similar content being viewed by others
References
J. M. Bismut, Théorie probabiliste du contrôle des diffusions,Memoirs Amer. Math. Soc., 167, 1976.
M. H. A. Davis and P. Varaiya, Dynamic programming conditions for partially observable stochastic systems,SIAM J. Control, 11, 226–261 (1973).
W. H. Fleming, The Cauchy problem for a nonlinear first-order partial differential equation,J. Differential Eqns. 5, 515–530 (1969).
W. H. Fleming, Stochastic control for small noise intensities,SIAM J. Control, 9, 473–517 (1971).
W. H. Fleming, Inclusion probability and optimal stochastic control,IRIA Seminars Review, 1977.
W. H. Fleming and R. Rishel,Deterministic and Stochastic Optimal Control, Springer-Verlag, 1975.
A. Friedman,Stochastic Differential Equations and Applications, Academic Press, vol. I, 1975; vol. II, 1976.
C. J. Holland, A new energy characterization of the smallest eigenvalue of the Schrödinger equation,Communications Pure Appl. Math., 30, 755–765 (1977).
C. J. Holland, A minimum principle for the principal eigenvalue for second order linear elliptic equations with natural boundary conditions,Communications Pure Appl. Math., (in press).
E. Hopf, The partial differential equationu t + uux = µuxx,Communications Pure Appl. Math., 3, 201–230 (1950).
O. A. Ladyzhenskaya and N. N. Uralseva,Linear and Quasilinear Elliptic Equations, Academic Press, 1968.
O. A. Ladyzhenskaya, V. A. Solonnikov, and N. N. Uralseva,Linear and Quasilinear Equations of Parabolic Type, American Math. Soc., 1968.
P. Priouret, Ecole d'Eté de Probabilités de Saint-Flour III,Springer-Lecture Notes in Math., 390, Springer-Verlag, 1974.
A. V. Skorokhod, Limit theorems for stochastic processes,Theory Prob. Appl. 1, 261–290 (1956).
A. D. Ventcel, Rough limit theorems on large deviations for Markov stochastic processes,Theory Prob. Appl., 21, 227–242, 499–512 (1976).
A. D. Ventcel and M. I. Freidlin, On small random perturbations of dynamical systems,Russian Math. Surveys 25, 1–56 (1970).
A. D. Ventcel and M. I. Freidlin, Some problems concerning stability under small random perturbations,Theory Prob. Appl., 17, 269–283 (1972).
Author information
Authors and Affiliations
Additional information
This research was supported by the Air Force Office of Scientific Research under AF-AFOSR 76-3063, and in part by the National Science Foundation under NSF-MCS 76-37247.
Rights and permissions
About this article
Cite this article
Fleming, W.H. Exit probabilities and optimal stochastic control. Appl Math Optim 4, 329–346 (1977). https://doi.org/10.1007/BF01442148
Received:
Issue Date:
DOI: https://doi.org/10.1007/BF01442148