Skip to main content
Log in

Optimal stochastic control without convexity conditions in the dynamical equation

  • Contributed Papers
  • Published:
Journal of Optimization Theory and Applications Aims and scope Submit manuscript

Abstract

The stochastic control system studied is modelled by then-dimensional stochastic differential equation

$$dz_t = f(t, z, u) dt + \sigma (t, z) dW_t ,$$

whereW t isn-dimensional Brownian motion andu takes its values in a setU υR m. We prove the existence of a controlu*(t,z) which minimizes the cost functional

$$E\int_0^T {c(t, z, u) dt,} $$

under mild conditions off and σ, and without requiring thatf(t,z,U) be convex for each (t,z) or thatU be compact.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Duncan, T., andVaraiya, P.,On the Solutions of a Stochastic Control System, SIAM Journal on Control, Vol. 9, No. 3, 1971.

  2. Benès, V. E.,Existence of Optimal Stochastic Control Laws, SIAM Journal on Control, Vol. 9, No. 3, 1971.

  3. Davis, M. H. A.,On the Existence of Optimal Policies in Stochastic Control, SIAM Journal on Control, Vol. 11, No. 4, 1973.

  4. Berkovitz, L. D.,Lower Semicontinuity of Integral Functionals, Transactions of the American Mathematical Society, Vol. 192, pp. 51–57, 1974.

    Google Scholar 

  5. Girsanov, I. V.,On Transforming a Certain Class of Stochastic Processes by Absolutely Continuous Substitution of Measures, Theory of Probability and Applications, Vol. 5, pp. 285–301, 1960.

    Google Scholar 

  6. Krasnosel'skii, M. A., Zabreiko, P. P., Pustyl'nik, E. I., andSobolevskii, P. E.,Integral Operators in Spaces of Summable Functions (in Russian), Nauka, Moscow, USSR, 1966.

    Google Scholar 

  7. Stroock, D. W., andVaradhan, S. R. S.,Diffusion Processes with Continuous Coefficients, II, Communications on Pure and Applied Mathematics, Vol. 12, pp. 479–530, 1969.

    Google Scholar 

  8. Friedlin, M. I.,On Small Perturbations in the Coefficients of a Diffusion Process, Theory of Probability and Applications, Vol. 12, No. 3, 1967.

  9. Dunford, N., andSchwartz, J.,Linear Operators, Part I, John Wiley and Sons, New York, New York, 1967.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Additional information

Communicated by G. Leitmann

This research was supported by the National Research Council of Canada, Grant No. A9072.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Boyarsky, A. Optimal stochastic control without convexity conditions in the dynamical equation. J Optim Theory Appl 20, 481–488 (1976). https://doi.org/10.1007/BF00933132

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF00933132

Key Words

Navigation