Nonlinear optimal stochastic control — some approximations when the noise is small
Stochastic control problems for a rather general class of nonlinear systems have been considered in this paper. Deterministic models for the prediction of expected performance have been presented, and it has been shown that optimal controllers designed using the models are good approximations to the true optimal controllers for the stochastic system. Some results have been presented on the use of an estimator coupled with an optimal controller based on continuous observation of the state.
The problems associated with the non-Markov nature of the system, and relaxation of the smoothness conditions imposed on the state and control laws will be the subject of a separate paper.
KeywordsPerformance Index Optimal Controller Nonlinear Stochastic System Stochastic Control Problem Optimal Control Policy
- 1.Joffe, B. L., and R. W. H. Sargent, "A Naïve Approach to the Optimal Control of Nonlinear Stochastic Systems", in "Recent Mathematical Developments in Control", D. J. Bell (Ed.), Academic Press (1973)Google Scholar
- 2.Perkins, J. D., "Optimal Stochastic Control of Continuous Processes — Some Approximations Applicable to Chemical Engineering Problems", Ph.D. Thesis, London (1976)Google Scholar
- 3.Wonham, W. M., "On the Separation Theorem of Stochastic Control", SIAM J. Control, 6 (2), 312 (1968)Google Scholar
- 4.Jazwinski, A. H., "Stochastic Processes and Filtering Theory", (Academic Press, New York, 1970)Google Scholar