Causal discrete-time stochastic control problems with nonclassical information patterns are not necessarily sequential in the sense that the order of the various control actions is fixed in advance. When this sequential condition does hold, then they can be reduced to a (theoretical) standard form which enables the establishment of a maximum principle, a reachable set concept and dynamic programming, all in a straightforward and transparent way.
This is a preview of subscription content, log in to check access.
Buy single article
Instant access to the full article PDF.
Price includes VAT for USA
Subscribe to journal
Immediate online access to all issues from 2019. Subscription will auto renew annually.
This is the net price. Taxes to be calculated in checkout.
P. R. Halmos,Measure Theory, Van Nostrand, Princeton, 1950.
H. Hermes andJ. P. LaSalle,Functional Analysis and Time Optimal Control, Academic Press, New York, 1969.
H. S. Witsenhausen, On information structures, feedback and causality,SIAM J. Control 9 (1971), 149–160.
H. S. Witsenhausen, Separation of estimation and control for discrete-time systems,Proc. IEEE,59 (1971), 1557–1566.
R. Bellman,Dynamic Programming, Princeton Univ. Press, Princeton, N.J., 1957.
L. Hormander, Sur la fonction d'appui des ensembles convexes dans un espace localement convexe,Arkiv Mat. 3 (1954), 181–186.
About this article
Cite this article
Witsenhausen, H.S. A standard form for sequential stochastic control. Math. Systems Theory 7, 5–11 (1973). https://doi.org/10.1007/BF01824800
- Control Problem
- Computational Mathematic
- Dynamic Programming
- Control Action
- Maximum Principle