In stochastic optimal control, a key issue is the fact that “solutions” are searched for in terms of “closed-loop control laws” over available information and, as a consequence, a major potential difficulty is the fact that present control may affect future available information. This is known as the “dual effect” of control. Our main result consists in characterizing the maximal set of closed-loop control laws containing open-loop ones and for which the information provided by observations closed with such a feedback remains fixed. We give more specific results in the two following cases: multi-agent systems and discrete time stochastic input-output systems with dynamic information structure.
KeywordsStochastic control Dual effect Information structure
Unable to display preview. Download preview PDF.
- Carpentier, P., G. Cohen, and J.-C. Culioli. (1995). “Stochastic Optimal Control and Decomposition-Coordination Methods—Part I: Theory.” In Roland Durier and Christian Michelot (Eds.), Recent Developments in Optimization. LNEMS 429, 72–87, Springer-Verlag, Berlin.Google Scholar
- Cormen, T.H., C.E. Leiserson, and R.L. Rivest. (1990). Introduction to Algorithms. The MIT Press, Cambridge, Massachusetts.Google Scholar
- Dellacherie, C. and P. Meyer. (1975). Probabilités et Potentiel. Hermann, Paris.Google Scholar
- Feldbaum, A.A. (1965). Optimal Control Systems. Academic, New York.Google Scholar
- Ho, Y.C. and K.C. Chu. (1972). “Team Decision Theory and Information Structure in Optimal Control Problems – Part I.” IEEE Trans. Automat. Control, 17(1), 15–22.Google Scholar
- Szász, G. (1971). Théorie des Treillis. Dunod, Paris.Google Scholar
- Tse, E. and Y. Bar-Shalom. (1975). “Generalized Certainty Equivalence and Dual Effect in Stochastic Control.” IEEE Trans. Automat. Control, pp. 817–819.Google Scholar
- Witsenhausen, H.S. (1971b). “Separation of Estimation and Control for Discrete Time Systems.” Proceedings of the IEEE 69(11), 1557–1566.Google Scholar
- Witsenhausen, H.S. (1975). The Intrinsic Model for Discrete Stochastic Control: Some Open Problems. In A. Bensoussan, and J.L. Lions (eds.), Control Theory, Numerical Methods and Computer Systems Modelling, volume 107 of Lecture Notes in Economics and Mathematical Systems, pp. 322–335. Springer-Verlag.Google Scholar