Abstract
A new state variable is introduced for the problem of controlling a Markov chain under partial observations, which, under a suitably altered probability measure, has a simple evolution.
Similar content being viewed by others
References
A. Bensoussan and W. Runggaldier, An approximation method for stochastic control problems with partial observation of the state — a method for constructing ε-optimal controls, Acta Appl. Math. 10 (1987) 145–170.
P.R. Kumar and P.P. Varaiya,Stochastic Systems: Estimation, Identification and Adaptive Control (Prentice-Hall, Englewood Cliffs, NJ, 1986).
P. Whittle,Optimization over Time: Dynamic Programming and Stochastic Control, vol. 2 (Wiley, Chichester, 1983).
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Borkar, V.S. A remark on control of partially observed Markov chains. Ann Oper Res 29, 429–438 (1991). https://doi.org/10.1007/BF02283609
Issue Date:
DOI: https://doi.org/10.1007/BF02283609