Mean-square optimal filtration of the states of a special Markov process, which is the generalization of Markov chains with a finite or denumerable number of states, is studied. By way of example, tracking of the state of a network connection under TCP is given.
This is a preview of subscription content, access via your institution.
Buy single article
Instant access to the full article PDF.
Tax calculation will be finalised during checkout.
Borisov, A.V. and Miller, G.B., Analysis and Filtration of Special Discrete-Time Markov Processes. I, Avtom. Telemekh., 2005, no. 6, pp. 114–125.
Miller, B., Avrachenkov, K., Stepanyan, K., and Miller, G., Flow Control as a Stochastic Optimal Control Problem with Incomplete Information, INRIA Research Report, no. 5239, 2004 (http://www.inria.fr/rrrt/rr-5239.html).
Jacobson, V., Congestion Avoidance and Control, Comput. Commun. Rev., 1988, vol. 18, no.4, pp. 314–329.
Altman, E., Avrachenkov, K., and Barakat, C., TCP in the Presence of Bursty Losses, Performance Evaluation, 2000, no. 42, pp. 129–147.
Charalambous, C.D., Elliott, R.J., and Krishnamurthy, V., Conditional Moment Generating Functions for Integrals and Stochastic Integrals, SIAM J. Control Optim., 2003, vol. 42, no.5, pp. 1578–1603.
Elliott, R.J., Aggoun, L., and Moore, J.B., Hidden Markov Models: Estimation and Control, Berlin: Springer-Verlag, 1995.
Shiryaev, A.N., Veroyatnost’ (Probability), Moscow: Nauka, 1989.
Translated from Avtomatika i Telemekhanika, No. 7, 2005, pp. 112–125.
Original Russian Text Copyright © 2005 by Borisov, Miller.
This work was supported by INTAS, project no. YSF 04-83-3623.
About this article
Cite this article
Borisov, A.V., Miller, G.B. Analysis and Filtration of Special Discrete-Time Markov Processes. II. Optimal Filtration. Autom Remote Control 66, 1125–1136 (2005). https://doi.org/10.1007/s10513-005-0153-7
- Mechanical Engineer
- Markov Chain
- System Theory
- Markov Process