Skip to main content
Log in

Analysis and Filtration of Special Discrete-Time Markov Processes. II. Optimal Filtration

  • Stochastic Systems
  • Published:
Automation and Remote Control Aims and scope Submit manuscript


Mean-square optimal filtration of the states of a special Markov process, which is the generalization of Markov chains with a finite or denumerable number of states, is studied. By way of example, tracking of the state of a network connection under TCP is given.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others


  1. Borisov, A.V. and Miller, G.B., Analysis and Filtration of Special Discrete-Time Markov Processes. I, Avtom. Telemekh., 2005, no. 6, pp. 114–125.

  2. Miller, B., Avrachenkov, K., Stepanyan, K., and Miller, G., Flow Control as a Stochastic Optimal Control Problem with Incomplete Information, INRIA Research Report, no. 5239, 2004 (

  3. Jacobson, V., Congestion Avoidance and Control, Comput. Commun. Rev., 1988, vol. 18, no.4, pp. 314–329.

    Google Scholar 

  4. Altman, E., Avrachenkov, K., and Barakat, C., TCP in the Presence of Bursty Losses, Performance Evaluation, 2000, no. 42, pp. 129–147.

  5. Charalambous, C.D., Elliott, R.J., and Krishnamurthy, V., Conditional Moment Generating Functions for Integrals and Stochastic Integrals, SIAM J. Control Optim., 2003, vol. 42, no.5, pp. 1578–1603.

    Google Scholar 

  6. Elliott, R.J., Aggoun, L., and Moore, J.B., Hidden Markov Models: Estimation and Control, Berlin: Springer-Verlag, 1995.

    Google Scholar 

  7. Shiryaev, A.N., Veroyatnost’ (Probability), Moscow: Nauka, 1989.

    Google Scholar 

Download references

Author information

Authors and Affiliations


Additional information


Translated from Avtomatika i Telemekhanika, No. 7, 2005, pp. 112–125.

Original Russian Text Copyright © 2005 by Borisov, Miller.

This work was supported by INTAS, project no. YSF 04-83-3623.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Borisov, A.V., Miller, G.B. Analysis and Filtration of Special Discrete-Time Markov Processes. II. Optimal Filtration. Autom Remote Control 66, 1125–1136 (2005).

Download citation

  • Received:

  • Issue Date:

  • DOI: