Skip to main content

Analysis and Filtration of Special Discrete-Time Markov Processes. II. Optimal Filtration

Abstract

Mean-square optimal filtration of the states of a special Markov process, which is the generalization of Markov chains with a finite or denumerable number of states, is studied. By way of example, tracking of the state of a network connection under TCP is given.

This is a preview of subscription content, access via your institution.

REFERENCES

  1. 1.

    Borisov, A.V. and Miller, G.B., Analysis and Filtration of Special Discrete-Time Markov Processes. I, Avtom. Telemekh., 2005, no. 6, pp. 114–125.

  2. 2.

    Miller, B., Avrachenkov, K., Stepanyan, K., and Miller, G., Flow Control as a Stochastic Optimal Control Problem with Incomplete Information, INRIA Research Report, no. 5239, 2004 (http://www.inria.fr/rrrt/rr-5239.html).

  3. 3.

    Jacobson, V., Congestion Avoidance and Control, Comput. Commun. Rev., 1988, vol. 18, no.4, pp. 314–329.

    Google Scholar 

  4. 4.

    Altman, E., Avrachenkov, K., and Barakat, C., TCP in the Presence of Bursty Losses, Performance Evaluation, 2000, no. 42, pp. 129–147.

  5. 5.

    Charalambous, C.D., Elliott, R.J., and Krishnamurthy, V., Conditional Moment Generating Functions for Integrals and Stochastic Integrals, SIAM J. Control Optim., 2003, vol. 42, no.5, pp. 1578–1603.

    Google Scholar 

  6. 6.

    Elliott, R.J., Aggoun, L., and Moore, J.B., Hidden Markov Models: Estimation and Control, Berlin: Springer-Verlag, 1995.

    Google Scholar 

  7. 7.

    Shiryaev, A.N., Veroyatnost’ (Probability), Moscow: Nauka, 1989.

    Google Scholar 

Download references

Author information

Affiliations

Authors

Additional information

__________

Translated from Avtomatika i Telemekhanika, No. 7, 2005, pp. 112–125.

Original Russian Text Copyright © 2005 by Borisov, Miller.

This work was supported by INTAS, project no. YSF 04-83-3623.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Borisov, A.V., Miller, G.B. Analysis and Filtration of Special Discrete-Time Markov Processes. II. Optimal Filtration. Autom Remote Control 66, 1125–1136 (2005). https://doi.org/10.1007/s10513-005-0153-7

Download citation

Keywords

  • Filtration
  • Mechanical Engineer
  • Markov Chain
  • System Theory
  • Markov Process