Skip to main content
SpringerLink
Log in

Optimal Control of Data Transmission over a Fluctuating Channel with Unknown State

  • ANALYSIS AND SYNTHESIS OF CONTROL SYSTEMS
  • Published:
Journal of Communications Technology and Electronics Aims and scope Submit manuscript

Abstract—Optimization problem for data packet transmission over a communication channel governed by a hidden Markov process is considered. The transmitter is modeled as a single-channel finite-buffer queuing system with non-stationary Poisson arrivals. The service rate is proportional to the controlled transmission rate with channel-dependent factor. Buffer overflow leads to packet losses, whereas channel state worsening results in lower service rate. The goal of the optimization problem is to minimize average losses under constraint on the transmitter energy consumption. The exact form of the optimal policy is presented for the augmented control problem. Several control policies with incomplete information are proposed on the basis of the optimal control and hidden state estimates. We consider two estimates based on the optimal filtering equations and the current queue state. Results of computer simulation are presented to compare the control policies under consideration.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1.
Fig. 2.
Fig. 3.
Fig. 4.
Fig. 5.
Fig. 6.
Fig. 7.
Fig. 8.

Similar content being viewed by others

REFERENCES

  1. A. V. Borisov, “Monitoring remote server accessibility: the optimal filtering approach,” Informatics and Applications 8 (3), 53–69 (2014).

    Google Scholar 

  2. A. V. Borisov, A. V. Bosov, and G. B. Miller, “Modeling and monitoring of VoIP connection,” Informatics and Applications 10 (2), 2–13 (2016).

    Google Scholar 

  3. M. Welzl, Network Congestion Control: Managing Internet Traffic (Wiley, New York, 2005).

    Book  Google Scholar 

  4. B. M. Miller, K. E. Avrachenkov, K. V. Stepanyan, and G. B. Miller, “Flow control as a stochastic optimal control problem with incomplete information,” Problems of Information Transmission 41 (2), 150–170 (2005).

    Article  MathSciNet  MATH  Google Scholar 

  5. B. M. Miller, G. B. Miller, and K. V. Semenikhin, “Optimal channel choice for lossy data flow transmission,” Automation and Remote Control 79 (1), 66–77 (2018).

  6. U. Rieder and J. Winter, “Optimal control of Markovian jump processes with partial information and applications to a parallel queueing model,” Math. Meth. Oper. Res. 70, 567–596 (2009).

    Article  MathSciNet  MATH  Google Scholar 

  7. N. A. Kuznetsov, D. V. Myasnikov, and K. V. Semenikhin, “Optimization of two-phase queuing system and its application to the control of data transmission between two robotic agents,” Journal of Communications Technology and Electronics 62 (12), 1484–1498 (2017).

    Article  Google Scholar 

  8. A. Hordijk and F. Spieksma, “Constrained admission control to a queueing system,” Adv. Appl. Probab. 21, 409–431 (1989).

    Article  MathSciNet  MATH  Google Scholar 

  9. M. Y. Kitaev and V. V. Rykov, Controlled Queueing Systems (CRC, Boca Raton, 1995).

    MATH  Google Scholar 

  10. E. Altman, Constrained Markov Decision Processes (Chapman & Hall/CRC, Boca Raton, 1999).

    MATH  Google Scholar 

  11. R. J. Elliott, L. Aggoun, and J. B. Moore, Hidden Markov Models. Estimation and Control (Springer-Verlag, New York, 2008).

    MATH  Google Scholar 

  12. B. M. Miller, G. B. Miller, and K. V. Semenikhin, “Methods to design optimal control of Markov process with finite state set in the presence of constraints,” Automation and Remote Control 72 (2), 323‒341 (2011).

  13. D.-T. Ho, E. I. Grotli, P. B. Sujit, T. A. Johansen, and J. B. Sousa, “Optimization of wireless sensor network and UAV data acquisition,” J. Intell. & Robotic Syst. 78 (1), 159–179 (2015).

    Article  Google Scholar 

  14. B. Miller, G. Miller, and K. Semenikhin, “Optimization of the data transmission flow from moving object to nonhomogeneous network of base stations,” in Proc. 20th IFAC World Congress (IFAC’2017), Toulouse, France, 2017 (IFAC, 2017).

  15. T. M. Cover and J. A. Thomas, Elements of Information Theory (Wiley, New York, 1991).

  16. T. S. Rappaport, Wireless Communications: Principles and Practice, 2nd Ed. (Prentice Hall, Upper Saddle River, 2002).

    MATH  Google Scholar 

  17. B. M. Miller, G. B. Miller, and K. V. Semenikhin, “Optimal control problem regularization for the Markov process with finite number of states and constraints,” Automation and Remote Control 77 (9), 1589–1611 (2016).

Download references

ACKNOWLEDGMENTS

This work was supported by the Russian Science Foundation (project no. 16-11-00063).

Author information

Authors and Affiliations

  1. Kotel’nikov Institute of Radio Engineering and Electronics, Russian Academy of Sciences, 125009, Moscow, Russia

    N. A. Kuznetsov, D. V. Myasnikov & K. V. Semenikhin

  2. Moscow Institute of Physics and Technology, 141700 , Dolgoprudnyi, Moscow oblast, Russia

    N. A. Kuznetsov & K. V. Semenikhin

  3. Moscow Aviation Institute (National Research University), 125993, Moscow, Russia

    K. V. Semenikhin

Authors
  1. N. A. Kuznetsov
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. D. V. Myasnikov
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. K. V. Semenikhin
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to N. A. Kuznetsov, D. V. Myasnikov or K. V. Semenikhin.

Additional information

Translated by A. Chikishev

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kuznetsov, N.A., Myasnikov, D.V. & Semenikhin, K.V. Optimal Control of Data Transmission over a Fluctuating Channel with Unknown State. J. Commun. Technol. Electron. 63, 1506–1517 (2018). https://doi.org/10.1134/S1064226918120136

Download citation

  • Received:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1134/S1064226918120136

Keywords:

Search

Navigation