Skip to main content
Log in

Ergodic optimization of stochastic differential systems in wireless networks

  • Published:
Multidimensional Systems and Signal Processing Aims and scope Submit manuscript

Abstract

The present work is the second article in a couple of intertwined papers. They form complementary items on the same subject. They both address the problem of joint power allocation and time slot scheduling in a wireless communication system with time varying traffic. The system is handled by a single base station transmitting over time varying channels. The operating time horizon is divided into time slots, and a fixed amount of power is available at each time slot. The mobile users share each time slot and the power available at this time slot. Since many wireless network applications have stringent delay requirements, designing high-performance resource allocation algorithms to achieve minimum possible delay is of great importance, and this is the main objective of the work presented in this paper. The delay performance of a resource allocation algorithm can be characterized by the average delay experienced by the data transmitted in the network. We propose a heavy traffic analysis for the physical system on hand, i.e., appropriate re-scaling that leads to a diffusion approximation of the system in the sense of weak convergence. The approximate diffusion is constrained or bounded in the K-dimensional positive orthant. We establish the convergence result of the heavy traffic analysis, and then a closed form solution to the resource optimization problem is provided. Here the solution relies on the ergodicity of the approximate diffusion.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  • Baili, H. (2015). Optimization of hybrid stochastic differential systems in communications networks. Nonlinear Analysis: Hybrid Systems, 17(3), 25–43.

    MathSciNet  MATH  Google Scholar 

  • Baili, H. (2016). Optimal scheduling and power allocation in wireless networks with heavy traffic: The infinite time horizon case. International Journal of Systems Science: Operations & Logistics. https://doi.org/10.1080/23302674.2016.1250969

  • Buche, R., & Kushner, H. J. (2002). Control of mobile communications with time varying channels in heavy traffic. IEEE Transactions on Automatic Control, 47(6), 992–1003.

    Article  MathSciNet  MATH  Google Scholar 

  • Budhiraja, A., & Lee, C. (2009). Stationary distribution convergence for generalized Jackson networks in heavy traffic. Mathematics of Operations Research, 34, 45–56.

    Article  MathSciNet  MATH  Google Scholar 

  • Davis, M. H. A. (1993). Markov models and optimization. London: Chapman & Hall.

    Book  MATH  Google Scholar 

  • Gamarnik, D., & Stolyar, A. L. (2012). Multiclass multiserver queueing system in the Halfin–Whitt heavy traffic regime: Asymptotics of the stationary distribution. Queueing Systems, 71, 25–51.

    Article  MathSciNet  MATH  Google Scholar 

  • Gamarnik, D., & Zeevi, A. (2006). Validity of heavy traffic steady-state approximation in generalized Jackson networks. The Annals of Applied Probability, 16, 56–90.

    Article  MathSciNet  MATH  Google Scholar 

  • Gardiner, C. W. (1985). Handbook of stochastic methods for physics, chemistry and the natural sciences (2nd ed.). Berlin: Springer.

    Book  Google Scholar 

  • Gurvich, I. (2014a). Validity of heavy-traffic steady-state approximations in multiclass queueing networks: The case of queue-ratio disciplines. Mathematics of Operations Research, 39, 121–162.

    Article  MathSciNet  MATH  Google Scholar 

  • Gurvich, I. (2014b). Diffusion models and steady-state approximations for exponentially ergodic Markovian queues. The Annals of Applied Probability, 24, 2527–2559.

    Article  MathSciNet  MATH  Google Scholar 

  • Harrison, J. M., & Nguyen, V. (1993). Brownian models of multiclass queueing networks: Current status and open problems. Queueing Systems, 13, 5–40.

    Article  MathSciNet  MATH  Google Scholar 

  • Harrison, J. M., & Reiman, M. I. (1981). Reflected Brownian motion on an orthant. Annals of Probability, 9, 302–308.

    Article  MathSciNet  MATH  Google Scholar 

  • Harrison, J. M., & Williams, R. J. (1987). Brownian models of open queueing networks with homogeneous customer populations. Stochastics, 22, 77–115.

    Article  MathSciNet  MATH  Google Scholar 

  • Krylov, N. V. (1995). Introduction to the theory of diffusion processes. Providence, RI: American Mathematical Society.

    MATH  Google Scholar 

  • Leon-Garcia, A. (2008). Probability, statistics, and random processes for electrical engineering (3rd ed.). Englewood Cliffs, NJ: Prentice Hall.

    Google Scholar 

  • Miyazawa, M. (2015). Diffusion approximation for stationary analysis of queues and their networks: A review. Journal of the Operations Research Society of Japan, 58, 104–148.

    Article  MathSciNet  MATH  Google Scholar 

  • Risken, H. (1989). The Fokker–Planck equation: Methods of solution and applications (2nd ed.). Berlin: Springer.

    MATH  Google Scholar 

  • Serfozo, R. (1999). Introduction to stochastic networks (1st ed.). Berlin: Springer.

    Book  MATH  Google Scholar 

  • Skorokhod, A. V. (1989). Asymptotic methods in the theory of stochastic differential equations. New York: American Mathematical Society.

    MATH  Google Scholar 

  • Skorokhod, A. V. (2005). Basic principles and applications of probability theory. Berlin: Springer.

    MATH  Google Scholar 

  • Skorokhod, A. V., Hoppensteadt, F. C., & Salehi, H. (2002). Random perturbation methods with applications in science and engineering. New York: Springer.

    Book  MATH  Google Scholar 

  • Wu, W., Arapostathis, A., & Shakkottai, S. (2006). Optimal power allocation for a time-varying wireless channel under heavy-traffic approximation. IEEE Transactions on Automatic Control, 51(4), 580–594.

    Article  MathSciNet  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Hana Baili.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Baili, H. Ergodic optimization of stochastic differential systems in wireless networks. Multidim Syst Sign Process 30, 413–449 (2019). https://doi.org/10.1007/s11045-018-0563-7

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11045-018-0563-7

Keywords

Navigation