Telecommunication Systems

, Volume 29, Issue 1, pp 9-31

First online:

Optimal Threshold Policies for Admission Control in Communication Networks via Discrete Parameter Stochastic Approximation

  • Shalabh BhatnagarAffiliated withDepartment of Computer Science and Automation, Indian Institute of Science Email author 
  • , I. Bala Bhaskar ReddyAffiliated withDepartment of Computer Science and Automation, Indian Institute of Science

Rent the article at a discount

Rent now

* Final gross prices may vary according to local VAT.

Get Access


The problem of admission control of packets in communication networks is studied in the continuous time queueing framework under different classes of service and delayed information feedback. We develop and use a variant of a simulation based two timescale simultaneous perturbation stochastic approximation (SPSA) algorithm for finding an optimal feedback policy within the class of threshold type policies. Even though SPSA has originally been designed for continuous parameter optimization, its variant for the discrete parameter case is seen to work well. We give a proof of the hypothesis needed to show convergence of the algorithm on our setting along with a sketch of the convergence analysis. Extensive numerical experiments with the algorithm are illustrated for different parameter specifications. In particular, we study the effect of feedback delays on the system performance.


admission control communication networks regularized semi-Markov modulated Poisson process two timescale stochastic approximation simultaneous perturbation stochastic approximation threshold type policies