Telecommunication Systems

, Volume 29, Issue 1, pp 9–31

Optimal Threshold Policies for Admission Control in Communication Networks via Discrete Parameter Stochastic Approximation


DOI: 10.1007/s11235-005-6629-5

Cite this article as:
Bhatnagar, S. & Reddy, I.B.B. Telecommun Syst (2005) 29: 9. doi:10.1007/s11235-005-6629-5


The problem of admission control of packets in communication networks is studied in the continuous time queueing framework under different classes of service and delayed information feedback. We develop and use a variant of a simulation based two timescale simultaneous perturbation stochastic approximation (SPSA) algorithm for finding an optimal feedback policy within the class of threshold type policies. Even though SPSA has originally been designed for continuous parameter optimization, its variant for the discrete parameter case is seen to work well. We give a proof of the hypothesis needed to show convergence of the algorithm on our setting along with a sketch of the convergence analysis. Extensive numerical experiments with the algorithm are illustrated for different parameter specifications. In particular, we study the effect of feedback delays on the system performance.


admission controlcommunication networksregularized semi-Markov modulated Poisson processtwo timescale stochastic approximationsimultaneous perturbation stochastic approximationthreshold type policies

Copyright information

© Springer Science + Business Media, Inc. 2005

Authors and Affiliations

  1. 1.Department of Computer Science and AutomationIndian Institute of ScienceBangaloreIndia