Abstract
Sample-path-based stochastic gradient estimators for performance measures of queueing systems rely on the assumption that a probability distribution of the random vector of interest (e.g., a service or interarrival time sequence) is given. In this paper, we address the issue of dealing with unknown probability distributions and investigate the robustness of such estimators with respect to possibly erroneous distribution choices. We show that infinitesimal perturbation analysis (IPA) can be robust in this sense and, in some cases, provides distribution-independent estimates. Comparisons with other gradient estimators are provided, including experimental results. We also show that finite perturbation analysis (FPA), though only providing gradient approximations, possesses some attractive robustness properties with respect to unknown distribution parameters. An application of FPA estimation is included for a queueing system performance optimization problem involving customers with real-time constraints.
Similar content being viewed by others
References
Robbins, H., andMonro, S.,A Stochastic Approximation Method, Annals of Mathematical Statistics, Vol. 22, pp. 400–407, 1951.
Rubinstein, R. V.,Monte Carlo Optimization, Simulation, and Sensitivity Analysis of Queueing Networks, Wiley, New York, New York, 1986.
Ho, Y. C.,Performance Evaluation and Perturbation Analysis of Discrete Event Dynamic Systems, IEEE Transactions on Automatic Control, Vol. AC-32, pp. 563–572, 1987.
Suri, R.,Perturbation Analysis: The State of the Art and Research Issues Explained via the GI/G/1 Queue, Proceedings of the IEEE, Vol. 77, pp. 114–137, 1989.
Heidelberger, P., andTowsley, D.,Sensitivity Analysis from Sample Paths Using Likelihoods, Management Science, Vol. 35, pp. 1475–1488, 1989.
Reiman, M. I., andWeiss, A.,Sensitivity Analysis for Simulations via Likelihood Ratios, Operations Research, Vol. 37, pp. 830–844, 1989.
Cao, X.,Convergence of Parameter Sensitivity Estimates in a Stochastic Experiment, IEEE Transactions on Automatic Control, Vol. AC-30, pp. 834–843, 1985.
Gong, W. B., andHo, Y. C.,Smoothed Perturbation Analysis of Discrete Event Dynamic Systems, IEEE Transactions on Automatic Control, Vol. AC-32, pp. 858–866, 1987.
Ho, Y. C., andLi, S.,Extensions of the Perturbation Analysis Techniques for Discrete Event Dynamic Systems, IEEE Transactions on Automatic Control, Vol. AC-33, pp. 427–438, 1988.
Ho, Y. C., Cao, X., andCassandras, C. G.,Infinitesimal and Finite Perturbation Analysis for Queueing Networks, Automatica, Vol. 19, pp. 439–445, 1983.
Cassandras, C. G., andLee, J. I.,Applications of Perturbation Techniques to Optimal Resource Sharing in Discrete Event Systems, Proceedings of the 1988 American Control Conference, Atlanta, Georgia, Vol. 1, pp. 450–455, 1988.
Gallager, R. G.,A Minimum Delay Routing Algorithm Using Distributed Computation, IEEE Transactions on Communications, Vol. COM-25, pp. 73–85, 1977.
Tantawi, A., andTowsley, D.,Optimal Static Load Balancing in Distributed Computer Systems, Journal of the Association for Computing Machinery, Vol. 32, pp. 445–465, 1985.
Suri, R.,Infinitesimal Perturbation Analysis for General Discrete Event Systems, Journal of the Association for Computing Machinery, Vol. 34, pp. 686–717, 1987.
Suri, R., andZazanis, M.,Perturbation Analysis Gives Strongly Consistent Sensitivity Estimates for the M/G/1 Queue, Management Science, Vol. 34, pp. 39–64, 1988.
Cassandras, C. G., andStrickland, S. G.,Perturbation Analytic Methodologies for Design and Optimization of Communication Networks, IEEE Journal of Selected Areas in Communications, Vol. 6, pp. 158–171, 1988.
Kleinrock, L.,Queueing Systems, Vol. 1: Theory, Wiley, New York, New York, 1975.
Kurose, J. F., andChipalkatti, R.,Load Sharing in Soft Real-Time Distributed Computer Systems, IEEE Transactions on Computers, Vol. C-36, pp. 993–1000, 1987.
Holtzman, J. M.,On Using Perturbation Analysis to Do Sensitivity Analysis, Proceedings of the 28th IEEE Conference on Decision and Control, Tampa, Florida, Vol. 3, pp. 2018–2023, 1989.
Author information
Authors and Affiliations
Additional information
Communicated by Y. C. Ho
This work was supported in part by the National Science Foundation Grant ECS-88-01912 and by the Office of Naval Research Contract N00014-87-K-0304.
The authors wish to thank Dr. Jack Holtzman for several useful comments and suggestions.
Rights and permissions
About this article
Cite this article
Cassandras, C.G., Gong, W.B. & Lee, J.I. Robustness of perturbation analysis estimators for queueing systems with unknown distributions. J Optim Theory Appl 70, 491–519 (1991). https://doi.org/10.1007/BF00941299
Issue Date:
DOI: https://doi.org/10.1007/BF00941299