Abstract
Three classes of stochastic networks and their performance measures are considered. These performance measures are defined as the expected value of some random variables and cannot normally be obtained analytically as functions of network parameters in a closed form. We give similar representations for the random variables to provide a useful way of analytical study of these functions and their gradients. The representations are used to obtain sufficient conditions for the gradient estimates to be unbiased. The conditions are rather general and usually met in simulation study of the stochastic networks. Applications of the results are discussed and some practical algorithms of calculating unbiased estimates of the gradients are also presented.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Ermakov, S. M.:Die Monte-Carlo-Methode und verwandte Fragen, VEB Deutscher Verlag der Wisseschaften, 1975.
Ho, Y. C.: Performance evaluation and perturbation analysis of discrete event dynamic systems,IEEE Trans. Automat. Contr. AC-32(7) (1987), 563–572.
Suri, R.: Perturbation analysis: The state of the art and research issues explained via the GI/G/1 queue,Proc. IEEE,77 (1989), 114–137.
Glynn, P. W.: Optimization of stochastic systems, inProc. of 1986 Winter Simulation Conf., 1986, pp. 52–58.
Krivulin, N. K.: Optimization of complex systems for simulation modeling.Vestnik Leningrad. Univ. Math. 23 (1990), 64–67.
Krivulin, N. K.: Optimization of discrete event dynamic systems by using simulation, PhD Dissertation, St. Petersburg University, 1990 (in Russian).
Cao, X. R.: Convergence of parameter sensitivity estimates in a stochastic experiment,IEEE Trans. Automat. Contr.,AC-30(9) (1985), 845–853.
Loève, M.:Probability Theory, Van Nostrand, New York, 1960.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Krivulin, N. Unbiased estimates for gradients of stochastic network performance measures. Acta Appl Math 33, 21–43 (1993). https://doi.org/10.1007/BF00995493
Received:
Revised:
Issue Date:
DOI: https://doi.org/10.1007/BF00995493