Abstract
A queueing model is considered in which a controller can increase the service rate. There is a holding cost represented by functionh and the service cost proportional to the increased rate with coefficientl. The objective is to minimize the total expected discounted cost.
Whenh andl are small and the system operates in heavy traffic, the control problem can be approximated by a singular stochastic control problem for the Brownian motion, namely, the so-called “reflected follower” problem. The optimal policy in this problem is characterized by a single numberz * so that the optimal process is a reflected diffusion in [0,z *]. To obtainz * one needs to solve a free boundary problem for the second order ordinary differential equation. For the original problem the policy which increases to the maximum the service rate when the normalized queue-length exceedsz * is approximately optimal.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
F.M. Baldurson, Singular stochastic control and optimal stopping, Stochastics 21 (1987) 1–40.
C.E. Bell, Optimal operation of anM/G/1 priority queue with removable server, Oper. Res. 21 (1973) 1281–1290.
V.E. Benes, L.A. Shepp and H.S. Witsenhausen, Some solvable stochastic control problems, Stochastics 4 (1980) 134–160.
P. Billingsley,Probability and Measure (Wiley, New York, 1979).
P. Billingsley,Convergence of Probability Measures (Wiley, New York, 1968).
K.L. Chung,A Course in Probability Theory, 2nd ed. (Academic Press, 1974).
P. Dupuis and H. Ishii, On Lipschitz continuity of the solution mapping to the Skorohod problem with applications, Stochastics 35 (1991) 31–62.
S.N. Either and T.G. Kurtz,Markov Processes. Characterization and Convergence (Wiley, New York, 1986).
J.M. Harrison and M.I. Taksar, Instantaneous control of Brownian motion, Math. Oper. Res. 8 (1983) 439–453.
J.M. Harrison and M.I. Reiman, Reflected Brownian motion on an orthant, Ann. Prob. 9 (1981) 302–309.
J.M. Harrison,Brownian Motion and Stochastic Flow Systems (Wiley, New York, 1985).
P.R. Jacobs and S. Schach, Stochastic order relationships betweenGI/G/k systems, Ann. Math. Stat. 43 (1972) 1623–1633.
E. Kamke,Differentialgleichungen. Lösungsmethoden und Lösungen (Leipzig, 1959).
I. Karatzas, A class of a singular control problems, Adv. Appl. Prob. 15 (1983) 225–254.
I. Karatzas and S.E. Shreve, Connection between optimal stopping and singular stochastic control: I. Monotone follower problem, SIAM J. Control Optim. 22 (1984) 856–877.
I. Karatzas and S.E. Shreve, Connection between optimal stopping and singular stochastic control: II. Reflected follower problem, SIAM J. Control Optim. 23 (1985) 433–451.
M.A. Krasnoselski and A.V. Pokrowski,Systems with Hysteresis (Nauka, Moscow, 1983).
E.V. Krichagina, A diffusion approximation for the many server queue with phase service, Autom. Remote Control 3 (1989) 73–83.
H.J. Kushner and W. Rungaldier, Nearly optimal state feedback controls for stochastic systems with wideband noise disturbances, SIAM J. Control Optim. 25 (1987) 289–315.
H.J. Kushner and K.M. Ramachandran, Nearly optimal singular controls for wideband noise driven systems, SIAM J. Control Optim. 26 (1988) 569–591.
H.J. Kushner and K.M. Ramachandran, Optimal and approximately optimal control policies for queues in heavy traffic, SIAM J. Control Optim. 27 (1989) 1293–1318.
H.J. Kushner and L.F. Martins, Routing and singular control for queueing network in heavy traffic, SIAM J. Control Optim. 28 (1990) 1209–1233.
H.J. Kushner and L.F. Martins, Limit theorems for pathwise average cost per unit time problems for controlled queues in heavy traffic, Preprint LCDS/CCS#91-2 Division of Applied Mathematics, Brown University, USA (1991).
H.J. Kushner and L.F. Martins, Numerical methods for stochastic singularly controlled problems, Preprint LC.DS#89-21 Division of Applied Mathematics, Brown University, USA (1990).
P.-L. Lions and A.-S. Sznitman, Stochastic differential equations with reflecting boundary conditions, Comm. Pure Appl. Math. 37 (1984) 511–537.
S.A. Lippman, Semi-Markov decision processes with unbounded rewards, Manag. Sci. 19 (1984) 717–731.
R.Sh Liptser and A.N. Siryayev,Theory of Martingales (Kluwer Academic, Dordrecht-Boston-London, 1989).
J.M. Menaldi and M.I. Taksar, Optimal correction problem of a multidimensional stochastic system, Automatica 25 (1989) 223–232.
J.J. Moder and C.R. Phillips, Queueing with fixed and variable channels, Oper. Res. 10 (1962) 218–231.
S.T. Rachev,Probability Metrics and the Stability of Stochastic Models (Wiley, New York, 1991).
M.I. Reiman, Open queueing network in heavy traffic, Math. Oper. Res. 9 (1984) 441–458.
A.V. Skorohod, Stochastic equations for diffusions in a bounded region, Theor. Prob. Appl. 6 (1961) 264–274.
A.V. Skorohod, Limit theorems for stochastic processes, Theor. Prob. Appl. 1 (1956) 261–284.
M.I. Taksar, Average optimal singular control and a related optimal stopping problem, Math. Oper. Res. 10 (1985) 63–81.
H. Tanaka, Stochastic differential equations with reflecting boundary conditions in convex regions, Hiroshima Math. J. 9 (1979) 163–177.
W. Whitt, Complements to heavy traffic limit theorems for theGI/G/1 queue, J. Appl. Prob. 9 (1972) 185–191.
M. Yadin and P. Naor, Queueing systems with variable service capacities, Nav. Res. Log. Quart. 14 (1963) 393–405.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Krichagina, E.V., Taksar, M.I. Diffusion approximation forGI/G/1 controlled queues. Queueing Syst 12, 333–367 (1992). https://doi.org/10.1007/BF01158808
Received:
Revised:
Issue Date:
DOI: https://doi.org/10.1007/BF01158808