Abstract
We present a broad literature survey of parameter and state estimation for queueing systems. Our approach is based on various inference activities, queueing models, observations schemes, and statistical methods. We categorize these into branches of research that we call estimation paradigms. These include: the classical sampling approach, inverse problems, inference for non-interacting systems, inference with discrete sampling, inference with queueing fundamentals, queue inference engine problems, Bayesian approaches, online prediction, implicit models, and control, design, and uncertainty quantification. For each of these estimation paradigms, we outline the principles and ideas, while surveying key references. We also present various simple numerical experiments. In addition to some key references mentioned here, a periodically updated comprehensive list of references dealing with parameter and state estimation of queues will be kept in an accompanying annotated bibliography.
Similar content being viewed by others
References
Alouf, S., Nain, P., Towsley, D.: Inferring network characteristics via moment-based estimators. In: INFOCOM 2001. Twentieth Annual Joint Conference of the IEEE Computer and Communications Societies. Proceedings. IEEE, vol. 2, pp. 1045–1054. IEEE (2001)
Antunes, N., Jacinto, G., Pacheco, A.: Probing a M/G/1 queue with general input and service times. ACM SIGMETRICS Perform Eval Rev 41(3), 34–36 (2014)
Antunes, N., Jacinto, G., Pacheco, A., Wichelhaus, C.: Estimation of the traffic intensity in a piecewise-stationary M\(_t\)/G\(_t\)/1 queue with probing. ACM SIGMETRICS Perform Eval Rev 44(2), 3–5 (2016)
Armero, C.: Bayesian analysis of M/M/1/\(\infty \)/FIFO queues. Bayesian Stat. 2, 613–618 (1985)
Armero, C.: Bayesian inference in Markovian queues. Queueing Syst. 15(1), 419–426 (1994)
Armero, C., Bayarri, M.J.: Bayesian prediction in M/M/1 queues. Queueing Syst. 15(1), 401–417 (1994)
Armero, C., Bayarri, M.J.: Prior assessments for prediction in queues. Stat. 43(1), 139–153 (1994)
Armony, M., Plambeck, E.L.: The impact of duplicate orders on demand estimation and capacity investment. Manag. Sci. 51(10), 1505–1518 (2005)
Asanjarani, A., Nazarathy, Y.: Parameter and State Estimation in Queues and Related Stochastic Models: A Bibliography. arXiv:1701.08338 (2020)
Asanjarani, A., Nazarathy, Y.: The role of information in system stability with partially observable servers. Methodol. Comput. Appl. Probab. 22, 949–968 (2020)
Asanjarani, A., Nazarathy, Y., Taylor, G.P.: Queueing Estimation Survey. https://github.com/yoninazarathy/QueueingEstimationSurvey (2020)
Asmussen, S.: Applied Probability and Queues (Stochastic Modeling and Applied Probability Series), vol. 51. Springer, Berlin (2010)
Asmussen, S., Nerman, O., Olsson, M.: Fitting phase-type distributions via the EM algorithm. Scand. J. Stat. 23(4), 419–441 (1996)
Au, L., Byrnes, G.B., Bain, C.A., Fackrell, M., Brand, C., Campbell, D.A., Taylor, P.G.: Predicting overflow in an emergency department. IMA J. Manag. Math. 20(1), 39–49 (2009)
Ausín, M.C., Wiper, M.P., Lillo, R.E.: Bayesian estimation for the M/G/1 queue using a phase-type approximation. J. Stat. Plan. Inference 118(1–2), 83–101 (2004)
Baccelli, F., Kauffmann, B., Veitch, D.: Inverse problems in queueing theory and internet probing. Queueing Syst. 63(1), 59–107 (2009)
Bandi, C., Bertsimas, D., Youssef, N.: Robust queueing theory. Oper. Res. 63(3), 676–700 (2015)
Basawa, I.V., Bhat, U.N., Lund, R.: Maximum likelihood estimation for single server queues from waiting time data. Queueing Syst. 24(1), 155–167 (1996)
Basawa, I.V., Bhat, U.N., Zhou, J.: Parameter estimation using partial information with applications to queueing and related models. Stat. Prob. Lett. 78(12), 1375–1383 (2008)
Basawa, I.V., Prabhu, N.U.: Large sample inference from single server queues. Queueing Syst. 3(4), 289–304 (1988)
Bertsimas, D.J., Servi, L.D.: Deducing queueing from transactional data: the queue inference engine, revisited. Oper. Res. 40, S217–S228 (1992)
Bhat, U.N., Miller, G.K., Rao, S.S.: Statistical analysis of queueing systems. In: Dshalalow, J.H. (ed) Chapter in: Frontiers in Queueing, pp. 351–394 (1997)
Bhat, U.N., Rao, S.S.: Statistical analysis of queueing systems. Queueing Syst. 1(3), 217–247 (1987)
Bingham, N.H., Pitts, S.M.: Non-parametric estimation for the M/G/\(\infty \) queue. Ann. Inst. Stat. Math. 51(1), 71–97 (1999)
Bingham, N.H., Pitts, S.M.: Nonparametric inference from M/G/l busy periods. Stoch. Models 15(2), 247–272 (1999)
Bladt, M., Sørensen, M.: Statistical inference for discretely observed Markov jump processes. J. R. Stat. Soc. Ser. B (Statistical Methodology) 67(3), 395–410 (2005)
Blanghaps, N., Nov, Y., Weiss, G.: Sojourn time estimation in an M/G/\(\infty \) queue with partial information. J. Appl. Prob. 50(4), 1044–1056 (2013)
Bolstad, W.M., Curran, J.M.: Introduction to Bayesian statistics. Wiley, Hoboken (2016)
Boxma, O.J., Vlasiou, M.: On queues with service and interarrival times depending on waiting times. Queueing Syst. 56(3–4), 121–132 (2007)
Bramson, M.: Stability of Queueing Networks. Springer, Berlin (2008)
Brillinger, D.R.: Cross-spectral analysis of processes with stationary increments including the stationary G/G/\(\infty \) queue. Ann. Prob. 2(5), 815–827 (1974)
Brockwell, P.J., Davis, R.A., Fienberg, S.E.: Time Series: Theory and Methods. Springer, Berlin (1991)
Brown, M.: An M/G/\(\infty \) estimation problem. Ann. Math. Stat. 41(2), 651–654 (1970)
Carson, J.S., Law, A.M.: Conservation equations and variance reduction in queueing simulations. Oper. Res. 28(3–part–i), 535–546 (1980)
Chen, H., Yao, D.D.: Fundamentals of Queueing Networks: Performance, Asymptotics, and Optimization (stochastic Modelling and Applied Probability Series), vol. 46. Springer, Berlin (2013)
Chen, T.M., Walrand, J., Messerschmitt, D.G.: Parameter estimation for partially observed queues. IEEE Trans. Commun. 42(9), 2730–2739 (1994)
Clarke, A.B.: Maximum likelihood estimates in a simple queue. Ann. Math. Stat. 28(4), 1036–1040 (1957)
Cohen, J.W.: The Single Server Queue (Applied Mathematics and Mechanics), vol. 8. North-Holland, Amsterdam (1982)
Comert, G., Cetin, M.: Queue length estimation from probe vehicle location and the impacts of sample size. Eur. J. Oper. Res. 197(1), 196–202 (2009)
Conti, P.L.: Large sample Bayesian analysis for Geo/G/1 discrete-time queueing models. Ann. Stat. 27(6), 1785–1807 (1999)
Cox, D.R.: Some problems of statistical analysis connected via congestion. In: Proceedings of Symposium on Congestion Theory, pp. 289–316 (1965)
Daley, D.J., Servi, L.D.: Exploiting Markov chains to infer queue length from transactional data. J. Appl. Prob. 29(3), 713–732 (1992)
Daley, D.J., Servi, L.D.: A two-point Markov chain boundary-value problem. Adv. Appl. Prob. 25(3), 607–630 (1993)
Daley, D.J., Servi, L.D.: Estimating waiting times from transactional data. INFORMS J. Comput. 9(2), 224–229 (1997)
Daley, D.J., Servi, L.D.: Moment estimation of customer loss rates from transactional data. J. Appl. Math. Stoch. Anal. 11(3), 301–310 (1998)
den Boer, A.V., Mandjes, M.: Convergence rates of Laplace-transform based estimators. Bernoulli 23(4A), 2533–2557 (2017)
Dimitrijevic, D.D.: Inferring most likely queue length from transactional data. Oper. Res. Lett. 19(4), 191–199 (1996)
Dinh, T.V., Andrew, L.L.H., Nazarathy, Y.: Architecture and robustness tradeoffs in speed-scaled queues with application to energy management. Int. J. Syst. Sci. 45(8), 1728–1739 (2014)
Dong, J., Whitt, W.: Stochastic grey-box modeling of queueing systems: fitting birth-and-death processes to data. Queueing Syst. 79(3–4), 391–426 (2015)
Dong, J., Whitt, W.: Using a birth-and-death process to estimate the steady-state distribution of a periodic queue. Nav. Res. Logist. (NRL) 62(8), 664–685 (2015)
Duffie, D., Glynn, P.: Estimation of continuous-time Markov processes sampled at random time intervals. Econometrica 72(6), 1773–1808 (2004)
Duffy, K.R., Meyn, S.P.: Estimating Loynes’ exponent. Queueing Syst. 68(3–4), 285–293 (2011)
Edelmann, D., Wichelhaus, C.: Nonparametric inference for queueing networks of Geom\(_X\)/G/\(\infty \) queues in discrete time. Adv. Appl. Prob. 46(3), 790–811 (2014)
Fearnhead, P.: Filtering recursions for calculating likelihoods for queues based on inter-departure time data. Stat. Comput. 14(3), 261–266 (2004)
Foss, S., Konstantopoulos, T.: An overview of some stochastic stability methods (special issue: network design, control and optimization). J. Oper. Res. Soc. Jpn. 47(4), 275–303 (2004)
Frey, J.C., Kaplan, E.H.: Queue inference from periodic reporting data. Oper. Res. Lett. 38(5), 420–426 (2010)
Glynn, P.W., Melamed, B., Whitt, W.: Estimating customer and time averages. Oper. Res. 41(2), 400–408 (1993)
Glynn, P.W., Torres, M.: Parametric estimation of tail probabilities for the single-server queue. In: Dshalalow, J.H. (ed.) Chapter in Frontiers in Queueing: Models and Applications in Science and Engineering, pp. 449–462 (1997)
Glynn, P.W., Whitt, W.: A central-limit-theorem version of L= \(\lambda \)W. Queueing Syst. 1(2), 191–215 (1986)
Glynn, P.W., Whitt, W.: Indirect estimation via \({L}= \lambda {W}\). Oper. Res. 37(1), 82–103 (1989)
Glynn, P.W., Zeevi, A.J.: Estimating tail probabilities in queues via extremal statistics. Analysis of communication networks: call centres, traffic and performance. Fields Inst. Commun. 28, 135–158 (2000)
Goldenschluger, A.: Nonparametric estimation of the service time distribution in the M/G/\(\infty \) queue. Adv. Appl. Prob. 48(4), 1117–1138 (2016)
Goldenshluger, A.: The M/G/\(\infty \) estimation problem revisited. Bernoulli 24(4A), 2531–2568 (2018)
Goldenshluger, A., Koops, D.T.: Nonparametric estimation of service time characteristics in infinite-server queues with nonstationary Poisson input. Stoch. Syst. 9(3), 183–207 (2019)
Grübel, R.: Stochastic models as functionals: some remarks on the renewal case. J. Appl. Prob. 26(2), 296–303 (1989)
Grübel, R., Pitts, S.M.: A functional approach to the stationary waiting time and idle period distributions of the GI/G/1 queue. Ann. Prob. 20(4), 1754–1778 (1992)
Grübel, R., Wegener, H.: Matchmaking and testing for exponentiality in the M/G/\(\infty \) queue. J. Appl. Prob. 48(1), 131–144 (2011)
Hall, P., Park, J.: Nonparametric inference about service time distribution from indirect measurements. J. R. Stat. Soc. Ser. B (Statistical Methodology) 66(4), 861–875 (2004)
Hansen, M.B., Pitts, S.M.: Nonparametric inference from the M/G/1 workload. Bernoulli 12(4), 737–759 (2006)
Heckmuller, S., Wolfinger, B.E.: Reconstructing arrival processes to G/D/1 queueing systems and tandem networks. In: International Symposium on Performance Evaluation of Computer & Telecommunication Systems, 2009. SPECTS 2009, vol. 41, pp. 361–368. IEEE (2009)
Heckmüller, S., Wolfinger, B.E.: Reconstructing arrival processes to discrete queueing systems by inverse load transformation. Simulation 87(12), 1033–1047 (2011)
Hei, X., Bensaou, B., Tsang, D.H.K.: A light-weight available bandwidth inference methodology in a queueing analysis approach. In: 2005 IEEE International Conference on Communications, 2005. ICC 2005, vol. 1, pp. 120–124. IEEE (2005)
Hei, X., Bensaou, B., Tsang, D.H.K.: Model-based end-to-end available bandwidth inference using queueing analysis. Comput. Netw. 50(12), 1916–1937 (2006)
Hernandez-Lerma, O., Marcus, S.I.: Adaptive control of service in queueing systems. Syst. Control Lett. 3(5), 283–289 (1983)
Ibrahim, R., Whitt, W.: Wait-time predictors for customer service systems with time-varying demand and capacity. Oper. Res. Baltimore 59(5), 1106–1118 (2011)
Insua, D.R., Wiper, M., Ruggeri, F.: Bayesian analysis of M/Er/1 and M/H\(_k\)/1 queues. Queueing Syst. 30(3), 289–308 (1998)
Jones, L.K.: Inferring balking behavior from transactional data. Oper. Res. 47(5), 778–784 (1999)
Jones, L.K.: Remarks on queue inference from departure data alone and the importance of the queue inference engine. Oper. Res. Lett. 40(6), 503–505 (2012)
Jones, L.K., Larson, R.C.: Efficient computation of probabilities of events described by order statistics and applications to queue inference. ORSA J. Comput. 7(1), 89–100 (1995)
Kauffmann, B.: Inverse problems in bandwidth sharing networks. In: Proceedings of the 24th International Teletraffic Congress, p. 6. International Teletraffic Congress (2012)
Ke, J.C., Chu, Y.K.: Comparison on five estimation approaches of intensity for a queueing system with short run. Comput. Stat. 24(4), 567–582 (2009)
Kelly, F.P.: Reversibility and Stochastic Networks. Cambridge University Press, Cambridge (2011)
Kiessler, P.C., Lund, R.: Technical note: traffic intensity estimation. Nav. Res. Logist. (NRL) 56(4), 385–387 (2009)
Kim, S.H., Whitt, W.: Estimating waiting times with the time-varying Little’s law. Prob. Eng. Inform. Sci. 27(4), 471–506 (2013)
Kim, S.H., Whitt, W.: Statistical analysis with Little’s law. Oper. Res. 61(4), 1030–1045 (2013)
Kim, S.H., Whitt, W., Cha, W.C.: A data-driven model of an appointment-generated arrival process at an outpatient clinic. INFORMS J. Comput. 30(1), 181–199 (2018)
Krishnasamy, S., Arapostathis, A., Johari, R., Shakkottai, S.: On learning the c\(\mu \) rule in single and parallel server networks. In: 2018 56th Annual Allerton Conference on Communication, Control, and Computing (Allerton), pp. 153–154. IEEE (2018)
Larson, R.C.: The queue inference engine: deducing queue statistics from transactional data. Manag. Sci. 36(5), 586–601 (1990)
Latouche, G., Ramaswami, V., Sethuraman, J., Sigman, K., Squillante, M.S., Yao, D.: Matrix-Analytic Methods in Stochastic Models (Springer Proceedings in Mathematics Statistics), vol. 27. Springer, Berlin (2012)
Mandelbaum, A., Zeltyn, S.: Estimating characteristics of queueing networks using transactional data. Queueing Syst. 29(1), 75–127 (1998)
Mandjes, M., Patch, B., Walton, N.S.: Detecting Markov chain instability: a Monte Carlo approach. Stoch. Syst. 7(2), 289–314 (2017)
Mandjes, M., Ravner, L.: Hypothesis testing for a Lévy-driven storage system by Poisson sampling. Stoch. Process. Appl. 133, 41–73 (2020)
Mcgrath, M.F., Gross, D., Singpurwalla, N.D.: A subjective Bayesian approach to the theory of queues I—modeling. Queueing Syst. 1(4), 317–333 (1987)
McGrath, M.F., Singpurwalla, N.D.: A subjective Bayesian approach to the theory of queues II—inference and information in M/M/1 queues. Queueing Syst. 1(4), 335–353 (1987)
McVinish, R., Pollett, P.K.: Constructing estimating equations from queue length data. Preprint at https://people.smp.uq.edu.au/PhilipPollett/papers/2011dMcVinishPollett.pdf (2011)
Nam, S.Y., Kim, S., Sung, D.K.: Estimation of available bandwidth for an M/G/1 queueing system. Appl. Math. Model. 33(8), 3299–3308 (2009)
Neal, R.M.: Slice sampling. Ann. Stat. 31(3), 705–741 (2003)
Novak, A., Watson, R.: Determining an adequate probe separation for estimating the arrival rate in an M/D/1 queue using single-packet probing. Queueing Syst. 61(4), 255–272 (2009)
Nozari, A., Whitt, W.: Estimating average production intervals using inventory measurements: Little’s law for partially observable processes. Oper. Res. 36(2), 308–323 (1988)
Pagurek, B., Stanford, D.A., Woodside, C.M.: Optimal prediction of times and queue lengths in the M/G/1 queue. J. Oper. Res. Soc. 39(6), 585–593 (1988)
Park, J., Kim, Y.B., Willemain, T.R.: Analysis of an unobservable queue using arrival and departure times. Comput. Ind. Eng. 61(3), 842–847 (2011)
Pickands, J., Stine, R.A.: Estimation for an M/G/\(\infty \) queue with incomplete information. Biometrika 84(2), 295–308 (1997)
Pin, F., Veitch, D., Kauffmann, B.: Statistical estimation of delays in a multicast tree using accelerated EM. Queueing Syst. 66(4), 369–412 (2010)
Pitts, S.M.: Nonparametric estimation of the stationary waiting time distribution function for the GI/G/1 queue. Ann. Stat. 22(3), 1428–1446 (1994)
Ramirez-Cobo, P., Lillo, R.E., Wilson, S., Wiper, M.P.: Bayesian inference for double Pareto lognormal queues. Ann. Appl. Stat. 4(3), 1533–1557 (2010)
Ravner, L., Boxma, O., Mandjes, M.: Estimating the input of a Lévy-driven queue by Poisson sampling of the workload process. Bernoulli 25(4B), 3734–3761 (2019)
Reynolds, J.F.: The covariance structure of queues and related processes—a survey of recent work. Adv. Appl. Probab. 7(2), 383–415 (1975)
Rodrigo, A., Vazquez, M.: Large sample inference in retrial queues. Math. Comput. Modell. 30(3–4), 197–206 (1999)
Ross, J.V., Taimre, T., Pollett, P.K.: Estimation for queues from queue length data. Queueing Syst. 55(2), 131–138 (2007)
Schruben, L., Kulkarni, R.: Some consequences of estimating parameters for the M/M/1 queue. Oper. Res. Lett. 1(2), 75–78 (1982)
Schweer, S., Wichelhaus, C.: Nonparametric estimation of the service time distribution in the discrete-time GI/G/\(\infty \) queue with partial information. Stoch. Process. Appl. 125(1), 233–253 (2015)
Schweer, S., Wichelhaus, C.: Nonparametric estimation of the service time distribution in discrete-time queueing networks. Stoch. Process. Appl. 130(8), 4643–4666 (2020)
Senderovich, A., Leemans, S.J.J., Harel, S., Gal, A., Mandelbaum, A., van der Aalst, W.M.P.: Discovering queues from event logs with varying levels of information. In: International Conference on Business Process Management, pp. 154–166. Springer (2016)
Senderovich, A., Weidlich, M., Gal, A., Mandelbaum, A.: Queue mining for delay prediction in multi-class service processes. Inform. Syst. 53, 278–295 (2019)
Senderovich, A., Weidlich, M., Gal, A., Mandelbaum, A.: Queue mining–predicting delays in service processes. In: International Conference on Advanced Information Systems Engineering, pp. 42–57. Springer (2014)
Senderovich, A., Weidlich, M., Gal, A., Mandelbaum, A., Kadish, S., Bunnell, C.A.: Discovery and validation of queueing networks in scheduled processes. In: Advanced Information Systems Engineering, p. 417–433. Springer (2015)
Sharma, V., Mazumdar, R.: Estimating traffic parameters in queueing systems with local information. Perform. Eval. 32(3), 217–230 (1998)
Stanford, D.A., Pagurek, B., Woodside, C.M.: Optimal prediction of times and queue lengths in the GI/M/1 queue. Oper. Res. 31(2), 322–337 (1983)
Sutton, C., Jordan, M.I.: Bayesian inference for queueing networks and modeling of internet services. Ann. Appl. Stat. 5(1), 254–282 (2011)
Thiongane, M., Chan, W., l’Ecuyer, P.: New history-based delay predictors for service systems. In: 2016 Winter Simulation Conference (WSC), pp. 425–436. IEEE (2016)
Thiruvaiyaru, D., Basawa, I.V.: Empirical Bayes estimation for queueing systems and networks. Queueing Syst. 11(3), 179–202 (1992)
Thiruvaiyaru, D., Basawa, I.V., Bhat, U.N.: Estimation for a class of simple queueing networks. Queueing Syst. 9(3), 301–312 (1991)
Van der Aalst, W., Weijters, T., Maruster, L.: Workflow mining: discovering process models from event logs. IEEE Trans. Knowl. Data Eng. 16(9), 1128–1142 (2004)
Wang, W., Casale, G.: Maximum likelihood estimation of closed queueing network demands from queue length data. ACM SIGMETRICS Perform. Eval. Rev. 43(2), 45–47 (2015)
Wang, W., Casale, G., Kattepur, A., Nambiar, M.: Maximum likelihood estimation of closed queueing network demands from queue length data. In: Proceedings of the 7th ACM/SPEC on International Conference on Performance Engineering, pp. 3–14 (2016)
Whitt, W.: Predicting queueing delays. Manag. Sci. 45(6), 870–888 (1999)
Whitt, W.: Stochastic-Process Limits: An Introduction to Stochastic-process Limits and their Application to Queues. Springer, Berlin (2002)
Whitt, W.: Fitting birth-and-death queueing models to data. Stat. Prob. Lett. 82, 998–1004 (2012)
Woodside, C.M., Stanford, D.A., Pagurek, B.: Optimal prediction of queue lengths and delays in G\(_i\)/M/M multiserver queues. Oper. Res. 32(4), 809–817 (1984)
Zhang, L., Xia, C.H., Squillante, M.S., Mills, W.N.: Workload service requirements analysis: A queueing network optimization approach. In: 10th IEEE International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunications Systems, 2002. MASCOTS 2002. Proceedings, pp. 23–32. IEEE (2002)
Zheng, S., Seila, A.F.: Some well-behaved estimators for the M/M/1 queue. Oper. Res. Lett. 26(5), 231–235 (2000)
Acknowledgements
Azam Asanjarani’s and Peter Taylor’s research is supported by the Australian Research Council (ARC) Centre of Excellence for the Mathematical and Statistical Frontiers (ACEMS). Yoni Nazarathy is supported by ARC grant DP180101602. We are grateful to Liron Ravner for feedback on an early version of the manuscript. We also thank Ross McVinish and an anonymous referee for useful feedback. We thank Phil Pollett for contributions to an early version of the associated annotated bibliography [9].
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Asanjarani, A., Nazarathy, Y. & Taylor, P. A survey of parameter and state estimation in queues. Queueing Syst 97, 39–80 (2021). https://doi.org/10.1007/s11134-021-09688-w
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11134-021-09688-w
Keywords
- Queueing inference
- Queueing parameter estimation
- Inverse problems
- Queue inference engine
- Queueing prediction