Entropy maximisation and queueing network models
 Demetres D. Kouvatsos
 … show all 1 hide
Rent the article at a discount
Rent now* Final gross prices may vary according to local VAT.
Get AccessAbstract
Over recent years it has become increasingly evident that “classical” queueing theory cannot easily handle complex queueing systems and networks with many interacting elements. As a consequence, alternative ideas and tools, analogous to those applied in the field of Statistical Mechanics, have been proposed in the literature. In this context, the principles of Maximum Entropy (ME) and Minimum Relative Entropy (MRE), a generalisation, provide consistent methods of inference for characterising the form of an unknown but true probability distribution, based on information expressed in terms of known to exist true expected values or when, in addition, there exists a prior estimate of the unknown distribution. This paper traces the progress achieved so far towards the creation of ME and MRE productform approximations and related algorithms for the performance analysis of general Queueing Network Models (QNMs) and indicates potential research extensions in the area.
 Baskett, F., Chandy, K.M., Muntz, R.R., Palacios, F.G. (1975) Open, closed and mixed networks with different classes of customers. J.ACM 22: pp. 248260
 Reiser, M., Kobayashi, H. (1975) Queueing networks with multiple closed chains: theory and computational algorithms. IBM J. Res. Dev. 19: pp. 283294
 Marie, R. (1979) An approximate analytical method for general queueing networks. IEEE Trans. Software Eng. SE5: pp. 530538
 Reiser, M., Kobayashi, H. (1974) Accuracy of the diffusion approximation for some queueing systems. IBM J. Res. Dev. 18: pp. 110124
 Gelenbe, E., Pujolle, G. (1976) The behaviour of a single queue in a general queueing network. Acta Info. 7: pp. 123160
 Courtois, P.J. (1977) Decomposability: Queueing and Computer Systems Applications. Academic Press, New York
 Chandy, K.M., Herzog, U., Woo, L. (1975) Approximate analysis of general queueing networks. IBM J. Res. Dev. 19: pp. 4349
 Sevcik, K.C., Levy, A.I., Tripathi, S.K., Zahorjan, J.L. Improving approximation of aggregated queueing network subsystems. In: Chandy, K.M., Reiser, M. eds. (1977) Computer Performance. NorthHolland, New York, pp. 122
 Kelly, F.P. (1979) Reversibility and Stochastic Networks. Wiley, New York
 Bondi, B., Chuang, Y.M. (1988) A new MVAbased approximation for closed queueing networks with a preemptive priority server. Perf. Eval. 8: pp. 195221
 Bryant, R.M., Krzesinski, A.E., Laksmi, M.S., Chandy, K.M. (1984) The MVA priority approximation. T.O.C.S. 2: pp. 335359
 D. Neuse and K.M. Chandy, HAM: The heuristic algorithm method for solving general closed queueing models of computer systems, Perf. Eval. Rev. 11 (Proc. ACM SIGMETRICS Conf.) (1982) 195–212.
 J. Zahorjan, E.D. Lazowska and K.C. Sevick, The use of approximations in production performance evaluation software,Proc. Int. Workshop on Modelling Techniques and Performance Evaluation, Paris (1987).
 Altiok, T., Perros, H.G. (1987) Approximate analysis of arbitrary configurations of queueing networks with blocking. Ann. Oper. Res. 9: pp. 481509
 N.M. Van Dijk, A simple bounding methodology for nonproductform queueing networks with blocking, in:Queueing Networks with Blocking, eds. H.G. Perros and T. Altiok (NorthHolland, 1980) pp. 3–18.
 Akyildiz, I.F., Brand, H. (1989) Exact solutions for open, closed and mixed queueing networks with rejecton blocking. Theoret. Comp. Sci. 64: pp. 203219
 I.F. Akyildiz and H. Von Brand, Central server models with multiple job classes, state dependent routing and rejection blocking, IEEE Trans. Software Eng., to appear.
 H.G. Perros, Approximation algorithms for open queueing networks with blocking, in:Stochastic Analysis of Computer and Communication Systems, ed. H. Takagi (NorthHolland, 1990) pp. 451–494.
 Onvural, R.O. (1990) Survey of closed queueing networks with blocking. ACM Comp. Surveys 22: pp. 83121
 R.O. Onvural and H.G. Perros, Approximate analysis of multiclass tandem queueing networks with Coxian parameters and finite buffers, in:Performance 1990, eds. P.J.B. King et al. (NorthHolland, 1990) pp. 131–141.
 Benes, V.E. (1965) Mathematical Theory of Connecting Networks and Telephone Traffic. Academic Press, New York
 Ferdinand, A.E. (1970) A statistical mechanical approach to systems analysis. IBM J. Res. Dev. 14: pp. 539547
 E. Pinsky and Y. Yemini, A statistical mechanics of some interconnection networks, in:Performance '84, ed. E. Gelenbe (NorthHolland, 1984) pp. 147–158.
 E. Pinsky and Y. Yemini, The canonical approximation in performance analysis, in:Computer Networking and Performance Evaluation, eds. T. Hasegawa et al. (NorthHolland, 1986) pp. 125–137.
 Shore, J.E. (1982) Information theoretic approximations forM/G/1 queueing systems. Acta Info. 17: pp. 4361
 ElAffendi, M.A., Kouvatsos, D.D. (1983) A maximum entropy analysis of theM/G/1 andG/M/1 queueing systems at equilibrium. Acta Info. 19: pp. 339355
 D.D. Kouvatsos, Maximum entropy methods for general queueing networks, in:Modelling Techniques and Tools for Performance Analysis, ed. D. Potier (NorthHolland, 1985) pp. 589–609.
 D.D. Kouvatsos, A universal maximum entropy algorithm for the analysis of general closed networks, in:Computing Networking and Performance Evaluation, eds. T. Hasegawa et al. (NorthHolland, 1986) pp. 113–124.
 Jaynes, E.T. (1957) Information theory and statistical mechanics. Phys. Rev. 106: pp. 620630
 Jaynes, E.T. (1957) Information theory and statistical mechanics II. Phys. Rev. 108: pp. 171190
 Jaynes, E.T. (1968) Prior probabilities. IEEE Trans. Syst. Sci. Cybern. SSC4: pp. 227241
 Shannon, C.E. (1948) A mathematical theory of communication. Bell Syst. Tech. J. 27: pp. 379423
 Tribus, M. (1969) Rational Description, Decisions and Designs. Pergamon, New York
 Shore, J.E., Johnson, R.W. (1980) Axiomatic derivation of the principle of ME and the principle of minimum crossentropy. IEEE Trans. Info. Theory IT26: pp. 2637
 Shore, J.E., Johnson, R.W. (1981) Properties of crossentropy minimisation. IEEE Trans. Info. Theory IT27: pp. 472482
 Bard, Y. (1980) A model of shared DASD and multipathing. Commun. ACM 23: pp. 564572
 C. Bobrowski, The principle of maximum entropy in some computer systems modelling problems, MSc Thesis, University of Toronto (1983).
 Denning, P.J., Buzen, J.P. (1978) The operational analysis of queueing network models. Comp. Surveys 10: pp. 225261
 J.E. Shore, Derivation of equilibrium and timedependent solutions ofM/M/∞/N andM/M/∞ queueing systems using entropy maximisation,Proc. 1978 National Computer Conf., AFIPS (1978) pp. 483–487.
 Cantor, J., Ephremides, A., Horton, D. (1986) Information theoretic analysis for a general queueing system at equilibrium with application to queues in tandem. Acta Info. 23: pp. 657678
 Lutton, J.L., Bonomi, E., Feix, M.R. (1984) Information theory and statistical mechanics approach to solving a queueing problem encountered in telephone exchanges. Division ATR — Centre National d'Etudes des Télécommunications, France
 Guiasu, S. (1986) Maximum entropy condition in queueing theory. J. Oper. Res. Soc. 37: pp. 293301
 Rego, V., Szpankowski, W. (1989) The presence of exponentiality in entropy maximisedM/GI/1 queues. Comp. Oper. Res. 16: pp. 441449
 Kouvatsos, D.D. (1989) A maximum entropy analysis of theG/G/1 queue at equilibrium. J. Oper. Res. Soc. 39: pp. 183200
 Kouvatsos, D.D. (1986) Maximum entropy and theG/G/1/N queue. Acta Info. 23: pp. 545565
 Arizono, I., Cui, Y., Ohta, H. (1991) An analysis ofM/M/s queueing systems based on the maximum entropy principle. J. Oper. Res. Soc. 42: pp. 6973
 Kouvatsos, D.D., Almond, J. (1988) Maximum entropy twostation cyclic queues with multiple general servers. Acta Info. 26: pp. 241267
 Wu, J.S., Chan, W.C. (1989) Maximum entropy analysis of multipleserver queueing systems. J. Oper. Res. Soc. 40: pp. 815825
 C. Strelen, Piecewise approximation of densities applying the principle of maximum entropy: Waiting times inG/G/1systems, in:Modelling Techniques and Tools for Computer Performance Evaluation, eds. R. Puigjaner and D. Potier (Plenum, 1989) pp. 421–438.
 Kouvatsos, D.D., TabetAouel, N.M. (1989) A maximum entropy priority approximation for a stableG/G/1 queue. Acta Info. 27: pp. 247286
 TabetAouel, N.M., Kouvatsos, D.D. (1992) On an approximation to the mean response teimes of priority classes in a stableG/G/c/PR queue. J. Oper. Res. Soc. 43: pp. 227239
 D.D. Kouvatsos and N.M. TabetAouel, An MEbased approximation for multiserver queues with preemptive priority, Euro. J. Oper. Res. (1993), to appear.
 D.D. Kouvatsos and P.H. Georgatsos, General queueing networks with SQJ routing,Proc. 5th Performance Engineering Workshop, Edinburgh (1988).
 G. Falin, G.I. Martin and J. Artaleo, Information theoretic approximations for theM/G/1 retrial queue, Acta Info. (1993), to appear.
 D.D. Kouvatsos, P.H. Georgatsos and N.M. TabetAouel, A universal maximum entropy algorithm for general multiple class open networks with mixed service disciplines, in:Modelling Techniques and Tools for Computer Performance Evaluation, eds. R. Puigjaner and D. Potier (Plenum, 1989) pp. 397–419.
 D.D. Kouvatsos and N.M. TabetAouel, Productform approximations for an extended class of general closed queueing networks, in:Performance '90, eds. P.J.B. King et al. (NorthHolland, 1990) pp. 301–315.
 P.H. Georgatsos, Modelling and analysis of computer communication networks with random or semidynamic routing, PhD Thesis, Computer Systems Modelling Research Group, University of Bradford (1989).
 N.M. TabetAouel, General queueing networks with priorities, PhD Thesis, Computer Systems Modelling Research Group, University of Bradford (1989).
 J. Almond, Generalised analytic queueing network models, PhD Thesis, Computer Systems Modelling Research Group, University of Bradford (1988).
 Kouvatsos, D.D., TabetAouel, N.M. Approximate solutions for networks of queues with multiple server stations under PR discipline. In: Harrison, P., Field, T. eds. (1992) Proc. 8th UK Performance Engineering Workshop. Imperial College, London
 Kouvatsos, D.D., Xenios, N.P. Maximum entropy analysis of general queueing netwoks with blocking. In: Perros, H.G., Altiok, T. eds. (1989) Queueing Networks with Blocking. NorthHolland, Amsterdam, pp. 281309
 Kouvatsos, D.D., Xenios, N.P. (1989) MEM for arbitrary queueing networks with multiple general servers and repetitiveservice blocking. Perf. Eval. 10: pp. 169195
 D.D. Kouvatsos, S.G. Denazis and P.H. Georgatsos, MEM for arbitrary exponential open networks with blocking and multiple job classes,Proc. 7th Performance Engineering Workshop, eds. J. Hillston et al. (Springer, 1991) pp. 163–178.
 Kouvatsos, D.D., Denazis, S.G. (1993) Entropy maximised queueing networks with blocking and multiple job classes. Perf. Eval. 17: pp. 189205
 N.P. Xenios, General queueing networks with blocking, PhD Thesis, Computer Systems Modelling Research Group, University of Bradford (1989).
 Kouvatsos, D.D., Tomaras, P.J. (1992) Multilevel aggregation of central server models: A minimum relative entropy approach. Int. J. Syst. Sci. 23: pp. 713739
 Tomaras, P.J., Kouvatsos, D.D. (1991) MRE hierarchical decomposition of general queueing network models. Acta Info. 28: pp. 265295
 P.J. Tomaras, Decomposition of general queueing network models, PhD Thesis, University of Bradford (1989).
 D.D. Kouvatsos and P.H. Georgatsos, Queueing models of packetswitched networks with locally adaptive routing, in:Teletraffic and Datatraffic in Period of Change, ITC13, eds. A. Jensen and V.B. Iversen (NorthHolland, 1991) pp. 303–308.
 D.D. Kouvatsos and A.K. Simpson, Two new methods for analysing complex I/O subsystems, Technical Report, University of Bradford (February 1992).
 A.K. Simpson, Delay models for complex disk I/O subsystems, PhD Thesis, University of Bradford (1993).
 D.D. Kouvatsos and A. Skliros, General QNMs with variable concurrent programming structures and synchronisation,Proc. 7th UK Performance Engineering Workshop, eds. J. Hillston et al. (Springer, 1991) pp. 56–72.
 A. Skliros, Modelling computer systems with job concurrency and synchronisation, PhD Thesis, University of Bradford (1991).
 Kouvatsos, D.D., Othman, A.T. (1989) Optimal flow control of aG/G/c finite capacity queue. J. Oper. Res. Soc. 40: pp. 659670
 A.T. Othman, Performance analysis and control of computer communication network models, PhD Thesis, University of Bradford, Computer Systems Modelling Research Group (1988).
 Kouvatsos, D.D., Othman, A.T. (1989) Optimal flow control of endtoend packetswitched network with random routing. IEE Proc. 136: pp. 9099
 R.W. Johnson, Determining probability distributions by maximum entropy and minimum crossentropy, in:APL 1979 Conf. Proc. (1979) pp. 24–29.
 C. Sauer, Configuration of computing systems: An approach using queueing network models, PhD Thesis, University of Texas (1975).
 Nojo, S., Watanabe, H. (1987) A new stage method getting arbitrary coefficient of variation by two stages. Trans. IEICE 70: pp. 3336
 Whitt, W. (1984) On approximations for queues, III: Mixtures of exponential distributions. AT&T BLTJ 63: pp. 163175
 Reiser, M., Lavenberg, S.S. (1980) Meanvalue analysis of closed multichain queueing networks. J. ACM 27: pp. 313322
 R. Walstra, Iterative analysis of networks of queues, PhD Thesis, Technical Report CSE1166, University of Toronto (1984).
 M. Veran and D. Potier, QNAP2: A portable environment for queueing network modelling, in:Modelling Techniques and Tools for Performance Analysis, ed. D. Potier (NorthHolland, 1985) pp. 25–63.
 A.B. Bondi, Modelling the effect of local area networks contention on the performance of host computers,Perf. '84, ed. E. Gelenbe (NorthHolland, 1984) pp. 303–318.
 Mitrani, I., King, P.J.B. (1981) Multiprocessor systems with preemptive priorities. Perf. Eval. 1: pp. 118125
 D.D. Kouvatsos and S.G. Denazis, Comments on and tuning to: MEM for arbitrary queueing networks with repetitiveservice blocking, Technical Report CS1891, University of Bradford (May 1991).
 D.D. Kouvatsos and S.G. Denazis, An efficient convolution procedure for general productform approximations, Technical Report CS1892, University of Bradford (February 1992).
 Labetoulle, J., Pujolle, G. (1980) Isolation method in a network of queues. IEEE Trans. Software Eng. SE6: pp. 373381
 D.D. Kouvatsos and J. Almond, Maximum entropy twostation cyclic queues with blocking, Technical Report CS1888, University of Bradford (March 1988).
 D.D. Kouvatsos, J. Almond and J. Sztrik, TheGEtype building block for general queueing networks with before or after service blocking, Technical Report CS2391, University of Bradford (September 1991).
 D.D. Kouvatsos and S.G. Denazis, Queueing network models with before service blocking, Technical Report CS2092, University of Bradford (February 1992).
 Shore, J.E. (1982) Crossentropy minimisation given fully decomposable subset and aggregate constraints. IEEE Trans. Inf. Theory IT28: pp. 956961
 Vantilborgh, H. (1978) Exact aggregation in exponential queueing networks. ACM J. 24: pp. 620629
 S.K. Tripathi, On approximate solution techniques for queueing network models of computer systems, PhD Thesis, University of Toronto (1979).
 Koenigsberg, E. (1966) On jockeying in queues. Manag. Sci. 12: pp. 412412
 Disney, R.L., Mitchell, W.E. (1970) A solution for queues with instantaneous jockeying and other customer rules. Naval Res. Log. Quarterly 17: pp. 315325
 Bard, Y. (1980) Estimation of state probabilities using the maximum entropy principle. IBM J. Res. Dev. 24: pp. 563569
 E.D. Lazowska, J. Zahorjan, G. ScottGraham and K.C. Sevcik,Quantitiative Systems Performance (PrenticeHall, 1984).
 Heidelberger, P., Trivedi, K.S. (1983) Analytic queueing models for programs with internal concurrency. IEEE Trans. Comp. C32: pp. 7382
 Towsley, D., Chandy, K.M., Browne, J.C. (1978) Models for parallel processing with programs: Applications to CPU:I/O and I/O:I/O overlap. Commun. ACM 21: pp. 821831
 Lam, S.S., Reiser, M. (1979) Congestion control of storeandforward networks by input buffer limits — An analysis. IEEE Trans. Commun. COM27: pp. 127133
 Lazar, A.A. (1983) Optimal flow control of a class of queueing networks in equilibrium. IEEE Trans. Auto. Control AC28: pp. 10011007
 Tobagi, F.A. (1990) Fast packet switch architectures for broadband integrated service digital networks. Proc. IEEE 78: pp. 133167
 G. Pujolle, Discretetime queueing systems for data networks performance evaluation, in:Queueing, Performance and Control in ATM, eds. J.W. Cohen and C.D. Park (NorthHolland, 1991) pp. 239–244.
 D.D. Kouvatsos and N.M. TabetAouel,GGeotype approximations for general discretetime queueing systems,Proc. Modelling and Performance Evaluation of ATM Technology, eds. H.G. Perros et al., La Martinique (1993) pp. 11.1.1.–11.1.12.
 H.G. Perrors, R. Puignaner and G. Pujolle, Performance issues in ATM networks: An annotated bibliography, Research Report, North Carolina State University (1990).
 D.D. Kouvatsos, N.M. TabetAouel and S.G. Denazis, MEbased approximations for general discretetime queueing models, Technical Report CS4192, University of Bradford (November 1992).
 Sztrik, J., Kouvatsos, D.D. (1991) Asymptotic analysis of a heterogeneous multiprocessor system in a randomly changing environment. IEEE Trans. Software Eng. SE17: pp. 10691075
 Title
 Entropy maximisation and queueing network models
 Journal

Annals of Operations Research
Volume 48, Issue 1 , pp 63126
 Cover Date
 19940201
 DOI
 10.1007/BF02023095
 Print ISSN
 02545330
 Online ISSN
 15729338
 Publisher
 Baltzer Science Publishers, Baarn/Kluwer Academic Publishers
 Additional Links
 Topics
 Industry Sectors
 Authors

 Demetres D. Kouvatsos ^{(1)}
 Author Affiliations

 1. Computer Systems Modelling Research Group, University of Bradford, BD7 1DP, Bradford, West Yorkshire, England