Skip to main content

Operational Analysis and Basic Queueing Models

  • Chapter
Systems Benchmarking

Abstract

In this chapter, we start by looking at some basic quantitative relationships, which can be used to evaluate a system’s performance based on measured or known data, a process known as operational analysis. In the second part, we provide a brief introduction to the basic notation and principles of queueing theory. While queueing theory has been applied successfully to different domains, for example, to model manufacturing lines or call center operation, in this chapter, we focus on using queueing theory for performance evaluation of computer systems. The chapter is wrapped up with a case study, showing in a step-by-step fashion how to build a queueing model of a distributed software system and use it to predict the performance of the system for different workload and configuration scenarios.

“All models are wrong, but some are useful.”

—George E. P. Box (1919–2013), British statistician

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

eBook
USD 16.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 64.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 99.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Balsamo, S. (2000). Product form queueing networks. In G. Haring, C. Lindemann, & M. Reiser (Eds.) Performance evaluation: Origins and directions. Lecture Notes in Computer Science (Vol. 1769, pp. 377–401). Berlin: Springer.

    Google Scholar 

  • Baskett, F., Chandy, K. M., Muntz, R. R., & Palacios, F. G. (1975). Open, closed, and mixed networks of queues with different classes of customers. Journal of the ACM, 22(2), 248–260. New York: ACM.

    MATH  Google Scholar 

  • Bertoli, M., Casale, G., & Serazzi, G. (2009). JMT: Performance engineering tools for system modeling. SIGMETRICS Performance Evaluation Review, 36(4), 10–15. New York: ACM.

    Book  Google Scholar 

  • Bolch, G. (1989). Performance evaluation of computer systems with the help of analytical queueing network models. Leipzig: Teubner.

    Google Scholar 

  • Bolch, G. & Kirschnick, M. (1994). The performance evaluation and prediction system for queueing Networks—PEPSY-QNS. Technical report TR-I4-94-18. Germany: University of Erlangen-Nuremberg.

    Google Scholar 

  • Bolch, G., Greiner, S., Meer, H. de, & Trivedi, K. S. (2006). Queueing networks and Markov chains: Modeling and performance evaluation with computer science applications (2nd ed.). Hoboken: Wiley.

    Book  Google Scholar 

  • Cox, D. R. (1955). A use of complex probabilities in the theory of stochastic processes. Mathematical Proceedings of the Cambridge Philosophical Society, 51(2), 313–319. Cambridge: Cambridge University.

    Google Scholar 

  • Denning, P. J. & Buzen, J. P. (1978). The operational analysis of queueing network models. ACM Computing Surveys, 10(3), 225–261. New York: ACM.

    MATH  Google Scholar 

  • Field, T. (2006). JINQS: An extensible library for simulating multiclass queueing networks v1.0 user guide. London: Imperial College London.

    Google Scholar 

  • Franks, R. G. (2000). Performance analysis of distributed server systems (PhD thesis). Ottawa: Carlton University.

    Google Scholar 

  • Gagniuc, P. A. (2017). Markov chains: From theory to implementation and experimentation. Hoboken: Wiley.

    Book  Google Scholar 

  • Harchol-Balter, M. (2013). Performance modeling and design of computer systems: Queueing theory in action. Cambridge: Cambridge University.

    MATH  Google Scholar 

  • Hirel, C., Sahner, R. A., Zang, X., & Trivedi, K. S. (2000). Reliability and performability modeling using SHARPE 2000. In Proceedings of the 11th international conference on modelling techniques and tools for computer performance evaluation (TOOLS 2000) (Schaumburg, IL, USA). Lecture notes in computer science. Berlin: Springer, pp. 345–349.

    Google Scholar 

  • Jordon, D. (2014). Queueing-tool: A network simulator. https://github.com/djordon/queueing-tool. Accessed 18 Sept 2019.

    Google Scholar 

  • Kelly, F. P. (1975). Networks of queues with customers of different types. Journal of Applied Probability, 12(3), 542–554. Applied Probability Trust.

    Google Scholar 

  • Kelly, F. P. (1976). Networks of queues. Advances in Applied Probability, 8(2), 416–432. Applied Probability Trust.

    Google Scholar 

  • Kendall, D. G. (1953). Stochastic processes occurring in the theory of queues and their analysis by the method of the imbedded Markov chain. The Annals of Mathematical Statistics, 24(3), 338–354. The Institute of Mathematical Statistics.

    Google Scholar 

  • Kounev, S. (2005). Performance engineering of distributed component-based systems—benchmarking, modeling and performance prediction (Ph.D. Thesis). Technische Universität Darmstadt: Germany. Herzogenrath: Shaker.

    Google Scholar 

  • Kounev, S. (2006). Performance modeling and evaluation of distributed component-based systems using queueing petri nets. IEEE Transactions on Software Engineering, 32(7), 486–502. Washington: IEEE Computer Society.

    Google Scholar 

  • Kounev, S. & Buchmann, A. (2002). Improving data access of J2EE applications by exploiting asynchronous processing and caching services. In Proceedings of the 28th international conference on very large data bases (VLDB 2002) (Hong Kong, China). VLDB Endowment, pp. 574–585.

    Google Scholar 

  • Kounev, S. & Buchmann, A. (2003). Performance modeling and evaluation of large-scale J2EE applications. In Proceedings of the 29th international conference of the computer measurement group on resource management and performance evaluation of enterprise computing systems (CMG 2003) (Dallas, TX, USA) (pp. 273–283).

    Google Scholar 

  • Lazowska, E. D., Zahorjan, J., Graham, G. S., & Sevcik, K. C. (1984). Quantitative system performance: Computer system analysis using queueing network models. Upper Saddle River: Prentice-Hall.

    Google Scholar 

  • Little, J. D. C. (1961). A proof for the queuing formula: L = λW. Operations Research, 9(3), 383–387. Linthicum: Institute for Operations Research and the Management Sciences (INFORMS).

    Google Scholar 

  • Menascé, D. A. & Almeida, V. A. (1998). Capacity planning for web performance: Metrics, models, and methods. Upper Saddle River: Prentice Hall.

    Google Scholar 

  • Menascé, D. A., Almeida, V. A., & Dowdy, L. W. (1994). Capacity planning and performance modeling: From mainframes to client-server systems. Upper Saddle River: Prentice Hall.

    Google Scholar 

  • Menascé, D. A., Almeida, V. A., & Dowdy, L. W. (2004). Performance by design: Computer capacity planning by example. Upper Saddle River: Prentice Hall.

    Google Scholar 

  • Sahner, R. A. & Trivedi, K. S. (1987). Reliability modeling using SHARPE. IEEE Transactions on Reliability, 36(2), 186–193. Piscataway: IEEE.

    Google Scholar 

  • Smith, C. U. & Williams, L. G. (1997). Performance engineering evaluation of object-oriented systems with SPE*ED. In R. Marie, B. Plateau, M. Calzarossa, & G. Rubino (Eds.), Proceedings from the international conference on modelling techniques and tools for computer performance evaluation (TOOLS 1997). Lecture Notes in Computer Science (Vol. 1245, pp. 135–154). Berlin: Springer.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this chapter

Cite this chapter

Kounev, S., Lange, KD., Kistowski, J.v. (2020). Operational Analysis and Basic Queueing Models. In: Systems Benchmarking. Springer, Cham. https://doi.org/10.1007/978-3-030-41705-5_7

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-41705-5_7

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-41704-8

  • Online ISBN: 978-3-030-41705-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics