The Journal of Supercomputing

, Volume 73, Issue 5, pp 2130–2156 | Cite as

Performability analysis of cloud computing centers with large numbers of servers



The ability to deliver acceptable levels of quality of service is crucial for cloud systems, and this requires performance as well as availability analysis. Existing modeling attempts mainly focus on pure performance analysis; however, the software and hardware components of cloud infrastructures may have limited reliability. In this study, analytical models are presented for performability evaluation of cloud centers. A novel approximate solution approach is introduced which allows consideration of large numbers of servers. The challenges for analytical modeling of cloud systems mentioned in the literature are considered. The analytical models and solutions, therefore, are capable of considering large numbers of facility nodes typically up to orders of hundreds or thousands, and able to incorporate various traffic loads while evaluating quality of service for cloud centers together with server availabilities. The results obtained from the analytical models are presented comparatively with the results obtained from discrete event simulations for validation.


Cloud computing Fault-tolerant systems Performability Queuing theory 


  1. 1.
    Andrikopoulos V, Binz T, Leymann F, Strauch S (2013) How to adapt applications for the cloud environment. Computing 95(6):493–535CrossRefGoogle Scholar
  2. 2.
    Banks J, Carson J, Nelson B, Nicol DM (2000) Discrete-event system simulation. Prentice-hall, Englewood CliffsGoogle Scholar
  3. 3.
    Bruneo D (2014) A stochastic model to investigate data center performance and QoS in IaaS cloud computing systems. IEEE Trans Parallel Distrib Syst 25(3):560–569CrossRefGoogle Scholar
  4. 4.
    Bruneo D, Distefano S, Longo F, Puliafito A, Scarpa M (2013) Workload-based software rejuvenation in cloud systems. IEEE Trans Comput 62(6):1072–1085MathSciNetCrossRefGoogle Scholar
  5. 5.
    Calheiros RN, Ranjan R, Beloglazov A, De Rose CA, Buyya R (2011) Cloudsim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms. Softw Pract Exp 41(1):23–50CrossRefGoogle Scholar
  6. 6.
    Cao J, Hwang K, Li K, Zomaya AY (2013) Optimal multiserver configuration for profit maximization in cloud computing. IEEE Trans Parallel Distrib Syst 24(6):1087–1096CrossRefGoogle Scholar
  7. 7.
    Chakka R, Mitrani I (1996) Approximate solutions for open networks with breakdowns and repairs. Stochastic networks, theory and applications. R Stat Soc Lect Notes Ser 4:267–280MATHGoogle Scholar
  8. 8.
    Chang X, Wang B, Muppala JK, Liu J (2016) Modeling active virtual machines on IaaS clouds using an M/G/m/m+ K queue. IEEE Trans Serv Comput 9(3):408–420CrossRefGoogle Scholar
  9. 9.
    Chen S, Sun Y, Kozat U, Huang L, Sinha P, Liang, G, Liu X, Shroff N (2014) When queueing meets coding: Optimal-latency data retrieving scheme in storage clouds. In: 2014 Proceedings IEEE INFOCOM, pp 1042–1050Google Scholar
  10. 10.
    Chiang YJ, Ouyang YC, Hsu CH (2015) An efficient green control algorithm in cloud computing for cost optimization. IEEE Trans Cloud Comput 3(2):145–155CrossRefGoogle Scholar
  11. 11.
    Dantas J, Matos R, Araujo J, Maciel P (2015) Eucalyptus-based private clouds: availability modeling and comparison to the cost of a public cloud. Computing 97:1121–1140Google Scholar
  12. 12.
    Deelman E, Singh G, Livny M, Berriman B, Good J (208) The cost of doing science on the cloud: the montage example. In: 2008 SC—International Conference for High Performance Computing, Networking, Storage and Analysis, pp 1–12Google Scholar
  13. 13.
    Duan Q, Yan Y, Vasilakos A (2012) A survey on service-oriented network virtualization toward convergence of networking and cloud computing. IEEE Trans Netw Serv Manag 9(4):373–392CrossRefGoogle Scholar
  14. 14.
    Dustdar S, Guo Y, Satzger B, Truong HL (2011) Principles of elastic processes. IEEE Internet Comput 15(5):66–71Google Scholar
  15. 15.
    Entezari-Maleki R, Trivedi K, Movaghar A (2015) Performability evaluation of grid environments using stochastic reward nets. IEEE Trans Dependable Secur Comput 12(2):204–216CrossRefGoogle Scholar
  16. 16.
    Ever E, Gemikonakli O, Kocyigit A, Gemikonakli E (2013) A hybrid approach to minimize state space explosion problem for the solution of two stage tandem queues. J Netw Comput Appl 36(2):908–926CrossRefMATHGoogle Scholar
  17. 17.
    Ghosh R, Longo F, Naik VK, Trivedi KS (2013) Modeling and performance analysis of large scale IaaS clouds. Future Gen Comput Syst 29(5):1216–1234 Special section: Hybrid Cloud ComputingCrossRefGoogle Scholar
  18. 18.
    Gunarathne T, Wu TL, Choi JY, Bae SH, Qiu J (2011) Cloud computing paradigms for pleasingly parallel biomedical applications. Concurr Comput Pract Exp 23(17):2338–2354CrossRefGoogle Scholar
  19. 19.
    Haverkort BR, Marie R, Rubino G, Trivedi KS (2001) Performability modelling: techniques and tools. John Wiley, UKGoogle Scholar
  20. 20.
    Jin Y, Wen Y, Zhang W (2014) Content routing and lookup schemes using global bloom filter for content-delivery-as-a-service. IEEE Syst J 8(1):268–278MathSciNetCrossRefGoogle Scholar
  21. 21.
    Khazaei H, Misic J, Misic V (2012) Performance analysis of cloud computing centers using M/G/m/m+r queuing systems. IEEE Trans Parallel Distrib Syst 23(5):936–943CrossRefGoogle Scholar
  22. 22.
    Khazaei H, Misic J, Misic V (2013) A fine-grained performance model of cloud computing centers. IEEE Trans Parallel Distrib Syst 24(11):2138–2147CrossRefGoogle Scholar
  23. 23.
    Law AM (2007) Statistical analysis of simulation output data: the practical state of the art. In: IEEE Simulation Conference, pp 77–83Google Scholar
  24. 24.
    Maguluri ST, Srikant R (2014) Scheduling jobs with unknown duration in clouds. IEEE/ACM Trans Netw 22(6):1938–1951CrossRefGoogle Scholar
  25. 25.
    Matos R, Araujo J, Oliveira D, Maciel P, Trivedi K (2015) Sensitivity analysis of a hierarchical model of mobile cloud computing. Simul Model Pract Theory 50:151–164 (Special Issue on Resource Management in Mobile Clouds).Google Scholar
  26. 26.
    Mei J, Li K, Ouyang A, Li K (2015) A profit maximization scheme with guaranteed quality of service in cloud computing. IEEE Trans Comput 64(11):3064–3078MathSciNetCrossRefGoogle Scholar
  27. 27.
    Mitrani I, Chakka R (1995) Spectral expansion solution for a class of Markov models: application and comparison with the matrix-geometric method. Perform Eval 23(3):241–260CrossRefMATHGoogle Scholar
  28. 28.
    Muñoz-Escoí FD, Bernabéu-Aubán JM (2016) A survey on elasticity management in paas systems. Computing 98:1–40Google Scholar
  29. 29.
    Nurmi D, Wolski R, Grzegorczyk C, Obertelli G, Soman S, Youseff L, Zagorodnov D (2009) The Eucalyptus open-source cloud-computing system. In: 9th IEEE/ACM International Symposium on Cluster Computing and the Grid. CCGRID ’09, pp 124–131Google Scholar
  30. 30.
    Ostermann S, Iosup A, Yigitbasi N, Prodan R, Fahringer T, Epema D (2010) A performance analysis of EC2 cloud computing services for scientific computing. In: Cloud computing. Springer, pp 115–131Google Scholar
  31. 31.
    Qian H, Medhi D, Trivedi K (2011) A hierarchical model to evaluate quality of experience of online services hosted by cloud computing. In: 2011 IFIP/IEEE International Symposium on Integrated Network Management (IM), pp 105–112Google Scholar
  32. 32.
    Raei H, Yazdani N (2015) Analytical performance model for mobile network operator cloud. J Supercomput 71(12):4555–4577CrossRefGoogle Scholar
  33. 33.
    Schadt EE, Linderman MD, Sorenson J, Lee L, Nolan GP (2011) Cloud and heterogeneous computing solutions exist today for the emerging big data problems in biology. Nat Rev Genet 12(3):224–224CrossRefGoogle Scholar
  34. 34.
    Schroeder B, Gibson G et al (2010) A large-scale study of failures in high-performance computing systems. IEEE Trans Dependable Secur Comput 7(4):337–350CrossRefGoogle Scholar
  35. 35.
    Shi Z, Beard C, Mitchell K (2013) Analytical models for understanding space, backoff, and flow correlation in CSMA wireless networks. Wirel Netw 19(3):393–409CrossRefGoogle Scholar
  36. 36.
    Smith R, Trivedi K, Ramesh A (1988) Performability analysis: measures, an algorithm, and a case study. IEEE Trans Comput 37(4):406–417CrossRefGoogle Scholar
  37. 37.
    Tian W, Zhao Y, Xu M, Zhong Y, Sun X (2015) A toolkit for modeling and simulation of real-time virtual machine allocation in a cloud data center. IEEE Trans Autom Sci Eng 12(1):153–161CrossRefGoogle Scholar
  38. 38.
    Trivedi KS (2008) Probability and statistics with reliability, queuing and computer science applications. 2nd ed. Wiley, New jerseyGoogle Scholar
  39. 39.
    Tschaikowski M, Tribastone M (2014) Tackling continuous state-space explosion in a Markovian process algebra. Theor Comput Sci 517:1–33MathSciNetCrossRefMATHGoogle Scholar
  40. 40.
    Vilaplana J, Solsona F, Teixidó I, Mateo J, Abella F, Rius J (2014) A queuing theory model for cloud computing. J Supercomput 69(1):492–507CrossRefGoogle Scholar
  41. 41.
    Voorsluys W, Broberg J, Venugopal S, Buyya R (2009) Cost of virtual machine live migration in clouds: a performance evaluation. In: Cloud Computing. Springer, pp 254–265Google Scholar
  42. 42.
    Wang D, Joshi G, Wornell G (2014) Efficient task replication for fast response times in parallel computation. In: ACM SIGMETRICS Performance Evaluation Review, vol. 42, ACM. pp 599–600Google Scholar
  43. 43.
    Yang B, Tan F, Dai YS (2013) Performance evaluation of cloud service considering fault recovery. J Supercomput 65(1):426–444CrossRefGoogle Scholar
  44. 44.
    Yigitbasi N, Iosup A, Epema D, Ostermann S (2009) C-meter: a framework for performance analysis of computing clouds. In: Proceedings of the 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid. IEEE Computer Society, pp 472–477Google Scholar

Copyright information

© Springer Science+Business Media New York 2016

Authors and Affiliations

  1. 1.Computer EngineeringMiddle East Technical UniversityGüzelyurtTurkey

Personalised recommendations