Skip to main content
SpringerLink
Log in

Prediction of resource contention in cloud using second order Markov model

  • Regular Paper
  • Published:
Computing Aims and scope Submit manuscript

Abstract

The performance of applications running on the cloud entirely depends on two factors, namely, network availability and resource management. Resource contention occurs when request for resources to a host exceeds the availability of the resources and this leads to severe performance degradation of the application. Although virtualization has reduced the performance overhead, performance loss is still possible due to resource contention between collocated virtual machines (VMs). We propose a Second Order Markov Model based Prediction of Future State of Host algorithm for predicting resource contention in hosts in the cloud and to decide on the migration of VMs from one host to another. We also propose a Contention Mitigated Placement algorithm for placing the VMs that are migrated. The main objective of our work is to predict the hosts that will contend for resources and maximize the CPU utilization by reducing the number of VM migrations. Based on the predictions, the VMs from overloaded hosts are migrated to either under loaded or normally loaded hosts such that the destination host does not become overloaded after VM migration. As VM migration from one machine to another causes latency and decrease in CPU utilization due to migration overhead, we have used the number of VM migrations as a metric to measure the performance of our proposed work. Experimental results show that the proposed algorithms improve performance by reducing the number of VM migrations.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Ali SR (2018) Next generation and advanced network reliability analysis: using Markov models and software reliability engineering. Springer, Berlin

    Google Scholar 

  2. Anand A, Lakshmi J, Nandy S (2013) Virtual machine placement optimization supporting performance slas. In: Cloud Computing Technology and Science (CloudCom). In: 2013 IEEE 5th International conference on, IEEE, vol 1, pp. 298–305

  3. Asghari A, Sohrabi MK, Yaghmaee F (2020) A cloud resource management framework for multiple online scientific workflows using cooperative reinforcement learning agents. Computer Netw 179:107340

    Article  Google Scholar 

  4. Calheiros RN, Ranjan R, Beloglazov A, De Rose CA, Buyya R (2011) Cloudsim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms. Softw: Pract Exp 41(1):23–50

    Google Scholar 

  5. Chen L, Shen H, Platt S (2016) Cache contention aware virtual machine placement and migration in cloud datacenters. In: 2016 IEEE 24th International conference on network protocols (ICNP), IEEE, pp. 1–10

  6. Cheng Y, Chen W, Wang Z, Tang Z, Xiang Y (2020) Smart vm co-scheduling with the precise prediction of performance characteristics. Future Gener Computer Syst 105:1016–1027

    Article  Google Scholar 

  7. Dubey K, Nasr AA, Sharma S, El-Bahnasawy N, Attiya G, El-Sayed A (2020) Efficient vm placement policy for data centre in cloud environment. In: Pant M, Sharma T, Verma O, Singla R, Sikander A (eds) Soft computing: theories and applications. Springer, Berlin, pp 301–309

    Chapter  Google Scholar 

  8. Fox A, Turner A, Kim HS (2012) (2012) Resource contention-aware virtual machine management for enterprise applications. In: Global communications conference (GLOBECOM). IEEE, IEEE, pp. 1641–1646

  9. Gai K, Qiu M, Zhao H, Sun X (2018) Resource management in sustainable cyber-physical systems using heterogeneous cloud computing. IEEE Trans Sustain Comput 3(2):60–72

    Article  Google Scholar 

  10. Ghetas M (2021) A multi-objective monarch butterfly algorithm for virtual machine placement in cloud computing. Neural Comput Appl. https://doi.org/10.1007/s00521-020-05559-2

    Article  Google Scholar 

  11. Gohil BN, Gamit S, Patel DR (2021) Fair fit–a load balance aware vm placement algorithm in cloud data centers. In: Hura G, Singh A, Siong Hoe L (eds) Advances in communication and computational technology. Springer, Singapore, pp 437–451

    Chapter  Google Scholar 

  12. Hammer HL, Yazidi A, Begnum K (2017) An inhomogeneous hidden markov model for efficient virtual machine placement in cloud computing environments. J Forecast 36(4):407–420

    MathSciNet  MATH  Google Scholar 

  13. Han X, Schooley R, Mackenzie D, David O, Lloyd WJ (2020) Characterizing public cloud resource contention to support virtual machine co-residency prediction. In: 2020 IEEE International conference on cloud engineering (IC2E), IEEE, pp. 162–172

  14. Kandoussi EM, El Mir I, Hanini M, Haqiq A (2019) Modeling virtual machine migration as a security mechanism by using continuous-time markov chain model. In: 2019 4th World conference on complex systems (WCCS), IEEE, pp. 1–6

  15. Ky DX, Tuyen LT (2018) A higher order Markov model for time series forecasting. Int J Appl Math Stat TM 57(3):1–18

    Google Scholar 

  16. Lei Z, Sun E, Chen S, Wu J, Shen W (2017) A novel hybrid-copy algorithm for live migration of virtual machine. Future Internet 9(3):37

    Article  Google Scholar 

  17. Liu D, Cai Z, Li X (2017) Hidden markov model based spot price prediction for cloud computing. In: 2017 IEEE International symposium on parallel and distributed processing with applications and 2017 IEEE international conference on ubiquitous computing and communications (ISPA/IUCC), pp. 996–1003

  18. Lloyd W, Pallickara S, David O, Arabi M, Rojas K (2017) Mitigating resource contention and heterogeneity in public clouds for scientific modeling services. In: 2017 IEEE International conference on cloud engineering (IC2E), IEEE, pp. 159–166

  19. Mars J, Vachharajani N, Hundt R, Soffa ML (2010) Contention aware execution: online contention detection and response. In: Proceedings of the 8th annual IEEE/ACM international symposium on Code generation and optimization, ACM, pp. 257–265

  20. Melhem SB, Agarwal A, Goel N, Zaman M (2018) Markov prediction model for host load detection and vm placement in live migration. IEEE Access 6:7190–7205

    Article  Google Scholar 

  21. Moradi H, Wang W, Fernandez A, Zhu D (2019) upredict: A user-level profiler-based predictive framework for single vm applications in multi-tenant clouds. arXiv preprint arXiv:1908.04491

  22. Mukherjee J, Krishnamurthy D, Rolia J (2015) Resource contention detection in virtualized environments. IEEE Trans Netw Serv Manag 12(2):217–231

    Article  Google Scholar 

  23. Park K, Pai VS (2006) Comon: a mostly-scalable monitoring system for planetlab. ACM SIGOPS Op Syst Rev 40(1):65–74

    Article  Google Scholar 

  24. Perez D, Hung LH, Xu S, Yeung KY, Lloyd W (2020) An investigation on public cloud performance variation for an rna sequencing workflow. In: Proceedings of the 11th ACM international conference on bioinformatics, computational biology and health informatics, pp. 1–7

  25. Popiolek PF, dos Santos Machado K, Mendizabal OM (2021) Low overhead performance monitoring for shared infrastructures. Expert Syst Appl 171:114558

    Article  Google Scholar 

  26. Rajabzadeh M, Haghighat AT, Rahmani AM (2020) New comprehensive model based on virtual clusters and absorbing markov chains for energy-efficient virtual machine management in cloud computing. J Supercomput 76:1–20

    Article  Google Scholar 

  27. Regaieg R, Koubàa M, Ales Z, Aguili T (2021) Multi-objective optimization for vm placement in homogeneous and heterogeneous cloud service provider data centers. Computing 103:1–25

    Article  MathSciNet  Google Scholar 

  28. Sheikhalishahi M, Grandinetti L, Wallace RM, Vazquez-Poletti JL (2015) Autonomic resource contention-aware scheduling. Softw: Pr Exp 45(2):161–175

    Google Scholar 

  29. Somani G, Khandelwal P, Phatnani K (2012) Vupic: Virtual machine usage based placement in iaas cloud. arXiv preprint arXiv:1212.0085

  30. Talebian H, Gani A, Sookhak M, Abdelatif AA, Yousafzai A, Vasilakos AV, Yu FR (2020) Optimizing virtual machine placement in iaas data centers: taxonomy, review and open issues. Clust Comput 23(2):837–878

    Article  Google Scholar 

  31. Vallone J, Birke R, Chen L (2017) Making neighbors quiet: An approach to detect virtual resource contention. In: IEEE Transactions on services computing

  32. Van Beek V, Oikonomou G, Iosup A (2019) A cpu contention predictor for business-critical workloads in cloud datacenters. In: 2019 IEEE 4th International workshops on foundations and applications of self* systems (FAS* W), IEEE, pp. 56–61

  33. Wu Q, Zhou M, Wen J (2021) Endpoint communication contention-aware cloud workflow scheduling. IEEE Trans Autom Sci Eng. https://doi.org/10.1109/TASE.2020.3046673

    Article  Google Scholar 

  34. Xu D, Nahrstedt K, Wichadakul D (2001) Qos and contention-aware multi-resource reservation. Clust Comput 4(2):95–107

    Article  Google Scholar 

  35. Zhao H, Wang Q, Wang J, Wan B, Li S (2020) Vm performance maximization and pm load balancing virtual machine placement in cloud. In: 2020 20th IEEE/ACM International symposium on cluster, cloud and internet computing (CCGRID), pp. 857–864, https://doi.org/10.1109/CCGrid49817.2020.00011

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, Anna University, Chennai, 600025, India

    K Surya & V. Mary Anita Rajam

Authors
  1. K Surya
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. V. Mary Anita Rajam
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to V. Mary Anita Rajam.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Surya, K., Rajam, V.M.A. Prediction of resource contention in cloud using second order Markov model. Computing 103, 2339–2360 (2021). https://doi.org/10.1007/s00607-021-00967-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00607-021-00967-1

Keywords

Search

Navigation