Abstract
Live migration of virtual machines proves to be inexorable in providing load balancing among physical devices and allowing scalability and flexibility in resource allocation. The existing approaches exhibit different policies, distinct performance characteristics, and side effects such as power consumption and performance degradation. Therefore, determining the most optimal live migration algorithm in certain situations remains an open challenge. In this work, a new prediction-based model to manage the live migration process of VMs is introduced. Our adaptive model dynamically identifies the optimal live migration algorithm for a given performance metric based on a prior diagnosis of the system. The model is developed by considering the assumption of different workloads alongside certain resource constraints for any of the currently available migration algorithms. The proposed model consists of an ensemble-learning strategy that involves linear and non-parametric regression methods to predict six live migration key metrics, provided by the operator and/or the user, for each live migration algorithm. Our model allows considering the best combination which is constituted of the algorithm-metric pair to migrate a VM. The experimental results show that the proposed model allows to significantly alleviate the service level agreement violation rate by between \(31\%\) and \(60\%\), along with decreasing the total CPU time required for the prediction process.
Similar content being viewed by others
Data availability
The data that support the findings of this paper are available from the corresponding author, Saloua El Motaki, upon reasonable request.
References
Aljoumah E et al (2015) SLA in cloud computing architectures: a comprehensive study. Int J Grid Distrib Comput 8(2):7–32
Smith J, Verge J (2014) What will the data center of 2025 look like? Data Center Knowledge. www.datacenterknowledge.com/archives/2014/04/29/will-data-center-2025-look-like
Creative Brackets (2014) interesting facts and statistics about the largest data centers in the world. https://creative-brackets.com/business/interesting-facts-statistics-largest-data-centers-world/
Shehabi A et al. (2016) United States Data Center Energy Usage Report. Tech. rep
Cook G et al. (2014) Clicking Clean: How Companies are Creating the Green Internet. Tech. rep
Andrae Anders SG, Tomas Edler (2015) On global electricity usage of communication technology: trends to 2030. Challenges 6:117–157. https://doi.org/10.3390/challe6010117.24
Clark Christopher et al. (2005) Live Migration of Virtual Machines. In: NSDI’05. USENIX Association, 273-286
Kurpicz M, Sobe A, Felber P (2014) Using Power Measurements As a Basis for Workload Placement in Heterogeneous Multi-cloud Environments. In: Proceedings of the 2Nd International Workshop on Cross-Cloud Systems. Bordeaux, France: ACM, 6:1-6:6. isbn: 978-1-4503-3233-0. https://doi.org/10.1145/2676662.2676678
Mishra M et al (2012) Dynamic resource management using virtual machine migrations. IEEE Commun Mag 50(9):34–40. https://doi.org/10.1109/MCOM.2012.6295709
Hines MR, Gopalan K (2009) Post-copy Based Live Virtual Machine Migration Using Adaptive Pre-paging and Dynamic Self-ballooning. In: Proceedings of the 2009 ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments. VEE’09. Washington, DC, USA: ACM, pp. 51-60. isbn: 978-1-60558-375-4. https://doi.org/10.1145/1508293.1508301
Jo C et al (2013) Efficient live migration of virtual machines using shared storage. SIGPLAN Notices 48(7):41–50. https://doi.org/10.1145/2517326.2451524
El Motaki S et al (2019) Comparative study between exact and metaheuristic approaches for virtual machine placement process as knapsack problem. J Supercomput 75:6239
Hoerl AE, Kennard RW (1970) Ridge regression: applications to nonorthogonal problems. Technometrics 12(1):69–82. https://doi.org/10.1080/00401706.1970.10488635
Li K et al. (2013) Assessment of machine learning algorithms in cloud computing frameworks. In: 2013 IEEE Systems and Information Engineering Design Symposium. pp. 98–103. https://doi.org/10.1109/SIEDS.2013.6549501
Andréa M, Fortes José AB (2010) On the Use of Machine Learning to Predict the Time and Resources Consumed by Applications. In: Proceedings of the 2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing. IEEE Computer Society, pp. 495–504. https://doi.org/10.1109/CCGRID.2010.98
Ye K et al (2015) Profiling-based workload consolidation and migration in virtualized data centers. IEEE Trans Parallel Distrib Syst 26(3):878–890. https://doi.org/10.1109/TPDS.2014.2313335
Moghaddam Marjan J et al (2020) Minimizing virtual machine migration probability in cloud computing environments. Cluster Comput 23:3029–3038. https://doi.org/10.1007/s10586-020-03067-5
Elsaid Esam Mohamed, Abbas M. Hazem, Meinel Christoph (2020) Live Migration Timing Optimization for VMware Environments using Machine Learning Techniques. In: CLOSER, pp. 91-102.Title Suppressed Due to Excessive Length 25
Duggan M et al. (2016) A reinforcement learning approach for dynamic selection of virtual machines in cloud data centres. In: 2016 Sixth International Conference on Innovative Computing Technology (INTECH). pp. 92–97
Duggan M et al (2019) A multitime-steps-ahead prediction approach for scheduling live migration in cloud data centers. Softw: Pract Exper 49:617–639. https://doi.org/10.1002/spe.2635
Karl Mason et al (2018) Predicting host CPU utilization in the cloud using evolutionary neural networks. Fut Generation Computer Syst 86:162–173. https://doi.org/10.1016/j.future.2018.03.040
Jerry Chun-Wei L, Zaw Ei P (2019) Machine learning based live VM migration for efficient cloud data center. In: Thi Thi (ed) Big data analysis and deep learning applications. Springer, Singapore, pp 130–138
El-Moursy A et al (2019) Multi-dimensional regression host utilization algorithm (MDRHU) for host overload detection in cloud computing. J Cloud Comput. https://doi.org/10.1186/s13677-019-0130-2
Jo Changyeon, Cho Youngsu, Egger Bernhard (2017) A Machine Learning Approach to Live Migration Modeling. In: ACM Symposium on Cloud Computing. SoCC’17. Santa Clara, CA, USA
Alrajeh O, Forshaw M, Thomas N (2017) Performance computer engineering. In: Reinecke P, Di Marco A (eds) Machine learning models for predicting timely virtual machine live migration. Springer International Publishing, Cham, pp 169–183
Arif M, Kiani AK, Qadir J (2016) Machine learning based optimized live virtual machine migration over WAN links. Telecommun Syst 64(2):245–257. https://doi.org/10.1007/s11235-016-0173-3
Hassan MK et al (2018) SLA management for virtual machine live migration using machine learning with modified Kernel and statistical approach. Eng, Technol Appl Sci Res 8(1):2459–2463
Sui X et al (2019) Virtual machine scheduling strategy based on machine learning algorithms for load balancing. EURASIP J Wireless Commun Netw. https://doi.org/10.1186/s13638-019-1454-9
Avi Kivity et al. (2007) KVM: the Linux Virtual Machine Monitor. In: In Proceedings of the 2007 Ottawa Linux Symposium (OLS’-07
VMware. https://www.vmware.com/. Accessed: 2021-04-23
Microsoft. https://azure.microsoft.com/fr-fr/services/virtual-machines/. Accessed: 2021-04-23
Clark C, Fraser K, Hand S, Hansen JG, Jult Er, Limpach C, Pratt I, Warfield A (2004) Live Migration of Virtual Machines. In: 2nd26 Symposium on Networked Systems Design & Implementation. USENIX Association, pp. 273–286
Liu Z et al (2010) Xen Live Migration with Slowdown Scheduling Algorithm. In: 2010 International Conference on Parallel and Distributed Computing, Applications and Technologies, pp. 215-221. https://doi.org/10.1109/PDCAT.2010.88
Svärd P et al. (2011) Evaluation of Delta Compression Techniques for Efficient Live Migration of Large Virtual Machines. In: SIGPLAN Not. 46.7, pp. 111-120. issn: 0362-1340. https://doi.org/10.1145/2007477.1952698
Jin H et al. (2009) Live virtual machine migration with adaptive, memory compression. In: 2009 IEEE International Conference on Cluster Computing and Workshops, pp. 1-10. https://doi.org/10.1109/CLUSTR.2009.5289170
Hines MR, Deshpande U, Gopalan K (2009) Post-copy Live Migration of Virtual Machines. In: SIGOPS Oper. Syst. Rev. 43.3, pp. 14-26. issn: 0163-5980. https://doi.org/10.1145/1618525.1618528
Duggan1 Martin (2019) The application of machine learning to optimise live migration in cloud data centres. PhD thesis. NUI Galway,
Duggan Martin et al (2017) A reinforcement learning approach for the scheduling of live migration from under utilised hosts. In: Memetic Computing 9.4, pp. 283-293. issn: 1865-9292. https://doi.org/10.1007/s12293-016-0218-x
Myers Raymond H (1990) Classical and modern regression with applications, vol 2. Duxbury press Belmont, CA
Marquardt DW, Snee RD (1975) Ridge regression in practice. Am Stat 29(1):3–20. https://doi.org/10.1080/00031305.1975.10479105
Hoerl AE, Hoerl C (1962) Application of ridge analysis to regression problems. In
Tibshirani R (1996) Regression Shrinkage and Selection via the Lasso. In: 58.1, pp. 267-288
Drucker Harris et al. (1996) Support Vector Regression Machines. In: Proceedings of the 9th International Conference on Neural Information Processing Systems. NIPS’96. Denver, Colorado: MIT Press, 155-161
Chi-Yuan Yeh, Chi-Wei Huang, Shie-Jue Lee (2011) A multiple-Kernel support vector regression approach for stock market price forecasting. Expert Syst Appl 38(3):2177–2186
Vladimir Vapnik (2013) The nature of statistical learning theory. Springer science & business media, Cham
Smola AJ, Scholkopf B (2003) A Tutorial on Support Vector Regression, Neuro-COLT Technical Report. Tech. rep. TR-98-030,
Fix E, Hodges JL (1989) Discriminatory Analysis. Nonparametric Discrimination: Consistency Properties. In: International Statistical Review / Revue Internationale de Statistique 57.3, pp. 238–247
Witten Ian H et al. (2005) Practical machine learning tools and techniques. In: Morgan Kaufmann, p. 578.Title Suppressed Due to Excessive Length 27
Hai Jin et al (2014) MECOM: Live migration of virtual machines by adaptively compressing memory pages. Fut Generation Computer Syst 38:23–35. https://doi.org/10.1016/j.future.2013.09.031
RubisWorkload. https://github.com/SaurabhSakpal/RubisWorkload. Accessed: 2020-09-30
Difallah Djellel Eddine et al (2013) OLTP-Bench: An Extensible Testbed for Benchmarking Relational Databases. In: Proc. VLDB Endow. 7.4, 277-288. issn: 2150-8097. https://doi.org/10.14778/2732240.2732246
MPlayer - The Movie Player. http://www.mplayerhq.hu/design7/news.html. Accessed: 2020-09-30
SPECweb (2009). https://www.spec.org/web2009/. Accessed: 2020-10-10
Christ M, Kempa-Liehr A, Feindt M (2016) Distributed and parallel time series feature extraction for industrial big data applications. In: arXiv:1610.07717
Frank J, Jr Massey (1951) The Kolmogorov-Smirnov test for goodness of fit. J Am Stat Assoc 46(253):68–78. https://doi.org/10.1080/01621459.1951.10500769
Benjamini Y (2001) the control of the false discovery rate in multiple testing under dependency. Annal Stat 29:1165–1188
Anton Beloglazov, Rajkumar Buyya (2012) Optimal online deterministic algorithms and adaptive heuristics for energy and performance efficient dynamic consolidation of virtual machines in cloud data centers. Concurr Comput Pract Exper 24(13):1397–1420. https://doi.org/10.1002/cpe.1867
Cawley Gavin C, Talbot Nicola LC (2010) On over-fitting in model selection and subsequent selection bias in performance evaluation. J Mach Learn Res 11:2079–2107
Acknowledgements
This research was supported through computational resources of HPC-MARWAN (hpc.marwan.ma) provided by the National Center for Scientific and Technical Research (CNRST), Rabat, Morocco.
Funding
The authors of this paper have not received any financial support for research, authorship and/or publication of this article.
Author information
Authors and Affiliations
Contributions
Conceptualization: SEM and AY; Formal analysis and implementation: SEM and AY; Writing - original draft preparation: Saloua El Motaki; Writing - review and editing: SEM, AY and HG; Supervision: AY.
Corresponding author
Ethics declarations
Conflict of interest
The authors of this paper declare that they have no significant competing financial, professional, or personal interests that might have influenced the performance or presentation of this work.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Motaki, S.E., Yahyaouy, A. & Gualous, H. A prediction-based model for virtual machine live migration monitoring in a cloud datacenter. Computing 103, 2711–2735 (2021). https://doi.org/10.1007/s00607-021-00981-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00607-021-00981-3