Abstract
Cloud data centers face various challenges, such as high energy consumption, environmental impact, and quality of service (QoS) requirements. Dynamic virtual machine (VM) consolidation is an effective approach to address these challenges, but it is a complex optimization problem that involves trade-offs between energy efficiency and QoS satisfaction. Moreover, the workload patterns in cloud data centers are often non-stationary and unpredictable, which makes it difficult to model them. In this paper, we propose a new method for dynamic VM consolidation that optimizes both energy efficiency and QoS objectives. Our approach is based on Markov chains and the artificial feeding birds (AFB) algorithm. Markov chains are used to model the resource utilization of each individual VM and PM based on the changes that happen in workload data. AFB algorithm is a metaheuristic optimization technique that mimics the behavior of birds in nature. We modify the AFB algorithm to suit the characteristics of the VM placement problem and to provide QoS-aware and energy-efficient solutions. Our approach also employs an online step detection method to capture variations in workload patterns. Furthermore, we introduce a new policy for VM selection from overloaded hosts, which considers the abrupt changes in the utilization processes of the VMs. The proposed algorithms are evaluated extensively using the CloudSim Toolkit with real workload data. The proposed system outperforms evaluation policies in multiple metrics, including energy consumption, SLA violations, and other essential metrics.
Similar content being viewed by others
References
Beloglazov A, Buyya R (2012) Managing overloaded hosts for dynamic consolidation of virtual machines in cloud data centers under quality of service constraints. IEEE Trans Parallel Distrib Syst 24(7):1366–1379
Ahmadi J, Toroghi Haghighat A, Rahmani AM, Ravanmehr R (2022) A flexible approach for virtual machine selection in cloud data centers with ahp. Software: Pract Exp 52(5):1216–1241
Barham P, Dragovic B, Fraser K, Hand S, Harris T, Ho A, Neugebauer R, Pratt I, Warfield A (2003) Xen and the art of virtualization. ACM SIGOPS Oper Syst Rev 37(5):164–177
Buyya R, Garg SK, Calheiros RN (2011) Sla-oriented resource provisioning for cloud computing: challenges, architecture, and solutions. In: 2011 International conference on cloud and service computing, pp 1–10. IEEE
Garg SK, Toosi AN, Gopalaiyengar SK, Buyya R (2014) Sla-based virtual machine management for heterogeneous workloads in a cloud datacenter. J Netw Comput Appl 45:108–120
Arianyan E, Taheri H, Sharifian S (2016) Novel heuristics for consolidation of virtual machines in cloud data centers using multi-criteria resource management solutions. J Supercomput 72:688–717
Verma A, Ahuja P, Neogi A (2008) pmapper: power and migration cost aware application placement in virtualized systems. In: ACM/IFIP/USENIX international conference on distributed systems platforms and open distributed processing. Springer, pp 243–264
Ahmad RW, Gani A, Hamid SHA, Shiraz M, Yousafzai A, Xia F (2015) A survey on virtual machine migration and server consolidation frameworks for cloud data centers. J Netw Comput Appl 52:11–25
Beloglazov A, Buyya R (2012) Optimal online deterministic algorithms and adaptive heuristics for energy and performance efficient dynamic consolidation of virtual machines in cloud data centers. Concurr Comput: Pract Exp 24(13):1397–1420
Masdari M, Nabavi SS, Ahmadi V (2016) An overview of virtual machine placement schemes in cloud computing. J Netw Comput Appl 66:106–127
Lamy J-B (2019) Artificial feeding birds (afb): a new metaheuristic inspired by the behavior of pigeons. Advances in nature-inspired computing and applications, pp 43–60
Abadi RMB, Rahmani AM, Alizadeh SH (2020) Challenges of server consolidation in virtualized data centers and open research issues: a systematic literature review. J Supercomput 76:2876–2927
Monshizadeh Naeen H, Zeinali E, Toroghi Haghighat A (2020) Adaptive markov-based approach for dynamic virtual machine consolidation in cloud data centers with quality-of-service constraints. Softw: Pract Exp 50(2):161–183
Song W, Xiao Z, Chen Q, Luo H (2013) Adaptive resource provisioning for the cloud using online bin packing. IEEE Trans Comput 63(11):2647–2660
Rajabzadeh M, Haghighat AT (2017) Energy-aware framework with markov chain-based parallel simulated annealing algorithm for dynamic management of virtual machines in cloud data centers. J Supercomput 73:2001–2017
Khan AA, Zakarya M, Rahman IU, Khan R, Buyya R (2021) Heporcloud: an energy and performance efficient resource orchestrator for hybrid heterogeneous cloud computing environments. J Netw Comput Appl 173:102869
Li H, Zhao Y, Fang S (2020) CSL-driven and energy-efficient resource scheduling in cloud data center. J Supercomput 76:481–498
Zhou Z, Abawajy J, Chowdhury M, Hu Z, Li K, Cheng H, Alelaiwi AA, Li F (2018) Minimizing SLA violation and power consumption in cloud data centers using adaptive energy-aware algorithms. Future Gener Comput Syst 86:836–850
Zhou Z, Shojafar M, Alazab M, Abawajy J, Li F (2021) AFED-EF: an energy-efficient VM allocation algorithm for IoT applications in a cloud data center. IEEE Trans Green Commun Netw 5(2):658–669
Zhou Z, Shojafar M, Li R, Tafazolli R (2022) EVCT: an efficient VM deployment algorithm for a software-defined data center in a connected and autonomous vehicle environment. IEEE Trans Green Commun Netw 6(3):1532–1542
Srikantaiah S, Kansal A, Zhao F (2008) Energy aware consolidation for cloud computing. In: USENIX HotPower’08: workshop on power aware computing and systems at OSDI
Gao Y, Guan H, Qi Z, Song T, Huan F, Liu L (2014) Service level agreement based energy-efficient resource management in cloud data centers. Comput Electr Eng 40(5):1621–1633
Arianyan E, Taheri H, Sharifian S (2015) Novel energy and SLA efficient resource management heuristics for consolidation of virtual machines in cloud data centers. Comput Electr Eng 47:222–240
Arianyan E, Taheri H, Khoshdel V (2017) Novel fuzzy multi objective DVFS-aware consolidation heuristics for energy and SLA efficient resource management in cloud data centers. J Netw Comput Appl 78:43–61
Zhang S, Qian Z, Luo Z, Wu J, Lu S (2015) Burstiness-aware resource reservation for server consolidation in computing clouds. IEEE Trans Parallel Distrib Syst 27(4):964–977
Rahmani S, Khajehvand V, Torabian M (2020) Burstiness-aware virtual machine placement in cloud computing systems. J Supercomput 76(1):362–387
Monshizadeh Naeen H, Zeinali E, Toroghi Haghighat A (2020) A stochastic process-based server consolidation approach for dynamic workloads in cloud data centers. J Supercomput 76(3):1903–1930
Li H, Zhu G, Zhao Y, Dai Y, Tian W (2017) Energy-efficient and QoS-aware model based resource consolidation in cloud data centers. Clust Comput 20:2793–2803
Monshizadeh Naeen H (2022) Cost reduction using SLA-aware genetic algorithm for consolidation of virtual machines in cloud data centers. Int J Inf Commun Technol Res 14(2):14–22
Farahnakian F, Ashraf A, Pahikkala T, Liljeberg P, Plosila J, Porres I, Tenhunen H (2014) Using ant colony system to consolidate VMS for green cloud computing. IEEE Trans Serv Comput 8(2):187–198
Tang M, Pan S (2015) A hybrid genetic algorithm for the energy-efficient virtual machine placement problem in data centers. Neural Process Lett 41:211–221
Wu G, Tang M, Tian Y-C, Li W (2012) Energy-efficient virtual machine placement in data centers by genetic algorithm. In: Neural information processing: 19th international conference, ICONIP 2012, Doha, Qatar, November 12–15, 2012, Proceedings, Part III 19, pp 315–323. Springer
Kurowski K, Oleksiak A, Piątek W, Piontek T, Przybyszewski A, Węglarz J (2013) Dcworms-a tool for simulation of energy efficiency in distributed computing infrastructures. Simul Model Pract Theory 39:135–151
Jararweh Y, Jarrah M, Alshara Z, Alsaleh MN, Al-Ayyoub M et al (2014) Cloudexp: a comprehensive cloud computing experimental framework. Simul Model Pract Theory 49:180–192
Castañé GG, Nunez A, Llopis P, Carretero J (2013) E-mc2: a formal framework for energy modelling in cloud computing. Simul Model Pract Theory 39:56–75
Zhou Z, Shojafar M, Abawajy J, Yin H, Lu H (2021) ECMS: an edge intelligent energy efficient model in mobile edge computing. IEEE Trans Green Commun Netw 6(1):238–247
Zhou Z, Abawajy JH, Li F, Hu Z, Chowdhury MU, Alelaiwi A, Li K (2017) Fine-grained energy consumption model of servers based on task characteristics in cloud data center. IEEE Access 6:27080–27090
Zhou Z, Shojafar M, Alazab M, Li F (2022) IECL: an intelligent energy consumption model for cloud manufacturing. IEEE Trans Ind Inf 18(12):8967–8976
Fan X, Weber W-D, Barroso LA (2007) Power provisioning for a warehouse-sized computer. ACM SIGARCH Comput Archit News 35(2):13–23
Montgomery DC (2019) Introduction to statistical quality control. Wiley
Ross SM (2014) Introduction to probability models. Academic Press
Calheiros RN, Ranjan R, Beloglazov A, De Rose CA, Buyya R (2011) Cloudsim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms. Softw: Pract Exp 41(1):23–50
Park K, Pai VS (2006) CoMon: a mostly-scalable monitoring system for planetlab. ACM SIGOPS Oper Syst Rev 40(1):65–74
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare no potential conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Monshizadeh Naeen, M.A., Ghaffari, H.R. & Monshizadeh Naeen, H. Cloud data center cost management using virtual machine consolidation with an improved artificial feeding birds algorithm. Computing (2024). https://doi.org/10.1007/s00607-024-01267-0
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s00607-024-01267-0