Abstract
An accurate host power model is necessary for effective power management in data centers which is crucial for reducing energy consumption and cost. One should evaluate the power models for different workloads and host configurations. We have analyzed several existing power models by varying the workload type (CPU, memory, and disk-intensive) and host configurations. By analyzing the system performance and nature of the power consumption of the hosts, we have identified some performance counter parameters that determine the system power consumption. We have proposed three power models based on multi-variable Linear Regression, Support Vector Regression (SVR), and Artificial Neural Network (ANN). Experimental results show that compared to the existing models, our proposed power models, especially those based on SVR and ANN, more accurately predict the power consumption of the hosts. We have also conducted simulation experiments to show the importance of the power model in the energy-efficient resource management of the hosts in the data center. Results show that the use of our SVR-based and ANN-based power models in a resource management approach can effectively decrease the energy consumption of the data center. Moreover, we have proposed an energy-efficient virtual machine (VM) placement and consolidation algorithm that further reduces energy consumption. At first, we formulated a model using integer linear programming. Then, we designed a heuristic based on Vogel’s Approximation Method. Extensive simulation on the CloudSim platform with benchmark workload data and the Google Cloud trace logs shows that our approach outperforms the state-of-the-art algorithms under comparison in terms of energy efficiency and quality of service (QoS). The results also highlight the importance of a suitable VM placement and consolidation approach and an accurate power model in reducing energy consumption.
Similar content being viewed by others
Data Availability
The Google Cloud traces data analyzed during the current study has been obtained from “Borg cluster traces from Google” (https://github.com/google/cluster-data). The benchmarks used in the current study have been obtained from “Systench” (https://github.com/akopytov/sysbench), “Lookbusy” (http://www.devin.com/lookbusy/), “Ramspeed” (https://github.com/cruvolo/ramspeed-smp ), and “IOzone benchmark” (https://openbenchmarking.org/test/pts/iozone-1.9.5).
References
(2016) Iozone filesystem benchmark. http://www.iozone.org/, accessed: 06 March 2022
(2016) Vogel’s approximation method. https://businessjargons.com/vogels-approximation-method.html, accessed: 12 March 2022
(2021) Google cluster traces. https://github.com/google/cluster-data, accessed: 06 March 2022
(2021) Pcmark benchmark. https://benchmarks.ul.com/pcmark10, accessed: 06 March 2022
(2021) The SPECpower Benchmark. https://www.spec.org/power_ssj2008/results/, accessed: 06 March 2022
Akopytov: Sysbench. https://github.com/akopytov/sysbench , accessed: 06 March 2022 (2021)
Atiewi, S., Yussof, S., Ezanee, M., Almiani, M.: A review energy-efficient task scheduling algorithms in cloud computing. In: 2016 IEEE long island systems, applications and technology conference (LISAT), IEEE, pp. 1-6 (2016)
Awad, M., Khanna, R.: Support vector regression. In: Efficient learning machines. Springer, pp. 67–80 (2015)
Barroso, L.A., Hölzle, U.: The datacenter as a computer: an introduction to the design of warehouse-scale machines. Synthesis Lectures on Computer Architecture 4(1), 1–108 (2009)
Beloglazov, A., Buyya, R.: Optimal online deterministic algorithms and adaptive heuristics for energy and performance efficient dynamic consolidation of virtual machines in cloud data centers. Concurrency and Computation: Practice and Experience 24(13), 1397–1420 (2012)
Beloglazov, A., Abawajy, J., Buyya, R.: Energy-aware resource allocation heuristics for efficient management of data centers for cloud computing. Futur. Gener. Comput. Syst. 28(5), 755–768 (2012)
Bohra, A.E.H., Chaudhary, V.: Vmeter: power modelling for virtualized clouds. In: 2010 ieee international symposium on parallel & distributed processing, workshops and phd forum (ipdpsw). Ieee, pp. 1–8 (2010)
Calheiros, R.N., Ranjan, R., Beloglazov, A., De Rose, C.A, Buyya, R.: CloudSim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms. Software: Practice and Experience 41(1), 23–50 (2011)
Carraway, D.: Lookbusy synthetic load generator. http://www.devin.com/lookbusy/, accessed: 06 March 2022 (2013)
Chen, H., Zhu, X., Qiu, D., Guo, H., Yang, L.T., Lu, P.: Eons: minimizing energy consumption for executing real-time Workflows in Virtualized cloud data centers. IEEE, ICPPW (2016)
Cheung, H., Wang, S., Zhuang, C., Gu, J.: A simplified power consumption model of information technology (it) equipment in data centers for energy system real-time dynamic simulation. Appl. Energy 222, 329–342 (2018)
Council NRD: America’s data centers consuming and wasting growing amounts of energy. https://www.nrdc.org/resources/americas-data-centers-consuming-and-wasting-growing-amounts-energy, Accessed: 04 March 2022 (2015)
Cruvolo: Ramspeed. https://github.com/cruvolo/ramspeed-smp . Accessed: 06 March 2022 (2018)
Cupertino, L.F., Da Costa, G., Pierson, J.M.: Towards a generic power estimator. Comput. Sci.-Res. Dev. 30(2), 145–153 (2015)
Dayarathna, M., Wen, Y., Fan, R.: Data center energy consumption modeling: a survey. IEEE Commun. Surveys Tutorials 18(1), 732–794 (2015)
Fan, X., Weber, W.D., Barroso, W.-D.: La: power provisioning for a warehouse-sized computer. In: Proce. of the 34th int. symposium on computer architecture, pp. 13–23 (2007)
Ghribi, C., Hadji, M., Zeghlache, D.: Energy efficient Vm scheduling for cloud data centers: exact allocation and migration algorithms. In: 2013 13th IEEE/ACM international symposium on cluster, cloud, and grid computing, IEEE, pp. 671-678 (2013)
Han, G., Que, W., Jia, G., Shu, L.: An efficient virtual machine consolidation scheme for multimedia cloud computing. Sensors 16(2), 246 (2016)
Huang, G.B., Chen, L., Siew, C.K., et al.: Universal approximation using incremental constructive feedforward networks with random hidden nodes. IEEE Trans. Neural Netw. 17(4), 879–892 (2006)
Ibrahim, A., Noshy, M., Ali, H.A., Badawy, M.: Papso: a power-aware vm placement technique based on particle swarm optimization. IEEE Access 8, 81747–81764 (2020)
Ismail, L., Materwala, H.: Computing server power modeling in a data center: survey, taxonomy, and performance evaluation. ACM Comput. Surveys (CSUR) 53(3), 1–34 (2020)
Jarus, M., Oleksiak, A., Piontek, T.: Wglarz, J. Runtime power usage estimation of hpc servers for various classes of real-life applications. Future Generation Computer Systems 36, 299–310 (2014)
Jin, C., Bai, X., Yang, C., Mao, W., Xu, X.: A review of power consumption models of servers in data centers. Appl. Energy 265, 114806 (2020)
Kansal, A., Zhao, F., Liu, J., Kothari, N., Bhattacharya, A.A.: Virtual machine power metering and provisioning. In: Proceedings of the 1st ACM symposium on cloud computing, pp. 39–50 (2010)
Li, Y., Wang, Y., Yin, B., Guan, L.: An online power metering model for cloud environment. In: 2012 ieee 11th International symposium on network computing and applications, IEEE, pp. 175–180 (2012)
Lin, W., Wu, G., Wang, X., Li, K.: An artificial neural network approach to power consumption model construction for servers in cloud data centers. IEEE Trans. Sustainable Comput. 5(3), 329–340 (2019a)
Lin, W., Wu, W., He, L.: An on-line virtual machine consolidation strategy for dual improvement in performance and energy conservation of server clusters in cloud data centers. IEEE Trans. Services Comput. (2019b)
Lin, W., Shi, F., Wu, W., Li, K., Wu, G., Mohammed, A.A.: A taxonomy and survey of power models and power modeling for cloud servers. ACM Comput. Surveys (CSUR) 53(5), 1–41 (2020)
Luo, L., Wu, W., Tsai, W.T., Di, D, Zhang, F: Simulation of power consumption of cloud data centers. Simul. Model. Pract. Theory 39, 152–171 (2013)
Malato, G.: Hyperparameter tuning with grid search and random search. https://www.yourdatateacher.com/2021/05/19/hyperparameter-tuning-grid-search-and-random-search/, accessed: 06 March 2022 (2021)
Mann, Z.Á.: Multicore-aware virtual machine placement in cloud data centers. IEEE Trans. Comput. 65(11), 3357–3369 (2016)
McCullough, J.C., Agarwal, Y., Chandrashekar, J., Kuppuswamy, S., Snoeren, A.C., Gupta, R.K.: Evaluating the effectiveness of model-based power characterization. In: USENIX annual technical Conf, vol. 20 (2011)
Möbius, C., Dargie, W., Schill, A.: Power consumption estimation models for processors, virtual machines, and servers. IEEE Trans Parallel Distribut. Syst. 25(6), 1600–1614 (2013)
Moreno, I.S., Garraghan, P., Townend, P., Xu, J.: An approach for characterizing workloads in google cloud to derive realistic resource utilization models. In: 2013 IEEE seventh international symposium on service-oriented system engineering, pp 49–60. IEEE (2013)
OpenBenchmarking. Iozone. https://openbenchmarking.org/test/pts/iozone-1.9.5, accessed: 06 March 2022 (2021a)
OpenBenchmarking. Ramspeed benchmark. https://openbenchmarking.org/test/pts/ramspeed-1.4.3, accessed: 06 March 2022 (2021b)
Reda, S., Nowroz, A.N.: Power modeling and characterization of computing devices: a survey. Foundations and Trends in Electronic Design Automation 6(2), 121–216 (2012)
Saadi, Y., El Kafhali, S.: Energy-efficient strategy for virtual machine consolidation in cloud environment. Soft. Comput. 24(19), 14845–14859 (2020)
Sagi, M., Doan, N.A.V., Fasfous, N., Wild, T., Herkersdorf, A.: Fine-grained power modeling of multicore processors using ffnns. In: International conference on embedded computer systems, pp. 186–199. Springer (2020)
Tarafdar, A., Debnath, M., Khatua, S., Das, RK.: Energy and quality of service-aware virtual machine consolidation in a cloud data center. Journal of Supercomputing, vol. 76(11) (2020)
Tarafdar, A., Debnath, M., Khatua, S., Das, R.K.: Energy and makespan aware scheduling of deadline sensitive tasks in the cloud environment. Journal of Grid Computing 19(2), 1–25 (2021a)
Tarafdar, A., Karmakar, K., Khatua, S., Das, R.K.: Energy-efficient scheduling of deadline-sensitive and budget-constrained workflows in the cloud. In: International conference on distributed computing and internet technology. Springer, pp. 65–80 (2021b)
Varasteh, A., Goudarzi, M.: Server consolidation techniques in virtualized data centers: a survey. IEEE Syst. J. 11(2), 772–783 (2015)
Wiki: Sysbench benchmark. https://wiki.gentoo.org/wiki/Sysbench, accessed: 06 March 2022 (2020)
Witkowski, M., Oleksiak, A., Piontek, T., Węglarz, J.: Practical power consumption estimation for real life hpc applications. Future Generation Comput. Syst. 29(1), 208–217 (2013)
Zhang, R., Chen, Y., Dong, B., Tian, F., Zheng, Q.: A genetic algorithm-based energy-efficient container placement strategy in caas. IEEE Access 7, 121360–121373 (2019a)
Zhang, W, Wen, Y, Wong, Y W, Toh, K C, Chen, C H: Towards joint optimization over ict and cooling systems in data centre: a survey. IEEE Commun. Surveys Tutor. 18(3), 1596–1616 (2016)
Zhang, X, Lu, J J, Qin, X, Zhao, X N: A high-level energy consumption model for heterogeneous data centers. Simul. Model. Pract. Theory 39, 41–55 (2013)
Zhang, X, Wu, T, Chen, M, Wei, T, Zhou, J, Hu, S, Buyya, R: Energy-aware virtual machine allocation for cloud with resource reservation. J. Syst. Softw. 147, 147–161 (2019b)
Zhu, H., Dai, H., Yang, S., Yan, Y., Lin, B.: Estimating power consumption of servers using gaussian mixture model. In: 2017 fifth international symposium on computing and networking (CANDAR), pp 427433. IEEE (2017)
Acknowledgements
We would like to acknowledge the UGC-NET Junior Research Fellowship (UGC-Ref. No.: 3610/(NET-NOV 2017)) provided by the University Grants Commission, Government of India, and the Visvesvaraya PhD Scheme of Ministry of Electronics & Information Technology, Government of India (Ref. No. MLA/MUM/GA/10(37)C) for supporting this research work.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interests
The authors declare that they have no conflict of interest.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Tarafdar, A., Sarkar, S., Das, R.K. et al. Power Modeling for Energy-Efficient Resource Management in a Cloud Data Center. J Grid Computing 21, 10 (2023). https://doi.org/10.1007/s10723-023-09642-5
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10723-023-09642-5