Methodology for energy aware adaptive management of virtualized data centers
- 248 Downloads
This paper proposes a methodology for energy aware management of virtualized data centers (DC) based on dynamically adapting and scaling the computing capacity to the characteristics of the workload. To assess the energy efficiency of DC operation, we have defined a novel ontological model for representing its energy and performance characteristics and a new metric for aggregating Green and Key Performance Indicators and calculating at run-time the DC Greenness Level. Workload balancing and consolidation is achieved by means of an automated reinforcement learning-based decision process targeting to increase the workload density and to scale down the unused computing resources. Evaluation results show that up to 15.6 % energy savings are obtained on our test bed DC. Tests conducted in a simulated environment show that the time and space overhead of our methodology are within reasonable limits and that by organizing the servers in hierarchical clusters, the methodology can manage highly dynamic workload in large DCs with thousands of servers. The methodology is already implemented in the Green Cloud Scheduler, an official component of the OpenNebula Middleware which is available in the OpenNebula Ecosystem web site to be downloaded and used.
KeywordsEnergy efficient data centers Green management of computing resources Energy awareness Cloud computing Reinforcement learning
This work has been partially funded by the GAMES project (2012) and has been partly funded by the European Commission ICT activity of the 7th Framework Program (number ICT-248514). This work expresses the opinions of the authors and not necessarily those of the European Commission. The European Commission is not liable for any use that may be made of the information contained in this work. This document is a collaborative effort. The scientific contribution of all authors is the same.
Compliance with ethical standards
This study was funded by GAMES FP7 project (grant number ICT-248,514).
Conflict of interest
The authors declare that they have no conflict of interest.
This article does not contain any studies with human participants or animals performed by any of the authors.
- America’s Data Centers Consuming and Wasting Growing Amounts of Energy. (2015). https://www.nrdc.org/resources/americas-data-centers-consuming-and-wasting-growin.
- Industry Outlook. (2014). Data center energy efficiency. The Data Center Journal. http://www.datacenterjournal.com/it/industry-outlook-data-center-energy-efficiency/.
- Benik, A., & Ventures, B. (2013). The sorry state of server utilization and the impending post-hypervisor era. https://gigaom.com/2013/11/30/the-sorry-state-of-server-utilization-and-the-impending-post-hypervisor-era/.
- Zhang, Z, Hsu, C.-C., & Chang, M. (2015). Cool cloud: a practical dynamic virtual machine placement framework for energy aware data centers, IEEE 8th International Conference on Cloud Computing.Google Scholar
- Kayed, A., & Akijian, T. (2015). Resource allocation technique to obtain energy efficient cloud, ICEMIS’15, September 24–26, Istanbul, Turkey.Google Scholar
- Delforge, P., & Whitney, J. (2014). Data center efficiency assessment, scaling up energy efficiency across the data center industry: evaluating key drivers and barriers. https://www.nrdc.org/energy/files/data-center-efficiency-assessment-IP.pdf.
- Oikonomou, E., Panagiotou, D., & Rouskas, A. (2015). Energy-aware management of virtual machines in cloud data centers, 16th EANN workshops, September 25–28, Rhodes Island, Greece.Google Scholar
- Panagiotou, D., Oikonomou, E., & Rouskas, A. (2015). Energy-efficient virtual machine provisioning mechanism in cloud computing environments. Proceedings of the 19th Panhellenic Conference on Informatics (pp. 197–202).Google Scholar
- Liao, D., Li, K., Sun, G., Anand, V., Gong, Y., & Tan, Z. (2015). Energy and performance management in large data centers: a queuing theory perspective. International Conference on Computing, Networking and Communications (ICNC), Workshop on Computing, Networking and Communications (CNC).Google Scholar
- Lin, H., Qi, X., Yang, S., & Midkiff, S. P. (2015). Workload-driven VM consolidation in Cloud Data Center, IEEE 29th International Parallel and Distributed Processing Symposium.Google Scholar
- Barbagallo, D., Di Nitto, E., Dubois, D., & Mirandola, R. (2010). A bio-inspired algorithm for energy optimization in a self-organizing data center, in proceedings first international conference on self-organizing architectures. LNCS, 6090, 127–151.Google Scholar
- Csorba, M., Meling, H., & Heegaard, P. (2010). Ant system for service deployment in private and public clouds. In Proceedings of the 2nd workshop on Bio-inspired algorithms for distributed systems. Washington, USA, pp. 19–28. doi: 10.1145/1809018.1809024.
- Khan, A., Yan, X., Tao, S., & Anerousis, N. (2012). Workload characterization and prediction in the cloud: a multiple time series approach. In Network Operations and Management Symposium (NOMS), IEEE, Hawaii, USA, pp. 1287–1294. doi: 10.1109/NOMS.2012.6212065.
- Ardito, L., & Morisio, M. (2013). Green IT—available data and guidelines for reducing energy consumption in IT systems, Sustainable Computing: Informatics and Systems, Elsevier. Available online. http://www.sciencedirect.com/science/article/pii/S2210537913000504.
- Huai, W., Huang, W., Jin, S., & Qian, Z. (2015). Towards energy efficient scheduling for online tasks in cloud data centers based on DVFS. 9th International Conference on Innovative Mobile and Internet Services in Ubiquitous Computing.Google Scholar
- Hieu, N. T., Di Francesco, M., & Ylä-Jääski, A. (2015). Virtual machine consolidation with usage prediction for energy-efficient cloud data centers. IEEE 8th International Conference on Cloud Computing.Google Scholar
- FIT4GREEN FP7 Project. (2012). http://www.fit4green.eu/.
- Mondal, S. K., & Muppala, J. K. (2014). Energy modeling of virtual machine replication schemes with checkpointing in data centers. IEEE Fourth International Conference on Big Data and Cloud Computing.Google Scholar
- Cioara, T., Anghel, I., Salomie, I., Copil, G., Moldovan, D., & Pernici, B. (2011). A context aware self-adapting algorithm for managing the energy efficiency of IT service centres. Ubiquitous Computing and Communication Journal, 6 (1).Google Scholar
- Salomie, I., Cioara, T., Anghel, I., & Dinsoreanu, M. (2008). RAP—a basic context awareness model. In Proceedings of the 4th International Conference on Intelligent Computer Communication and Processing. IEEE, pp. 315–318. doi: 10.1109/ICCP.2008.4648395.
- Nagios. (2016). The industry standard in IT infrastructure monitoring. http://www.nagios.org/.
- Kipp, A., Liu, J., Jiang, T., Buchholz, J., Schubert, L., Berge, M., & Christmann, W. (2011). Testbed architecture for generic, energy-aware evaluations and optimisations. Proc. of the First International Conference on Advanced Communications and Computation, Spain.Google Scholar
- CLM5. (2012). Christ-Elektronik Power Meter. http://www.christ-elektronik.com.
- OpenNebula Cloud Data Center Management Solution. (2016). http://opennebula.org/.
- KVM. (2012). Kernel Based Virtual Machine. http://www.linux-kvm.org/page/Main_Page.
- OpenSSH. (2012). Free SSH implementation. http://www.openssh.com/.
- Wake-On-LAN. (2012). http://wakeonlan.me/.
- TPC-Energy Specification. (2012). http://www.tpc.org/tpc_energy/default.asp.
- Spec. (2008). Standard Performance Evaluation Corporation, http://www.spec.org/power_ssj2008/.
- Stanley, J., Brill, K., & Koomey, J. (2009). Four metrics define data center greenness. Uptime Institute White paper. http://uptimeinstitute.org.
- Protégé. (2012). Protégé home. http://protege.stanford.edu/.
- KAON2 Introduction. (2012). http://kaon2.semanticweb.org/.
- HSQLDB. (2012). 100 % Java Database. http://hsqldb.org.
- Hibernate persistence. (2012). http://www.hibernate.org/.
- Prevayler. (2012). Prevayler API documentation. http://prevayler.org/.
- Pellet. (2012). Pellet Features. http://clarkparsia.com/pellet/features/.
- Reasoners and rule engines: Jena inference support. (2012). http://jena.sourceforge.net/inference/.
- SWRL. (2012). A semantic web rule language combining OWL and rule ML. http://www.w3.org/Submission/SWRL/.
- Johnson, P., & Marker, T. (2009). Data centre energy efficiency product profile report No 2009/05, Prepared for Equipment Energy Efficiency Committee. http://www.energyrating.gov.au/wp-content/uploads/Energy_Rating_Documents/Product_Profiles/Other/Data_Centres/200905-data-centre-efficiency.pdf.
- GAMES project. (2012). Green active management of energy in IT service centers. http://www.green-datacenters.eu/.
- GEYSER project. (2016). Green networked data centers as energy prosumers in smart city environments. http://www.geyser-project.eu/.
- OpenNebula Green Cloud Scheduler. (2012). http://community.opennebula.org/ecosystem:green_cloud_scheduler.
- Smart City Cluster. (2016). http://www.dc4cities.eu/en/smart-city-cluster-releases-new-report-on-measurement-and-verification-methodologies/.
- Environmentally sustainable data centre for Smart Cities. (2016). http://www.dc4cities.eu/en/.
- Dupont, C., Giuliani, G., Hermenier, F., Schulze, T., & Somov, A. (2012). An energy aware framework for virtual machine placement in cloud federated data centres. Proceeding of 3rd International Conference on Future Energy Systems: where energy, computing and communication meet.Google Scholar
- Lent, R. (2013). A model of a network server performance and power consumption. Sustainable Computing: Informatics and Systems, 3(2).Google Scholar