Abstract
Power consumption and cooling overheads are becoming increasingly significant for enterprise datacenters, affecting overall costs and the ability to extend resource capacities. To help mitigate these issues, active power management technologies are being deployed aggressively, including power budgeting, which enables improved power provisioning and can address critical periods when power delivery or cooling capabilities are temporarily reduced. Given the use of virtualization to encapsulate application components into virtual machines (VMs), however, such power management capabilities must address the interplay between budgeting physical resources and the performance of the virtual machines used to run these applications. This paper proposes a set of management components and abstractions for use by software power budgeting policies. The key idea is to manage power from a VM-centric point of view, where the goal is to be aware of global utility tradeoffs between different virtual machines (and their applications) when maintaining power constraints for the physical hardware on which they run. Our approach to VM-aware power budgeting uses multiple distributed managers integrated into the VirtualPower Management (VPM) framework whose actions are coordinated via a new abstraction, termed VPM tokens. An implementation with the Xen hypervisor illustrates technical benefits of VPM tokens that include up to 43% improvements in global utility, highlighting the ability to dynamically improve cluster performance while still meeting power budgets. We also demonstrate how VirtualPower based budgeting technologies can be leveraged to improve datacenter efficiency in the context of cooling infrastructure management.
Similar content being viewed by others
References
Abbasi, H., Wolf, M., Schwan, K.: Live data workspace: a flexible, dynamic and extensible platform for petascale applications. In: Proceedings of IEEE Cluster Computing Conference, 2007
Amazon Elastic Compute Cloud. http://aws.amazon.com/ec2
Barham, P., Dragovic, B., Fraser, K., Hand, S., Harris, T., Ho, A., Neugebauer, R., Pratt, I., Warfield, A.: Xen and the art of virtualization. In: Proceedings of the ACM Symposium on Operating Systems Principles (SOSP), 2003
Chase, J., Anderson, D., Thakar, P., Vahdat, A., Doyle, R.: Managing energy and server resources in hosting centers. In: Proceedings of the 18th Symposium on Operating Systems Principles (SOSP), 2001
Clark, C., Fraser, K., Hand, S., Hansen, J.G., Jul, E., Limpach, C., Pratt, I., Warfield, A.: Live migration of virtual machines. In: Proceedings of the 2nd ACM/USENIX Symposium on Networked Systems Design and Implementation (NSDI), May 2005
Elnozahy, E.N., Kistler, M., Rajamony, R.: Energy-efficient server clusters. In: Proceedings of the Workshop on Power-Aware Computing Systems, February 2002
Fan, X., Weber, W.-D., Barroso, L.: Power provisioning for a warehouse-sized computer. In: Proceedings of the International Symposium on Computer Architecture (ISCA), June 2007
Femal, M., Freeh, V.: Boosting data center performance through non-uniform power allocation. In: Proceedings of the IEEE International Conference on Autonomic Computing (ICAC), 2005
Ge, R., Feng, X., Feng, W., Cameron, K.: CPU miser: a performance-directed, run-time system for power-aware clusters. In: Proceedings of the International Conference on Parallel Processing (ICPP), 2007
Ghiasi, S., Keller, T., Rawson, F.: Scheduling for heterogeneous processors in server systems. In: Proceedings of the International Conference on Computing Frontiers, 2005
Heath, T., Centeno, A.P., George, P., Ramos, L., Jaluria, Y., Bianchini, R.: Mercury and freon: temperature emulation and management in server systems. In: Proceedings of the International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS), October 2006
Heath, T., Diniz, B., Carrera, E.V., Meira, W. Jr., Bianchini, R.: Energy conservation in heterogeneous server clusters. In: Proceedings of the 10th Symposium on Principles and Practice of Parallel Programming (PPoPP), 2005
Hewlett-Packard, Intel, Microsoft, Phoenix, and Toshiba. Advanced configuration and power interface specification. http://www.acpi.info, September 2004
Koh, Y., Knauerhase, R., Brett, P., Bowman, M., Wen, Z., Pu, C.: An analysis of performance interference effects in virtual environments. In: Proceedings of the IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS), 2007
Kotla, R., Ghiasi, S., Keller, T., Rawson, F.: Scheduling processor voltage and frequency in server and cluster systems. In: Proceedings of the Workshop on High-Performance, Power-Aware Computing (HP-PAC), 2005
Kumar, R., Tullsen, D., Ranganathan, P., Jouppi, N., Farkas, K.: Single-isa heterogeneous multi-core architectures for multithreaded workload performance. In: Proceedings of the International Symposium on Computer Architecture (ISCA), June 2004
Lefurgy, C., Wang, X., Ware, M.: Server-level power control. In: Proceedings of the IEEE International Conference on Autonomic Computing (ICAC), June 2007
Lim, M., Freeh, V., Lowenthal, D.: Adaptive, transparent frequency and voltage scaling of communication phases in mpi programs. In: IEEE/ACM Supercomputing, November 2006
Mallik, A., Cosgrove, J., Dick, R., Memik, G., Dinda, P.: Picsel: measuring user-perceived performance to control dynamic frequency scaling. In: Proceedings of the 13th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS), March 2008
Moore, J., Chase, J., Ranganathan, P., Sharma, R.: Making scheduling cool: temperature-aware workload placement in data centers. In: Proceedings of the USENIX Annual Technical Conference, June 2005
Nathuji, R., Isci, C., Gorbatov, E.: Exploiting platform heterogeneity for power efficient data centers. In: Proceedings of the IEEE International Conference on Autonomic Computing (ICAC), June 2007
Nathuji, R., Schwan, K.: Virtualpower: coordinated power management in virtualized enterprise systems. In: Proceedings of the 21st ACM Symposium on Operating Systems Principles (SOSP), October 2007
Neiger, G., Santoni, A., Leung, F., Rodgers, D., Uhlig, R.: Intel virtualization technology: hardware support for efficient processor virtualization. In: Intel Technology Journal (http://www.intel.com/technology/itj/2006/v10i3/), August (2006)
Rajamani, K., Lefurgy, C.: On evaluating request-distribution schemes for saving energy in server clusters. In: Proceedings of the IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS), March 2003
Ranganathan, P., Leech, P., Irwin, D., Chase, J.: Ensemble-level power management for dense blade servers. In: Proceedings of the International Symposium on Computer Architecture (ISCA), 2006
Rountree, B., Lowenthal, D., Funk, S., Freeh, V., Supinski, B., Schulz, M.: Bounding energy consumption in large-scale mpi programs. In: IEEE/ACM Supercomputing, November 2007
Stoess, J., Lang, C., Bellosa, F.: Energy management for hypervisor-based virtual machines. In: Proceedings of the USENIX Annual Technical Conference, June 2007
Sugerman, J., Venkitachalam, G., Lim, B.-H.: Virtualizing i/o devices on vmware workstation’s hosted virtual machine monitor. In: Proceedings of the USENIX Annual Technical Conference, 2001
Waldspurger, C., Weihl, W.: Lottery scheduling: Flexible proportional-share resource management. In: Proceedings of the First Symposium on Operating System Design and Implementation (OSDI), 1994
Walsh, W., Tesauro, G., Kephart, J., Das, R.: Utility functions in autonomic systems. In: Proceedings of the IEEE International Conference on Autonomic Computing (ICAC), 2004
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Nathuji, R., Schwan, K., Somani, A. et al. VPM tokens: virtual machine-aware power budgeting in datacenters. Cluster Comput 12, 189–203 (2009). https://doi.org/10.1007/s10586-009-0077-z
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10586-009-0077-z