Skip to main content
Log in

VPM tokens: virtual machine-aware power budgeting in datacenters

  • Published:
Cluster Computing Aims and scope Submit manuscript

Abstract

Power consumption and cooling overheads are becoming increasingly significant for enterprise datacenters, affecting overall costs and the ability to extend resource capacities. To help mitigate these issues, active power management technologies are being deployed aggressively, including power budgeting, which enables improved power provisioning and can address critical periods when power delivery or cooling capabilities are temporarily reduced. Given the use of virtualization to encapsulate application components into virtual machines (VMs), however, such power management capabilities must address the interplay between budgeting physical resources and the performance of the virtual machines used to run these applications. This paper proposes a set of management components and abstractions for use by software power budgeting policies. The key idea is to manage power from a VM-centric point of view, where the goal is to be aware of global utility tradeoffs between different virtual machines (and their applications) when maintaining power constraints for the physical hardware on which they run. Our approach to VM-aware power budgeting uses multiple distributed managers integrated into the VirtualPower Management (VPM) framework whose actions are coordinated via a new abstraction, termed VPM tokens. An implementation with the Xen hypervisor illustrates technical benefits of VPM tokens that include up to 43% improvements in global utility, highlighting the ability to dynamically improve cluster performance while still meeting power budgets. We also demonstrate how VirtualPower based budgeting technologies can be leveraged to improve datacenter efficiency in the context of cooling infrastructure management.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Abbasi, H., Wolf, M., Schwan, K.: Live data workspace: a flexible, dynamic and extensible platform for petascale applications. In: Proceedings of IEEE Cluster Computing Conference, 2007

  2. Amazon Elastic Compute Cloud. http://aws.amazon.com/ec2

  3. Barham, P., Dragovic, B., Fraser, K., Hand, S., Harris, T., Ho, A., Neugebauer, R., Pratt, I., Warfield, A.: Xen and the art of virtualization. In: Proceedings of the ACM Symposium on Operating Systems Principles (SOSP), 2003

  4. Chase, J., Anderson, D., Thakar, P., Vahdat, A., Doyle, R.: Managing energy and server resources in hosting centers. In: Proceedings of the 18th Symposium on Operating Systems Principles (SOSP), 2001

  5. Clark, C., Fraser, K., Hand, S., Hansen, J.G., Jul, E., Limpach, C., Pratt, I., Warfield, A.: Live migration of virtual machines. In: Proceedings of the 2nd ACM/USENIX Symposium on Networked Systems Design and Implementation (NSDI), May 2005

  6. Elnozahy, E.N., Kistler, M., Rajamony, R.: Energy-efficient server clusters. In: Proceedings of the Workshop on Power-Aware Computing Systems, February 2002

  7. Fan, X., Weber, W.-D., Barroso, L.: Power provisioning for a warehouse-sized computer. In: Proceedings of the International Symposium on Computer Architecture (ISCA), June 2007

  8. Femal, M., Freeh, V.: Boosting data center performance through non-uniform power allocation. In: Proceedings of the IEEE International Conference on Autonomic Computing (ICAC), 2005

  9. Ge, R., Feng, X., Feng, W., Cameron, K.: CPU miser: a performance-directed, run-time system for power-aware clusters. In: Proceedings of the International Conference on Parallel Processing (ICPP), 2007

  10. Ghiasi, S., Keller, T., Rawson, F.: Scheduling for heterogeneous processors in server systems. In: Proceedings of the International Conference on Computing Frontiers, 2005

  11. Heath, T., Centeno, A.P., George, P., Ramos, L., Jaluria, Y., Bianchini, R.: Mercury and freon: temperature emulation and management in server systems. In: Proceedings of the International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS), October 2006

  12. Heath, T., Diniz, B., Carrera, E.V., Meira, W. Jr., Bianchini, R.: Energy conservation in heterogeneous server clusters. In: Proceedings of the 10th Symposium on Principles and Practice of Parallel Programming (PPoPP), 2005

  13. Hewlett-Packard, Intel, Microsoft, Phoenix, and Toshiba. Advanced configuration and power interface specification. http://www.acpi.info, September 2004

  14. Koh, Y., Knauerhase, R., Brett, P., Bowman, M., Wen, Z., Pu, C.: An analysis of performance interference effects in virtual environments. In: Proceedings of the IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS), 2007

  15. Kotla, R., Ghiasi, S., Keller, T., Rawson, F.: Scheduling processor voltage and frequency in server and cluster systems. In: Proceedings of the Workshop on High-Performance, Power-Aware Computing (HP-PAC), 2005

  16. Kumar, R., Tullsen, D., Ranganathan, P., Jouppi, N., Farkas, K.: Single-isa heterogeneous multi-core architectures for multithreaded workload performance. In: Proceedings of the International Symposium on Computer Architecture (ISCA), June 2004

  17. Lefurgy, C., Wang, X., Ware, M.: Server-level power control. In: Proceedings of the IEEE International Conference on Autonomic Computing (ICAC), June 2007

  18. Lim, M., Freeh, V., Lowenthal, D.: Adaptive, transparent frequency and voltage scaling of communication phases in mpi programs. In: IEEE/ACM Supercomputing, November 2006

  19. Mallik, A., Cosgrove, J., Dick, R., Memik, G., Dinda, P.: Picsel: measuring user-perceived performance to control dynamic frequency scaling. In: Proceedings of the 13th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS), March 2008

  20. Moore, J., Chase, J., Ranganathan, P., Sharma, R.: Making scheduling cool: temperature-aware workload placement in data centers. In: Proceedings of the USENIX Annual Technical Conference, June 2005

  21. Nathuji, R., Isci, C., Gorbatov, E.: Exploiting platform heterogeneity for power efficient data centers. In: Proceedings of the IEEE International Conference on Autonomic Computing (ICAC), June 2007

  22. Nathuji, R., Schwan, K.: Virtualpower: coordinated power management in virtualized enterprise systems. In: Proceedings of the 21st ACM Symposium on Operating Systems Principles (SOSP), October 2007

  23. Neiger, G., Santoni, A., Leung, F., Rodgers, D., Uhlig, R.: Intel virtualization technology: hardware support for efficient processor virtualization. In: Intel Technology Journal (http://www.intel.com/technology/itj/2006/v10i3/), August (2006)

  24. Nutch. http://lucene.apache.org/nutch

  25. Rajamani, K., Lefurgy, C.: On evaluating request-distribution schemes for saving energy in server clusters. In: Proceedings of the IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS), March 2003

  26. Ranganathan, P., Leech, P., Irwin, D., Chase, J.: Ensemble-level power management for dense blade servers. In: Proceedings of the International Symposium on Computer Architecture (ISCA), 2006

  27. Rountree, B., Lowenthal, D., Funk, S., Freeh, V., Supinski, B., Schulz, M.: Bounding energy consumption in large-scale mpi programs. In: IEEE/ACM Supercomputing, November 2007

  28. Stoess, J., Lang, C., Bellosa, F.: Energy management for hypervisor-based virtual machines. In: Proceedings of the USENIX Annual Technical Conference, June 2007

  29. Sugerman, J., Venkitachalam, G., Lim, B.-H.: Virtualizing i/o devices on vmware workstation’s hosted virtual machine monitor. In: Proceedings of the USENIX Annual Technical Conference, 2001

  30. Waldspurger, C., Weihl, W.: Lottery scheduling: Flexible proportional-share resource management. In: Proceedings of the First Symposium on Operating System Design and Implementation (OSDI), 1994

  31. Walsh, W., Tesauro, G., Kephart, J., Das, R.: Utility functions in autonomic systems. In: Proceedings of the IEEE International Conference on Autonomic Computing (ICAC), 2004

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ripal Nathuji.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Nathuji, R., Schwan, K., Somani, A. et al. VPM tokens: virtual machine-aware power budgeting in datacenters. Cluster Comput 12, 189–203 (2009). https://doi.org/10.1007/s10586-009-0077-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10586-009-0077-z

Keywords

Navigation