Skip to main content

Advertisement

Log in

Loosely coupled coordinated management in virtualized data centers

  • Published:
Cluster Computing Aims and scope Submit manuscript

Abstract

Management is an important challenge for future enterprises. Previous work has addressed platform management (e.g., power and thermal management) separately from virtualization management (e.g., virtual machine (VM) provisioning, application performance). Coordinating the actions taken by these different management layers is important and beneficial, for reasons of performance, stability, and efficiency. Such coordination, in addition to working well with existing multi-vendor solutions, also needs to be extensible to support future management solutions potentially operating on different sensors and actuators. In response to these requirements, this paper proposes vManage, a solution to loosely couple platform and virtualization management and facilitate coordination between them in data centers. Our solution is comprised of registry and proxy mechanisms that provide unified monitoring and actuation across platform and virtualization domains, and coordinators that provide policy execution for better VM placement and runtime management, including a formal approach to ensure system stability from inefficient management actions. The solution is instantiated in a Xen environment through a platform-aware virtualization manager at a cluster management node, and a virtualization-aware platform manager on each server. Experimental evaluations using enterprise benchmarks show that compared to traditional solutions, vManage can achieve additional power savings (10% lower power) with significantly improved service-level guarantees (71% less violations) and stability (54% fewer VM migrations), at low overhead.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Gartner TCO Reports. 2005-08. www.gartner.com

  2. Clark, C., Fraiser, K., Hand, S., Hansen, J.G., Jul, E., Limpach, C., Pratt, I., Warfield, A.: Live migration of virtual machines. In: Proceedings of the 2nd ACM/USENIX Symposium on Networked Systems Design and Implementation (NSDI) (2005)

  3. Kumar, S., Schwan, K.: Netchannel: a VMM-level mechanism for continuous, transparent device access during VM migration. In: Proceedings of the Fourth ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments (VEE) (2008)

  4. HP Proliant Esentials: Systems Insight Manager. www.hp.com/go/proliantessentials, www.hp.com/go/sim

  5. Raghavendra, R., Ranganathan, P., Talwar, V., Wang, Z., Zhu, X.: No “power” struggles: coordinated multilevel power management for the data center. In: Proceedings of the 13th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) (2008)

  6. Nathuji, R., Schwan, K.: VirtualPower: Coordinated power management in virtualized enterprise systems. In: Proceedings of 21st ACM SIGOPS Symposium on Operating Systems Principles (SOSP) (2007)

  7. VMWare Virtual Center. www.vmware.com/products/vi/vc/

  8. Microsoft Virtualization Management. www.microsoft.com/VIRTUALIZATION/solution-tech-management.mspx

  9. Wood, T., Shenoy, P., Venkataramani, A.: Black-box and gray-box strategies for virtual machine migration. In: Proceedings of 4th ACM/USENIX Symposium on Networked Systems Design and Implementation (NSDI) (2007)

  10. Padala, P., Shin, K.G., Zhu, X., Uysal, M., Wang, Z., Singhal, S., Merchant, A., Salem, K.: Adaptive control of virtualized resources in utility computing environments. In: Proceedings of the 2nd ACM SIGOPS/EuroSys European Conference on Computer Systems (Eurosys) (2007)

  11. Kumar, V., Schwan, K., Iyer, S., Chen, Y., Sahai, A.: A state space approach to SLA based management. In: Proceedings of Network Operations and Management Symposium (NOMS) (2008)

  12. Hellerstein, J., Diao, Y., Parekh, S., Tilbury, D.M.: Feedback Control of Computing Systems. Wiley, New York (2004)

    Book  Google Scholar 

  13. HP iLO Management Processor. www.hp.com/go/ilo

  14. Chase, J., Anderson, D., Thakar, P., Vahdat, A., Doyle, R.: Managing energy and server resources in hosting centers. In: Proceedings of the Eighteenth ACM Symposium on Operating Systems Principles (SOSP) (2001)

  15. Donald, J., Martonosi, M.: Techniques for multicore thermal management: classification and new exploration. In: Proceedings of 33rd Annual International Symposium on Computer Architecture (ISCA) (2006)

  16. Lefurgy, C., Rajamani, K., Rawson, F., Felter, W., Kistler, M., Keller, T.: Energy management for commercial servers. IEEE Comput. 39–48 (2003)

  17. Ranganathan, P., Leech, P., Irwin, D., Chase, J.: Ensemble-level power management for dense blade servers. In: Proceedings of the 33rd Annual International Symposium on Computer Architecture (ISCA) (2006)

  18. Nathuji, R., Schwan, K.: VPM tokens: virtual machine-aware power budgeting in datacenters. In: Proceedings of the 17th International Symposium on High Performance Distributed Computing (HPDC) (2008)

  19. Verma, A., Ahuja, P., Neogi, A.: pMapper: power and migration cost aware application placement in virtualized systems. In: Proceedings of the 9th ACM/IFIP/USENIX International Conference on Middleware (2008)

  20. Kephart, J.O., Chan, H., Das, R., Levine, D.W., Tesauro, G., Rawson, F., Lefurgy, C.: Coordinating multiple autonomic managers to achieve specified power-performance tradeoffs. In: Proceedings of the Fourth International Conference on Autonomic Computing (ICAC) (2007)

  21. Das, R., Kephart, J.O., Lefurgy, C., Tesauro, G., Levine, D.W., Chan, H.: Autonomic multi-agent management of power and performance in data centers. In: Proceedings of the 7th International Joint Conference on Autonomous Agents and Multiagent Systems (AAMAS) (2008)

  22. Gmach, D., Rolia, J., Cherkasova, L., Belrose, G., Turicchi, T., Kemper, A.: An integrated approach to resource pool management: policies, efficiency and quality metrics. In: Proceedings of IEEE International Conference on Dependable Systems and Networks (DSN) (2008)

  23. Chen, G., He, W., Liu, J., Nath, S., Rigas, L., Xiao, L., Zhao, F.: Energy-aware server provisioning and load dispatching for connection-intensive internet services. In: Proceedings of the 5th USENIX Symposium on Networked Systems Design and Implementation (NSDI) (2008)

  24. Adve, S., Harris, A., Hughes, C., Jones, D., Kravets, R., Nahrstedt, K., Sachs, D., Sachs, D.G., Sasanka, R., Srinivasan, J., Yuan, W.: The Illinois GRACE project: global resource adaptation through cooperation. In: Proceedings of the Workshop on Self-Healing, Adaptive, self-MANaged Systems (SHAMAN) (2002)

  25. Common Information Model. http://www.dmtf.org/standards/cim/

  26. EPA-HTTP—a day of HTTP logs from EPA WWW server. http://ita.ee.lbl.gov/html/contrib/EPA-HTTP.html

  27. Worldspan by Travelport. http://www.worldspan.com

  28. Intelligent Platform Management Interface (IPMI). http://www.intel.com/design/servers/ipmi/index.htm

  29. Gupta, D., Gardner, R., Cherkasova, L.: Xenmon: QoS monitoring and performance profiling tool. Technical Report HPL-2005-187, HP Labs (2005)

  30. RUBiS: Rice University Bidding System. http://rubis.objectweb.org/

  31. Nutch: Open Source Web-Search Software. http://lucene.apache.org/nutch/

  32. VMWare Distributed Power Management (DPM). http://www.vmware.com/files/pdf/DPM.pdf

  33. ObjectManagementGroup: The Common Object Request Broker: Architecture and Specification, 2.0 edn., July 1995

  34. Web-based Enterprise Management (WBEM). http://www.dmtf.org/standards/wbem/

  35. Pietzuch, P.: Hermes: a scalable event-based middleware. Ph.D. thesis, Computer Laboratory, Queens’ College, University of Cambridge, February 2004

  36. Urgaonkar, B., Shenoy, P., Roscoe, T.: Resource overbooking and application profiling in shared hosting platforms. In: Proceedings of the 5th Symposium on Operating Systems Design and Implementation (OSDI) (2002)

  37. Talwar, V., Nahrstedt, K., Milojicic, D.: Modeling remote desktop systems in utility environments with application to QoS management. In: Proceedings of IFIP/IEEE International Symposium on Integrated Network Management (IM) (2009)

  38. Allen, A.: Probability, Statistics, and Queueing Theory with Computer Science Applications. Academic Press, San Diego (1990)

    MATH  Google Scholar 

  39. Qt Plug-Ins. http://www.qtsoftware.com/products/

  40. Guttman, E.: Service location protocol: automatic discovery of IP network services. IEEE Internet Comput. 3, 4 (1999)

    Article  Google Scholar 

  41. Kesavan, M., Ranadive, A., Gavrilovska, A., Schwan, K.: Active CoordinaTion (ACT)—towards effectively managing virtualized multicore clouds. In: Proceedings of Cluster (2008)

  42. Kong, J., Schwan, K., Lee, M., Ahamad, M.: ProtectIT: trusted distributed services operating on sensitive data. In: Proceedings of the 3rd ACM SIGOPS/EuroSys European Conference on Computer Systems (Eurosys) (2008)

  43. VMWare Consolidated Backup. http://www.vmware.com/products/vi/consolidated_backup.html

  44. Urgaonkar, B., Shenoy, P.: Resource overbooking and application profiling in shared hosting platforms. In: The Proceedings of the 5th Symposium on Operating Systems Design and Implementation (OSDI) (2002)

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Sanjay Kumar.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Kumar, S., Talwar, V., Kumar, V. et al. Loosely coupled coordinated management in virtualized data centers. Cluster Comput 14, 259–274 (2011). https://doi.org/10.1007/s10586-010-0124-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10586-010-0124-9

Keywords

Navigation