Skip to main content

Advertisement

Log in

Energy optimization schemes in cluster with virtual machines

  • Published:
Cluster Computing Aims and scope Submit manuscript

Abstract

Large scale clusters based on virtualization technologies have been widely used in many areas, including the data center and cloud computing environment. But how to save energy is a big challenge for building a “green cluster” recently. However, previous researches, including local approaches, which focus on saving the energy of the components in a single workstation without a global vision on the whole cluster, and cluster-wide energy saving techniques, which can only be applied to homogeneous workstations and specific applications, cannot solve the challenges. This paper describes the design and implementation of a novel scheme, called Magnet, that uses live migration of virtual machines to transfer load among the nodes on a multi-layer ring-based overlay. This scheme can reduce the power consumption greatly by regarding all the cluster nodes as a whole based on virtualization technologies. And, it can be applied to both the homogeneous and heterogeneous servers. Experimental measurements show that the new method can reduce the power consumption by 74.8% over base at most with certain adjustably acceptable overhead. The effectiveness and performance insights are also analytically verified.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Acharya, A., Setia, S.: Availability and utility of idle memory in workstation clusters. In: Proceedings of ACM SIGMETRICS Conference on Measuring and Modeling of Computer Systems, pp. 35–46 (1999)

  2. APC-American Power Conversion. Determining Total Cost of Ownership for Data Center and Network Room Infrastructure. ftp://www.apcmedia.com/salestools/CMRP-5T9PQG_R2_EN.pdf (2003)

  3. Bobroff, N., Kochut, A., Beaty, K.A.: Dynamic placement of virtual machines for managing SLA violations. In: Proceedings of 9th IFIP/IEEE International Symposium on Integrated Network Management, pp. 119–128. IEEE, New York (2007)

    Chapter  Google Scholar 

  4. Burd, T., Pering, T., Stratakos, A., Brodersen, R.: A dynamic voltage scaled microprocessor system. In: Proceedings of IEEE International Conference on Solid-State Circuits, pp. 294–295 (2000)

  5. Chase, J., Anderson, D., Thackar, P., Vahdat, A., Boyle, R.: Managing energy and server resources in hosting centers. In: Proceedings of the 18th Symposium on Operating Systems Principles (2001)

  6. Chen, S., Xiao, L., Zhang, X.: Adaptive and virtual reconfigurations for effective dynamic job scheduling in cluster systems. In: Proceedings of the 22nd International Conference on Distributed Computing and Systems (ICDCS 2002) (2002)

  7. Chen, Y., Das, A., Qin, W., Sivasubramaniam, A., Wang, Q., Gautam, N.: Managing server energy and operational costs in hosting centers. In: Proceedings of the 2005 ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Systems, Banff, Alberta, Canada (2005)

  8. Clark, C., Fraser, K., Hand, S., Hansen, J.G., Jul, E., Limpach, C., Pratt, I., Warfield, A.: Live migration of virtual machines. In: Proceedings of 2nd Symposium on Networked Systems Design and Implementation (NSDI 2005), USENIX (2005)

  9. Elnozahy, E.N., Kistler, M., Rajamony, R.: Energy conservation policies for Web servers. In: Proceedings of the 4th USENIX Symposium on Internet Technologies and Systems (2003)

  10. Heath, T., Diniz, B., Carrera, E.V., Meira, W. Jr., Bianchini, R.: Energy conservation in heterogeneous server clusters. In: Proceedings of the Tenth ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming (PPoPP 2005), pp. 186–195. ACM, New York (2005)

    Chapter  Google Scholar 

  11. Hopkins, M.: The onsite energy generation option. Data Center J. (2004). http://datacenterjournal.com/News/Article.asp?article_id=66

  12. Huang, W., Gao, Q., Liu, J., Panda, D.K.: High performance virtual machine migration with RDMA over modern interconnects. In: Proceedings of IEEE International Conference on Cluster Computing (Cluster 2007), September (2007)

  13. Jenkins, G., Reinsel, G., Box, G.: Time Series Analysis: Forecasting and Control. Prentice-Hall, New York (1994)

    MATH  Google Scholar 

  14. Jiang, S., Zhang, X.: TPF: a system thrashing protection facility in Linux. Softw. Pract. Exp. 32(3), 295–318 (2002)

    Article  MATH  Google Scholar 

  15. Kephart, J.O., Chan, H., Das, R., Levine, D.W., Tesauro, G., Rawson, F., Lefurgy, C.: Coordinating multiple autonomic managers to achieve specified power-performance tradeoffs. In: Proceedings of the Fourth International Conference on Autonomic Computing (ICAC-4), p. 24. IEEE Computer Society, Washington (2007)

    Chapter  Google Scholar 

  16. Kim, E.J., Yum, K.H., Link, G.M., Vijaykrishnan, N., Kandemir, M., Irwin, M.J., Yousif, M., Das, C.R.: Energy optimization techniques in cluster interconnects. In: Proceedings of International Symposium on Low Power Electronics and Design (ISLPED 2003), pp. 459–464. ACM, New York (2003)

    Chapter  Google Scholar 

  17. Kim, E.J., Yum, K.H., Link, G.M., Vijaykrishnan, N., Kandemir, M., Irwin, M.J., Yousif, M., Das, C.R.: A holistic approach to designing energy-efficient cluster interconnects. IEEE Trans. Comput. 54(6) (2005)

  18. Pinheiro, E., Bianchini, R., Carrera, E., Heath, T.: Dynamic cluster reconfiguration for power and performance. In: Benini, L., Kandemir, M., Ramanujam, J. (eds.) Compilers and Operating Systems for Low Power. Kluwer Academic, Dordrecht (2003)

    Google Scholar 

  19. Shafi, H., Bohrer, P.J., Phelan, J.: Design and validation of a performance and power simulator for PowerPC systems. IBM J. Res. Develop. 47, 641–652 (2003)

    Article  Google Scholar 

  20. Shmueli, E., Feitelson, D.G.: Backfilling with look ahead to optimize the performance of parallel job scheduling. In: Feitelson, D.G., Rudolph, L., Schwiegelshohn, U. (eds.) Job Scheduling Strategies for Parallel Processing. Lecture Notes on Computer Science, vol. 2862, pp. 228–251. Springer, Berlin (2003)

    Chapter  Google Scholar 

  21. Standard Performance Evaluation Corporation. [Online]. Available: www.spec.org (2008)

  22. VMware Distributed Resource Scheduler. [Online]. Available: http://www.vmware.com/products/vi/vc/drs.html (2008)

  23. Wiseman, Y., Feitelson, D.G.: Paired gang scheduling. IEEE Trans. Parallel Distrib. Syst. 14(6), 581–592 (2003)

    Article  Google Scholar 

  24. Xiao, L., Zhang, X., Kubricht, S.A.: Incorporating job migration and network RAM to share cluster memory resources. In: Proceedings of the 9th IEEE International Symposium on High Performance Distributed Computing (HPDC 2000), pp. 71–78 (2000)

  25. Zhang, X., Qu, Y., Xiao, L.: Improving distributed workload performance by sharing both CPU and memory resources. In: Proceedings of 20th International Conference on Distributed Computing Systems (ICDCS 2000), pp. 233–241 (2000)

  26. Zhao, M., Figueiredo, R.J.: Experimental study of virtual machine migration in support of reservation of cluster resources. In: Proceedings of 2nd International Workshop on Virtualization Technologies in Distributed Computing (VTDC 2007) (2007)

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Xiaofei Liao.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Liao, X., Hu, L. & Jin, H. Energy optimization schemes in cluster with virtual machines. Cluster Comput 13, 113–126 (2010). https://doi.org/10.1007/s10586-009-0110-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10586-009-0110-2

Navigation