Skip to main content

Advertisement

SpringerLink
Log in

Data center energy efficient resource scheduling

  • Published:
Cluster Computing Aims and scope Submit manuscript

Abstract

The information and communication technology (ICT) sector has grown exponentially in the recent years. An essential component of the ICT organizations is constituted by the data centers that are densely populated with redundant servers and communicational links to ensure the provision of 99.99 % availability of services; a fact responsible for the heavy energy consumption by data centers. For energy economy, the redundant elements can be powered off based on the current workload within the data center. We propose a Data Center-wide Energy-Efficient Resource Scheduling framework (DCEERS) that schedules data center resources according to the current workload of the data center. Minimum subset of resources to service the current workload are calculated by solving the Minimum Cost Multi Commodity Flow (MCMCF) using the Benders decomposition algorithm. The Benders decomposition algorithm is scalable: it solves the MCMCF problem in linear time for large data center environments. Our simulated results depict that DCEERS achieves better energy efficiency than the previous data center resource scheduling methodologies.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Notes

  1. http://www.ilog.com

  2. http://www.isi.edu/nsnam/ns/

References

  1. Masanet, E., Brown, R., Shehabi, A., Koomey, J., Nordman, B.: Estimating the energy use and efficiency potential of u.s. data centers. Proc. IEEE 99(8), 1440–1453 (2011)

    Article  Google Scholar 

  2. Brown, R.: Report to congress on server and data center energy efficiency public law 109–431. Environ. Prot. 109, 431 (2007)

    Google Scholar 

  3. Bolla, R., Davoli, F., Bruschi, R., Christensen, K., Cucchietti, F., Singh, S.: The potential impact of green technologies in next-generation wireline networks: Is there room for energy saving optimization? Commun. Mag. IEEE 49(8), 80–86 (2011)

    Article  Google Scholar 

  4. Webb, M.: SMART 2020: Enabling the low carbon economy in the information age. Tech. rep, Climate Group on behalf of the Global eSustainability Initiative (GeSI) (2008)

  5. Koomey, J.G.: Worldwide electricity used in data centers. Environ. Res. Lett., IOPscience 3(3), 1–8 (2008).

    Google Scholar 

  6. Wang, L., Khan, S.U.: Review of performance metrics for green data centers: a taxonomy study. J. Supercomput. 63(3), 639–656 (2013)

    Article  MathSciNet  Google Scholar 

  7. Kliazovich, D., Bouvry, P., Audzevich, Y., Khan, S.: Greencloud: A packet-level simulator of energy-aware cloud computing data centers. In: GLOBECOM 2010, 2010 IEEE Global Telecommunications Conference, pp. 1–5 (2010).

  8. Despins, C., Labeau, F., Le Ngoc, T., Labelle, R., Cheriet, M., Thibeault, C., Gagnon, F., Leon-Garcia, A., Cherkaoui, O., St Arnaud, B., et al.: Leveraging green communications for carbon emission reductions: Techniques, testbeds, and emerging carbon footprint standards. Communications Magazine, IEEE 49(8), 101–109 (2011).

  9. Khan, S.U., Wang, L., Yang, L.T., Xia, F.: Green computing and communications. J. Supercomput. 63(3), 637–638 (2013)

    Article  Google Scholar 

  10. Khargharia, B., Hariri, S., Szidarovszky, F., Houri, M., El-Rewini, H., Khan, S., Ahmad, I., Yousif, M.: Autonomic power performance management for large-scale data centers. In: Parallel and Distributed Processing Symposium, 2007. IPDPS 2007. IEEE, International, pp. 1–8 (2007).

  11. Wang, L., Khan, S.U., Chen, D., Kołodziej, J., Ranjan, R., Xu, Cz, Zomaya, A.: Energy-aware parallel task scheduling in a cluster. Future Gener. Comput. Syst. 29(7), 1661–1670 (2013)

    Article  Google Scholar 

  12. Heller, B., Seetharaman, S., Mahadevan, P., Yiakoumis, Y., Sharma, P., Banerjee, S., Mckeown, N.: Elastictree: Saving energy in data center networks. In: IN NSDI (2010).

  13. Da Costa, G., Gelas, J.P., Georgiou, Y., Lefevre, L., Orgerie, A.C., Pierson, J.M., Richard, O., Sharma, K.: The green-net framework: Energy efficiency in large scale distributed systems. In: Parallel Distributed Processing, 2009. IPDPS 2009. IEEE International Symposium on, pp. 1–8 (2009).

  14. Garg, M., Smith, J.C.: Models and algorithms for the design of survivable multicommodity flow networks with general failure scenarios. Omega 36(6), 1057–1071 (2008)

    Article  Google Scholar 

  15. Kliazovich, D., Bouvry, P., Khan, S.: Dens: Data center energy-efficient network-aware scheduling. In: Green Computing and Communications (GreenCom), 2010 IEEE/ACM Int’l Conference on Int’l Conference on Cyber, Physical and Social Computing (CPSCom), pp. 69–75 (2010).

  16. Cisco: Cisco data center infrastructure 2.5 design guide. Cisco press (2007).

  17. Raiciu, C., Barre, S., Pluntke, C., Greenhalgh, A., Wischik, D., Handley, M.: Improving datacenter performance and robustness with multipath tcp. SIGCOMM Comput. Commun. Rev. 41, 266–277 (2011)

    Article  Google Scholar 

  18. Al-Fares, M., Loukissas, A., Vahdat, A.: A scalable, commodity data center network architecture. SIGCOMM Comput. Commun. Rev. 38, 63–74 (2008)

    Article  Google Scholar 

  19. Greenberg, A., Hamilton, J.R., Jain, N., Kandula, S., Kim, C., Lahiri, P., Maltz, D.A., Patel, P., Sengupta, S.: Vl2: a scalable and flexible data center network. Proceedings of the ACM SIGCOMM 2009 conference on Data communication. SIGCOMM ’09, pp. 51–62. ACM, New York, NY, USA (2009)

  20. Bilal, K., Khan, S.U., Zhang, L., Li, H., Hayat, K., Madani, S.A., Min-Allah, N., Wang, L., Chen, D., Iqbal, M., et al.: Quantitative comparisons of the state-of-the-art data center architectures. Concurr. Comput.: Pract. Exp. 25(12), 1771–1783 (2013)

    Article  Google Scholar 

  21. Al-fares, M., Radhakrishnan, S., Raghavan, B., Huang, N., Vahdat, A.: Hedera: Dynamic flow scheduling for data center networks. In: In Proceedings of Networked Systems Design and Implementation (NSDI) Symposium (2010).

  22. Greenberg, A., Hamilton, J., Maltz, D.A., Patel, P.: The cost of a cloud: research problems in data center networks. SIGCOMM Comput. Commun. Rev. 39, 68–73 (2008)

    Article  Google Scholar 

  23. Bilal, K., Malik, S.U.R., Khalid, O., Hameed, A., Alvarez, E., Wijaysekara, V., Irfan, R., Shrestha, S., Dwivedy, D., Ali, M., et al.: A taxonomy and survey on green data center networks. Future Gener. Comput. Syst. (2013).

  24. Valentini, G.L., Lassonde, W., Khan, S.U., Min-Allah, N., Madani, S.A., Li, J., Zhang, L., Wang, L., Ghani, N., Kolodziej, J., et al.: An overview of energy efficiency techniques in cluster computing systems. Clust. Comput. 16(1), 3–15 (2013)

    Article  Google Scholar 

  25. Liu, J., Zhao, F., Liu, X., He, W.: Challenges towards elastic power management in internet data centers. In: Distributed Computing Systems Workshops, 2009. ICDCS Workshops ’09. 29th IEEE International Conference on, pp. 65–72 (2009).

  26. Wang, L., von Laszewski, G., Tao, J., Kunze, M.: Grid virtualization engine: design, implementation, and evaluation. Syst. J. IEEE 3(4), 477–488 (2009)

    Article  Google Scholar 

  27. Kołodziej, J., Khan, S.U., Wang, L., Byrski, A., Min-Allah, N., Madani, S.A.: Hierarchical genetic-based grid scheduling with energy optimization. Clust. Comput. 16(3), 591–609 (2013)

    Article  Google Scholar 

  28. Horvath, T., Abdelzaher, T., Skadron, K., Liu, X.: Dynamic voltage scaling in multitier web servers with end-to-end delay control. Comput. IEEE Trans. 56(4), 444–458 (2007)

    Article  MathSciNet  Google Scholar 

  29. Bilal, K., Khan, S., Madani, S., Hayat, K., Khan, M., Min-Allah, N., Kolodziej, J., Wang, L., Zeadally, S., Chen, D.: A survey on green communications using adaptive link rate. Clust. Comput. 16(3), 575–589 (2013)

    Article  Google Scholar 

  30. Shuja, J., Madani, S.A., Bilal, K., Hayat, K., Khan, S.U., Sarwar, S.: Energy-efficient data centers. Computing 94(12), 973–994 (2012)

    Article  MATH  Google Scholar 

  31. Cha, M., Kwak, H., Rodriguez, P., Ahn, Y.Y., Moon, S.: I tube, you tube, everybody tubes: analyzing the world’s largest user generated content video system. In: Proceedings of the 7th ACM SIGCOMM conference on Internet measurement. IMC ’07, pp. 1–14. ACM, New York, NY, USA (2007)

  32. Meisner, D., Sadler, C.M., Barroso, L.A., Weber, W.D., Wenisch, T.F.: Power management of online data-intensive services. In: Computer Architecture (ISCA), 2011 38th Annual International Symposium on, pp. 319–330. IEEE (2011).

  33. Wang, L., Tao, J., Ranjan, R., Marten, H., Streit, A., Chen, J., Chen, D.: G-hadoop: Mapreduce across distributed data centers for data-intensive computing. Future Gener. Comput. Syst. 29(3), 739–750 (2013)

    Article  Google Scholar 

  34. Wang, L., Tao, J., Marten, H., Streit, A., Khan, S.U., Kolodziej, J., Chen, D.: Mapreduce across distributed clusters for data-intensive applications. In: Parallel and Distributed Processing Symposium Workshops & PhD Forum (IPDPSW), 2012 IEEE 26th International, pp. 2004–2011. IEEE (2012).

  35. Urgaonkar, R., Kozat, U.C., Igarashi, K., Neely, M.J.: Dynamic resource allocation and power management in virtualized data centers. In: NOMS, pp. 479–486 (2010).

  36. Beloglazov, A., Buyya, R.: Energy efficient resource management in virtualized cloud data centers. In: Cluster, Cloud and Grid Computing (CCGrid), 2010 10th IEEE/ACM International Conference on, pp. 826–831 (2010).

  37. Wang, L., Khan, S., Dayal, J.: Thermal aware workload placement with task-temperature profiles in a data center. J. Supercomput. 61(3), 780–803 (2012)

    Article  Google Scholar 

  38. Wang, L., von Laszewski, G., Dayal, J., He, X., Younge, A.J., Furlani, T.R.: Towards thermal aware workload scheduling in a data center. In: Proceedings of the 2009 10th International Symposium on Pervasive Systems. Algorithms, and Networks, ISPAN ’09, pp. 116–122. IEEE Computer Society, Washington, DC, USA (2009)

  39. Wang, L., von Laszewski, G., Huang, F., Dayal, J., Frulani, T., Fox, G.: Task scheduling with ann-based temperature prediction in a data center: a simulation-based study. Eng. Comput. 27(4), 381–391 (2011)

    Article  Google Scholar 

  40. Meng, X., Pappas, V., Zhang, L.: Improving the scalability of data center networks with traffic-aware virtual machine placement. In: INFOCOM, 2010 Proceedings IEEE, pp. 1–9 (2010).

  41. Wang, G., Ng, T.S.E.: The impact of virtualization on network performance of amazon ec2 data center. In: Proceedings of the 29th conference on Information communications. INFOCOM’10, pp. 1163–1171. IEEE Press, Piscataway, NJ, USA (2010)

  42. Voorsluys, W., Broberg, J., Venugopal, S., Buyya, R.: Cost of virtual machine live migration in clouds: A performance evaluation. In: Proceedings of the 1st International Conference on Cloud Computing. CloudCom ’09, pp. 254–265. Springer-Verlag, Berlin, Heidelberg (2009)

  43. Banerjee, A., Mukherjee, T., Varsamopoulos, G., Gupta, S.: Cooling-aware and thermal-aware workload placement for green hpc data centers. In: Green Computing Conference, 2010 International, pp. 245–256 (2010).

  44. Parolini, L., Sinopoli, B., Krogh, B.H., Wang, Z.: A cyber-physical systems approach to data center modeling and control for energy efficiency. Proc. IEEE PP(99), 1–15 (2011).

  45. Le, K., Bianchini, R., Martonosi, M., Nguyen, T.: Cost-and energy-aware load distribution across data centers. Proc. HotPower pp. 1–5 (2009).

  46. McKeown, N., Anderson, T., Balakrishnan, H., Parulkar, G., Peterson, L., Rexford, J., Shenker, S., Turner, J.: Openflow: enabling innovation in campus networks. SIGCOMM Comput. Commun. Rev. 38(2), 69–74 (2008)

    Article  Google Scholar 

  47. Wang, L., Tao, J., von Laszewski, G., Marten, H.: Multicores in cloud computing: research challenges for applications. J. Comput. 5(6), 958–964 (2010)

    Google Scholar 

  48. Zink, M., Suh, K., Gu, Y., Kurose, J.: Characteristics of youtube network traffic at a campus network-measurements, models, and implications. Comput. Netw. 53(4), 501–514 (2009)

    Article  Google Scholar 

  49. Bilal, K., Manzano, M., Khan, S.U., Calle, E., Li, K., Zomaya, A.Y.: On the characterization of the structural robustness of data center networks. IEEE Transaction on Cloud Computing (2013).

  50. Geoffrion, A.M., Graves, G.W.: Multicommodity distribution system design by benders decomposition. Manag. Sci. 20(5), 822–844 (1974)

    Article  MATH  MathSciNet  Google Scholar 

  51. Multicommodity network flow models and algorithms in telecommunications. Handbook of optimization in telecommunications, pp. 163–184. Springer, New York (2006)

  52. Wang, L., Anta, A.F., Zhang, F., Hou, C., Liu, Z.: Routing for energy minimization with discrete cost functions. arXiv, preprint arXiv:1302.0234 (2013).

  53. Costa, A.M.: A survey on benders decomposition applied to fixed-charge network design problems. Comput. Oper. Res. 32(6), 1429–1450 (2005)

    Article  MathSciNet  Google Scholar 

  54. Chen, G., He, W., Liu, J., Nath, S., Rigas, L., Xiao, L., Zhao, F.: Energy-aware server provisioning and load dispatching for connection-intensive internet services. In: Proceedings of the 5th USENIX Symposium on Networked Systems Design and Implementation. NSDI’08, pp. 337–350. USENIX Association, Berkeley, CA, USA (2008)

  55. Jiang, N., Parashar, M.: Enabling autonomic power-aware management of instrumented data centers. In: Parallel Distributed Processing, 2009. IPDPS 2009. IEEE International Symposium on, pp. 1–8 (2009).

  56. Bianzino, A.P., Chaudet, C., Rossi, D., Rougier, J.L.: A survey of green networking research. CoRR (2010).

Download references

Author information

Authors and Affiliations

  1. Faculty of Computer Science and Information Technology, University of Malaya, Kuala Lumpur, Malaysia

    Junaid Shuja

  2. Department of Electrical and Computer Engineering, North Dakota State University, Fargo, ND, 58108-6050, USA

    Kashif Bilal & Samee U. Khan

  3. COMSATS Institute of Information Technology (CIIT), Abbottabad, 22060 , Pakistan

    Sajjad Ahmad Madani

Authors
  1. Junaid Shuja
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Kashif Bilal
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sajjad Ahmad Madani
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Samee U. Khan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Samee U. Khan.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Shuja, J., Bilal, K., Madani, S.A. et al. Data center energy efficient resource scheduling. Cluster Comput 17, 1265–1277 (2014). https://doi.org/10.1007/s10586-014-0365-0

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10586-014-0365-0

Keywords

Search

Navigation