Skip to main content

Advertisement

SpringerLink
Log in

Energy-Aware Scheduling on Multicore Heterogeneous Grid Computing Systems

  • Published:
Journal of Grid Computing Aims and scope Submit manuscript

Abstract

We address a multicriteria non-preemptive energy-aware scheduling problem for computational Grid systems. This work introduces a new formulation of the scheduling problem for multicore heterogeneous computational Grid systems in which the minimization of the energy consumption, along with the makespan metric, is considered. We adopt a two-level model, in which a meta-broker agent (level 1) receives all user tasks and schedules them on the available resources, belonging to different local providers (level 2). The computing capacity and energy consumption of resources are taken from real multi-core processors from the main current vendors. Twenty novel list scheduling methods for the problem are proposed, and a comparative analysis of all of them over a large set of problem instances is presented. Additionally, a scalability study is performed in order to analyze the contribution of the best new bi-objective list scheduling heuristics when the problem dimension grows. We conclude after the experimental analysis that accurate trade-off schedules are computed by using the new proposed methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Condor high throughput computing: Available online at http://www.cs.wisc.edu/condor/ (2011). Cited August 2011

  2. Globus: Available online at http://www.globus.org/ (2012). Cited November 2012.

  3. Openpbs: Available online at http://www.mcs.anl.gov/research/projects/openpbs/ (2012). Cited November 2012

  4. Lsf—load sharing facility: Available online at http://www.vub.ac.be/BFUCC/LSF/ (2013). Cited January 2013.

  5. Oar resource management system for high performance computing: Available online at http://oar.imag.fr (2013). Cited January 2013

  6. Ali, S., Siegel, H.J., Maheswaran, M., Ali, S., Hensgen, D.: Task execution time modeling for heterogeneous computing systems. In: Proc. of the 9th Heterogeneous Computing Workshop, p. 185. IEEE Computer Society, Washington DC (2000)

    Google Scholar 

  7. Ambrosio, P., Auletta, V.: Deterministic monotone algorithms for scheduling on related machines. Theory Comput. Sci. 406, 173–186 (2008)

    Article  MathSciNet  MATH  Google Scholar 

  8. Barrondo, A., Tchernykh, A., Schaeffer, E., Pecero, J.E.: Energy efficiency of knowledge-free scheduling in peer-to-peer desktop Grids. In: Proc. of the International Conference on High Performance Computing & Simulation (HPCS), pp. 105–111 (2012)

  9. Baskiyar, S., Abdel-Kader, R.: Energy aware DAG scheduling on heterogeneous systems. Cluster Comput. 13, 373–383 (2010)

    Article  Google Scholar 

  10. Baskiyar, S., Palli, K.: Low power scheduling of DAGs to minimize finish times. In: Robert, Y., Parashar, M., Badrinath, R., Prasanna, V. (eds.) High Performance Computing—HiPC 2006. Lecture Notes in Computer Science, vol. 4297, pp. 353–362. Springer Berlin, Heidelberg (2006)

    Chapter  Google Scholar 

  11. Berman, F., Fox, G., Hey, A.: Grid Computing: Making the Global Infrastructure a Reality. Wiley, New York (2003)

    Book  Google Scholar 

  12. Blazewicz, J., Ecker, K.H., Pesch, E., Schmidt, G., Weglarz, J.: Handbook on Scheduling: From Theory to Applications. Springer (2007)

  13. Braun, T., Siegel, H.J., Beck, N., Bölöni, L., Maheswaran, M., Reuther, A., Robertson, J., Theys, M., Yao, B., Hensgen, D., Freund, R.: A comparison of eleven static heuristics for mapping a class of independent tasks onto heterogeneous distributed computing systems. J. Parallel Distrib. Comput. 61(6), 810–837 (2001)

    Article  Google Scholar 

  14. Buscemi, M.G., Montanari, U., Taneja, S.: A game-theoretic analysis of Grid job scheduling. J. Grid Computing 10(3), 501–519 (2012)

    Article  Google Scholar 

  15. Coutinho, F., de Carvalho, L.A.V.: Strategies based on green policies to the Grid resource allocation. In: Proceedings of the 21st International Conference on Parallel Architectures and Compilation Techniques, PACT ’12, pp. 487–488. ACM, New York (2012)

    Chapter  Google Scholar 

  16. Da Costa, G., Gelas, J.-P., Georgiou, Y., Lefevre, L., Orgerie, A.-C., Pierson, J.-M., Richard, O., Sharma, K.: The green-net framework: Energy efficiency in large scale distributed systems. In: Proceedings of the 2009 IEEE International Symposium on Parallel&Distributed Processing, IPDPS ’09, pp. 1–8. IEEE Computer Society, Washington (2009)

    Chapter  Google Scholar 

  17. Dail, H., Sievert, O., Berman, F., Casanova, H., YarKhan, A., Vadhiyar, S., Dongarra, J., Liu, C., Yang, L., Angulo, D., Foster, I.: Grid Resource Management, chapter Scheduling in the Grid Application Development Software Project, pp. 73–98. Kluwer Academic Publishers (2004)

  18. Develder, C., Pickavet, M., Dhoedt, B., Demeester, P.: A power-saving strategy for Grids. In: Proceedings of GridNets2008, the ICST 2nd International Conference on Networks for Grid Applications and Workshops. ICST (2008)

  19. Dorronsoro, B., Bouvry, P., Cañero, J., Maciejewski, A., Siegel, H.: Multi-objective robust static mapping of independent tasks on Grids. In: IEEE Congress on Evolutionary Computation (CEC). Part of the World Congress on Computational Intelligence (WCCI), pp. 3389–3396 (2010)

  20. El-Rewini, H., Lewis, T., Ali, H.: Task Scheduling in Parallel and Distributed Systems. Prentice-Hall Inc. (1994)

  21. Eshaghian, M.: Heterogeneous Computing. Artech House (1996)

  22. Eyraud, L.: A pragmatic analysis of scheduling environments on new computing platforms. Int. J. High Perform. Comput. Appl. 20(4), 507–516 (2006)

    Article  Google Scholar 

  23. Foster, I., Kesselman, C.: The Grid 2: Blueprint for a Future Computing Infrastructure. Morgan Kaufmann Publishers (2003)

  24. Freund, R., Gherrity, M., Ambrosius, S., Campbell, M., Halderman, M., Hensgen, D., Keith, E., Kidd, T., Kussow, M., Lima, J., Mirabile, F., Moore, L., Rust, B., Siegel, H.: Scheduling resources in multi-user, heterogeneous, computing environments with SmartNet. In: Proc. of the 7th Heterogeneous Computing Workshop, p. 3. IEEE Computer Society, Washington DC (1998)

    Google Scholar 

  25. Freund, R., Sunderam, V., Gottlieb, A., Hwang, K., Sahni, S.: Special issue on heterogeneous processing. J. Parallel Distrib. Comput. 21(3) (1994)

  26. Garey, M., Johnson, D.: Computers and Intractability. Freeman (1979)

  27. Garg, S.K., Buyya, R., Siegel, H.J.: Scheduling parallel applications on utility Grids: time and cost trade-off management. In: Proc. of the 32nd Australasian Computer Science Conference ACSC, vol. 91, pp. 139–147 (2009)

  28. Kumar Garg, S., Buyya, R.: Exploiting heterogeneity in Grid computing for energy-efficient resource allocation. In: Proceedings of the 2009 17th International Conference on Advanced Computing and Communications, ADCOM 2009, pp. 1–7. Bengaluru, India (2009)

  29. GISELA: Grid Infrastructures for e-Science virtual communities in Europe and Latin-America (GISELA) project. Available at http://www.gisela-grid.eu/ (2011). Retrieved April 2011.

  30. Gray, L., Kumar, A., Li, H.: Workload Characterization of the SPECpower_ssj2008 Benchmark. In: Kounev, S., Gorton, I., Sachs, K. (eds.) Performance Evaluation: Metrics, Models and Benchmarks. Lecture Notes in Computer Science, vol. 5119, pp. 262–282. Springer Berlin/Heidelberg (2008)

    Chapter  Google Scholar 

  31. Hermenier, F., Loriant, N., Menaud, J.-M.: Power management in Grid computing with xen. In: Proceedings of the 2006 International Conference on Frontiers of High Performance Computing and Networking, ISPA’06, pp. 407–416. Springer, Berlin, Heidelberg (2006)

    Google Scholar 

  32. Hirales-Carbajal, A., Tchernykh, A., Yahyapour, R., González-García, J.L., Röblitz, T., Ramírez-Alcaraz, J.M.: Multiple workflow scheduling strategies with user run time estimates on a Grid. J. Grid Computing 10(2), 325–346 (2012)

    Article  Google Scholar 

  33. Ibarra, O., Kim, C.: Heuristic algorithms for scheduling independent tasks on nonidentical processors. J. ACM 24(2), 280–289 (1977)

    Article  MathSciNet  MATH  Google Scholar 

  34. Kertész, A., Kacsuk, P.: Gmbs: A new middleware service for making Grids interoperable. Future Gener. Comput. Syst. 26(4), 542–553 (2010)

    Article  Google Scholar 

  35. Khan, S., Ahmad, I.: A cooperative game theoretical technique for joint optimization of energy consumption and response time in computational Grids. IEEE Trans. Parallel Distrib. Syst. 20, 346–360 (2009)

    Article  Google Scholar 

  36. Kim, J.-K., Siegel, H.J., Maciejewski, A., Eigenmann, R.: Dynamic resource management in energy constrained heterogeneous computing systems using voltage scaling. IEEE Trans. Parallel Distrib. Syst. 19, 1445–1457 (2008)

    Article  Google Scholar 

  37. Kim, K., Buyya, R., Kim, J.: Power aware scheduling of bag-of-tasks applications with deadline constraints on DVS-enabled clusters. In: Proc. of the 7th IEEE International Symposium on Cluster Computing and the Grid, pp. 541–548. IEEE Computer Society, Washington DC (2007)

    Google Scholar 

  38. Kolodziej, J., Xhafa, F.: Intelligent Decision Systems in Large-Scale Distributed Environments. Studies in Computational Intelligence, chapter Task Allocation Oriented Users Decisions in Computational Grid, vol. 362, pp. 1–23. Springer Berlin-Heidelberg (2011)

    Google Scholar 

  39. Kurowski, K., Nabrzyski, J., Oleksiak, A., Weglarz, J.: A multicriteria approach to two-level hierarchy scheduling in Grids. J. Scheduling 11(5), 371–379 (2008)

    Article  MathSciNet  MATH  Google Scholar 

  40. Kurowski, K., Oleksiak, A., Witkowski, M., Nabrzyski, J.: Distributed power management and control system for sustainable computing environments. In: International Green Computing Conference, pp. 365–372. IEEE (2010)

  41. Kwok, Y., Ahmad, I.: Static scheduling algorithms for allocating directed task graphs to multiprocessors. ACM Comput. Surv. 31(4), 406–471 (1999)

    Article  Google Scholar 

  42. Lammie, M., Brenner, P., Thain, D.: Scheduling Grid workloads on multicore clusters to minimize energy and maximize performance. In: GRID, pp. 145–152. IEEE (2009)

  43. Lee, Y.C., Zomaya, A.: Minimizing energy consumption for precedence-constrained applications using dynamic voltage scaling. In: Proc. of the 9th IEEE/ACM International Symposium on Cluster Computing and the Grid, pp. 92–99. IEEE Computer Society, Washington DC (2009)

    Google Scholar 

  44. Lee, Y.C., Zomaya, A.: Energy conscious scheduling for distributed computing systems under different operating conditions. IEEE Trans. Parallel Distrib. Syst. 22, 1374–1381 (2011)

    Article  Google Scholar 

  45. Lenstra, J., Shmoys, D., Tardos, É.: Approximation algorithms for scheduling unrelated parallel machines. Math. Program. 46, 259–271 (1990)

    Article  MathSciNet  MATH  Google Scholar 

  46. Leung, J., Kelly, L., Anderson, J.: Handbook of Scheduling: Algorithms, Models, and Performance Analysis. CRC Press, Inc. (2004)

  47. Li, K.: Optimal load distribution for multiple heterogeneous blade servers in a cloud computing environment. J. Grid Comput. 11(1), 27–46 (2013)

    Article  Google Scholar 

  48. Li, Y., Liu, Y., Qian, D.: A heuristic energy-aware scheduling algorithm for heterogeneous clusters. In: Proc. of the 2009 15th International Conference on Parallel and Distributed Systems, ICPADS ’09, pp. 407–413. IEEE Computer Society, Washington DC (2009)

    Chapter  Google Scholar 

  49. Lindberg, P., Leingang, J., Lysaker, D., Khan, S., Li, J.: Comparison and analysis of eight scheduling heuristics for the optimization of energy consumption and makespan in large-scale distributed systems. J. Supercomputing 59(1), 323–360 (2012)

    Article  Google Scholar 

  50. Ludwig, S.A., Moallem, A.: Swarm intelligence approaches for Grid load balancing. J. Grid Computing 9(3), 279–301 (2011)

    Article  Google Scholar 

  51. Luo, P., Lü, K., Shi, Z.: A revisit of fast greedy heuristics for mapping a class of independent tasks onto heterogeneous computing systems. J. Parallel Distrib. Comput. 67(6), 695–714 (2007)

    Article  MATH  Google Scholar 

  52. Mezmaz, M., Melab, N., Kessaci, Y., Lee, Y., Talbi, E.-G., Zomaya, A., Tuyttens, D.: A parallel bi-objective hybrid metaheuristic for energy-aware scheduling for cloud computing systems. J. Parallel Distrib. Comput. 71, 1497–1508 (2011)

    Article  Google Scholar 

  53. Minas, L., Ellison, B.: Energy Efficiency for Information Technology: How to Reduce Power Consumption in Servers and Data Centers. Intel Press (2009)

  54. Nesmachnow, S.: Cluster FING: High Performance Computing at Universidad de la República. Available online at http://www.fing.edu.uy/cluster (2011). Accessed June 2011

  55. Orgerie, A.-C., Lefèvre, L., Gelas, J.-P.: Chasing gaps between bursts: towards energy efficient large scale experimental Grids. In: Proceedings of the 2008 Ninth International Conference on Parallel and Distributed Computing, Applications and Technologies, PDCAT ’08, pp. 381–389. IEEE Computer Society, Washington DC (2008)

    Chapter  Google Scholar 

  56. Orgerie, A.-C., Lefèvre, L., Gelas, J.-P.: Save watts in your Grid: green strategies for energy-aware framework in large scale distributed systems. In: Proceedings of the 2008 14th IEEE International Conference on Parallel and Distributed Systems, ICPADS ’08, pp. 171–178. IEEE Computer Society, Washington, DC (2008)

    Chapter  Google Scholar 

  57. Pecero, J., Bouvry, P., Fraire Huacuja, H.J., Khan, S.: A multi-objective grasp algorithm for joint optimization of energy consumption and schedule length of precedence-constrained applications. In: Int. Conf. Cloud and Green Computing, pp. 1–8. IEEE CS Press, Sydney (2011)

    Google Scholar 

  58. Pinel, F., Dorronsoro, B., Pecero, J., Bouvry, P., Khan, S.U.: A two-phase heuristic for the energy-efficient scheduling of independent tasks on computational Grids. Clust. Comput. (2012). doi:10.1007/s10586-012-0207-x

    MATH  Google Scholar 

  59. Pugliese, A., Talia, D., Yahyapour, R.: Modeling and supporting Grid scheduling. J. Grid Computing 6, 195–213 (2008)

    Article  Google Scholar 

  60. Ramírez-Alcaraz, J.M., Tchernykh, A., Yahyapour, R., Schwiegelshohn, U., Quezada-Pina, A., González-García, J.L., Hirales-Carbajal, A.: Job allocation strategies with user run time estimates for online scheduling in hierarchical Grids. J. Grid Computing 9(1), 95–116 (2011)

    Article  Google Scholar 

  61. Riedel, M., Laure, E., et al.: Interoperation of world-wide production e-science infrastructures. Concurr. Comput.: Pract. Exper. 21(8), 961–990 (2009)

    Article  Google Scholar 

  62. Rizvandi, N., Taheri, J., Zomaya, A.: Some observations on optimal frequency selection in dvfs-based energy consumption minimization. J. Parallel Distrib. Comput. 71, 1154–1164 (2011)

    Article  MATH  Google Scholar 

  63. Rodero, I., Guim, F., Corbalán, J., Fong, L., Sadjadi, S.M.: Grid broker selection strategies using aggregated resource information. Future Gener. Comput. Syst. 26(1), 72–86 (2010)

    Article  Google Scholar 

  64. Schwiegelshohn, U., Yahyapour, R.: Attributes for communication between Grid scheduling instances. In: Nabrzyski, J., Schopf, J.M., Weglarz, J. (eds.) Grid Resource Management. International Series in Operations Research & Management Science, vol. 64, pp. 41–52. Springer US, Norwell (2004)

    Google Scholar 

  65. Shmoys, D.B., Wein, J., Williamson, D.P.: Scheduling parallel machines on-line. SIAM J. Comput. 24(6), 1313–1331 (1995)

    Article  MathSciNet  MATH  Google Scholar 

  66. SPEC: Standard performance evaluation corporation, power and performance methodology. Available online at http://www.spec.org/power/docs/SPEC-Power_and_Performance_Methodology.pdf (2011). Accessed September 2011

  67. SPEC: Standard performance evaluation corporation, specpower_ssj2008. Available online at http://www.spec.org/power_ssj2008 (2011). Accessed September 2011

  68. Subrata, R., Zomaya, A.Y., Landfeldt, B.: Cooperative power-aware scheduling in Grid computing environments. J. Parallel Distrib. Comput. 70(2), 84–91 (2010)

    Article  MATH  Google Scholar 

  69. Tchernykh, A., Schwiegelshohn, U., Yahyapour, R., Kuzjurin, N.: On-line hierarchical job scheduling on Grids with admissible allocation. J. Scheduling 13(5), 545–552 (2010)

    Article  MathSciNet  MATH  Google Scholar 

  70. Xhafa, F., Abraham, A.: Computational models and heuristic methods for Grid scheduling problems. Future Gener. Comput. Syst. 26, 608–621 (2010)

    Article  Google Scholar 

  71. Yin, F., Jiang, C., Deng, R., Yuan, J.: Grid resource management policies for load-balancing and energy-saving by vacation queuing theory. Comput. Electr. Eng. 35(6), 966–979 (2009)

    Article  MATH  Google Scholar 

  72. Yu, J., Kirley, M., Buyya, R.: Multi-objective planning for workflow execution on Grids. In: IEEE/ACM Int. Conf. on Grid Computing, pp. 10–17 (2007)

  73. Zhu, D., Melhem, R., Childers, B.: Scheduling with dynamic voltage/speed adjustment using slack reclamation in multiprocessor real-time systems. IEEE Trans. Parallel Distrib. Syst. 14, 686–700 (2003)

    Article  Google Scholar 

  74. Zomaya, A., Teh, Y.: Observations on using genetic algorithms for dynamic load-balancing. IEEE Trans. Parallel Distrib. Syst. 12, 899–911 (2001)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Universidad de la República, Montevideo, Uruguay

    Sergio Nesmachnow

  2. LIFL, University of Lille 1, Villeneuve d’Ascq Cedex, France

    Bernabé Dorronsoro

  3. University of Luxembourg, Luxembourg City, Luxembourg

    Johnatan E. Pecero & Pascal Bouvry

Authors
  1. Sergio Nesmachnow
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Bernabé Dorronsoro
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Johnatan E. Pecero
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Pascal Bouvry
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Sergio Nesmachnow.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Nesmachnow, S., Dorronsoro, B., Pecero, J.E. et al. Energy-Aware Scheduling on Multicore Heterogeneous Grid Computing Systems. J Grid Computing 11, 653–680 (2013). https://doi.org/10.1007/s10723-013-9258-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10723-013-9258-3

Keywords

Search

Navigation