Energy Efficient Scheduling of MapReduce Jobs

  • Evripidis Bampis
  • Vincent Chau
  • Dimitrios Letsios
  • Giorgio Lucarelli
  • Ioannis Milis
  • Georgios Zois
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8632)

Abstract

MapReduce has emerged as a prominent programming model for data-intensive computation. In this work, we study power-aware MapReduce scheduling in the speed scaling setting first introduced by Yao et al. [FOCS 1995]. We focus on the minimization of the total weighted completion time of a set of MapReduce jobs under a given budget of energy. Using a linear programming relaxation of our problem, we derive a polynomial time constant-factor approximation algorithm. We also propose a convex programming formulation that we combine with standard list scheduling policies, and we evaluate their performance using simulations.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Albers, S.: Algorithms for dynamic speed scaling. In: STACS, pp. 1–11 (2011)Google Scholar
  2. 2.
    Angel, E., Bampis, E., Kacem, F.: Energy aware scheduling for unrelated parallel machines. In: Green Computing Conference, pp. 533–540 (2012)Google Scholar
  3. 3.
    Bansal, N., Pruhs, K., Stein, C.: Speed scaling for weighted flow time. SIAM J. on Computing 39(4), 1294–1308 (2009)MathSciNetCrossRefMATHGoogle Scholar
  4. 4.
    Chang, H., Kodialam, M.S., Kompella, R.R., Lakshman, T.V., Lee, M., Mukherjee, S.: Scheduling in mapreduce-like systems for fast completion time. In: INFOCOM, pp. 3074–3082 (2011)Google Scholar
  5. 5.
    Chen, F., Kodialam, M.S., Lakshman, T.V.: Joint scheduling of processing and shuffle phases in mapreduce systems. In: INFOCOM, pp. 1143–1151 (2012)Google Scholar
  6. 6.
    Feller, E., Ramakrishnan, L., Morin, C.: On the performance and energy efficiency of Hadoop deployment models. In: BigData Conference, pp. 131–136 (2013)Google Scholar
  7. 7.
    Feng, B., Lu, J., Zhou, Y., Yang, N.: Energy efficiency for MapReduce workloads: An in-depth study. In: ADC, pp. 61–70 (2012)Google Scholar
  8. 8.
    Goiri, I., Le, K., Nguyen, T.D., Guitart, J., Torres, J., Bianchini, R.: GreenHadoop: leveraging green energy in data-processing frameworks. In: EuroSys, pp. 57–70 (2012)Google Scholar
  9. 9.
    Hall, L.A., Shmoys, D.B., Wein, J.: Scheduling to minimize average completion time: Off-line and on-line algorithms. In: ACM-SIAM SODA, pp. 142–151 (1996)Google Scholar
  10. 10.
    Mastrolilli, M., Queyranne, M., Schulz, A.S., Svensson, O., Uhan, N.A.: Minimizing the sum of weighted completion times in a concurrent open shop. Oper. Res. Letters 38(5), 390–395 (2010)MathSciNetCrossRefMATHGoogle Scholar
  11. 11.
    Megow, N., Verschae, J.: Dual techniques for scheduling on a machine with varying speed. In: Fomin, F.V., Freivalds, R., Kwiatkowska, M., Peleg, D. (eds.) ICALP 2013, Part I. LNCS, vol. 7965, pp. 745–756. Springer, Heidelberg (2013)CrossRefGoogle Scholar
  12. 12.
    Moseley, B., Dasgupta, A., Kumar, R., Sarlós, T.: On scheduling in map-reduce and flow-shops. In: ACM-SPAA, pp. 289–298 (2011)Google Scholar
  13. 13.
    Phillips, C.A., Stein, C., Wein, J.: Minimizing average completion time in the presence of release dates. Math. Programming 82(1-2), 199–223 (1998)MathSciNetCrossRefMATHGoogle Scholar
  14. 14.
    Pruhs, K., van Stee, R., Uthaisombut, P.: Speed scaling of tasks with precedence constraints. Theory Comput. Syst. 43, 67–80 (2008)MathSciNetCrossRefMATHGoogle Scholar
  15. 15.
    Roemer, T.A.: A note on the complexity of the concurrent open shop problem. Journal of Scheduling 9, 389–396 (2006)MathSciNetCrossRefMATHGoogle Scholar
  16. 16.
    Schulz, A.S., Skutella, M.: Scheduling unrelated machines by randomized rounding. SIAM J. Discr. Mathematics 15(4), 450–469 (2002)MathSciNetCrossRefMATHGoogle Scholar
  17. 17.
    Wirtz, T., Ge, R.: Improving MapReduce energy efficiency for computation intensive workloads. In: IGCC, pp. 1–8 (2011)Google Scholar
  18. 18.
    Yao, F.F., Demers, A.J., Shenker, S.: A scheduling model for reduced cpu energy. In: IEEE- FOCS, pp. 374–382 (1995)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Evripidis Bampis
    • 1
  • Vincent Chau
    • 2
  • Dimitrios Letsios
    • 1
  • Giorgio Lucarelli
    • 1
  • Ioannis Milis
    • 3
  • Georgios Zois
    • 1
    • 3
  1. 1.Sorbonne Universités, UPMC Univ Paris 06, UMR 7606, LIP6France
  2. 2.IBISCUniversité d’ÉvryFrance
  3. 3.Dept. of InformaticsAUEBAthensGreece

Personalised recommendations