Advertisement

Long-Term Multi-objective Task Scheduling with Diff-Serv in Hybrid Clouds

  • Puheng ZhangEmail author
  • Chuang Lin
  • Wenzhuo Li
  • Xiao Ma
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10569)

Abstract

With the speedy development of E-commerce, requests over the internet from intensive users are soaring, especially in global online shopping festivals. In order to meet the increasing demands of temporary capacity and reduce daily expenses, hybrid clouds are often used, and the task scheduling problem with multi-objectives is further investigated. In this paper, we firstly build a differentiated-service (Diff-Serv) task scheduling model, and formulate a dynamic programming problem, where the state space is too large to be solved by exhaustive iterations. Therefore, we carefully design the value approximation function, and with reference to the reinforcement learning theory, we put forward an approximate dynamic programming (ADP) algorithm so as to conduct the long-term optimization for performance benefit, energy and rental costs. Furthermore, both scheduling quality and scheduling speed are taken into consideration in this algorithm. Experiments with both random synthetic workloads and Google cloud trace-logs are conducted to evaluate the proposed algorithm, and results demonstrate that our algorithm is effective and efficient, especially under bursty requests.

Keywords

Multi-objective optimization Hybrid cloud Task scheduling Approximate dynamic programming (ADP) 

Notes

Acknowledgments

This work is supported by the National Natural Science Foundation of China (No. 61472199 and No. 61370132).

References

  1. 1.
    Amazon_Web_Services: Aws auto scaling user guide. http://docs.aws.amazon.com/autoscaling/latest/userguide/as-dg.pdf
  2. 2.
    Calheiros, R.N., Buyya, R.: Cost-effective provisioning and scheduling of deadline-constrained applications in hybrid clouds (2012)Google Scholar
  3. 3.
  4. 4.
  5. 5.
    Moreno, I.S., Garraghan, P., Townend, P., Xu, J.: An approach for characterizing workloads in Google cloud to derive realistic resource utilization models. In: IEEE Seventh International Symposium on Service-Oriented System Engineering, pp. 49–60 (2013)Google Scholar
  6. 6.
    Niu, Y., Luo, B., Liu, F., Liu, J.: When hybrid cloud meets flash crowd: towards cost-effective service provisioning. In: IEEE INFOCOM 2015 - IEEE Conference on Computer Communications, pp. 1044–1052 (2015)Google Scholar
  7. 7.
    Ousterhout, K., Wendell, P., Zaharia, M., Stoica, I.: Sparrow: distributed, low latency scheduling. In: Twenty-Fourth ACM Symposium on Operating Systems Principles, pp. 69–84 (2013)Google Scholar
  8. 8.
    Peterson, L.L., Davie, B.S.: Computer Networks: A Systems Approach. Elsevier, Amsterdam (2007)zbMATHGoogle Scholar
  9. 9.
    Powell, W.B.: Approximate Dynamic Programming: Solving the Curses of Dimensionality, vol. 703. Wiley, Hoboken (2007)CrossRefzbMATHGoogle Scholar
  10. 10.
    Powell, W.B.: What you should know about approximate dynamic programming. Nav. Res. Logistics 56(3), 239–249 (2009)MathSciNetCrossRefzbMATHGoogle Scholar
  11. 11.
    Puterman, M.L.: Markov Decision Processes: Discrete Stochastic Dynamic Programming. Wiley, Hoboken (2014)zbMATHGoogle Scholar
  12. 12.
    Ruben, V.D.B., Vanmechelen, K., Broeckhove, J.: Cost-efficient scheduling heuristics for deadline constrained workloads on hybrid clouds. In: IEEE Third International Conference on Cloud Computing Technology and Science, pp. 320–327 (2011)Google Scholar
  13. 13.
    Wang, J., Bao, W., Zhu, X., Yang, L.T., Xiang, Y.: FESTAL: fault-tolerant elastic scheduling algorithm for real-time tasks in virtualized clouds. IEEE Trans. Comput. 64(9), 2545–2558 (2015)MathSciNetCrossRefzbMATHGoogle Scholar
  14. 14.
  15. 15.
  16. 16.
    WiseGEEK: What are the different types of network services? http://www.wisegeek.com/what-are-the-different-types-of-network-services.htm
  17. 17.
    Zuo, X., Zhang, G., Tan, W.: Self-adaptive learning PSO-based deadline constrained task scheduling for hybrid IAAS cloud. IEEE Trans. Autom. Sci. Eng. 11(2), 564–573 (2014)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  1. 1.Tsinghua National Laboratory for Information Science and Technology, Department of Computer Science and TechnologyTsinghua UniversityBeijingChina

Personalised recommendations