Skip to main content

Advertisement

SpringerLink
Log in

A novel deep reinforcement learning scheme for task scheduling in cloud computing

  • Published:
Cluster Computing Aims and scope Submit manuscript

Abstract

Recently, the demand of cloud computing systems has increased drastically due to their significant use in various real-time online and offline applications. Moreover, it is widely being adopted from research, academia and industrial field as a main solution for computation and storage platform. Due to increased workload and big-data, the cloud servers receive huge amount of data storage and computation request which need to be processed through cloud modules by mapping the tasks to available virtual machines. The cloud computing models consume huge amount of energy and resources to complete these tasks. Thus, the energy aware and efficient task scheduling approach need to be developed to mitigate these issues. Several techniques have been introduced for task scheduling, where most of the techniques are based on the heuristic algorithms, where the scheduling problem is considered as NP-hard problem and obtain near optimal solution. But handling the different size of tasks and achieving near optimal solution for varied number of VMs according to the task configuration remains a challenging task. To overcome these issues, we present a machine learning based technique and adopted deep reinforcement learning approach. In the proposed approach, we present a novel policy to maximize the reward for task scheduling actions. An extensive comparative analysis is also presented, which shows that the proposed approach achieves better performance, when compared with existing techniques in terms of makespan, throughput, resource utilization and energy consumption.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17

Similar content being viewed by others

Data Availability

The data that support the findings of this study are available from the corresponding author, upon reasonable request.

References

  1. Pradeep, K., Jacob, T.P.: A hybrid approach for task scheduling using the cuckoo and harmony search in cloud computing environment. Wirel Pers. Commun. 101(4), 2287–2311 (2018)

    Article  Google Scholar 

  2. Ebadifard, F., Babamir, S.M.: A PSO-based task scheduling algorithm improved using a load-balancing technique for the cloud computing environment. Concurr. Comput. 30(12), e4368 (2018)

    Article  Google Scholar 

  3. Singh, P., Dutta, M., Aggarwal, N.: A review of task scheduling based on meta-heuristics approach in cloud computing. Knowl. Inf. Syst. 52(1), 1–51 (2017)

    Article  Google Scholar 

  4. Madni, S.H.H., Abd Latiff, M.S., Abdullahi, M., Abdulhamid, S.I.M., Usman, M.J.: Performance comparison of heuristic algorithms for task scheduling in IaaS cloud computing environment. PLoS ONE 12(5), e0176321 (2017)

    Article  Google Scholar 

  5. Shafiq, D.A., Jhanjhi, N.Z., Abdullah, A., Alzain, M.A.: A load balancing algorithm for the data centres to optimize cloud computing applications. IEEE Access 9, 41731–41744 (2021)

    Article  Google Scholar 

  6. Chhabra, A., Singh, G., Kahlon, K.S.: Multi-criteria HPC task scheduling on IaaS cloud infrastructures using meta-heuristics. Clust. Comput. 24(2), 885–918 (2021)

    Article  Google Scholar 

  7. Gani, A., Nayeem, G.M., Shiraz, M., Sookhak, M., Whaiduzzaman, M., Khan, S.: A review on interworking and mobility techniques for seamless connectivity in mobile cloud computing. J. Netw. Comput. Appl. 43, 84–102 (2014)

    Article  Google Scholar 

  8. Ab-Rahman, N.H., Choo, K.K.R.: A survey of information security incident handling in the cloud. Comput. Secur. 49, 45–69 (2015)

    Article  Google Scholar 

  9. Khan, S., Ahmad, E., Shiraz, M., Gani, A., Wahab, A.W.A., Bagiwa, M.A.: Forensic challenges in mobile cloud computing. Computer, Communications, and Control Technology (I4CT), 2014 International Conference on; 2014: IEEE.

  10. Iqbal, S., Kiah, M.L.M., Dhaghighi, B., Hussain, M., Khan, S., Khan, M.K., et al.: On cloud security attacks: a taxonomy and intrusion detection and prevention as a service. J. Netw. Comput. Appl. 74, 98–120 (2016)

    Article  Google Scholar 

  11. Han, S., Min, S., Lee, H.: Energy efficient VM scheduling for big data processing in cloud computing environments. J. Amb. Intell. Hum. Comput. 14, 1–10 (2019)

    Google Scholar 

  12. Kurp, P.: Green computing. Commun. ACM 51(10), 11–13 (2008)

    Article  Google Scholar 

  13. https://www.computerworld.com/article/3089073/cloud-computing-slows-energy-demand-us-says.html

  14. Zhang, J., Yu, F.R., Wang, S., Huang, T., Liu, Z., Liu, Y.: Load balancing in data center networks: a survey. IEEE Commun. Surv. Tutor. 20(3), 2324–2352 (2018)

    Article  Google Scholar 

  15. Afzal, S., Kavitha, G.: Load balancing in cloud computing: a hierarchical taxonomical classification. J. Cloud Comput. 8(1), 1–24 (2019)

    Article  Google Scholar 

  16. Arunarani, A.R., Manjula, D., Sugumaran, V.: Task scheduling techniques in cloud computing: a literature survey. Futur. Gener. Comput. Syst. 91, 407–415 (2019)

    Article  Google Scholar 

  17. Alworafi, M. A., Dhari, A., El-Booz, S. A., Nasr, A. A., Arpitha, A., & Mallappa, S.: An enhanced task scheduling in cloud computing based on hybrid approach. In: Data Analytics and Learning (pp. 11–25). Springer, Singapore (2019)

  18. Liu, L., & Qiu, Z.: A survey on virtual machine scheduling in cloud computing. In 2016 2nd IEEE International Conference on Computer and Communications (ICCC) (pp. 2717–2721). IEEE. (2016)

  19. Zakarya, M.: An extended energy-aware cost recovery approach for virtual machine migration. IEEE Syst. J. 13(2), 1466–1477 (2018)

    Article  Google Scholar 

  20. Alkayal, E. S., Jennings, N. R., & Abulkhair, M. F.: Survey of task scheduling in cloud computing based on particle swarm optimization. In 2017 International Conference on Electrical and Computing Technologies and Applications (ICECTA) (pp. 1–6). IEEE. (2017)

  21. Tong, Z., Deng, X., Chen, H., Mei, J., Liu, H.: QL-HEFT: a novel machine learning scheduling scheme base on cloud computing environment. Neural Comput. Appl. 15, 1–18 (2019)

    Google Scholar 

  22. Sharma, M., Garg, R.: An artificial neural network based approach for energy efficient task scheduling in cloud data centers. Sustain. Comput. 26, 100373 (2020)

    Google Scholar 

  23. Rjoub, G., Bentahar, J., Abdel Wahab, O., Saleh Bataineh, A.: Deep and reinforcement learning for automated task scheduling in large-scale cloud computing systems. Concurr. Comput. 15, 5919 (2020)

    Google Scholar 

  24. Mansouri, N., Zade, B.M.H., Javidi, M.M.: Hybrid task scheduling strategy for cloud computing by modified particle swarm optimization and fuzzy theory. Comput. Ind. Eng. 130, 597–633 (2019)

    Article  Google Scholar 

  25. Negi, S., Rauthan, M.M.S., Vaisla, K.S., Panwar, N.: CMODLB: an efficient load balancing approach in cloud computing environment. J Supercomput. 12, 1–53 (2021)

    Google Scholar 

  26. Sulaiman, M., Halim, Z., Lebbah, M., Waqas, M., Tu, S.: An evolutionary computing-based efficient hybrid task scheduling approach for heterogeneous computing environment. J. Grid Comput. 19(1), 1–31 (2021)

    Article  Google Scholar 

  27. https://data.mendeley.com/datasets/b7bp6xhrcd/1

  28. Shukri, S.E., Al-Sayyed, R., Hudaib, A., Mirjalili, S.: Enhanced multi-verse optimizer for task scheduling in cloud computing environments. Expert Syst. Appl. 15, 114230 (2020). https://doi.org/10.1016/j.eswa.2020.114230

    Article  Google Scholar 

  29. Alsaidy, S. A., Abbood, A. D., & Sahib, M. A.: Heuristic initialization of PSO task scheduling algorithm in cloud computing. J. King Saud Univ. Comput. Inform. Sci. (2020)

  30. Ding, D., Fan, X., Zhao, Y., Kang, K., Yin, Q., Zeng, J.: Q-learning based dynamic task scheduling for energy-efficient cloud computing. Futur. Gener. Comput. Syst. 108, 361–371 (2020)

    Article  Google Scholar 

  31. Hoseiny, F., Azizi, S., Shojafar, M., Tafazolli, R.: Joint QoS-aware and cost-efficient task scheduling for fog-cloud resources in a volunteer computing system. ACM Trans. Internet Technol. (TOIT) 21(4), 1–21 (2021)

    Article  Google Scholar 

  32. Abualigah, L., Diabat, A.: A novel hybrid antlion optimization algorithm for multi-objective task scheduling problems in cloud computing environments. Clust. Comput. 24(1), 205–223 (2021)

    Article  Google Scholar 

  33. Hoseiny, F., Azizi, S., Shojafar, M., Ahmadiazar, F., & Tafazolli, R.: PGA: a priority-aware genetic algorithm for task scheduling in heterogeneous fog-cloud computing. In IEEE INFOCOM 2021-IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS) (pp. 1–6). IEEE. (2021)

  34. Calzarossa, M.C., Della Vedova, M.L., Massari, L., Nebbione, G., Tessera, D.: Multi-objective optimization of deadline and budget-aware workflow scheduling in uncertain clouds. IEEE Access 9, 89891–89905 (2021)

    Article  Google Scholar 

  35. Beloglazov, A., Buyya, R., Lee, Y. C., & Zomaya, A.: A taxonomy and survey of energy-efficient data centers and cloud computing systems. In Advances in computers (Vol. 82, pp. 47–111). Elsevier (2011).

Download references

Funding

None.

Author information

Authors and Affiliations

  1. Dr. Ambedkar Institute of Technology, Bengaluru, India

    K. Siddesha & G. V. Jayaramaiah

  2. Xsys Softech, Bengaluru, India

    Chandrapal Singh

Authors
  1. K. Siddesha
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. G. V. Jayaramaiah
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Chandrapal Singh
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to K. Siddesha.

Ethics declarations

Conflict of interest

None.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Siddesha, K., Jayaramaiah, G.V. & Singh, C. A novel deep reinforcement learning scheme for task scheduling in cloud computing. Cluster Comput 25, 4171–4188 (2022). https://doi.org/10.1007/s10586-022-03630-2

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10586-022-03630-2

Keywords

Search

Navigation