Advertisement

Cluster Computing

, Volume 22, Supplement 3, pp 7539–7548 | Cite as

An improved task scheduling algorithm for scientific workflow in cloud computing environment

  • Xiaozhong GengEmail author
  • Yingshuang Mao
  • Mingyuan Xiong
  • Yang Liu
Article

Abstract

As an emerging business computing model, cloud computing needs to deal with the scientific workflow submitted by user groups. How to efficiently schedule massive tasks of scientific workflow is an important problem in cloud computing. In order to minimize the total execution time of workflow, reduce the consume of cloud resources, reduce execution costs of users, a new task scheduling algorithm based on task duplication and task grouping is proposed in this paper. The new algorithm is composed of four steps. Firstly, the join nodes are duplicated, a DAG is converted into an in-tree graph, then all tasks are divide into task groups, it reduces communication overhead between tasks; then some task groups are merged by utilizing the idle time between tasks in a task group, it reduces the use of the processors; lastly, Assign the tasks to processors by making full use of the idle time of the processors, it increases resource utilization. The new algorithm is compared with TDS and TDCS by simulation platform CloudSim. The performance indicators for comparison include makespan of workflow, the number of used processors and resource utilization. The experiment results show that the new algorithm has a smaller makespan of workflow, fewer processors are used, and has higher resource utilization for both compute-intensive and data-intensive workflow, especially for data-intensive workflow, the new algorithm has obvious advantages on the three performance indicators.

Keywords

Scientific workflow Task scheduling Task duplication DAG Cloud computing Task grouping 

Notes

Acknowledgements

This research was supported by the Foundation of Jilin Province Education Department ([2015] No. 306).

References

  1. 1.
    Mell, P., Grance, T.: The NIST definition of cloud computing (2011)Google Scholar
  2. 2.
    Ali, S.A., Alam, M.: A: relative study of task scheduling algorithms in cloud computing environment. In: Proceedings of 2016 2nd International Conference on Contemporary Computing and Informatics (IC3I). IEEE (2016)Google Scholar
  3. 3.
    DUAN, J., CHEN, W.H., WANG, R.P., YU, M.Y., WANG, S.K.: Execution optimization policy of scientific workflow based on cluster aggregation under cloud environment. J. Comput. Appl. 35(6), 1580–1584 (2015)Google Scholar
  4. 4.
    Darbha, S., Agrawal, D.P.: Optimal scheduling algorithm for dis-tributed-memory machines. IEEE Trans. Parallel Distrib. Syst. 9(1), 87–95 (1998)CrossRefGoogle Scholar
  5. 5.
    Wang, X.J., Wang, Y., Hao, Z., Du, J.: The research on resource scheduling based on fuzzy clustering in cloud computing. In: Proceedings of 8th International Conference on ICICTA 2015, pp. 1025–1028 (2016)Google Scholar
  6. 6.
    Sreenu, K., Sreelatha, M.: Whale optimization for task scheduling in cloud computing. Clust. Comput. pp. 1–12 (2017)Google Scholar
  7. 7.
    Geng, X.Z., Xu, G.C., Fu, X.D., Zhang, Y.: A task scheduling algorithm for multi-core-cluster systems. J. Comput. (Finl.) 7(11), 2797–2804 (2012)Google Scholar
  8. 8.
    Chien, N.K., Hong, S.N., Ho, D.L.: Load balancing algorithm based on estimating finish time of services in cloud computing. In: Proceedings of International Conference on Advanced Communication Technology, ICACT, pp. 228–232 (2016)Google Scholar
  9. 9.
    Xu, J., Zhu, J.C., Lu, K.: Task scheduling algorithm based on dual fitness genetic annealing algorithm in cloud computing environment. J. Univ. Electron. Sci. Technol. China 42(6), 900–904 (2013)Google Scholar
  10. 10.
    Zhang, X.L.: Study on scheduling algotithm of the independend and associated for cloud computing. Chongqing University (2014)Google Scholar
  11. 11.
    Meng, X.F., Liu, W.W.: A DAG scheduling algorithm based on selected duplication of precedent tasks. J. Comput. Aided Des. Comput. Graph. 22(6), 1056–1062 (2010)CrossRefGoogle Scholar
  12. 12.
    Chen, W.H., Xie, G.Q., Li, R.F., Bai, Y.: Efficient task scheduling for budget constrained parallel applications on heterogeneous cloud computing systems. Futur. Gener. Comput. Syst. 74, 1–11 (2017)CrossRefGoogle Scholar
  13. 13.
    Ding, Y.S., Yao, G.S., Hao, K.R.: Fault-tolerant elastic scheduling algorithm for workflow in cloud systems. Inf. Sci. 393, 47–65 (2017)CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2018

Authors and Affiliations

  • Xiaozhong Geng
    • 1
    Email author
  • Yingshuang Mao
    • 1
  • Mingyuan Xiong
    • 2
  • Yang Liu
    • 3
  1. 1.School of Computer Technology and EngineeringChangchun Institute of TechnologyChangchunChina
  2. 2.School of ComputerChangchun University of Science and TechnologyChangchunChina
  3. 3.College of Computer Science and TechnologyJilin UniversityChangchunChina

Personalised recommendations