Skip to main content
SpringerLink
Log in
SpringerLink
Log in

Workflow Scheduling Algorithms and Approaches

  • Chapter
  • First Online:
Automated Workflow Scheduling in Self-Adaptive Clouds

Part of the book series: Computer Communications and Networks ((CCN))

Abstract

Cloud infrastructures typically offer access to boundless virtual resources dynamically provisioned on demand for hosting, running, and managing a variety of mission-critical applications like scientific workflows, big data processing application, business intelligence-based applications, high-performance computing (HTC), and high transaction computing (HTC). Due to the surging popularity of the irresistible cloud idea, there are cloud datacenters spreading across the globe comprising heterogeneous cloud platforms and infrastructures catering to fast-evolving demands of worldwide businesses. The pervasive connectivity has enabled for the unprecedented success of the cloud concept. However, intensive automation is the key to the originally intended success of the cloud paradigm. Researchers across the world are focusing on unearthing powerful and pioneering tools and techniques for automated infrastructure life-cycle management. Similarly there are pathbreaking work-around approaches, algorithms, and architectures for workload consolidation. In short, there are many cloud-related aspects yearning for technologically sound automation, acceleration, and augmentation capabilities.

Efficient scheduling algorithms become mandatory for automated operations of distributed and disparate cloud resources and workloads. The resource scheduling is a dynamic problem, and it is associated with on-demand resource provisioning, fault tolerance support, and hybrid resource scheduling with appropriate Quality of Service, considering time, cost, and budget. This chapter provides the details about various automated solutions for workflow scheduling and also comprehensive survey of various existing workflow scheduling algorithms in the cloud computing environment.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 49.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 49.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Wu F, Wu Q, Tan Y (2015) Workflow scheduling in cloud: a survey. J Supercomputing 71(9):3373–3418

    Google Scholar 

  2. Ullman JD (1975) Np-complete scheduling problems. J Comput Syst Sci 10(3):384–393. Math SciNetCrossRefMATHGoogle Scholar

    Article  MathSciNet  MATH  Google Scholar 

  3. Mell P, Grance T (2009) The nist definition of cloud computing. Natl Inst Stand Technol 53(6):50Google Scholar

    Google Scholar 

  4. Amazon ec2 pricing. http://aws.amazon.com/ec2/pricing/

  5. Abawajy JH (2004) Fault-tolerant scheduling policy for grid computing systems. In: Proceedings of parallel and distributed processing symposium, 2004, 18th international, IEEE, p 238

    Chapter  Google Scholar 

  6. Abrishami S, Naghibzadeh M, Epema DH (2012) Cost-driven scheduling of grid workflows using partial critical paths. IEEE Trans Parallel Distrib Syst 23(8):1400–1414

    Article  Google Scholar 

  7. Abrishami S, Naghibzadeh M, Epema DH (2013) Deadline-constrained workflow scheduling algorithms for infrastructure as a service clouds. Futur Gener Comput Syst 29(1):158–169

    Article  Google Scholar 

  8. Ahmad I, Dhodhi MK (1995) Task assignment using a problem genetic algorithm. Concurr Pract Exp 7(5):411–428

    Article  Google Scholar 

  9. Ahmad I, Kwok YK (1998) On exploiting task duplication in parallel program scheduling. IEEE Trans Parallel Distrib Syst 9(9):872–892

    Article  Google Scholar 

  10. Ali S, Maciejewski AA, Siegel HJ, Kim JK (2004) Measuring the robustness of a resource allocation. IEEE Trans Parallel Distrib Syst 15(7):630–641

    Article  Google Scholar 

  11. Ali S, Sait SM, Benten MS (1994) Gsa: scheduling and allocation using genetic algorithm. In: Proceedings of the conference on European design automation, IEEE, pp 84–89

    Google Scholar 

  12. Mohanapriya N, Kousalya G, Balakrishnan P, Cloud workflow scheduling algorithms: a survey. Int J Adv Eng Technol E-ISSN 0976-3945

    Google Scholar 

  13. Hou ESH, Ansari N, Ren H (1994) A genetic algorithm for multiprocessor scheduling. IEEE Trans Parallel Distrib Syst 5(2):113–120

    Article  Google Scholar 

  14. Wu AS, Yu H, Jin S, Lin KC, Schiavone G (2004) An incremental genetic algorithm approach to multiprocessor scheduling. IEEE Trans Parallel Distrib Syst 15(9):824–834

    Article  Google Scholar 

  15. Blythe J, Jain S, Deelman E, Gil Y, Vahi K, Mandal A, Kennedy K (2005) Task scheduling strategies for workflow-based applications in grids. In: Proceedings of cluster computing and the grid, CCGrid 2005, vol 2, IEEE International Symposium on 2005, pp 759–767

    Chapter  Google Scholar 

  16. Young L, McGough S, Newhouse S, Darlington J (2003) Scheduling architecture and algorithms within the iceni grid middleware. In: Proceedings of UK e-science all hands meeting, Citeseer, pp 5–12

    Google Scholar 

  17. Xie T, Qin X (2006) Scheduling security-critical real-time applications on clusters. IEEE Trans Comput 55(7):864–879

    Article  Google Scholar 

  18. Xie X, Qin (2007) Performance evaluation of a new scheduling algorithm for distributed systems with security heterogeneity. J Parallel Distrib Comput 67(10):1067–1081

    Article  MATH  Google Scholar 

  19. Kataria D, Kumar S (2015) A study on workflow scheduling algorithms in cloud. Int J Res Appl Sci Technol 3(8)

    Google Scholar 

  20. Tao J, Kunze M, Rattu D, Castellanos AC (2008) The cumulus project: build a scientific cloud for a data center. In: Cloud Computing and its Applications, Chicago

    Google Scholar 

  21. Chopra N, Singh S, Survey on scheduling in hybrid clouds, 5th ICCCNT–2014 July 1113, 2014, Hefei, China

    Google Scholar 

  22. Yadav SS, Hua ZW (2010) CLOUD: a computing infrastructure on demand, IEEE

    Google Scholar 

  23. Chopra N, Singh S (2013) HEFT based workflow scheduling algorithm for cost optimization within deadline in hybrid clouds. In: Computing, Communications and Networking Technologies (ICCCNT), 2013 Fourth International Conference, pp 1–6. doi:10.1109/ICCCNT.2013.6726627

    Google Scholar 

  24. Pandey S, Wu L, Guru SM, Buyya R A particle swarm optimization-based heuristic for scheduling workflow applications in cloud computing environments. In: Advanced Information Networking and Applications (AINA), 2010 24th IEEE international conference, pp 400–407. 20–23 April 2010. doi:10.1109/AINA.2010.31

  25. Bittencourt LF, Madeira ERM HCOC: a cost optimization algorithm for workflow scheduling in hybrid clouds. Int J Internet Serv Appl 2:207–227. doi:10.1007/s13174-011-0032-0

  26. Garg R, Singh AK (2015) Adaptive workflow scheduling in grid computing based on dynamic resource availability. Eng Sci Technol An Int J 18(2):256–269. http://dx.doi.org/10.1016/j.jestch.2015.01.001

    Article  Google Scholar 

  27. Luo H, Yan C, Hu Z (2015) An Enhanced Workflow Scheduling Strategy for Deadline Guarantee on Hybrid Grid/Cloud Infrastructure. J Appl Sci Eng 18(1):6778. doi:10.6180/jase.2015.18.1.09

    Google Scholar 

  28. Verma A, Kaushal S (2015) Cost-time efficient scheduling plan for executing workflows in the cloud. J Grid Comput 13(4):495–506. doi:10.1007/s10723-015-9344-9

    Article  MathSciNet  Google Scholar 

  29. Udomkasemsub O, Xiaorong L, Achalakul T (2012) A multiple-objective workflow scheduling framework for cloud data analytics. In: Computer Science and Software Engineering (JCSSE), International Joint Conference, pp 391–398. doi:10.1109/JCSSE.2012.6261985

    Google Scholar 

  30. Wu Z, Ni Z, Gu L, Liu X A revised discrete particle swarm optimization for cloud workflow scheduling. In: Computational Intelligence and Security (CIS), 2010 International conference on 11–14 Dec 2010, pp 184–188. doi:10.1109/CIS.2010.46

  31. Ke L, Hai J, Jinjun CXL, Dong Y (2010) A compromised time-cost scheduling algorithm in SwinDeW-C for instance-intensive cost-constrained workflows on cloud computing platform. J High-Perform Comput Appl 24(4):445–456

    Article  Google Scholar 

  32. Arabnejad H, Barbosa JG (2014) A budget constrained scheduling algorithm for workflow applications. J Grid Comput 12(4):665–679. http://dx.doi.org/10.1007/s10723-014-9294-7

    Article  Google Scholar 

  33. Singh R, Singh S (2013) Score based deadline constrained workflow scheduling algorithm for cloud systems. Int J Cloud Comput Serv Archit 3(6). doi:10.5121/IJCCSA.2013.3603

  34. Verma A, Kaushal S, Deadline and budget distribution based cost- time optimization workflow scheduling algorithm for cloud. In: IJCA Proceedings on International Conference on Recent Advances and Future Trends in Information Technology (iRAFIT 2012) iRAFIT(7):1–4

    Google Scholar 

  35. Malawski M, Juve G, Deelman E, Nabrzyski J, Cost- and deadline-constrained provisioning for scientific workflow ensembles in IaaS clouds. In: Proceedings of the international conference on high-performance computing, networking, storage and analysis (SC ’12). IEEE Computer Society Press, Los Alamitos, CA, USA, Article 22

    Google Scholar 

  36. Xu M, Cui L, Wang H, Bi Y (2009) A multiple QoS constrained scheduling strategy of multiple workflows for cloud computing. In: Parallel and distributed processing with applications, 2009 IEEE International Symposium on, Chengdu, pp 629–634. doi: 10.1109/ISPA.2009.95

  37. Bessai K, Youcef S, Oulamara A, Godart C, Nurcan S (2012) Bi-criteria workflow tasks allocation and scheduling in cloud computing environments. In: Cloud Computing (CLOUD), IEEE 5th International Conference, pp 638–645. doi: 10.1109/CLOUD.2012.83

  38. Chopra N, Singh S (2013) HEFT based workflow scheduling algorithm for cost optimization within deadline in hybrid clouds. In: Computing, Communications and Networking Technologies (ICCCNT), 2013 Fourth International Conference, pp 1–6. doi: 10.1109/ICCCNT.2013.6726627

  39. Verma A, Kaushal S (2015) Cost minimized PSO based workflow scheduling plan for cloud computing. IJITCS 7(8):37–43. doi:10.5815/ijitcs.2015.08.06

    Article  Google Scholar 

  40. Lin C, Lu S (2011) Scheduling scientific workflows elastically for cloud computing. In: Cloud computing 2011 IEEE, international conference, Washington, DC, pp 746–747. doi: 10.1109/CLOUD.2011.110

  41. Poola D, Ramamohanarao K, Buyya R (2014) Fault-tolerant workflow scheduling using spot instances on clouds. Proc Comput Sci 29:523–533

    Article  Google Scholar 

  42. Bilgaiyan S, Sagnika S, Das M (2014) A multi-objective cat swarm optimization algorithm for workflow scheduling in cloud computing environment. Intell Comput Commun Devices 308:73–84. http://dx.doi.org/10.1007/978-81-322-2012-1_9

    Article  Google Scholar 

  43. Kumar B, Ravichandran T Scheduling multiple workflow using De-De Dodging Algorithm and PBD Algorithm in cloud: detailed study. Int J Comput Electr Autom Control and Inf Eng 9(4):917–922

    Google Scholar 

  44. Yassa S, Chelouah R, Kadima H, Granado B (2013) Multi-objective approach for energy-aware workflow scheduling in cloud computing environments. Sci World J:Article ID 350934. doi:10.1155/2013/350934

  45. Li Z, Ge J, Yang H, Huang L, Hu H, Hu H, Luo B (2016) A security and cost aware scheduling algorithm for heterogeneous tasks of scientific workflow in clouds. J Futur Gener Comput Syst. http://dx.doi.org/10.1016/j.future.2015.12.014

  46. Jayadivya S, Bhanu SMS Qos based scheduling of workflows in cloud computing. Int J Comput Sci Electr Eng 2012:2315–4209

    Google Scholar 

  47. Rahman M, Hassan R, Ranjan R, Buyya R (2013) Adaptive workflow scheduling for dynamic grid and cloud computing environment. Concurr Comput Pract Exp 25(13):1816–1842. doi:10.1002/cpe.3003

    Article  Google Scholar 

  48. Olteanu A, Pop F, Dobre C, Cristea V (2012) A dynamic rescheduling algorithm for resource management in large-scale dependable distributed systems. Comput Math Appl 63(9):1409–1423. http://dx.doi.org/10.1016/j.camwa.2012.02.066

    Article  MATH  Google Scholar 

  49. Beloglazov A, Abawajy J, Buyya R Energy-aware resource allocation heuristics for efficient management of data centers for cloud computing. Futur Gener Comput Syst 28(5):755–768. http://dx.doi.org/10.1016/j.future.2011.04.017

  50. Beloglazov A, Buyya R (2012) Optimal online deterministic algorithms and adaptive heuristics for energy and performance efficient dynamic consolidation of virtual machines in Cloud data centers. Concurr Comput Pract Exp 24(13):1397–1420. http://dx.doi.org/10.1002/cpe.1867

    Article  Google Scholar 

  51. Meng X, Pappas V, Zhang L (2010) Improving the scalability of data center networks with traffic-aware virtual machine placement. In: Proceedings of the 29th conference on information communications. IEEE Press, Piscataway, NJ, USA, pp 1154–1162

    Google Scholar 

  52. Sonmez O, Yigitbasi N, Abrishami S, Iosup A, Epema D (2010) Performance analysis of dynamic workflow scheduling in multicluster grids. In: Proceedings of the 19th ACM international symposium on high performance distributed computing, ACM, pp 49–60

    Google Scholar 

  53. Ge R, Feng X, Cameron KW, Performance-constrained distributed DVS scheduling for scientific applications on power-aware clusters. In: Supercomputing, 2005. Proceedings of the ACM/IEEE SC 2005 Conference, pp 34–34, 12–18 Nov 2005. doi: 10.1109/SC.2005.57

  54. Rountree B, Lowenthal DK, Funk S, Freeh VW, de Supinski BR, Schulz M Bounding energy consumption in large-scale MPI programs. In: Supercomputing, 2007. SC ‘07. Proceedings of the 2007 ACM/IEEE Conference, pp 1–9, 10–16, Nov 2007. doi: 10.1145/1362622.1362688

  55. Baskiyar S, Abdel-Kader R (2010) Energy-aware DAG scheduling on heterogeneous systems. Clust Comput 13(4):373–383. http://dx.doi.org/10.1007/s10586-009-0119-6

    Article  Google Scholar 

  56. Cao F, Zhu MM, Wu CQ, Energy-efficient resource management for scientific workflows in clouds. In: Services, 2014 IEEE world congress, pp 402–409, July 2014 doi: 10.1109/SERVICES.2014.76

  57. Wang Y, Lu P, Kent KB (2015) WaFS: a workflow-aware file system for effective storage utilization in the cloud. Comput IEEE Trans 64(9):2716–2729. doi:10.1109/TC.2014.2375195

    Article  MathSciNet  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Coimbatore Institute of Technology, Coimbatore, India

    G. Kousalya

  2. SCOPE, VIT University, Vellore, India

    P. Balakrishnan

  3. Reliance Jio Cloud Services (JCS), Bangalore, India

    C. Pethuru Raj

Authors
  1. G. Kousalya
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. P. Balakrishnan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. C. Pethuru Raj
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this chapter

Cite this chapter

Kousalya, G., Balakrishnan, P., Pethuru Raj, C. (2017). Workflow Scheduling Algorithms and Approaches. In: Automated Workflow Scheduling in Self-Adaptive Clouds. Computer Communications and Networks. Springer, Cham. https://doi.org/10.1007/978-3-319-56982-6_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-56982-6_4

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-56981-9

  • Online ISBN: 978-3-319-56982-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation