Skip to main content
SpringerLink
Log in

Cost-effective workflow scheduling approach on cloud under deadline constraint using firefly algorithm

  • Original Submission
  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

Cloud computing, a novel and promising methodology in the distributed computing domain, provides a pay-per-use framework to solve large-scale scientific and business workflow applications. These workflow applications have a constraint that each of them must completed within the limited time (deadline constraint). Therefore, scheduling a workflow with deadline constraints is increasingly becoming a crucial research issue. However, many analytical reviews on scheduling problems reveal that existing solutions fail to provide cost-effective solutions and they do not consider the parameters like CPU performance variation, delay in acquisition and termination of Virtual Machines (VMs). This paper presents a Cost-Effective Firefly based Algorithm (CEFA) to solve workflow scheduling problems that can occur in an Infrastructure as a Service (IaaS) platform. The proposed CEFA uses a novel method for problem encoding, population initialization and fitness evaluation with an objective to provide cost-effective and optimized workflow execution within the time limit. The performance of the proposed CEFA is compared with the state-of-the-art algorithms such as IaaS Cloud-Partial Critical Path (IC-PCP), Particle Swarm Optimization (PSO), Robustness-Cost-Time (RCT), Robustness-Time-Cost (RTC), and Regressive Whale Optimization (RWO). Our experimental results demonstrate that the proposed CEFA outperforms current state-of-the-art heuristics with the criteria of achieving the deadline constraint and minimizing the cost of execution.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  1. Arabnejad V, Bubendorfer K, Ng B (2019) Budget and deadline aware e-science workflow scheduling in clouds. IEEE Trans Parallel and Distrib Sys 30(1):29–44. https://doi.org/10.1109/tpds.2018.2849396

    Article  Google Scholar 

  2. Partheeban P, Kavitha V (2018) Versatile provisioning and workflow scheduling in WaaS under cost and deadline constraints for cloud computing. Trans Emerg Telecommun Technol 30(1). https://doi.org/10.1002/ett.3527

  3. Guo W, Lin B, Chen G, Chen Y, Liang F (2018) Cost-driven scheduling for deadline-based workflow across multiple clouds. IEEE Transactions on Network and Service Management 15(4):1571–1585. https://doi.org/10.1109/tnsm.2018.2872066

    Article  Google Scholar 

  4. Iyenghar P, Pulvermueller E (2018) A model-driven workflow for energy-aware scheduling analysis of IoT-enabled use cases. IEEE Internet of Things Journal 5(6):4914–4925. https://doi.org/10.1109/jiot.2018.2879746

    Article  Google Scholar 

  5. Juve G, Chervenak A, Deelman E, Bharathi S, Mehta G, Vahi K (2013) Characterizing and profiling scientific workflows. Future Gen Comput Sys 29(3):682–692. https://doi.org/10.1016/j.future.2012.08.015

    Article  Google Scholar 

  6. Rodriguez MA, Buyya R (2016) A taxonomy and survey on scheduling algorithms for scientific workflows in IaaS cloud computing environments. Concurrency and Computation: Practice and Experience 29(8). https://doi.org/10.1002/cpe.4041

  7. Gupta BB, Agrawal DP (2019) Handbook of research on cloud computing and big data applications in IoT. Hershey, PA: IGI Global, Engineering Science Reference (an imprint of IGI Global). https://doi.org/10.4018/978-1-5225-8407-0

  8. Gabrani N (n.d.) Formal definition of cloud computing by NIST. Retrieved from http://www.thecloudtutorial.com/nistcloudcomputingdefinition.htmlhttp://www.thecloudtutorial.com/nistcloudcomputingdefinition.html

  9. Buyya R, Yeo CS, Venugopal S, Broberg J, Brandic I (2009) Cloud computing and emerging IT platforms: vision, hype, and reality for delivering computing as the 5th utility. Future Gen Comput Sys 25(6):599–616. https://doi.org/10.1016/j.future.2008.12.001

    Article  Google Scholar 

  10. Meena J, Kumar M, Vardhan M (2015) Efficient utilization of commodity computers in academic institutes: a cloud computing approach [Abstract]. Int J Comput Elect Autom Control Inform Eng 9(2)

  11. Aloisio G, Cafaro M (2011) Scientific workflows in the cloud grids, clouds and virtualization. Springer, New York

    Google Scholar 

  12. Olakanmi OO, Dada A (2019) An efficient privacy-preserving approach for secure verifiable outsourced computing on untrusted platforms. Int J Cloud Appl Comput 9(2):79–98. https://doi.org/10.4018/ijcac.2019040105

    Google Scholar 

  13. Zhu Z, Zhang G, Li M, Liu X (2016) Evolutionary multi-objective workflow scheduling in cloud. IEEE Trans Parallel Distributed Sys 27(5):1344–1357. https://doi.org/10.1109/tpds.2015.2446459

    Article  Google Scholar 

  14. Schad J, Dittrich J, Quiane-Ruiz J (2010) Runtime measurements in the cloud. Proceedings of the VLDB Endowment 3(1-2):460–471. https://doi.org/10.14778/1920841.1920902

    Article  Google Scholar 

  15. Pooranian Z, Shojafar M, Abawajy JH, Abraham A (2015) An efficient meta-heuristic algorithm for grid computing. J Comb Optim 30(3):413–434

    Article  MathSciNet  Google Scholar 

  16. Fister I, Fister I, Yang X, Brest J (2013) A comprehensive review of firefly algorithms. Swarm and Evolutionary Computation 13:34–46. https://doi.org/10.1016/j.swevo.2013.06.001

    Article  Google Scholar 

  17. Sousa T (2004) Particle swarm based data mining algorithms for classification tasks. Parallel Computing. https://doi.org/10.1016/s0167-8191(04)00042-0

  18. Yu J, Buyya R, Tham CK (n.d.) Cost-based scheduling of scientific workflow application on utility grids. In: First international conference on e-science and grid computing (e-Science’05). https://doi.org/10.1109/e-science.2005.26ce.2005.26

  19. Afzal A, Darlington J, Mcgough A (2006) QoS-constrained stochastic workflow scheduling in enterprise and scientific grids. In: 2006 7th IEEE/ACM international conference on grid computing. https://doi.org/10.1109/icgrid.2006.310991

  20. Duan R, Prodan R, Fahringer T (2007) Performance and cost optimization for multiple large-scale grid workflow applications. In: Proceedings of the 2007 ACM/IEEE conference on supercomputing - SC 07. https://doi.org/10.1145/1362622.1362639

  21. Garg R, Singh AK (2013) Multi-objective workflow grid scheduling using ε-fuzzy dominance sort based discrete particle swarm optimization. J Supercomput 68 (2):709–732. https://doi.org/10.1007/s11227-013-1059-8

    Article  Google Scholar 

  22. Smanchat S, Viriyapant K (2015) Taxonomies of workflow scheduling problem and techniques in the cloud. Future Gen Comput Sys 52:1–12. https://doi.org/10.1016/j.future.2015.04.019

    Article  Google Scholar 

  23. Alkhanak EN, Lee SP, Khan SU (2015) Cost-aware challenges for workflow scheduling approaches in cloud computing environments: taxonomy and opportunities. Future Gen Comput Sys 50:3–21. https://doi.org/10.1016/j.future.2015.01.007

    Article  Google Scholar 

  24. Mao M, Humphrey M (2011) Auto-scaling to minimize cost and meet application deadlines in cloud workflows. In: Proceedings of 2011 international conference for high performance computing, networking, storage and analysis on - SC 11. https://doi.org/10.1145/2063384.2063449

  25. Malawski M, Juve G, Deelman E, Nabrzyski J (2012) Cost and deadline-constrained provisioning for scientific workflow ensembles in IaaS clouds. In: 2012 international conference for high performance computing, networking, storage and analysis. https://doi.org/10.1109/sc.2012.38

  26. Pietri I, Malawski M, Juve G, Deelman E, Nabrzyski J, Sakellariou R (2013) Energy-constrained provisioning for scientific workflow ensembles. In: 2013 international conference on cloud and green computing. https://doi.org/10.1109/cgc.2013.14

  27. Abrishami S, Naghibzadeh M, Epema DH (2013) Deadline-constrained workflow scheduling algorithms for infrastructure as a service clouds. Future Gen Comput Sys 29(1):158–169. https://doi.org/10.1016/j.future.2012.05.004

    Article  Google Scholar 

  28. Calheiros RN, Buyya R (2014) Meeting deadlines of scientific workflows in public clouds with tasks replication. IEEE Trans Parallel Distrib Sys 25(7):1787–1796. https://doi.org/10.1109/tpds.2013.238

    Article  Google Scholar 

  29. Poola D, Garg SK, Buyya R, Yang Y, Ramamohanarao K (2014) Robust scheduling of scientific workflows with deadline and budget constraints in clouds. In: 2014 IEEE 28th international conference on advanced information networking and applications. https://doi.org/10.1109/aina.2014.105

  30. Sahni J, Vidyarthi P (2018) A cost-effective deadline-constrained dynamic scheduling algorithm for scientific workflows in a cloud environment. IEEE Trans Cloud Comput 6(1):2–18. https://doi.org/10.1109/tcc.2015.2451649

    Article  Google Scholar 

  31. Chen Z, Du K, Zhan Z, Zhang J (2015) Deadline constrained cloud computing resources scheduling for cost optimization based on dynamic objective genetic algorithm. In: 2015 IEEE congress on evolutionary computation (CEC). https://doi.org/10.1109/cec.2015.7256960

  32. Rodriguez MA, Buyya R (2014) Deadline based resource provisioning and scheduling algorithm for scientific workflows on clouds. IEEE Trans Cloud Comput 2(2):222–235. https://doi.org/10.1109/tcc.2014.2314655

    Article  Google Scholar 

  33. Pandey S, Wu L, Guru SM, Buyya R (2010) A particle swarm optimization-based heuristic for scheduling workflow applications in cloud computing environments. In: 2010 24th IEEE international conference on advanced information networking and applications. https://doi.org/10.1109/aina.2010.31

  34. Wu Z, Ni Z, Gu L, Liu X (2010) A revised discrete particle swarm optimization for cloud workflow scheduling. In: 2010 international conference on computational intelligence and security. https://doi.org/10.1109/cis.2010.46

  35. Huang J (2014) The workflow task scheduling algorithm based on the GA model in the cloud computing environment. J Soft 9(4). https://doi.org/10.4304/jsw.9.4.873-880

  36. Luke S (2009) Essentials of metaheuristics: a set of undergraduate lecture notes. Place of publication not identified: Lulu

  37. Yang X (2008) Nature-inspired metaheuristic algorithms. Luniver Press, Frome

    Google Scholar 

  38. Mapetu JPB, Chen Z, Kong L (2019) Low-time complexity and low-cost binary particle swarm optimization algorithm for task scheduling and load balancing in cloud computing. Applied Intelligence 49(9):3308–3330. https://doi.org/10.1007/s10489-019-01448-x

    Article  Google Scholar 

  39. Amazon Elastic Block Store (EBS) - Amazon Web Services. (n.d.). Retrieved from http://aws.amazon.com/ebs

  40. Ostermann S, Iosup A, Yigitbasi N, Prodan R, Fahringer T, Epema D (2010) A performance analysis of ec2 cloud computing services for scientific computing. Cloud Computing Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, pp 115–131. https://doi.org/10.1007/978-3-642-12636-9_9

  41. Anwar N, Deng H (2018) Elastic scheduling of scientific workflows under deadline constraints in cloud computing environments. Future Internet 10(1):5. https://doi.org/10.3390/fi10010005

    Article  Google Scholar 

  42. WorkflowGenerator- Pegasus - Pegasus Workflow Management System. Retrieved from https://confluence.pegasus.isi.edu/

  43. Bharathi S, Chervenak A, Deelman E, Mehta G, Su M, Vahi K (2008) Characterization of scientific workflows. In: 2008 third workshop on workflows in support of large-scale science. https://doi.org/10.1109/works.2008.4723958

  44. Ma T, Buyya R (2005) Critical-path and priority based algorithms for scheduling workflows with parameter sweep tasks on global grids. In: 17th international symposium on computer architecture and high-performance computing (SBAC-PAD05). https://doi.org/10.1109/cahpc.2005.22

  45. Yang X (2013) Chaos-enhanced firefly algorithm with automatic parameter tuning. In: Shi Y (ed) Recent algorithms and applications in swarm intelligence research. IGI Global, Hershey, pp 125–136. https://doi.org/10.4018/978-1-4666-2479-5.ch007

  46. Yang X (2009) Firefly algorithms for multimodal optimization. Stochastic Algorithms: Foundations and Applications Lecture Notes in Computer Science, pp 169–178. https://doi.org/10.1007/978-3-642-04944-6_14

  47. Reddy GN, Kumar SP (2019) Regressive whale optimization for workflow scheduling in cloud computing. Int J Computat Intell Appl 18(04):1950024. https://doi.org/10.1142/s146902681950024x

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Computer Science and Engineering, Vellore Institute of Technology, Chennai, India

    Koneti Kalyan Chakravarthi & L. Shyamala

  2. Mother Teresa Women’s University, Kodaikanal, Tamil Nadu, India

    V. Vaidehi

Authors
  1. Koneti Kalyan Chakravarthi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. L. Shyamala
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. V. Vaidehi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Koneti Kalyan Chakravarthi.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chakravarthi, K.K., Shyamala, L. & Vaidehi, V. Cost-effective workflow scheduling approach on cloud under deadline constraint using firefly algorithm. Appl Intell 51, 1629–1644 (2021). https://doi.org/10.1007/s10489-020-01875-1

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-020-01875-1

Keywords

Search

Navigation