Skip to main content
SpringerLink
Log in

Proposing an Architecture for Scientific Workflow Management System in Cloud

  • Conference paper
  • First Online:
Computing and Network Sustainability

Part of the book series: Lecture Notes in Networks and Systems ((LNNS,volume 12))

Abstract

With the growth in IT infrastructure and advances in technologies, workflow scheduling poses many challenging issues for complex applications which require many computing resources. Hence, there is a requirement of a workflow management system adaptable with many cloud environments due to the heterogeneity of resources and applications. In this paper, we have proposed a general workflow management system architecture and a scientific workflow model, followed by a model for monitoring tool in the cloud environment, based on a comprehensive study of literature in cloud computing.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Yu J, Buyya R, Ramamohanarao K (2008) Workflow scheduling algorithms for grid computing. In: Metaheuristics for scheduling in distributed computing environments, volume 146 of the series studies in computational intelligence, pp 173–214

    Google Scholar 

  2. Pegasus workflow management system. https://pegasus.isi.edu/

  3. Triana scientific workflow. http://www.trianacode.org/

  4. Apache Taverna. http://www.taverna.org.uk/

  5. Kepler scientific workflow system. https://kepler-project.org/

  6. Vahi K, Harvey I, Samak T, Gunter D, Evans K, Rogers D, Taylor I, Goode M, Silva F, Al-Shakarchi E, Mehta G, Deelman E, Jones A (2013) A case study into using common real-time workflow monitoring infrastructure for scientific workflows. Springer Science + Business Media, Dordrecht

    Google Scholar 

  7. Amazon web services. https://aws.amazon.com/

  8. Salesforce cloud. http://www.salesforce.org/

  9. Microsoft azure cloud. https://azure.microsoft.com/

  10. Juve G, Deelman E (2011) Scientific workflows in the cloud. in: grids, clouds and virtualization. Comput Commun Netw 71–89 (Springer, London Limited)

    Google Scholar 

  11. Jin H, Ibrahim S, Bell T, Qi L, Cao H, Wu S, Shi X (2010) Tools and technologies for building clouds. In: Cloud computing part of the series computer communications and networks, Springer, London Limited, pp 3–20

    Google Scholar 

  12. Yu J, Buyya R (2006) Scheduling scientific workflow applications with deadline and budget constraints using genetic algorithms. Sci Program 14(3–4):217–230

    Google Scholar 

  13. Wu F, Wu Q, Tan Y (2015) Workflow scheduling in cloud: a survey. J Supercomput 1–46 (Springer Science + Business Media, New York)

    Google Scholar 

  14. Cunsolo VD, Distefano S, Puliafito A, Scarpa M (2010) Open and interoperable clouds: the Cloud@Home Way. In: Cloud computing part of the series computer communications and networks. Springer, London Limited, pp 93–111

    Google Scholar 

  15. Zhang Fan, Cao Junwei, Tan Wei, Khan Samee U, Li Keqin, Zomaya Albert Y (2014) Evolutionary scheduling of dynamic multitasking workloads for big-data analytics in elastic cloud. IEEE Trans Emerg Top Comput 2(3):338–351

    Article  Google Scholar 

  16. Li X, Song J, Huang B (2015) A scientific workflow management system architecture and its scheduling based on cloud service platform for manufacturing big data analytics. Int J Adv Manuf Technol 1–13 (Springer, London)

    Google Scholar 

  17. Zhang F, Cao J, Hwang K, Wu C (2011) Ordinal optimized scheduling of scientific workflows in elastic compute clouds. In: Third IEEE international conference on cloud computing technology and science, pp 9–17

    Google Scholar 

  18. Varalakshmi P, Ramaswamy A, Balasubramanian A, Vijaykumar P (2011) An optimal workflow based scheduling and resource allocation in cloud. In: Advances in computing and communications volume 190 of the series communications in computer and information science, Springer, Berlin, Heidelberg, pp 411–420

    Google Scholar 

  19. Ho Y-C, Zhao Q-C, Jia Q-S (2007) Ordinal optimization, soft optimization for hard problems. Springer Science + Business Media, New York, USA

    Google Scholar 

  20. Cafaro M, Aloisio G (2011) Grids, clouds and virtualization, computer communications and networks. Springer, London Limited, pp 71–91

    Google Scholar 

  21. Prodan R, Wieczorek M (2010) Bi-criteria scheduling of scientific grid workflows. IEEE Trans Autom Sci Eng 7(2):364–376

    Article  Google Scholar 

  22. Chen C, Liu J, Wen Y, Chen J (2015) Research on workflow scheduling algorithms in the cloud. In: Process-aware systems, volume 495 of the series communications in computer and information science. Springer, Berlin, Heidelberg, pp 35–48

    Google Scholar 

  23. Benoit A, Marchal L, Pineau J-F, Robert Y, Vivien F (2009) Resource-aware allocation strategies for divisible loads on large-scale systems. In: Proceedings of IEEE international parallel and distributed processing symposium (IPDPS), Rome, Italy, pp 1–4

    Google Scholar 

  24. Zhang F, Cao J, Hwang K, Li K, Khan SU (2015) Adaptive workflow scheduling on cloud computing platforms with iterative ordinal optimization. IEEE Trans Cloud Comput 3(2):156–168

    Google Scholar 

  25. Rodriguez MA, Buyya R (2014) Deadline based resource provisioning and scheduling algorithm for scientific workflows on clouds. IEEE Trans Cloud Comput 2(2):222–234

    Google Scholar 

  26. Emeakaroha VC, Maurer M, Stern P, Labaj PP, Brandic I, Kreil DP (2013) Managing and optimizing bioinformatics workflows for data analysis in clouds. J Grid Comput 407–427 (Springer Science + Business Media Dordrecht)

    Google Scholar 

  27. Calheiros RN, Masoumi E, Ranjan R, Buyya R (2014) Workload prediction using ARIMA model and its impact on cloud applications’ QoS. IEEE Trans Cloud Comput 1–11

    Google Scholar 

  28. Freund RF et al (1998) Scheduling resources in multi-user, heterogeneous, computing environments with smartnet. In: Proceedings of 7th heterogeneous computing workshop (HCW), Washington, DC, USA, pp 184–199

    Google Scholar 

  29. Li H, Buyya R (2007) Model-driven simulation of grid scheduling strategies. In: 3rd IEEE international conference on e-science and grid computing 287–294

    Google Scholar 

  30. Smith J, Siegel HJ, Maciejewski AA (2008) A stochastic model for robust resource allocation in heterogeneous parallel and distributed computing systems. In: Proceedings of IEEE international parallel and distributed processing symposium, Miami, FL, USA, pp 1–5

    Google Scholar 

  31. Lin C, Lu S, Fei X, Chebotko A, Pai D, Lai Z, Fotouhi F, Hua J (2009) A reference architecture for scientific workflow management systems and the VIEW SOA solution. IEEE Trans Serv Comput 2(1):79–92

    Google Scholar 

  32. Macías M, Guitart J (2012) Client classification policies for SLA negotiation and allocation in shared cloud datacenters. In: Economics of grids, clouds, systems, and services, volume 7150 of the series Lecture Notes in Computer Science pp 90–104

    Google Scholar 

  33. Moses J, Iyer R, Illikkal R, Srinivasan S, Aisopos K (2011) Shared resource monitoring and throughput optimization in cloud-computing datacenters. In: IEEE international parallel and distributed processing symposium, pp 1024–1033

    Google Scholar 

  34. Ge J, Zhang B, Fang Y (2010) Research on the resource monitoring model under cloud computing environment. In: Web information systems and mining, volume 6318 of the series Lecture Notes in Computer Science, pp 111–118

    Google Scholar 

  35. Wang J, Korambath P, Altintas I, Davis J, Crawl D (2014) Workflow as a service in the cloud: architecture and scheduling algorithms. In: 14th international conference on computational science, vol 29. Elsevier, pp 546–556

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Information Technology, Maharashtra Institute of Technology, Pune, India

    Vahab Samandi & Debajyoti Mukhopadhyay

Authors
  1. Vahab Samandi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Debajyoti Mukhopadhyay
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to Vahab Samandi or Debajyoti Mukhopadhyay .

Editor information

Editors and Affiliations

  1. Department of Software and Systems Engineering, VIT University, Vellore, Tamil Nadu, India

    H.R . Vishwakarma

  2. Department of Electronics and Communication Engineering, ITM University, Gwalior, Madhya Pradesh, India

    Shyam Akashe

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer Nature Singapore Pte Ltd.

About this paper

Cite this paper

Samandi, V., Mukhopadhyay, D. (2017). Proposing an Architecture for Scientific Workflow Management System in Cloud. In: Vishwakarma, H., Akashe, S. (eds) Computing and Network Sustainability. Lecture Notes in Networks and Systems, vol 12. Springer, Singapore. https://doi.org/10.1007/978-981-10-3935-5_30

Download citation

  • DOI: https://doi.org/10.1007/978-981-10-3935-5_30

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-10-3934-8

  • Online ISBN: 978-981-10-3935-5

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation