Skip to main content
Log in

Model-as-you-go: An Approach for an Advanced Infrastructure for Scientific Workflows

  • Published:
Journal of Grid Computing Aims and scope Submit manuscript

Abstract

Most of the existing scientific workflow systems rely on proprietary concepts and workflow languages. We are convinced that the conventional workflow technology that is established in business scenarios for years is also beneficial for scientists and scientific applications. We are therefore working on a scientific workflow system based on business workflow concepts and technologies. The system offers advanced flexibility features to scientists in order to support them in creating workflows in an explorative manner and to increase robustness of scientific applications. We named the approach Model-as-you-go because it enables users to model and execute workflows in an iterative process that eventually results in a complete scientific workflow. In this paper, we present main ingredients of Model-as-you-go, show how existing workflow concepts have to be extended in order to cover the requirements of scientists, discuss the application of the concepts to BPEL, and introduce the current prototype of the system.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Akram, A., Meredith, D., Allan, R.: Evaluation of BPEL to scientific workflows. In: CCGRID ‘06: Proc. of the 6th IEEE International Symposium on Cluster Computing and the Grid, IEEE Computer Society, pp. 269–274 (2006)

  2. Wassermann, B., Emmerich, W., Butchart, B., Cameron, N., Chen, L., Patel, J., Sedna: A BPEL-based environment for visual scientific workflow modelling. In: Taylor, I., Deelman, E., Gannon, D., Shields, M. (eds.) Workflows for e-Science: Scientific Workflows for Grids, pp. 428–449. Springer (2007)

  3. Sonntag, M., Karastoyanova, D.: Next generation interactive scientific experimenting based on the workflow technology. In: Alhajj, R.S. et al. (eds.) Proceedings of the 21st IASTED International Conference on Modelling and Simulation (MS 2010) (2010)

  4. Ludäscher, B., Altintas, I., Berkley, C., Higgins, D., Jaeger, E., Jones, M., Lee, E.A., Tao, J., Zhao, Y.: Scientific workflow management and the Kepler system. Conc. Comput. Prac. Exper. 18, 1039–1065 (2006)

    Article  Google Scholar 

  5. Taylor, I., Shields, M., Wang, I., Harrison A.: The Triana workflow environment: architecture and applications. In: Taylor, I., Deelman, E., Gannon, D., Shields, M. (eds.) Workflows for e-Science: Scientific Workflows for Grids, pp. 320–339. Springer (2007)

  6. Hull, D., Wolstencroft, K., Stevens, R., Goble, C., Pocock, M.R., Li, P., Oinn, T.: Taverna: a tool for building and running workflows of services. Nucleic Acids Res. 34, 729–732 (2006). Web Server issue

    Google Scholar 

  7. Sonntag, M., Karastoyanova, D., Leymann, F.: The missing features of workflow systems for scientific computations. In: Proceedings of the 3rd Grid Workflow Workshop (GWW), Software Engineering Conference, GI-Edition. Lecture Notes in Informatics (LNI), vol. P-160 (2010)

  8. Sonntag, M., Karastoyanova, D., Deelman, E.: Bridging the gap between business and scientific workflows. In: Proceedings of the IEEE 6th International Conference on e-Science (2010)

  9. Vossen, G., Weske, M.: The WASA approach to workflow management for scientific applications. In: Dogac et al. (eds.) Workflow Management Systems and Interoperability, NATO ASI Series F: Computer and System Sciences, vol. 164, pp. 145–164. Springer-Verlag, Berlin (1998)

  10. Wassink, I., Ooms, M., van der Vet, P.: Designing workflows on the fly using e-BioFlow. Lect. Notes Comput. Sci. (LNCS) 5900, 470–484 (2009)

    Article  Google Scholar 

  11. Sonntag, M., Karastoyanova, D.: Concurrent workflow evolution. In: Electronic Communications of the EASST, vol. 37 (2011)

  12. OASIS: Web services business process execution language (WS-BPEL) Version 2.0. OASIS Standard (2007)

  13. Barga, R., Gannon, D.B.: Scientific versus business workflows. In: Taylor, I., Deelman, E., Gannon, D., Shields, M. (eds.) Workflows for e-Science: Scientific Workflows for Grids, pp. 9–16. Springer (2007)

  14. Kizler, P., Uhlmann, D., Schmauder, S.: Linking nanoscale and macroscale: calculation of the change in crack growth resistance of steels with different states of Cu precipitation using a modification of stress-strain curves owing to dislocation theory. Nucl. Eng. Des. 196, 175–183 (2000)

    Article  Google Scholar 

  15. Schmauder, S., Binkele, P.: Atomistic computer simulation of the formation of Cu-precipitates in steels. Comput. Mater. Sci. 24, 42–53 (2002)

    Article  Google Scholar 

  16. Binkele, P., Schmauder, S.: An atomistic Monte Carlo simulation for precipitation in a binary system. Int. J. Mater. Res. 94, 1–6 (2003)

    Google Scholar 

  17. Sonntag, M., Hotta, S., Karastoyanova, D., Molnar, D., Schmauder, S.: Using services and service compositions to enable the distributed execution of legacy simulation applications. In: Proceedings of the 4th European Conference Service Wave (2011)

  18. Object Management Group (OMG): Business process modeling notation (BPMN) Version 1.2. OMG Specification (2009)

  19. World Wide Web Consortium (W3C): Web Services Description Language (WSDL) Version 1.1, W3C Note. http://www.w3.org/TR/2001/NOTE-wsdl-20010315 (2001)

  20. World Wide Web Consortium (W3C): XML Path Language (XPath) 2.0 (Second Edition), W3C Recommendation. http://www.w3.org/TR/2010/REC-xpath20-20101214/ (2010)

  21. World Wide Web Consortium (W3C): SOAP Version 1.2 Part 0: Primer (Second Edition), W3C Recommendation. http://www.w3.org/TR/2007/REC-soap12-part0-20070427/ (2007)

  22. IBM WebSphere Process Server: http://www-01.ibm.com/software/integration/wps/

  23. Oracle BPEL process manager: http://www.oracle.com/technetwork/middleware/bpel/overview/index.html. Accessed 6 June 2013

  24. van der Aalst, W.M.P., Basten, T., Verbeek, H.M.W., Verkoulen, P.A.C., Voorhoeve, M.: Adaptive workflow-On the interplay between flexibility and support. In: Filipe J. (ed.) Enterprise Information Systems, pp. 63–70. Kluwer Academic Publishers (2000)

  25. Reichert, M., Rinderle, S.: On design principles for realizing adaptive service flows with BPEL. In: Proceedings of the EMISA Workshop (2006)

  26. Rinderle, S., Reichert, M., Dadam, P.: Correctness criteria for dynamic changes in workflow systems - a survey. Data Knowl. Eng. 50, 9–34 (2004)

    Article  Google Scholar 

  27. Sonntag, M., Karastoyanova, D.: Ad hoc iteration and re-execution of activities in workflows. In: International Journal On Advances in Software, vol. 5, no. 1–2. Xpert Publishing Services (2012)

  28. Leymann, F., Roller, D.: Production Workflow - Concepts and Techniques. Prentice Hall (2000)

  29. Karastoyanova, D., Leymann, F.: Making scientific applications on the grid reliable through flexibility approaches borrowed from service compositions. In: Antonopoulos, N., Exarchakos, G., Li, M., Liotta, A. (eds.) Handbook of Research on P2P and Grid Systems for Service-Oriented Computing: Models, Methodologies and Applications, vol. II. IGI Global (2010)

  30. Casati, F., Ceri, S., Pernici, B., Pozzi, G.: Workflow evolution. Data Knowl. Eng. 24(3) (1998). Special Issue on ER

  31. Reichert, M., Dadam, P.: ADEPTflex - Supporting dynamic changes of workflows without losing control. In: Journal of Intelligent Information Systems, Special Issue on Workflow Management Systems, vol. 10, no. 2, pp. 93–129. Kluwer Academic Publishers, (1998)

  32. Karastoyanova, D., Houspanossian, A., Cilia, M., Leymann, F., Buchmann, A.P.: Extending BPEL for run time adaptability. In: 9th IEEE International Enterprise Computing Conference (EDOC 2005) (2005)

  33. Karastoyanova, D., Leymann, F.: BPEL‘n’aspects: adapting service orchestration logic. In: Proceedings of 7th International Conference on Web Services (ICWS 2009) (2009)

  34. Sonntag, M., Karastoyanova, D.: Enforcing the repeated execution of logic in workflows. In: Proceedings of the 1st International Conference on Business Intelligence and Technology (BUSTECH 2011) (2011)

  35. Reichert, M., Weber, B.: Enabling Flexibility in Process-Aware Information Systems. Springer (2012)

  36. World Wide Web Consortium (W3C): Web services addressing 1.0 - core, W3C Recommendation. http://www.w3.org/TR/ws-addr-core/ (2006)

  37. Khalaf, R., Karastoyanova, D., Leymann, F.: Pluggable framework for enabling the execution of extended BPEL behavior. In: Proceedings of the 3rd International Workshop on Engineering Service-Oriented Application (WESOA 2007) (2007)

  38. Firebug JavaScript Debugger and Profiler: http://getfirebug.com/javascript. Accessed 6 June 2013

  39. Sonntag, M., Currle-Linde, N., Görlach, K., Karastoyanova, D.: Towards simulation workflows with BPEL: deriving missing features from GriCoL. In: Alhajj, R.S., Leung, V.C.M., Saif, M., Thring, R. (eds.) Proceedings of the 21st IASTED International Conference on Modelling and Simulation (MS 2010) (2010)

  40. Sonntag, M.: Model-as-you-go, prototype demo. http://www.iaas.uni-stuttgart.de/institut/ehemalige/sonntag/videos_en.html#maygoVideo (2011)

  41. Sonntag, M.: Mayflower, prototype demo. http://www.iaas.uni-stuttgart.de/institut/ehemalige/sonntag/videos_en.html#mayflowerVideo (2012)

  42. The Trident scientific workflow workbench. In: Proceedings of the IEEE International Conference on e-Science (2008)

  43. BonitaSoft Bonita Open Solution: http://www.bonitasoft.com/products/bonita-open-solution-open-source-bpm

  44. Weber, B., Rinderle, S., Reichert, M.: Process change patterns (aktuelles schlagwort). EMISA Forum 27(2), 45–51 (2008)

    Google Scholar 

  45. Weber, B., Rinderle, S., Reichert, M.: Change patterns and change support features in process-aware information systems. LNCS 4495, 574–588 (2007)

    Google Scholar 

  46. Schonenberg, M.H., Mans, R.S., Russell, N.C., Mulyar, N.A., van der Aalst, W.M.P.: Process flexibility: a survey of contemporary approaches. Lect. Notes Business Informat. Syst. 10, 16–30 (2008)

    Article  Google Scholar 

  47. Karastoyanova, D., Leymann, F., Buchmann, A.P.: An approach to parameterizing web service flows. In: Benatallah, B., Casati, F., Traverso, P. (eds.) Proceedings of the 3rd International Conference on Service Oriented Computing (ICSOC 2005) (2005)

  48. Sonntag, M., Karastoyanova, D.: Compensation of adapted service orchestration logic in BPEL‘n’aspects. In: Proceedings of the 9th International Conference on Business Process Management (BPM 2011). Clermont-Ferrand, France (2011)

  49. Active Endpoints ActiveBPEL: http://www.activevos.com/products/activevos/overview

  50. Active Endpoints ActiveBPEL: Education unit 22: simulation. http://www.activevos.com/content/developers/education/bpel/unit22_simulation.pdf. Accessed 6 June 2013

  51. Active Endpoints ActiveBPEL: Education unit 25: remote debugging. http://www.activevos.com/content/developers/education/bpel/unit25_remotedebugging.pdf. Accessed 6 June 2013

  52. Reichert, M., Dadam, P., Bauer, T.: Dealing with forward and backward jumps in workflow management systems. Int. J. Soft. Syst. Model. (SOSYM) 2(1), 37–58 (2003)

    Article  Google Scholar 

  53. Leymann, F.: Supporting business transactions via partial backward recovery in workflow management systems. In: Proceedings of the BTW. Springer (1995)

  54. Eberle, H., Kopp, O., Leymann, F., Unger, T.: Retry scopes to enable robust workflow execution in pervasive environments. In: Proceedings of the 2nd MONA+ Workshop (2009)

  55. Apache Orchestration Director Engine (ODE): http://ode.apache.org/activity-failure-and-recovery.html

  56. Chiu, D., Li, Q., Karlapalem, K.: A meta modeling approach to workflow management systems supporting exception handling. Inform. Syst. 24, 159–184 (1999)

    Article  Google Scholar 

  57. Deelman, E., Mehta, G., Singh, G., Su, M.-H., Vahi, K.: Pegasus: mapping large-scale workflows to distributed resources. In: Taylor, I., Deelman, E., Gannon, D., Shields, M. (eds.) Workflows for e-Science: Scientific Workflows for Grids, pp. 376–394. Springer (2007)

  58. Altintas, I., Barney, O., Jaeger-Frank, E.: Provenance collection support in the Kepler scientific workflow system. In: Provenance and Annotation of Data, IPAW, LNCS, vol. 4145, pp. 118–132. Springer (2006)

  59. van der Aalst, W.M.P., Weske, M., Grünbauer, D.: Case handling: a new paradigm for business process support. Data Knowl. Eng. 53(2), 129–162 (2005)

    Article  Google Scholar 

  60. van der Aalst, W.M.P., Pesic, M., Schonenberg, H.: Declarative workflows: balancing between flexibility and support. Comput. Sci. Res. Dev. 23(2), 99–113 (2009)

    Article  Google Scholar 

  61. Taylor, I., Deelman, E., Gannon, D., Shields, M. (eds.): Workflows for e-Science: Scientific Workflows for Grids. Springer (2007)

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Mirko Sonntag.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Sonntag, M., Karastoyanova, D. Model-as-you-go: An Approach for an Advanced Infrastructure for Scientific Workflows. J Grid Computing 11, 553–583 (2013). https://doi.org/10.1007/s10723-013-9268-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10723-013-9268-1

Keywords

Navigation