Skip to main content
SpringerLink
Log in

Scientific workflows

  • Introduction
  • Published:
International Journal on Software Tools for Technology Transfer Aims and scope Submit manuscript

Abstract

This article commences the special section on scientific workflows. A brief history is given of workflow approaches in general. More detail is given of scientific workflows, including sample applications. Challenges and research issues are then identified. Finally, an overview is given of the articles appearing in this special section.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Al-Mashari, M., Irani, Z., Zairi, M.: Business process reengineering: a survey of international experience. Bus. Process Manag. J. 7(5), 437–455 (2001)

    Article  Google Scholar 

  2. Alonso, G.: BioOpera: Grid Computing in Virtual Laboratories. ERCIM News (45) (2001)

  3. Alonso, G., Pautasso, C.: JOpera: a toolkit for efficient visual composition of web services. Int. J. Electron. Commer. 9(2), 107–141 (2004)

    Google Scholar 

  4. Andrews, T., Curbera, F., Dholakia, H., Goland, Y., Klein, J., Leymann, F., Liu, K., Roller, D., Smith, D., Thatte, S., Trickovic, I., Weerawarana, S.: Business Process Execution Language for Web Services. Version 1.1. BEA, IBM, Microsoft, SAP, Siebel (2003)

  5. Arkin, A., Askary, S., Bloch, B., Curbera, F., Goland, Y., Kartha, N., Lie, C.K., Thatte, S., Yendluri, P., Yiu, A.: Web Services Business Process Execution Language. Version 2.0. Organization for The Advancement of Structured Information Standards, Billerica, Massachusetts, USA (2007)

  6. Barga, R., Gannon, D.: Scientific versus business workflows. In: Taylor, I.J., Deelman, E., Gannon, D.B., Shields, M. (eds.) Workflows for E-Science, pp. 9–16. Springer, Berlin (2007)

    Chapter  Google Scholar 

  7. Barker, A., van Hemert, J.: Scientific workflow: A survey andresearch directions. In Wyrzykowski, R., Dongarra, J., Karczewski, K., Wasniewski, J. (eds.) Proceedings of the 7th International Conference on Parallel Processing and Applied Mathematics, volume 4967 of Lecture Notes in Computer Science, pp. 746-753. Springer, Berlin (2008)

  8. Bhagat, J., Tanoh, F., Nzuobontane, E., Laurent, T., Orlowski, J., Roos, M., Wolstencroft, K., Aleksejevs, S., Stevens, R., Pettifer, S., Lopez, R., Goble, C.A.: BioCatalogue: A universal catalogue of web services for the life sciences. Nucl. Acids Res. 38(suppl_2), W689-W694 (2010)

  9. BPMI. Business Process Modeling Notation. Version 1.0. Business Process Management Initiative (2004)

  10. Christensen, S., Jørgensen, J.B., Kristensen, L.M.: Tools and algorithms for the construction and analysis of systems: third international workshop, TACAS’97 Enschede, The Netherlands, April 2-4, 1997 Proceedings, chapter Design/CPN–a computer tool for Coloured Petri Nets, pp. 209-223. Springer, Berlin (1997)

  11. Cress Project. Communication representation employing systematic specification. http://www.cs.stir.ac.uk/kjt/research/cress. Online, retrieved (2016)

  12. Dames Project. Data management through e-social science. http://www.dames.org.uk. Online, retrieved (2016)

  13. Deelman, E., Singh, G., hui Su, M., Blythe, J., Gil, A., Kesselman, C., Mehta, G., Vahi, K., Berriman, G.B., Good, J., Laity, A., Jacob, J.C., Katz, D.S.: Pegasus: a framework for mapping complex scientific workflows onto distributed systems. Sci. Program. J. 13, 219–237 (2005)

    Google Scholar 

  14. e-Stat Project. E-Stat. http://www.bristol.ac.uk/cmm/research/estat. Online, retrieved (2016)

  15. E lixir. Elixir–a distributed infrastructure for life-science information. https://www.elixir-europe.org/about. Online, retrieved (2016)

  16. E lixir. Elixir–tools and data services registry. https://bio.tools. Online, retrieved (2016)

  17. Ghanem, M., Curcin, V.: Scientific workflow systems–can one size fit all? In: Biomedical Engineering Conference, pp. 1-9, New York, USA. Institution of Electrical and Electronic Engineers Press (2008)

  18. Ghanem, M., Curcin, V., Wendel, P., Guo, Y.: Building and using analytical workflows in Discovery Net. In: Dubitzky, W. (ed.) Data Mining Techniques in Grid Computing Environments, pp. 119–139. Wiley, Chichester (2009)

    Chapter  Google Scholar 

  19. Gil, Y., Deelman, E., Ellisman, M., Fahringer, T., Fox, G., Gannon, D., Goble, C., Livny, M., Moreau, L., Myers, J.: Examining the challenges of scientific workflows. Computer 40(12), 24–32 (2007)

    Article  Google Scholar 

  20. Goble, C.A., Bhagat, J., Aleksejevs, S., Cruickshank, D., Michaelides, D., Newman, D., Borkum, M., Bechhofer, S., Roos, M., Li, P., Roure, D.D.: myExperiment: a repository and social network for the sharing of bioinformatics workflows. Nucl. Acids Res. 38(suppl_2), W677–682 (2010)

    Article  Google Scholar 

  21. Görlach, K., Sonntag, M., Karastoyanova, D., Leymann, F., Reiter, M.: Conventional Workflow Technology for Scientific Simulation, pp. 1-31. Guide to e-Science. Springer (2011)

  22. Harel, D., Politi, M.: Modeling Reactive Systems With Statecharts : The Statemate Approach. McGraw-Hill Companies, London (1998)

    Google Scholar 

  23. Hey, T., Tansley, S., Tolle, K. (eds.): The Fourth Paradigm: Data-Intensive Scientific Discovery. Microsoft Research, Redmond (2009)

    Google Scholar 

  24. Huhns, M.N., Singh, M.P.: Service-oriented computing: key concepts and principles. IEEE Internet Comput. 9(1), 75–81 (2005)

    Article  Google Scholar 

  25. IEEE. IEEE international symposium on scientific workflows and big data science. http://www.cs.wayne.edu/shiyong/swf/. Online, retrieved (2016)

  26. Kepler Project. Kepler. https://kepler-project.org. Online, retrieved (2016)

  27. Koehler, J., Alonso, G.: Service-oriented computing—introduction to the special theme. ERCIM News 70, 2007 (2007)

    Google Scholar 

  28. Lamprecht, A.-L.: User-Level Workflow Design–A BioinformaticsPerspective, volume 8311 of Lecture Notes in Computer Science.Springer, Berlin (2013)

  29. Lamprecht, A.-L., Steffen, B., Margaria, T.: Scientific workflows with the jABC framework–a review after a decade in the field. Int. J. Softw. Tools Technol. Transf. (this issue)

  30. Leymann, F.: Web Services Flow Language. Technical report, IBM,Somers, New York, USA (2001)

  31. Ludäscher, B., Altintas, I., Berkley, C., Higgins, D., Jaeger, E., Jones, M., Lee, E.A., Tao, J., Zhao, Y.: Scientific workflow management and the Kepler systems. Concurr. Comput. Pract. Exp. 18(10), 1039–1065 (2006)

    Article  Google Scholar 

  32. Ludäscher, B., Weske, M., McPhillips, T., Bowers, S.: Scientificworkflows: Business as usual? In Business Process Management,volume 5701 of Lecture Notes in Computer Science, pp. 31-47. Springer, Berlin (2009)

  33. Margaria, T.: Components, Features, and Agents in the ABC. In: Ryan, M., Meyer, J.-J., Ehrich, H.-D. (eds.) Objects. Agents, and Features, volume 2975 of Lecture Notes in Computer Science, pp. 7-29. Springer, Berlin (2004)

  34. Margaria, T., Kubczak, C., Steffen, B.: Bio-jETI: a service integration, design, and provisioning platform for orchestrated bioinformatics processes. BMC Bioinform. 9 Suppl 4:S12, (2008)

  35. MethodBox Project. MethodBox. https://www.methodbox.org. Online, retrieved (2016)

  36. Ménager, H., KalaŠ, M., Rapacki, K., Ison, J.: Using registries to integrate bioinformatics tools into workbench environments. Int. J. Softw. Tools Technol. Transf. (this issue)

  37. myExperiment Project. myExperiment. http://www.myexperiment.org. Online, retrieved (2016)

  38. myGrid Consortium. myGrid. http://www.mygrid.org.uk. Online, retrieved (2016)

  39. NeISS Project. National e-infrastructure for social simulation–workflows. http://www.taverna.org.uk/introduction/related-projects/neiss. Online, retrieved (2016)

  40. Object Management Group. Business Process Model and Notation. Version 2.0. Object Management Group, Needham, Massachusetts, USA (2011)

  41. Oinn, T., Addis, M., Ferris, J., Marvin, D., Senger, M., Greenwood, M., Carver, T., Glover, K., Pocock, M.R., Wipat, A., Li, P.: Taverna: a tool for the composition and enactment of bioinformatics workflows. Bioinformatics 20(17), 3045–3054 (2004)

    Article  Google Scholar 

  42. Oinn, T., Greenwood, M., Addis, M., Alpdemir, M.N., Ferris, J., Glover, K., Goble, C., Goderis, A., Hull, D., Marvin, D., Li, P., Lord, P., Pocock, M.R., Senger, M., Stevens, R., Wipat, A., Wroe, C.: Taverna: lessons in creating a workflow environment for the life sciences. Concurr. Comput. Pract. Exp. 18(10), 1067–1100 (2006)

    Article  Google Scholar 

  43. PADLS Project. Portal of the Administrative Data Liaison Service. http://www.adls.ac.uk/padls. Online, retrieved (2016)

  44. Papazoglou, M.P., Traverso, P., Dustdar, S., Leymann, F.: Service-oriented computing: a research roadmap. Int. J. Coop. Inf. Syst. 17(02), 223–255 (2008)

    Article  Google Scholar 

  45. Qin, J., Fahringer, T.: Scientific Workflows—Programming, Optimization, and Synthesis with ASKALON and AWDL. Springer, Berlin (2012)

    MATH  Google Scholar 

  46. Research Data Alliance. RDA–research data sharing without barriers.https://rd-alliance.org. Online, retrieved (2016)

  47. Rice, P., Longden, I., Bleasby, A.: Emboss: the European molecular biology open software suite. Trends Genet. 16(6), 276–277 (2000)

    Article  Google Scholar 

  48. Rice, P.M., Bleasby, A.J., Ison, J.C., Mullan, L., Bottu, G.: Emboss User’s Guide: Practical Bioinformatics. Cambridge University Press, UK (2011)

    Google Scholar 

  49. Sinnott, R., Voorsluys, W.: A scalable cloud-based system for data-intensive spatial analysis. Int. J. Softw. Tools Technol. Transf. (this issue)

  50. Steffen, B., Margaria, T., Claßen, A., Braun, V.: The METAFrame’95 Environment. In CAV, pp. 450-453 (1996)

  51. Steffen, B., Margaria, T., Nagel, R., Jörges, S., Kubczak, C.: Model-driven development with the jABC. In: Bin, E., Ziv, A., Ur, S. (eds.) Hardware and Software. Verification and Testing, volume 4383 of Lecture Notes in Computer Science, pp. 92-108. Springer, Berlin (2007)

  52. Stevens, R.D., Robinson, A.J., Goble, C.A.: myGrid: personalised bioinformatics on the information grid. Bioinformatics 19(suppl 1), i302–i304 (2003)

    Article  Google Scholar 

  53. Taylor, F.W.: The Principles of Scientific Management. Harper and Brothers, New York (1911)

    Google Scholar 

  54. Taylor, I.J., Deelman, E., Gannon, D.B., Shields, M.: Workflows for E-Science: Scientific Workflows for Grids. Springer, Berlin (2007)

    Book  Google Scholar 

  55. Thatte, S.: XLANG: Web services for business process design. Technical report, Microsoft, Redmond, Washington, USA (2001)

  56. Turner, K.J., Lambert, P.S.: Workflows for quantitative data analysis in the social sciences. Softw. Tools Technol. Transf. 17, 321–338 (2015)

    Article  Google Scholar 

  57. van der Aalst, W., de Leoni, M., Bolt, A.: Scientific workflows for process mining: building blocks, scenarios, and implementation. Int. J. Softw. Tools Technol. Transf. (this issue)

  58. Vigder, M.R., Vinson, N.G., Singer, J., Stewart, D.A., Mews, K.: Supporting scientists’ everyday work: automating scientific workflows. IEEE Softw. 25(4), 52–58 (2008)

  59. Wikipedia. Scientific workflow system. https://en.wikipedia.org/wiki/Scientific_workflow_system. Online, retrieved (2016)

  60. Wolstencroft, K., Haines, R., Fellows, D., Williams, A., Withers, D., Owen, S., Soiland-Reyes, S., Dunlop, I., Nenadic, A., Fisher, P., Bhagat, J., Belhajjame, K., Bacall, F., Hardisty, A., de la Hidalga, A.N., Balcazar Vargas, M.P., Sufi, S., Goble, C.: The Taverna workflow suite: designing and executing workflows of web services on the desktop, web or in the cloud. Nucl. Acids Res. 41(W1), W557–W561 (2013)

    Article  Google Scholar 

  61. Yu, J., Buyya, R.: A taxonomy of scientific workflow systems for grid computing. SIGMOD Rec. 34(3), 44–49 (2005)

    Article  Google Scholar 

  62. Zhao, Y., Raicu, I., Foster, I.: Scientific workflow systems for 21st century, New bottle or new wine? In: Proceedings of congress on services–Part I, pp. 467-471, Los Alamitos, California, USA. IEEE Computer Society (2008)

Download references

Acknowledgments

We are very grateful to all authors of the special section for their contributions, to the referees for their careful reviewing of these articles, and to Julia Rehder for editorial support throughout.

This work was supported, in part, by Science Foundation Ireland grant 13/RC/2094 and co-funded under the European Regional Development Fund through the Southern and Eastern Regional Operational Programme to Lero - the Irish Software Research Centre (http://www.lero.ie).

Author information

Authors and Affiliations

  1. Lero - The Irish Software Research Centre, University of Limerick, Limerick, V94 NYD3, Ireland

    Anna-Lena Lamprecht

  2. Computing Science and Mathematics, University of Stirling, Scotland, FK9 4LA, UK

    Kenneth J. Turner

Authors
  1. Anna-Lena Lamprecht
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Kenneth J. Turner
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Anna-Lena Lamprecht.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lamprecht, AL., Turner, K.J. Scientific workflows. Int J Softw Tools Technol Transfer 18, 575–580 (2016). https://doi.org/10.1007/s10009-016-0428-z

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10009-016-0428-z

Keywords

Search

Navigation