Grid Service Orchestration Using the Business Process Execution Language (BPEL)
- 262 Downloads
Modern scientific applications often need to be distributed across Grids. Increasingly applications rely on services, such as job submission, data transfer or data portal services. We refer to such services as Grid services. While the invocation of Grid services could be hard coded in theory, scientific users want to orchestrate service invocations more flexibly. In enterprise applications, the orchestration of web services is achieved using emerging orchestration standards, most notably the Business Process Execution Language (BPEL). We describe our experience in orchestrating scientific workflows using BPEL. We have gained this experience during an extensive case study that orchestrates Grid services for the automation of a polymorph prediction application. Using this example, we explain the extent with which the BPEL language supports the definition of scientific workflows. We then describe the reliability, performance and scalability that can be achieved by executing a complex scientific workflow with ActiveBPEL, an industrial strength but freely available BPEL engine.
Key wordsGrid computing Grid services workflow business process execution language
Unable to display preview. Download preview PDF.
- 1.K. Amin, G.v. Laszewski, M. Hategan, N.J. Zaluzec, S. Hampton and A. Rossi, “GridAnt: A client-controllable Grid workflow system”, in D. King and A. Dennis (eds.), Proc. of the 37th Annual Hawaii International Conference on System Sciences (HICSS'04) – Track 7. IEEE Computer Society, 2004, p. 70210c.Google Scholar
- 2.T. Andrews, F. Cubera, H. Dholakia, Y. Goland, J. Klein, F. Leymann, K. Liu, D. Roller, D. Smith, S. Thatte, I. Trickovic and S. Weerawarana, Business Process Execution Language for Web Services Version 1.1. OASIS, http://ifr.sap.com/bpel4ws, 2003.
- 3.A. Arkin, S. Askary, S. Fordin, W. Jekeli, K. Kawaguchi, D. Orchard, S. Pogliani, K. Riemer, S. Struble, P. Takacsi-Nagi, I. Trickovic and S. Zimek, Web Service Choreography Interface (WSCI) 1.0. W3C, http://www.w3.org/TR/wsci, 2002.
- 4.S. Bailliez, et al., “Ant User Manual”, Apache Jakarta, http://jakarta.apache.org/ant, 2005.
- 5.K. Beck and E. Gamma, “Test-infected: Programmers love writing tests”, in More Java Gems. Cambridge University Press, New York, New York, USA, pp. 357–376, 2000.Google Scholar
- 6.B. Butchart, C. Chapman and W. Emmerich, “OGSA First Impressions: A case study using the open Grid service architecture”, in S. Cox (ed.), Proceedings of the UK E-Science All Hands Meeting, Nottingham, EPSRC, 2003, pp. 810–816.Google Scholar
- 7.J. Cao, S.A. Jarvis, S. Saini and G.R. Nudd, “GridFlow: Workflow management for Grid computing”, in: 3rd Int. Symposium on Cluster Computing and the Grid, IEEE Computer Society, 2003, pp. 198–205.Google Scholar
- 8.R. Chinnici, M. Gudgin, J.-J. Moreau, J. Schlimmer and S. Weerawarana, Web Services Description Language. W3c working draft, W3C, http://www.w3.org/TR/wsdl20, 2004.
- 10.G. Drinkwater, K. Kleese, S. Sufi, L. Blanshard, A. Manandhar, R. Tyer, K. O'Neill, M. Doherty, M. Williams and A. Woolf, “The CCLRC data portal”, in S. Cox (ed.), Proc. of the UK e-Science All Hands Meeting. EPSRC, UK, 2003, pp. 540–547. ISBN 1-904425-11-9.Google Scholar
- 11.J. Frey, “Condor DAGMan: Handling Inter-Job Dependencies”, Technical report, University of Wisconsin, Dept. of Computer Science, http://www.cs.wisc.edu/condor/dagman, 2002.
- 12.A. Fuggetta, “Software process: A Roadmap”, in The Future of Software Engineering, ACM Press New York, New York, USA, 2000, pp. 25–34.Google Scholar
- 13.E. Gamma and K. Beck, Contributing to Eclipse: Principles, Patterns and Plug-in. Addison-Wesley, 2004.Google Scholar
- 14.H. Garcia-Molina and K. Salem, “SAGAS”, in Proc. of ACM SIGMOD Annual Conference, 1987, pp. 249–259.Google Scholar
- 16.S. Krishnan, P.W. and G. v. Laszewski, “GSFL: A workflow framework for Grid services”, Technical Report Preprint ANL/MCS-P980-0802, Argonne National Laboratory, 2002.Google Scholar
- 17.W. Lee, S. McGough, S. Newhouse and J. Darlington, “A standard based approach to job submission through web services”, in S. Cox (ed.) Proc. of the UK e-Science All Hands Meeting, Nottingham. EPSRC, UK, 2004, pp. 901–905. ISBN 1-904425-21-6.Google Scholar
- 18.F. Leymann and D. Roller, “Business process management with FlowMark”, in Compcon Spring ‘94: Digest of Papers. IEEE Computer Society, 1994, pp. 230–234.Google Scholar
- 19.F. Leymann, “Web services flow language”, Technical report, IBM, 2001.Google Scholar
- 20.S. Majithia, M. Shields, I. Taylor and I. Wang, “Triana: A graphical web service composition and execution toolkit”, in Proc. of the 4th Int. Conference on Web Services. IEEE Computer Society, 2004, pp. 514–524.Google Scholar
- 21.W.D.S. Motherwell, H.L. Ammon, J.D.D.A. Dzyabchenko, P. Erk, A. Gavezzotti, D.W.M. Hofmann, F.J.J. Leusen, J.P.M. Lommerse, W.T.M. Mooij, S.L. Price, H. Scheraga, B. Schweizer, M.U. Schmidt, B.P. v. Eijck, P. Verwer and D.E. Williams, “Crystal structure prediction of small organic molecules: A second blind test”, Acta Crystallographica Section B-Structural Science, Vol. 58, pp. 647–661, 2002.CrossRefGoogle Scholar
- 22.P. Murray-Rust, “Chemical markup language”, World Wide Web Journal, Vol. 2, No. 4, pp. 135–147, 1997.Google Scholar
- 23.H. Nowell, B. Butchart, D.S. Coombes, S.L. Price, W. Emmerich and C.R.A. Catlow, “Increasing the scope for polymorph prediction using e-Science”, in S. Cox (ed.) Proc of the 2004 UK E-Science All Hands Meeting, Nottingham, Engineering and Physical Science Research Council, UK, 2004, pp. 968–971.Google Scholar
- 25.L.J. Osterweil, “Software processes are software too”, in Proc. of the 9th Int. Conf. on Software Engineering. IEEE Computer Society, 1987, pp. 2–13.Google Scholar
- 26.C. Peltz, “Web services orchestration and choreography”, IEEE Computer, Vol. 36, No. 10, pp. 46–52, 2003.Google Scholar
- 27.M.L. Peterson, S.L. Morissette, C. McNulty, A. Goldsweig, P. Shaw, M. LeQuesne, J. Monagle, N.N. Encina, J. Marchionna, A.A. Johnson, J. Gonzalez-Zugasti, A.V. Lemmo, S.J. Ellis, M.J. Cima, and O. Almarsson, “Iterative high-throughput polymorphism studies on acetaminophen and an experimentally derived structure for form III”, Journal of the American Chemical Society, Vol. 124, No. 37, pp. 10958–10959, 2002.CrossRefPubMedGoogle Scholar
- 30.S. Thatte, “XLANG: Web Services for Business Process Design”, Technical report, Microsoft, 2001.Google Scholar
- 32.M. Zelkowitz and D. Wallace, “Experimental models for validating technology”, IEEE Computer, Vol. 31, No. 5, pp. 23–31, 1998.Google Scholar